Apr 29 18:51:52 devstack cinder-volume[75401]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "singleton_lock" {{(pid=75401) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:390}} Apr 29 18:51:52 devstack cinder-volume[75401]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "singleton_lock" {{(pid=75401) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:393}} Apr 29 18:51:52 devstack cinder-volume[75401]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "singleton_lock" {{(pid=75401) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:413}} Apr 29 18:51:53 devstack cinder-volume[75401]: INFO dbcounter [None req-257b8688-1ced-4d58-89fa-f3dd3ebaf968 None None] Registered counter for database cinder Apr 29 18:51:53 devstack cinder-volume[75401]: DEBUG oslo_db.sqlalchemy.engines [None req-257b8688-1ced-4d58-89fa-f3dd3ebaf968 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=75401) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Apr 29 18:51:53 devstack cinder-volume[75401]: DEBUG dbcounter [-] [75401] Writer thread running {{(pid=75401) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}} Apr 29 18:51:53 devstack cinder-volume[75401]: INFO cinder.rpc [None req-257b8688-1ced-4d58-89fa-f3dd3ebaf968 None None] Automatically selected cinder-scheduler objects version 1.39 as minimum service version. Apr 29 18:51:53 devstack cinder-volume[75401]: INFO cinder.rpc [None req-257b8688-1ced-4d58-89fa-f3dd3ebaf968 None None] Automatically selected cinder-scheduler RPC version 3.12 as minimum service version. Apr 29 18:51:53 devstack cinder-volume[75401]: DEBUG oslo_db.sqlalchemy.engines [None req-257b8688-1ced-4d58-89fa-f3dd3ebaf968 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=75401) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Apr 29 18:51:53 devstack cinder-volume[75401]: INFO cinder.volume.manager [None req-257b8688-1ced-4d58-89fa-f3dd3ebaf968 None None] Determined volume DB was empty at startup. Apr 29 18:51:53 devstack cinder-volume[75401]: DEBUG cinder.volume.manager [None req-257b8688-1ced-4d58-89fa-f3dd3ebaf968 None None] Cinder Volume DB check: vol_db_empty=True {{(pid=75401) __init__ /opt/stack/cinder/cinder/volume/manager.py:288}} Apr 29 18:51:53 devstack cinder-volume[75401]: INFO cinder.volume.manager [None req-257b8688-1ced-4d58-89fa-f3dd3ebaf968 None None] Service not found for updating active_backend_id, assuming default for driver init. Apr 29 18:51:53 devstack cinder-volume[75401]: WARNING stevedore.named [None req-257b8688-1ced-4d58-89fa-f3dd3ebaf968 None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Apr 29 18:51:53 devstack cinder-volume[75401]: WARNING castellan.key_manager [None req-257b8688-1ced-4d58-89fa-f3dd3ebaf968 None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Apr 29 18:51:53 devstack cinder-volume[75401]: WARNING cinder.keymgr.conf_key_mgr [None req-257b8688-1ced-4d58-89fa-f3dd3ebaf968 None None] This key manager is insecure and is not recommended for production deployments: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Apr 29 18:51:53 devstack cinder-volume[75401]: DEBUG cinder.volume.drivers.lvm [None req-257b8688-1ced-4d58-89fa-f3dd3ebaf968 None None] Attempting to initialize LVM driver with the following target_driver: cinder.volume.targets.lio.LioAdm {{(pid=75401) __init__ /opt/stack/cinder/cinder/volume/drivers/lvm.py:106}} Apr 29 18:51:53 devstack cinder-volume[75401]: DEBUG oslo_concurrency.processutils [None req-257b8688-1ced-4d58-89fa-f3dd3ebaf968 None None] Running cmd (subprocess): cinder-rtstool verify {{(pid=75401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 18:51:53 devstack cinder-volume[75401]: DEBUG oslo_concurrency.processutils [None req-257b8688-1ced-4d58-89fa-f3dd3ebaf968 None None] CMD "cinder-rtstool verify" returned: 0 in 0.353s {{(pid=75401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 18:51:53 devstack cinder-volume[75401]: DEBUG oslo_db.sqlalchemy.engines [None req-257b8688-1ced-4d58-89fa-f3dd3ebaf968 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=75401) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Apr 29 18:51:53 devstack cinder-volume[75401]: INFO cinder.rpc [None req-257b8688-1ced-4d58-89fa-f3dd3ebaf968 None None] Automatically selected cinder-volume objects version 1.39 as minimum service version. Apr 29 18:51:53 devstack cinder-volume[75401]: INFO cinder.rpc [None req-257b8688-1ced-4d58-89fa-f3dd3ebaf968 None None] Automatically selected cinder-volume RPC version 3.20 as minimum service version. Apr 29 18:51:53 devstack cinder-volume[75401]: WARNING stevedore.named [None req-257b8688-1ced-4d58-89fa-f3dd3ebaf968 None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Apr 29 18:51:53 devstack cinder-volume[75401]: WARNING castellan.key_manager [None req-257b8688-1ced-4d58-89fa-f3dd3ebaf968 None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Apr 29 18:51:53 devstack cinder-volume[75401]: INFO cinder.volume.manager [None req-257b8688-1ced-4d58-89fa-f3dd3ebaf968 None None] Image-volume cache enabled for host devstack@lvmdriver-1. Apr 29 18:51:53 devstack cinder-volume[75401]: DEBUG oslo_db.sqlalchemy.engines [None req-257b8688-1ced-4d58-89fa-f3dd3ebaf968 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=75401) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Apr 29 18:51:53 devstack cinder-volume[75401]: INFO oslo_service.backend._eventlet.service [None req-257b8688-1ced-4d58-89fa-f3dd3ebaf968 None None] Starting 1 workers Apr 29 18:51:53 devstack cinder-volume[75401]: DEBUG oslo_service.backend._eventlet.service [None req-257b8688-1ced-4d58-89fa-f3dd3ebaf968 None None] Started child 75577 {{(pid=75401) _start_child /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:491}} Apr 29 18:51:53 devstack cinder-volume[75401]: DEBUG oslo_service.backend._eventlet.service [None req-257b8688-1ced-4d58-89fa-f3dd3ebaf968 None None] Full set of CONF: {{(pid=75401) wait /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:565}} Apr 29 18:51:53 devstack cinder-volume[75401]: DEBUG oslo_service.backend._eventlet.service [None req-257b8688-1ced-4d58-89fa-f3dd3ebaf968 None None] ******************************************************************************** {{(pid=75401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2979}} Apr 29 18:51:53 devstack cinder-volume[75401]: DEBUG oslo_service.backend._eventlet.service [None req-257b8688-1ced-4d58-89fa-f3dd3ebaf968 None None] Configuration options gathered from: {{(pid=75401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2980}} Apr 29 18:51:53 devstack cinder-volume[75401]: DEBUG oslo_service.backend._eventlet.service [None req-257b8688-1ced-4d58-89fa-f3dd3ebaf968 None None] command line args: ['--config-file', '/etc/cinder/cinder.conf'] {{(pid=75401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2981}} Apr 29 18:51:53 devstack cinder-volume[75401]: DEBUG oslo_service.backend._eventlet.service [None req-257b8688-1ced-4d58-89fa-f3dd3ebaf968 None None] config files: ['/etc/cinder/cinder.conf'] {{(pid=75401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2982}} Apr 29 18:51:53 devstack cinder-volume[75401]: DEBUG oslo_service.backend._eventlet.service [None req-257b8688-1ced-4d58-89fa-f3dd3ebaf968 None None] ================================================================================ {{(pid=75401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2987}} Apr 29 18:51:53 devstack cinder-volume[75401]: DEBUG oslo_service.backend._eventlet.service [None req-257b8688-1ced-4d58-89fa-f3dd3ebaf968 None None] allow_availability_zone_fallback = False {{(pid=75401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 18:51:53 devstack cinder-volume[75401]: DEBUG oslo_service.backend._eventlet.service [None req-257b8688-1ced-4d58-89fa-f3dd3ebaf968 None None] allow_compression_on_image_upload = False {{(pid=75401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 18:51:53 devstack cinder-volume[75401]: DEBUG oslo_service.backend._eventlet.service [None req-257b8688-1ced-4d58-89fa-f3dd3ebaf968 None None] allowed_direct_url_schemes = [] {{(pid=75401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 18:51:53 devstack cinder-volume[75401]: DEBUG oslo_service.backend._eventlet.service [None req-257b8688-1ced-4d58-89fa-f3dd3ebaf968 None None] api_rate_limit = True {{(pid=75401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 18:51:53 devstack cinder-volume[75401]: DEBUG oslo_service.backend._eventlet.service [None req-257b8688-1ced-4d58-89fa-f3dd3ebaf968 None None] auth_strategy = keystone {{(pid=75401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 18:51:53 devstack cinder-volume[75401]: DEBUG oslo_service.backend._eventlet.service [None req-257b8688-1ced-4d58-89fa-f3dd3ebaf968 None None] az_cache_duration = 3600 {{(pid=75401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 18:51:53 devstack cinder-volume[75401]: DEBUG oslo_service.backend._eventlet.service [None req-257b8688-1ced-4d58-89fa-f3dd3ebaf968 None None] backend_availability_zone = None {{(pid=75401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 18:51:53 devstack cinder-volume[75577]: INFO cinder.service [-] Starting cinder-volume node (version 28.0.0) Apr 29 18:51:53 devstack cinder-volume[75401]: DEBUG oslo_service.backend._eventlet.service [None req-257b8688-1ced-4d58-89fa-f3dd3ebaf968 None None] backend_host = None {{(pid=75401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 18:51:53 devstack cinder-volume[75401]: DEBUG oslo_service.backend._eventlet.service [None req-257b8688-1ced-4d58-89fa-f3dd3ebaf968 None None] backend_name = None {{(pid=75401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 18:51:53 devstack cinder-volume[75401]: DEBUG oslo_service.backend._eventlet.service [None req-257b8688-1ced-4d58-89fa-f3dd3ebaf968 None None] backend_stats_polling_interval = 60 {{(pid=75401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 18:51:53 devstack cinder-volume[75401]: DEBUG oslo_service.backend._eventlet.service [None req-257b8688-1ced-4d58-89fa-f3dd3ebaf968 None None] backup_api_class = cinder.backup.api.API {{(pid=75401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 18:51:53 devstack cinder-volume[75401]: DEBUG oslo_service.backend._eventlet.service [None req-257b8688-1ced-4d58-89fa-f3dd3ebaf968 None None] backup_manager = cinder.backup.manager.BackupManager {{(pid=75401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 18:51:53 devstack cinder-volume[75401]: DEBUG oslo_service.backend._eventlet.service [None req-257b8688-1ced-4d58-89fa-f3dd3ebaf968 None None] backup_name_template = backup-%s {{(pid=75401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 18:51:53 devstack cinder-volume[75401]: DEBUG oslo_service.backend._eventlet.service [None req-257b8688-1ced-4d58-89fa-f3dd3ebaf968 None None] backup_use_same_host = False {{(pid=75401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 18:51:53 devstack cinder-volume[75401]: DEBUG oslo_service.backend._eventlet.service [None req-257b8688-1ced-4d58-89fa-f3dd3ebaf968 None None] backup_use_temp_snapshot = False {{(pid=75401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 18:51:53 devstack cinder-volume[75401]: DEBUG oslo_service.backend._eventlet.service [None req-257b8688-1ced-4d58-89fa-f3dd3ebaf968 None None] chap_password = **** {{(pid=75401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 18:51:53 devstack cinder-volume[75401]: DEBUG oslo_service.backend._eventlet.service [None req-257b8688-1ced-4d58-89fa-f3dd3ebaf968 None None] chap_username = {{(pid=75401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 18:51:53 devstack cinder-volume[75401]: DEBUG oslo_service.backend._eventlet.service [None req-257b8688-1ced-4d58-89fa-f3dd3ebaf968 None None] chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=75401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 18:51:53 devstack cinder-volume[75401]: DEBUG oslo_service.backend._eventlet.service [None req-257b8688-1ced-4d58-89fa-f3dd3ebaf968 None None] cinder_internal_tenant_project_id = dece91964b24460f8d24561836f27c9f {{(pid=75401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 18:51:53 devstack cinder-volume[75401]: DEBUG oslo_service.backend._eventlet.service [None req-257b8688-1ced-4d58-89fa-f3dd3ebaf968 None None] cinder_internal_tenant_user_id = 029d4e2c59b444a59d4282ffce967113 {{(pid=75401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 18:51:53 devstack cinder-volume[75401]: DEBUG oslo_service.backend._eventlet.service [None req-257b8688-1ced-4d58-89fa-f3dd3ebaf968 None None] cloned_volume_same_az = True {{(pid=75401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 18:51:53 devstack cinder-volume[75401]: DEBUG oslo_service.backend._eventlet.service [None req-257b8688-1ced-4d58-89fa-f3dd3ebaf968 None None] cluster = None {{(pid=75401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 18:51:53 devstack cinder-volume[75401]: DEBUG oslo_service.backend._eventlet.service [None req-257b8688-1ced-4d58-89fa-f3dd3ebaf968 None None] compression_format = gzip {{(pid=75401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 18:51:53 devstack cinder-volume[75401]: DEBUG oslo_service.backend._eventlet.service [None req-257b8688-1ced-4d58-89fa-f3dd3ebaf968 None None] compute_api_class = cinder.compute.nova.API {{(pid=75401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 18:51:53 devstack cinder-volume[75401]: DEBUG oslo_service.backend._eventlet.service [None req-257b8688-1ced-4d58-89fa-f3dd3ebaf968 None None] config_dir = [] {{(pid=75401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 18:51:53 devstack cinder-volume[75401]: DEBUG oslo_service.backend._eventlet.service [None req-257b8688-1ced-4d58-89fa-f3dd3ebaf968 None None] config_file = ['/etc/cinder/cinder.conf'] {{(pid=75401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 18:51:53 devstack cinder-volume[75401]: DEBUG oslo_service.backend._eventlet.service [None req-257b8688-1ced-4d58-89fa-f3dd3ebaf968 None None] config_source = [] {{(pid=75401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 18:51:53 devstack cinder-volume[75401]: DEBUG oslo_service.backend._eventlet.service [None req-257b8688-1ced-4d58-89fa-f3dd3ebaf968 None None] consistencygroup_api_class = cinder.consistencygroup.api.API {{(pid=75401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 18:51:53 devstack cinder-volume[75401]: DEBUG oslo_service.backend._eventlet.service [None req-257b8688-1ced-4d58-89fa-f3dd3ebaf968 None None] control_exchange = openstack {{(pid=75401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 18:51:53 devstack cinder-volume[75401]: DEBUG oslo_service.backend._eventlet.service [None req-257b8688-1ced-4d58-89fa-f3dd3ebaf968 None None] debug = True {{(pid=75401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 18:51:53 devstack cinder-volume[75401]: DEBUG oslo_service.backend._eventlet.service [None req-257b8688-1ced-4d58-89fa-f3dd3ebaf968 None None] default_availability_zone = None {{(pid=75401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 18:51:53 devstack cinder-volume[75401]: DEBUG oslo_service.backend._eventlet.service [None req-257b8688-1ced-4d58-89fa-f3dd3ebaf968 None None] default_group_type = None {{(pid=75401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 18:51:53 devstack cinder-volume[75401]: DEBUG oslo_service.backend._eventlet.service [None req-257b8688-1ced-4d58-89fa-f3dd3ebaf968 None None] default_log_levels = ['amqp=WARN', 'boto=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO'] {{(pid=75401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 18:51:53 devstack cinder-volume[75401]: DEBUG oslo_service.backend._eventlet.service [None req-257b8688-1ced-4d58-89fa-f3dd3ebaf968 None None] default_volume_type = lvmdriver-1 {{(pid=75401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 18:51:53 devstack cinder-volume[75401]: DEBUG oslo_service.backend._eventlet.service [None req-257b8688-1ced-4d58-89fa-f3dd3ebaf968 None None] disk_geometry = None {{(pid=75401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 18:51:53 devstack cinder-volume[75401]: DEBUG oslo_service.backend._eventlet.service [None req-257b8688-1ced-4d58-89fa-f3dd3ebaf968 None None] driver_client_cert = None {{(pid=75401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 18:51:53 devstack cinder-volume[75401]: DEBUG oslo_service.backend._eventlet.service [None req-257b8688-1ced-4d58-89fa-f3dd3ebaf968 None None] driver_client_cert_key = None {{(pid=75401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 18:51:53 devstack cinder-volume[75401]: DEBUG oslo_service.backend._eventlet.service [None req-257b8688-1ced-4d58-89fa-f3dd3ebaf968 None None] driver_data_namespace = None {{(pid=75401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 18:51:53 devstack cinder-volume[75401]: DEBUG oslo_service.backend._eventlet.service [None req-257b8688-1ced-4d58-89fa-f3dd3ebaf968 None None] driver_ssl_cert_path = None {{(pid=75401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 18:51:53 devstack cinder-volume[75401]: DEBUG oslo_service.backend._eventlet.service [None req-257b8688-1ced-4d58-89fa-f3dd3ebaf968 None None] driver_ssl_cert_verify = False {{(pid=75401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 18:51:53 devstack cinder-volume[75401]: DEBUG oslo_service.backend._eventlet.service [None req-257b8688-1ced-4d58-89fa-f3dd3ebaf968 None None] driver_use_ssl = False {{(pid=75401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 18:51:53 devstack cinder-volume[75401]: DEBUG oslo_service.backend._eventlet.service [None req-257b8688-1ced-4d58-89fa-f3dd3ebaf968 None None] enable_force_upload = False {{(pid=75401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 18:51:53 devstack cinder-volume[75401]: DEBUG oslo_service.backend._eventlet.service [None req-257b8688-1ced-4d58-89fa-f3dd3ebaf968 None None] enable_new_services = True {{(pid=75401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 18:51:53 devstack cinder-volume[75401]: DEBUG oslo_service.backend._eventlet.service [None req-257b8688-1ced-4d58-89fa-f3dd3ebaf968 None None] enable_unsupported_driver = False {{(pid=75401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 18:51:53 devstack cinder-volume[75401]: DEBUG oslo_service.backend._eventlet.service [None req-257b8688-1ced-4d58-89fa-f3dd3ebaf968 None None] enabled_backends = ['lvmdriver-1'] {{(pid=75401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 18:51:53 devstack cinder-volume[75401]: DEBUG oslo_service.backend._eventlet.service [None req-257b8688-1ced-4d58-89fa-f3dd3ebaf968 None None] enforce_multipath_for_image_xfer = False {{(pid=75401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 18:51:53 devstack cinder-volume[75401]: DEBUG oslo_service.backend._eventlet.service [None req-257b8688-1ced-4d58-89fa-f3dd3ebaf968 None None] filter_function = None {{(pid=75401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 18:51:53 devstack cinder-volume[75401]: DEBUG oslo_service.backend._eventlet.service [None req-257b8688-1ced-4d58-89fa-f3dd3ebaf968 None None] glance_api_insecure = False {{(pid=75401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 18:51:53 devstack cinder-volume[75401]: DEBUG oslo_service.backend._eventlet.service [None req-257b8688-1ced-4d58-89fa-f3dd3ebaf968 None None] glance_api_servers = ['http://192.168.122.135/image'] {{(pid=75401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 18:51:53 devstack cinder-volume[75401]: DEBUG oslo_service.backend._eventlet.service [None req-257b8688-1ced-4d58-89fa-f3dd3ebaf968 None None] glance_api_ssl_compression = False {{(pid=75401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 18:51:53 devstack cinder-volume[75401]: DEBUG oslo_service.backend._eventlet.service [None req-257b8688-1ced-4d58-89fa-f3dd3ebaf968 None None] glance_ca_certificates_file = None {{(pid=75401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 18:51:53 devstack cinder-volume[75401]: DEBUG oslo_service.backend._eventlet.service [None req-257b8688-1ced-4d58-89fa-f3dd3ebaf968 None None] glance_catalog_info = image:glance:publicURL {{(pid=75401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 18:51:53 devstack cinder-volume[75401]: DEBUG oslo_service.backend._eventlet.service [None req-257b8688-1ced-4d58-89fa-f3dd3ebaf968 None None] glance_certfile = None {{(pid=75401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 18:51:53 devstack cinder-volume[75401]: DEBUG oslo_service.backend._eventlet.service [None req-257b8688-1ced-4d58-89fa-f3dd3ebaf968 None None] glance_core_properties = ['checksum', 'container_format', 'disk_format', 'image_name', 'image_id', 'min_disk', 'min_ram', 'name', 'size'] {{(pid=75401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 18:51:53 devstack cinder-volume[75401]: DEBUG oslo_service.backend._eventlet.service [None req-257b8688-1ced-4d58-89fa-f3dd3ebaf968 None None] glance_keyfile = None {{(pid=75401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 18:51:53 devstack cinder-volume[75401]: DEBUG oslo_service.backend._eventlet.service [None req-257b8688-1ced-4d58-89fa-f3dd3ebaf968 None None] glance_num_retries = 3 {{(pid=75401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 18:51:53 devstack cinder-volume[75401]: DEBUG oslo_service.backend._eventlet.service [None req-257b8688-1ced-4d58-89fa-f3dd3ebaf968 None None] glance_request_timeout = None {{(pid=75401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 18:51:53 devstack cinder-volume[75401]: DEBUG oslo_service.backend._eventlet.service [None req-257b8688-1ced-4d58-89fa-f3dd3ebaf968 None None] goodness_function = None {{(pid=75401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 18:51:53 devstack cinder-volume[75401]: DEBUG oslo_service.backend._eventlet.service [None req-257b8688-1ced-4d58-89fa-f3dd3ebaf968 None None] graceful_shutdown_timeout = 5 {{(pid=75401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 18:51:53 devstack cinder-volume[75401]: DEBUG oslo_service.backend._eventlet.service [None req-257b8688-1ced-4d58-89fa-f3dd3ebaf968 None None] group_api_class = cinder.group.api.API {{(pid=75401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 18:51:53 devstack cinder-volume[75401]: DEBUG oslo_service.backend._eventlet.service [None req-257b8688-1ced-4d58-89fa-f3dd3ebaf968 None None] host = devstack {{(pid=75401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 18:51:53 devstack cinder-volume[75401]: DEBUG oslo_service.backend._eventlet.service [None req-257b8688-1ced-4d58-89fa-f3dd3ebaf968 None None] image_compress_on_upload = True {{(pid=75401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 18:51:53 devstack cinder-volume[75401]: DEBUG oslo_service.backend._eventlet.service [None req-257b8688-1ced-4d58-89fa-f3dd3ebaf968 None None] image_conversion_address_space_limit = 1 {{(pid=75401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 18:51:53 devstack cinder-volume[75401]: DEBUG oslo_service.backend._eventlet.service [None req-257b8688-1ced-4d58-89fa-f3dd3ebaf968 None None] image_conversion_cpu_limit = 60 {{(pid=75401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 18:51:53 devstack cinder-volume[75401]: DEBUG oslo_service.backend._eventlet.service [None req-257b8688-1ced-4d58-89fa-f3dd3ebaf968 None None] image_conversion_dir = /opt/stack/data/cinder/conversion {{(pid=75401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 18:51:53 devstack cinder-volume[75401]: DEBUG oslo_service.backend._eventlet.service [None req-257b8688-1ced-4d58-89fa-f3dd3ebaf968 None None] image_conversion_disable = False {{(pid=75401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 18:51:53 devstack cinder-volume[75401]: DEBUG oslo_service.backend._eventlet.service [None req-257b8688-1ced-4d58-89fa-f3dd3ebaf968 None None] image_upload_use_cinder_backend = False {{(pid=75401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 18:51:53 devstack cinder-volume[75401]: DEBUG oslo_service.backend._eventlet.service [None req-257b8688-1ced-4d58-89fa-f3dd3ebaf968 None None] image_upload_use_internal_tenant = False {{(pid=75401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 18:51:53 devstack cinder-volume[75401]: DEBUG oslo_service.backend._eventlet.service [None req-257b8688-1ced-4d58-89fa-f3dd3ebaf968 None None] image_volume_cache_enabled = False {{(pid=75401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 18:51:53 devstack cinder-volume[75401]: DEBUG oslo_service.backend._eventlet.service [None req-257b8688-1ced-4d58-89fa-f3dd3ebaf968 None None] image_volume_cache_max_count = 0 {{(pid=75401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 18:51:53 devstack cinder-volume[75401]: DEBUG oslo_service.backend._eventlet.service [None req-257b8688-1ced-4d58-89fa-f3dd3ebaf968 None None] image_volume_cache_max_size_gb = 0 {{(pid=75401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 18:51:53 devstack cinder-volume[75401]: DEBUG oslo_service.backend._eventlet.service [None req-257b8688-1ced-4d58-89fa-f3dd3ebaf968 None None] init_host_max_objects_retrieval = 0 {{(pid=75401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 18:51:53 devstack cinder-volume[75401]: DEBUG oslo_service.backend._eventlet.service [None req-257b8688-1ced-4d58-89fa-f3dd3ebaf968 None None] instance_format = [instance: %(uuid)s] {{(pid=75401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 18:51:53 devstack cinder-volume[75401]: DEBUG oslo_service.backend._eventlet.service [None req-257b8688-1ced-4d58-89fa-f3dd3ebaf968 None None] instance_uuid_format = [instance: %(uuid)s] {{(pid=75401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 18:51:53 devstack cinder-volume[75401]: DEBUG oslo_service.backend._eventlet.service [None req-257b8688-1ced-4d58-89fa-f3dd3ebaf968 None None] iscsi_target_flags = {{(pid=75401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 18:51:53 devstack cinder-volume[75401]: DEBUG oslo_service.backend._eventlet.service [None req-257b8688-1ced-4d58-89fa-f3dd3ebaf968 None None] iscsi_write_cache = on {{(pid=75401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 18:51:53 devstack cinder-volume[75401]: DEBUG oslo_service.backend._eventlet.service [None req-257b8688-1ced-4d58-89fa-f3dd3ebaf968 None None] iser_helper = tgtadm {{(pid=75401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 18:51:53 devstack cinder-volume[75401]: DEBUG oslo_service.backend._eventlet.service [None req-257b8688-1ced-4d58-89fa-f3dd3ebaf968 None None] iser_ip_address = 192.168.122.135 {{(pid=75401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 18:51:53 devstack cinder-volume[75401]: DEBUG oslo_service.backend._eventlet.service [None req-257b8688-1ced-4d58-89fa-f3dd3ebaf968 None None] iser_port = 3260 {{(pid=75401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 18:51:53 devstack cinder-volume[75401]: DEBUG oslo_service.backend._eventlet.service [None req-257b8688-1ced-4d58-89fa-f3dd3ebaf968 None None] iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=75401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 18:51:53 devstack cinder-volume[75401]: DEBUG oslo_service.backend._eventlet.service [None req-257b8688-1ced-4d58-89fa-f3dd3ebaf968 None None] log_color = False {{(pid=75401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 18:51:53 devstack cinder-volume[75401]: DEBUG oslo_service.backend._eventlet.service [None req-257b8688-1ced-4d58-89fa-f3dd3ebaf968 None None] log_config_append = None {{(pid=75401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 18:51:53 devstack cinder-volume[75401]: DEBUG oslo_service.backend._eventlet.service [None req-257b8688-1ced-4d58-89fa-f3dd3ebaf968 None None] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=75401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 18:51:53 devstack cinder-volume[75401]: DEBUG oslo_service.backend._eventlet.service [None req-257b8688-1ced-4d58-89fa-f3dd3ebaf968 None None] log_dir = None {{(pid=75401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 18:51:53 devstack cinder-volume[75401]: DEBUG oslo_service.backend._eventlet.service [None req-257b8688-1ced-4d58-89fa-f3dd3ebaf968 None None] log_file = None {{(pid=75401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 18:51:53 devstack cinder-volume[75401]: DEBUG oslo_service.backend._eventlet.service [None req-257b8688-1ced-4d58-89fa-f3dd3ebaf968 None None] log_options = True {{(pid=75401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 18:51:53 devstack cinder-volume[75401]: DEBUG oslo_service.backend._eventlet.service [None req-257b8688-1ced-4d58-89fa-f3dd3ebaf968 None None] log_rotate_interval = 1 {{(pid=75401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 18:51:53 devstack cinder-volume[75401]: DEBUG oslo_service.backend._eventlet.service [None req-257b8688-1ced-4d58-89fa-f3dd3ebaf968 None None] log_rotate_interval_type = days {{(pid=75401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 18:51:53 devstack cinder-volume[75401]: DEBUG oslo_service.backend._eventlet.service [None req-257b8688-1ced-4d58-89fa-f3dd3ebaf968 None None] log_rotation_type = none {{(pid=75401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 18:51:53 devstack cinder-volume[75401]: DEBUG oslo_service.backend._eventlet.service [None req-257b8688-1ced-4d58-89fa-f3dd3ebaf968 None None] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=75401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 18:51:53 devstack cinder-volume[75401]: DEBUG oslo_service.backend._eventlet.service [None req-257b8688-1ced-4d58-89fa-f3dd3ebaf968 None None] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=75401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 18:51:53 devstack cinder-volume[75401]: DEBUG oslo_service.backend._eventlet.service [None req-257b8688-1ced-4d58-89fa-f3dd3ebaf968 None None] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=75401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 18:51:53 devstack cinder-volume[75401]: DEBUG oslo_service.backend._eventlet.service [None req-257b8688-1ced-4d58-89fa-f3dd3ebaf968 None None] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=75401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 18:51:53 devstack cinder-volume[75401]: DEBUG oslo_service.backend._eventlet.service [None req-257b8688-1ced-4d58-89fa-f3dd3ebaf968 None None] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=75401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 18:51:53 devstack cinder-volume[75401]: DEBUG oslo_service.backend._eventlet.service [None req-257b8688-1ced-4d58-89fa-f3dd3ebaf968 None None] max_age = 0 {{(pid=75401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 18:51:53 devstack cinder-volume[75401]: DEBUG oslo_service.backend._eventlet.service [None req-257b8688-1ced-4d58-89fa-f3dd3ebaf968 None None] max_logfile_count = 30 {{(pid=75401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 18:51:53 devstack cinder-volume[75401]: DEBUG oslo_service.backend._eventlet.service [None req-257b8688-1ced-4d58-89fa-f3dd3ebaf968 None None] max_logfile_size_mb = 200 {{(pid=75401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 18:51:53 devstack cinder-volume[75401]: DEBUG oslo_service.backend._eventlet.service [None req-257b8688-1ced-4d58-89fa-f3dd3ebaf968 None None] max_over_subscription_ratio = 20.0 {{(pid=75401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 18:51:54 devstack cinder-volume[75401]: DEBUG oslo_service.backend._eventlet.service [None req-257b8688-1ced-4d58-89fa-f3dd3ebaf968 None None] message_reap_interval = 86400 {{(pid=75401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 18:51:54 devstack cinder-volume[75577]: INFO cinder.volume.manager [None req-108ed54b-9ee2-483e-ae17-f87d899e7dce None None] Starting volume driver LVMVolumeDriver (3.0.0) Apr 29 18:51:54 devstack cinder-volume[75401]: DEBUG oslo_service.backend._eventlet.service [None req-257b8688-1ced-4d58-89fa-f3dd3ebaf968 None None] message_ttl = 2592000 {{(pid=75401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 18:51:54 devstack cinder-volume[75401]: DEBUG oslo_service.backend._eventlet.service [None req-257b8688-1ced-4d58-89fa-f3dd3ebaf968 None None] migration_create_volume_timeout_secs = 300 {{(pid=75401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 18:51:54 devstack cinder-volume[75401]: DEBUG oslo_service.backend._eventlet.service [None req-257b8688-1ced-4d58-89fa-f3dd3ebaf968 None None] monkey_patch = False {{(pid=75401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 18:51:54 devstack cinder-volume[75401]: DEBUG oslo_service.backend._eventlet.service [None req-257b8688-1ced-4d58-89fa-f3dd3ebaf968 None None] monkey_patch_modules = [] {{(pid=75401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 18:51:54 devstack cinder-volume[75401]: DEBUG oslo_service.backend._eventlet.service [None req-257b8688-1ced-4d58-89fa-f3dd3ebaf968 None None] my_ip = 192.168.122.135 {{(pid=75401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 18:51:54 devstack cinder-volume[75401]: DEBUG oslo_service.backend._eventlet.service [None req-257b8688-1ced-4d58-89fa-f3dd3ebaf968 None None] no_snapshot_gb_quota = False {{(pid=75401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 18:51:54 devstack cinder-volume[75401]: DEBUG oslo_service.backend._eventlet.service [None req-257b8688-1ced-4d58-89fa-f3dd3ebaf968 None None] num_iser_scan_tries = 3 {{(pid=75401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 18:51:54 devstack cinder-volume[75577]: DEBUG oslo_concurrency.processutils [None req-108ed54b-9ee2-483e-ae17-f87d899e7dce None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=75577) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 18:51:54 devstack cinder-volume[75401]: DEBUG oslo_service.backend._eventlet.service [None req-257b8688-1ced-4d58-89fa-f3dd3ebaf968 None None] num_shell_tries = 3 {{(pid=75401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 18:51:54 devstack cinder-volume[75401]: DEBUG oslo_service.backend._eventlet.service [None req-257b8688-1ced-4d58-89fa-f3dd3ebaf968 None None] num_volume_device_scan_tries = 3 {{(pid=75401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 18:51:54 devstack cinder-volume[75401]: DEBUG oslo_service.backend._eventlet.service [None req-257b8688-1ced-4d58-89fa-f3dd3ebaf968 None None] nvmeof_conn_info_version = 1 {{(pid=75401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 18:51:54 devstack cinder-volume[75401]: DEBUG oslo_service.backend._eventlet.service [None req-257b8688-1ced-4d58-89fa-f3dd3ebaf968 None None] nvmet_ns_id = 10 {{(pid=75401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 18:51:54 devstack cinder-volume[75401]: DEBUG oslo_service.backend._eventlet.service [None req-257b8688-1ced-4d58-89fa-f3dd3ebaf968 None None] nvmet_port_id = 1 {{(pid=75401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 18:51:54 devstack cinder-volume[75401]: DEBUG oslo_service.backend._eventlet.service [None req-257b8688-1ced-4d58-89fa-f3dd3ebaf968 None None] osapi_max_limit = 1000 {{(pid=75401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 18:51:54 devstack cinder-volume[75401]: DEBUG oslo_service.backend._eventlet.service [None req-257b8688-1ced-4d58-89fa-f3dd3ebaf968 None None] osapi_volume_ext_list = [] {{(pid=75401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 18:51:54 devstack cinder-volume[75401]: DEBUG oslo_service.backend._eventlet.service [None req-257b8688-1ced-4d58-89fa-f3dd3ebaf968 None None] osapi_volume_extension = ['cinder.api.contrib.standard_extensions'] {{(pid=75401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 18:51:54 devstack cinder-volume[75401]: DEBUG oslo_service.backend._eventlet.service [None req-257b8688-1ced-4d58-89fa-f3dd3ebaf968 None None] osapi_volume_listen = 0.0.0.0 {{(pid=75401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 18:51:54 devstack cinder-volume[75401]: DEBUG oslo_service.backend._eventlet.service [None req-257b8688-1ced-4d58-89fa-f3dd3ebaf968 None None] osapi_volume_listen_port = 8776 {{(pid=75401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 18:51:54 devstack cinder-volume[75401]: DEBUG oslo_service.backend._eventlet.service [None req-257b8688-1ced-4d58-89fa-f3dd3ebaf968 None None] osapi_volume_use_ssl = False {{(pid=75401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 18:51:54 devstack cinder-volume[75401]: DEBUG oslo_service.backend._eventlet.service [None req-257b8688-1ced-4d58-89fa-f3dd3ebaf968 None None] osapi_volume_workers = 2 {{(pid=75401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 18:51:54 devstack cinder-volume[75401]: DEBUG oslo_service.backend._eventlet.service [None req-257b8688-1ced-4d58-89fa-f3dd3ebaf968 None None] per_volume_size_limit = -1 {{(pid=75401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 18:51:54 devstack cinder-volume[75401]: DEBUG oslo_service.backend._eventlet.service [None req-257b8688-1ced-4d58-89fa-f3dd3ebaf968 None None] periodic_fuzzy_delay = 60 {{(pid=75401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 18:51:54 devstack cinder-volume[75401]: DEBUG oslo_service.backend._eventlet.service [None req-257b8688-1ced-4d58-89fa-f3dd3ebaf968 None None] periodic_interval = 60 {{(pid=75401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 18:51:54 devstack cinder-volume[75401]: DEBUG oslo_service.backend._eventlet.service [None req-257b8688-1ced-4d58-89fa-f3dd3ebaf968 None None] project_id_regex = [0-9a-f\-]+ {{(pid=75401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 18:51:54 devstack cinder-volume[75401]: DEBUG oslo_service.backend._eventlet.service [None req-257b8688-1ced-4d58-89fa-f3dd3ebaf968 None None] public_endpoint = None {{(pid=75401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 18:51:54 devstack cinder-volume[75401]: DEBUG oslo_service.backend._eventlet.service [None req-257b8688-1ced-4d58-89fa-f3dd3ebaf968 None None] publish_errors = False {{(pid=75401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 18:51:54 devstack cinder-volume[75401]: DEBUG oslo_service.backend._eventlet.service [None req-257b8688-1ced-4d58-89fa-f3dd3ebaf968 None None] quota_backup_gigabytes = 1000 {{(pid=75401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 18:51:54 devstack cinder-volume[75401]: DEBUG oslo_service.backend._eventlet.service [None req-257b8688-1ced-4d58-89fa-f3dd3ebaf968 None None] quota_backups = 10 {{(pid=75401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 18:51:54 devstack cinder-volume[75401]: DEBUG oslo_service.backend._eventlet.service [None req-257b8688-1ced-4d58-89fa-f3dd3ebaf968 None None] quota_driver = cinder.quota.DbQuotaDriver {{(pid=75401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 18:51:54 devstack cinder-volume[75401]: DEBUG oslo_service.backend._eventlet.service [None req-257b8688-1ced-4d58-89fa-f3dd3ebaf968 None None] quota_gigabytes = 1000 {{(pid=75401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 18:51:54 devstack cinder-volume[75401]: DEBUG oslo_service.backend._eventlet.service [None req-257b8688-1ced-4d58-89fa-f3dd3ebaf968 None None] quota_groups = 10 {{(pid=75401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 18:51:54 devstack cinder-volume[75401]: DEBUG oslo_service.backend._eventlet.service [None req-257b8688-1ced-4d58-89fa-f3dd3ebaf968 None None] quota_snapshots = 10 {{(pid=75401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 18:51:54 devstack cinder-volume[75401]: DEBUG oslo_service.backend._eventlet.service [None req-257b8688-1ced-4d58-89fa-f3dd3ebaf968 None None] quota_volumes = 10 {{(pid=75401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 18:51:54 devstack cinder-volume[75401]: DEBUG oslo_service.backend._eventlet.service [None req-257b8688-1ced-4d58-89fa-f3dd3ebaf968 None None] rate_limit_burst = 0 {{(pid=75401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 18:51:54 devstack cinder-volume[75401]: DEBUG oslo_service.backend._eventlet.service [None req-257b8688-1ced-4d58-89fa-f3dd3ebaf968 None None] rate_limit_except_level = CRITICAL {{(pid=75401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 18:51:54 devstack cinder-volume[75401]: DEBUG oslo_service.backend._eventlet.service [None req-257b8688-1ced-4d58-89fa-f3dd3ebaf968 None None] rate_limit_interval = 0 {{(pid=75401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 18:51:54 devstack cinder-volume[75401]: DEBUG oslo_service.backend._eventlet.service [None req-257b8688-1ced-4d58-89fa-f3dd3ebaf968 None None] reinit_driver_count = 3 {{(pid=75401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 18:51:54 devstack cinder-volume[75401]: DEBUG oslo_service.backend._eventlet.service [None req-257b8688-1ced-4d58-89fa-f3dd3ebaf968 None None] replication_device = **** {{(pid=75401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 18:51:54 devstack cinder-volume[75401]: DEBUG oslo_service.backend._eventlet.service [None req-257b8688-1ced-4d58-89fa-f3dd3ebaf968 None None] report_discard_supported = False {{(pid=75401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 18:51:54 devstack cinder-volume[75401]: DEBUG oslo_service.backend._eventlet.service [None req-257b8688-1ced-4d58-89fa-f3dd3ebaf968 None None] report_interval = 120 {{(pid=75401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 18:51:54 devstack cinder-volume[75401]: DEBUG oslo_service.backend._eventlet.service [None req-257b8688-1ced-4d58-89fa-f3dd3ebaf968 None None] reservation_clean_interval = 86400 {{(pid=75401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 18:51:54 devstack cinder-volume[75401]: DEBUG oslo_service.backend._eventlet.service [None req-257b8688-1ced-4d58-89fa-f3dd3ebaf968 None None] reservation_expire = 86400 {{(pid=75401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 18:51:54 devstack cinder-volume[75401]: DEBUG oslo_service.backend._eventlet.service [None req-257b8688-1ced-4d58-89fa-f3dd3ebaf968 None None] reserved_image_namespaces = [] {{(pid=75401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 18:51:54 devstack cinder-volume[75401]: DEBUG oslo_service.backend._eventlet.service [None req-257b8688-1ced-4d58-89fa-f3dd3ebaf968 None None] reserved_percentage = 0 {{(pid=75401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 18:51:54 devstack cinder-volume[75401]: DEBUG oslo_service.backend._eventlet.service [None req-257b8688-1ced-4d58-89fa-f3dd3ebaf968 None None] resource_query_filters_file = /etc/cinder/resource_filters.json {{(pid=75401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 18:51:54 devstack cinder-volume[75401]: DEBUG oslo_service.backend._eventlet.service [None req-257b8688-1ced-4d58-89fa-f3dd3ebaf968 None None] rootwrap_config = /etc/cinder/rootwrap.conf {{(pid=75401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 18:51:54 devstack cinder-volume[75401]: DEBUG oslo_service.backend._eventlet.service [None req-257b8688-1ced-4d58-89fa-f3dd3ebaf968 None None] rpc_response_timeout = 120 {{(pid=75401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 18:51:54 devstack cinder-volume[75401]: DEBUG oslo_service.backend._eventlet.service [None req-257b8688-1ced-4d58-89fa-f3dd3ebaf968 None None] run_external_periodic_tasks = True {{(pid=75401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 18:51:54 devstack cinder-volume[75401]: DEBUG oslo_service.backend._eventlet.service [None req-257b8688-1ced-4d58-89fa-f3dd3ebaf968 None None] scheduler_manager = cinder.scheduler.manager.SchedulerManager {{(pid=75401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 18:51:54 devstack cinder-volume[75401]: DEBUG oslo_service.backend._eventlet.service [None req-257b8688-1ced-4d58-89fa-f3dd3ebaf968 None None] scst_target_driver = iscsi {{(pid=75401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 18:51:54 devstack cinder-volume[75401]: DEBUG oslo_service.backend._eventlet.service [None req-257b8688-1ced-4d58-89fa-f3dd3ebaf968 None None] scst_target_iqn_name = None {{(pid=75401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 18:51:54 devstack cinder-volume[75401]: DEBUG oslo_service.backend._eventlet.service [None req-257b8688-1ced-4d58-89fa-f3dd3ebaf968 None None] service_down_time = 720 {{(pid=75401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 18:51:54 devstack cinder-volume[75401]: DEBUG oslo_service.backend._eventlet.service [None req-257b8688-1ced-4d58-89fa-f3dd3ebaf968 None None] shell_completion = None {{(pid=75401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 18:51:54 devstack cinder-volume[75401]: DEBUG oslo_service.backend._eventlet.service [None req-257b8688-1ced-4d58-89fa-f3dd3ebaf968 None None] snapshot_name_template = snapshot-%s {{(pid=75401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 18:51:54 devstack cinder-volume[75401]: DEBUG oslo_service.backend._eventlet.service [None req-257b8688-1ced-4d58-89fa-f3dd3ebaf968 None None] snapshot_same_host = True {{(pid=75401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 18:51:54 devstack cinder-volume[75401]: DEBUG oslo_service.backend._eventlet.service [None req-257b8688-1ced-4d58-89fa-f3dd3ebaf968 None None] split_loggers = False {{(pid=75401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 18:51:54 devstack cinder-volume[75401]: DEBUG oslo_service.backend._eventlet.service [None req-257b8688-1ced-4d58-89fa-f3dd3ebaf968 None None] state_path = /opt/stack/data/cinder {{(pid=75401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 18:51:54 devstack cinder-volume[75401]: DEBUG oslo_service.backend._eventlet.service [None req-257b8688-1ced-4d58-89fa-f3dd3ebaf968 None None] storage_availability_zone = nova {{(pid=75401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 18:51:54 devstack cinder-volume[75401]: DEBUG oslo_service.backend._eventlet.service [None req-257b8688-1ced-4d58-89fa-f3dd3ebaf968 None None] storage_protocol = iSCSI {{(pid=75401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 18:51:54 devstack cinder-volume[75401]: DEBUG oslo_service.backend._eventlet.service [None req-257b8688-1ced-4d58-89fa-f3dd3ebaf968 None None] syslog_log_facility = LOG_USER {{(pid=75401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 18:51:54 devstack cinder-volume[75401]: DEBUG oslo_service.backend._eventlet.service [None req-257b8688-1ced-4d58-89fa-f3dd3ebaf968 None None] target_helper = lioadm {{(pid=75401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 18:51:54 devstack cinder-volume[75401]: DEBUG oslo_service.backend._eventlet.service [None req-257b8688-1ced-4d58-89fa-f3dd3ebaf968 None None] target_ip_address = 192.168.122.135 {{(pid=75401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 18:51:54 devstack cinder-volume[75401]: DEBUG oslo_service.backend._eventlet.service [None req-257b8688-1ced-4d58-89fa-f3dd3ebaf968 None None] target_port = 3260 {{(pid=75401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 18:51:54 devstack cinder-volume[75401]: DEBUG oslo_service.backend._eventlet.service [None req-257b8688-1ced-4d58-89fa-f3dd3ebaf968 None None] target_prefix = iqn.2010-10.org.openstack: {{(pid=75401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 18:51:54 devstack cinder-volume[75401]: DEBUG oslo_service.backend._eventlet.service [None req-257b8688-1ced-4d58-89fa-f3dd3ebaf968 None None] target_protocol = iscsi {{(pid=75401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 18:51:54 devstack cinder-volume[75401]: DEBUG oslo_service.backend._eventlet.service [None req-257b8688-1ced-4d58-89fa-f3dd3ebaf968 None None] target_secondary_ip_addresses = [] {{(pid=75401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 18:51:54 devstack cinder-volume[75401]: DEBUG oslo_service.backend._eventlet.service [None req-257b8688-1ced-4d58-89fa-f3dd3ebaf968 None None] trace_flags = None {{(pid=75401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 18:51:54 devstack cinder-volume[75401]: DEBUG oslo_service.backend._eventlet.service [None req-257b8688-1ced-4d58-89fa-f3dd3ebaf968 None None] transfer_api_class = cinder.transfer.api.API {{(pid=75401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 18:51:54 devstack cinder-volume[75401]: DEBUG oslo_service.backend._eventlet.service [None req-257b8688-1ced-4d58-89fa-f3dd3ebaf968 None None] transport_url = **** {{(pid=75401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 18:51:54 devstack cinder-volume[75401]: DEBUG oslo_service.backend._eventlet.service [None req-257b8688-1ced-4d58-89fa-f3dd3ebaf968 None None] until_refresh = 0 {{(pid=75401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 18:51:54 devstack cinder-volume[75401]: DEBUG oslo_service.backend._eventlet.service [None req-257b8688-1ced-4d58-89fa-f3dd3ebaf968 None None] use_chap_auth = False {{(pid=75401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 18:51:54 devstack cinder-volume[75401]: DEBUG oslo_service.backend._eventlet.service [None req-257b8688-1ced-4d58-89fa-f3dd3ebaf968 None None] use_default_quota_class = True {{(pid=75401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 18:51:54 devstack cinder-volume[75577]: DEBUG oslo_concurrency.processutils [None req-108ed54b-9ee2-483e-ae17-f87d899e7dce None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.027s {{(pid=75577) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 18:51:54 devstack cinder-volume[75401]: DEBUG oslo_service.backend._eventlet.service [None req-257b8688-1ced-4d58-89fa-f3dd3ebaf968 None None] use_journal = False {{(pid=75401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 18:51:54 devstack cinder-volume[75401]: DEBUG oslo_service.backend._eventlet.service [None req-257b8688-1ced-4d58-89fa-f3dd3ebaf968 None None] use_json = False {{(pid=75401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 18:51:54 devstack cinder-volume[75401]: DEBUG oslo_service.backend._eventlet.service [None req-257b8688-1ced-4d58-89fa-f3dd3ebaf968 None None] use_multipath_for_image_xfer = False {{(pid=75401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 18:51:54 devstack cinder-volume[75401]: DEBUG oslo_service.backend._eventlet.service [None req-257b8688-1ced-4d58-89fa-f3dd3ebaf968 None None] use_stderr = False {{(pid=75401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 18:51:54 devstack cinder-volume[75401]: DEBUG oslo_service.backend._eventlet.service [None req-257b8688-1ced-4d58-89fa-f3dd3ebaf968 None None] use_syslog = False {{(pid=75401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 18:51:54 devstack cinder-volume[75401]: DEBUG oslo_service.backend._eventlet.service [None req-257b8688-1ced-4d58-89fa-f3dd3ebaf968 None None] verify_glance_signatures = enabled {{(pid=75401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 18:51:54 devstack cinder-volume[75577]: DEBUG oslo_concurrency.processutils [None req-108ed54b-9ee2-483e-ae17-f87d899e7dce None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=75577) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 18:51:54 devstack cinder-volume[75401]: DEBUG oslo_service.backend._eventlet.service [None req-257b8688-1ced-4d58-89fa-f3dd3ebaf968 None None] vmdk_allowed_types = ['streamOptimized', 'monolithicSparse'] {{(pid=75401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 18:51:54 devstack cinder-volume[75401]: DEBUG oslo_service.backend._eventlet.service [None req-257b8688-1ced-4d58-89fa-f3dd3ebaf968 None None] volume_api_class = cinder.volume.api.API {{(pid=75401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 18:51:54 devstack cinder-volume[75401]: DEBUG oslo_service.backend._eventlet.service [None req-257b8688-1ced-4d58-89fa-f3dd3ebaf968 None None] volume_backend_name = None {{(pid=75401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 18:51:54 devstack cinder-volume[75401]: DEBUG oslo_service.backend._eventlet.service [None req-257b8688-1ced-4d58-89fa-f3dd3ebaf968 None None] volume_clear = zero {{(pid=75401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 18:51:54 devstack cinder-volume[75401]: DEBUG oslo_service.backend._eventlet.service [None req-257b8688-1ced-4d58-89fa-f3dd3ebaf968 None None] volume_clear_ionice = None {{(pid=75401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 18:51:54 devstack cinder-volume[75401]: DEBUG oslo_service.backend._eventlet.service [None req-257b8688-1ced-4d58-89fa-f3dd3ebaf968 None None] volume_clear_size = 0 {{(pid=75401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 18:51:54 devstack cinder-volume[75401]: DEBUG oslo_service.backend._eventlet.service [None req-257b8688-1ced-4d58-89fa-f3dd3ebaf968 None None] volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=75401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 18:51:54 devstack cinder-volume[75401]: DEBUG oslo_service.backend._eventlet.service [None req-257b8688-1ced-4d58-89fa-f3dd3ebaf968 None None] volume_copy_bps_limit = 0 {{(pid=75401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 18:51:54 devstack cinder-volume[75401]: DEBUG oslo_service.backend._eventlet.service [None req-257b8688-1ced-4d58-89fa-f3dd3ebaf968 None None] volume_dd_blocksize = 1M {{(pid=75401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 18:51:54 devstack cinder-volume[75401]: DEBUG oslo_service.backend._eventlet.service [None req-257b8688-1ced-4d58-89fa-f3dd3ebaf968 None None] volume_manager = cinder.volume.manager.VolumeManager {{(pid=75401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 18:51:54 devstack cinder-volume[75401]: DEBUG oslo_service.backend._eventlet.service [None req-257b8688-1ced-4d58-89fa-f3dd3ebaf968 None None] volume_name_template = volume-%s {{(pid=75401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 18:51:54 devstack cinder-volume[75401]: DEBUG oslo_service.backend._eventlet.service [None req-257b8688-1ced-4d58-89fa-f3dd3ebaf968 None None] volume_service_inithost_offload = False {{(pid=75401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 18:51:54 devstack cinder-volume[75401]: DEBUG oslo_service.backend._eventlet.service [None req-257b8688-1ced-4d58-89fa-f3dd3ebaf968 None None] volume_usage_audit_period = month {{(pid=75401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 18:51:54 devstack cinder-volume[75401]: DEBUG oslo_service.backend._eventlet.service [None req-257b8688-1ced-4d58-89fa-f3dd3ebaf968 None None] volumes_dir = /opt/stack/data/cinder/volumes {{(pid=75401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 18:51:54 devstack cinder-volume[75401]: DEBUG oslo_service.backend._eventlet.service [None req-257b8688-1ced-4d58-89fa-f3dd3ebaf968 None None] zoning_mode = None {{(pid=75401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 18:51:54 devstack cinder-volume[75401]: DEBUG oslo_service.backend._eventlet.service [None req-257b8688-1ced-4d58-89fa-f3dd3ebaf968 None None] os_brick.lightos_discovery_client_address = localhost {{(pid=75401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 18:51:54 devstack cinder-volume[75401]: DEBUG oslo_service.backend._eventlet.service [None req-257b8688-1ced-4d58-89fa-f3dd3ebaf968 None None] os_brick.lightos_discovery_client_dir_path = /etc/discovery-client/discovery.d/ {{(pid=75401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 18:51:54 devstack cinder-volume[75401]: DEBUG oslo_service.backend._eventlet.service [None req-257b8688-1ced-4d58-89fa-f3dd3ebaf968 None None] os_brick.lightos_discovery_client_port = 6060 {{(pid=75401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 18:51:54 devstack cinder-volume[75401]: DEBUG oslo_service.backend._eventlet.service [None req-257b8688-1ced-4d58-89fa-f3dd3ebaf968 None None] os_brick.lock_path = /opt/stack/data/os_brick {{(pid=75401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 18:51:54 devstack cinder-volume[75401]: DEBUG oslo_service.backend._eventlet.service [None req-257b8688-1ced-4d58-89fa-f3dd3ebaf968 None None] os_brick.wait_mpath_device_attempts = 4 {{(pid=75401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 18:51:54 devstack cinder-volume[75401]: DEBUG oslo_service.backend._eventlet.service [None req-257b8688-1ced-4d58-89fa-f3dd3ebaf968 None None] os_brick.wait_mpath_device_interval = 1 {{(pid=75401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 18:51:54 devstack cinder-volume[75401]: DEBUG oslo_service.backend._eventlet.service [None req-257b8688-1ced-4d58-89fa-f3dd3ebaf968 None None] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=75401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 18:51:54 devstack cinder-volume[75401]: DEBUG oslo_service.backend._eventlet.service [None req-257b8688-1ced-4d58-89fa-f3dd3ebaf968 None None] oslo_concurrency.disable_process_locking = False {{(pid=75401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 18:51:54 devstack cinder-volume[75401]: DEBUG oslo_service.backend._eventlet.service [None req-257b8688-1ced-4d58-89fa-f3dd3ebaf968 None None] oslo_concurrency.lock_path = /opt/stack/data/cinder {{(pid=75401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 18:51:54 devstack cinder-volume[75401]: DEBUG oslo_service.backend._eventlet.service [None req-257b8688-1ced-4d58-89fa-f3dd3ebaf968 None None] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=75401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 18:51:54 devstack cinder-volume[75401]: DEBUG oslo_service.backend._eventlet.service [None req-257b8688-1ced-4d58-89fa-f3dd3ebaf968 None None] keystone_authtoken.admin_password = **** {{(pid=75401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 18:51:54 devstack cinder-volume[75401]: DEBUG oslo_service.backend._eventlet.service [None req-257b8688-1ced-4d58-89fa-f3dd3ebaf968 None None] keystone_authtoken.admin_tenant_name = admin {{(pid=75401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 18:51:54 devstack cinder-volume[75401]: DEBUG oslo_service.backend._eventlet.service [None req-257b8688-1ced-4d58-89fa-f3dd3ebaf968 None None] keystone_authtoken.admin_token = **** {{(pid=75401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 18:51:54 devstack cinder-volume[75401]: DEBUG oslo_service.backend._eventlet.service [None req-257b8688-1ced-4d58-89fa-f3dd3ebaf968 None None] keystone_authtoken.admin_user = None {{(pid=75401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 18:51:54 devstack cinder-volume[75401]: DEBUG oslo_service.backend._eventlet.service [None req-257b8688-1ced-4d58-89fa-f3dd3ebaf968 None None] keystone_authtoken.auth_admin_prefix = {{(pid=75401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 18:51:54 devstack cinder-volume[75401]: DEBUG oslo_service.backend._eventlet.service [None req-257b8688-1ced-4d58-89fa-f3dd3ebaf968 None None] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=75401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 18:51:54 devstack cinder-volume[75401]: DEBUG oslo_service.backend._eventlet.service [None req-257b8688-1ced-4d58-89fa-f3dd3ebaf968 None None] keystone_authtoken.auth_port = 35357 {{(pid=75401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 18:51:54 devstack cinder-volume[75401]: DEBUG oslo_service.backend._eventlet.service [None req-257b8688-1ced-4d58-89fa-f3dd3ebaf968 None None] keystone_authtoken.auth_protocol = https {{(pid=75401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 18:51:54 devstack cinder-volume[75401]: DEBUG oslo_service.backend._eventlet.service [None req-257b8688-1ced-4d58-89fa-f3dd3ebaf968 None None] keystone_authtoken.auth_section = None {{(pid=75401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 18:51:54 devstack cinder-volume[75401]: DEBUG oslo_service.backend._eventlet.service [None req-257b8688-1ced-4d58-89fa-f3dd3ebaf968 None None] keystone_authtoken.auth_type = password {{(pid=75401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 18:51:54 devstack cinder-volume[75401]: DEBUG oslo_service.backend._eventlet.service [None req-257b8688-1ced-4d58-89fa-f3dd3ebaf968 None None] keystone_authtoken.auth_uri = None {{(pid=75401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 18:51:54 devstack cinder-volume[75401]: DEBUG oslo_service.backend._eventlet.service [None req-257b8688-1ced-4d58-89fa-f3dd3ebaf968 None None] keystone_authtoken.auth_version = None {{(pid=75401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 18:51:54 devstack cinder-volume[75401]: DEBUG oslo_service.backend._eventlet.service [None req-257b8688-1ced-4d58-89fa-f3dd3ebaf968 None None] keystone_authtoken.cache = None {{(pid=75401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 18:51:54 devstack cinder-volume[75401]: DEBUG oslo_service.backend._eventlet.service [None req-257b8688-1ced-4d58-89fa-f3dd3ebaf968 None None] keystone_authtoken.cafile = /opt/stack/data/ca-bundle.pem {{(pid=75401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 18:51:54 devstack cinder-volume[75401]: DEBUG oslo_service.backend._eventlet.service [None req-257b8688-1ced-4d58-89fa-f3dd3ebaf968 None None] keystone_authtoken.certfile = None {{(pid=75401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 18:51:54 devstack cinder-volume[75401]: DEBUG oslo_service.backend._eventlet.service [None req-257b8688-1ced-4d58-89fa-f3dd3ebaf968 None None] keystone_authtoken.delay_auth_decision = False {{(pid=75401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 18:51:54 devstack cinder-volume[75401]: DEBUG oslo_service.backend._eventlet.service [None req-257b8688-1ced-4d58-89fa-f3dd3ebaf968 None None] keystone_authtoken.enforce_token_bind = permissive {{(pid=75401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 18:51:54 devstack cinder-volume[75401]: DEBUG oslo_service.backend._eventlet.service [None req-257b8688-1ced-4d58-89fa-f3dd3ebaf968 None None] keystone_authtoken.http_connect_timeout = None {{(pid=75401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 18:51:54 devstack cinder-volume[75401]: DEBUG oslo_service.backend._eventlet.service [None req-257b8688-1ced-4d58-89fa-f3dd3ebaf968 None None] keystone_authtoken.http_request_max_retries = 3 {{(pid=75401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 18:51:54 devstack cinder-volume[75401]: DEBUG oslo_service.backend._eventlet.service [None req-257b8688-1ced-4d58-89fa-f3dd3ebaf968 None None] keystone_authtoken.identity_uri = None {{(pid=75401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 18:51:54 devstack cinder-volume[75401]: DEBUG oslo_service.backend._eventlet.service [None req-257b8688-1ced-4d58-89fa-f3dd3ebaf968 None None] keystone_authtoken.include_service_catalog = True {{(pid=75401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 18:51:54 devstack sudo[75581]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings -o name stack-volumes-lvmdriver-1 Apr 29 18:51:54 devstack cinder-volume[75577]: DEBUG oslo_concurrency.processutils [None req-108ed54b-9ee2-483e-ae17-f87d899e7dce None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.033s {{(pid=75577) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 18:51:54 devstack cinder-volume[75577]: DEBUG oslo_concurrency.processutils [None req-108ed54b-9ee2-483e-ae17-f87d899e7dce None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=75577) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 18:51:54 devstack sudo[75581]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 18:51:54 devstack cinder-volume[75401]: DEBUG oslo_service.backend._eventlet.service [None req-257b8688-1ced-4d58-89fa-f3dd3ebaf968 None None] keystone_authtoken.insecure = False {{(pid=75401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 18:51:54 devstack cinder-volume[75401]: DEBUG oslo_service.backend._eventlet.service [None req-257b8688-1ced-4d58-89fa-f3dd3ebaf968 None None] keystone_authtoken.interface = public {{(pid=75401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 18:51:54 devstack cinder-volume[75401]: DEBUG oslo_service.backend._eventlet.service [None req-257b8688-1ced-4d58-89fa-f3dd3ebaf968 None None] keystone_authtoken.keyfile = None {{(pid=75401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 18:51:54 devstack cinder-volume[75401]: DEBUG oslo_service.backend._eventlet.service [None req-257b8688-1ced-4d58-89fa-f3dd3ebaf968 None None] keystone_authtoken.memcache_password = {{(pid=75401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 18:51:54 devstack cinder-volume[75401]: DEBUG oslo_service.backend._eventlet.service [None req-257b8688-1ced-4d58-89fa-f3dd3ebaf968 None None] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=75401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 18:51:54 devstack cinder-volume[75401]: DEBUG oslo_service.backend._eventlet.service [None req-257b8688-1ced-4d58-89fa-f3dd3ebaf968 None None] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=75401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 18:51:54 devstack cinder-volume[75401]: DEBUG oslo_service.backend._eventlet.service [None req-257b8688-1ced-4d58-89fa-f3dd3ebaf968 None None] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=75401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 18:51:54 devstack cinder-volume[75401]: DEBUG oslo_service.backend._eventlet.service [None req-257b8688-1ced-4d58-89fa-f3dd3ebaf968 None None] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=75401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 18:51:54 devstack cinder-volume[75401]: DEBUG oslo_service.backend._eventlet.service [None req-257b8688-1ced-4d58-89fa-f3dd3ebaf968 None None] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=75401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 18:51:54 devstack cinder-volume[75401]: DEBUG oslo_service.backend._eventlet.service [None req-257b8688-1ced-4d58-89fa-f3dd3ebaf968 None None] keystone_authtoken.memcache_sasl_enabled = False {{(pid=75401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 18:51:54 devstack cinder-volume[75401]: DEBUG oslo_service.backend._eventlet.service [None req-257b8688-1ced-4d58-89fa-f3dd3ebaf968 None None] keystone_authtoken.memcache_secret_key = **** {{(pid=75401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 18:51:54 devstack cinder-volume[75401]: DEBUG oslo_service.backend._eventlet.service [None req-257b8688-1ced-4d58-89fa-f3dd3ebaf968 None None] keystone_authtoken.memcache_security_strategy = None {{(pid=75401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 18:51:54 devstack cinder-volume[75401]: DEBUG oslo_service.backend._eventlet.service [None req-257b8688-1ced-4d58-89fa-f3dd3ebaf968 None None] keystone_authtoken.memcache_tls_allowed_ciphers = None {{(pid=75401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 18:51:54 devstack cinder-volume[75401]: DEBUG oslo_service.backend._eventlet.service [None req-257b8688-1ced-4d58-89fa-f3dd3ebaf968 None None] keystone_authtoken.memcache_tls_cafile = None {{(pid=75401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 18:51:54 devstack cinder-volume[75401]: DEBUG oslo_service.backend._eventlet.service [None req-257b8688-1ced-4d58-89fa-f3dd3ebaf968 None None] keystone_authtoken.memcache_tls_certfile = None {{(pid=75401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 18:51:54 devstack cinder-volume[75401]: DEBUG oslo_service.backend._eventlet.service [None req-257b8688-1ced-4d58-89fa-f3dd3ebaf968 None None] keystone_authtoken.memcache_tls_enabled = False {{(pid=75401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 18:51:54 devstack cinder-volume[75401]: DEBUG oslo_service.backend._eventlet.service [None req-257b8688-1ced-4d58-89fa-f3dd3ebaf968 None None] keystone_authtoken.memcache_tls_keyfile = None {{(pid=75401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 18:51:54 devstack cinder-volume[75401]: DEBUG oslo_service.backend._eventlet.service [None req-257b8688-1ced-4d58-89fa-f3dd3ebaf968 None None] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=75401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 18:51:54 devstack cinder-volume[75577]: DEBUG oslo_concurrency.processutils [None req-108ed54b-9ee2-483e-ae17-f87d899e7dce None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.017s {{(pid=75577) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 18:51:54 devstack cinder-volume[75401]: DEBUG oslo_service.backend._eventlet.service [None req-257b8688-1ced-4d58-89fa-f3dd3ebaf968 None None] keystone_authtoken.memcache_username = {{(pid=75401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 18:51:54 devstack cinder-volume[75401]: DEBUG oslo_service.backend._eventlet.service [None req-257b8688-1ced-4d58-89fa-f3dd3ebaf968 None None] keystone_authtoken.memcached_servers = ['localhost:11211'] {{(pid=75401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 18:51:54 devstack cinder-volume[75577]: DEBUG oslo_concurrency.processutils [None req-108ed54b-9ee2-483e-ae17-f87d899e7dce None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings -o name stack-volumes-lvmdriver-1 {{(pid=75577) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 18:51:54 devstack cinder-volume[75401]: DEBUG oslo_service.backend._eventlet.service [None req-257b8688-1ced-4d58-89fa-f3dd3ebaf968 None None] keystone_authtoken.region_name = None {{(pid=75401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 18:51:54 devstack cinder-volume[75401]: DEBUG oslo_service.backend._eventlet.service [None req-257b8688-1ced-4d58-89fa-f3dd3ebaf968 None None] keystone_authtoken.service_token_roles = ['service'] {{(pid=75401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 18:51:54 devstack cinder-volume[75401]: DEBUG oslo_service.backend._eventlet.service [None req-257b8688-1ced-4d58-89fa-f3dd3ebaf968 None None] keystone_authtoken.service_token_roles_required = False {{(pid=75401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 18:51:54 devstack cinder-volume[75401]: DEBUG oslo_service.backend._eventlet.service [None req-257b8688-1ced-4d58-89fa-f3dd3ebaf968 None None] keystone_authtoken.service_type = None {{(pid=75401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 18:51:54 devstack cinder-volume[75401]: DEBUG oslo_service.backend._eventlet.service [None req-257b8688-1ced-4d58-89fa-f3dd3ebaf968 None None] keystone_authtoken.token_cache_time = 300 {{(pid=75401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 18:51:54 devstack cinder-volume[75401]: DEBUG oslo_service.backend._eventlet.service [None req-257b8688-1ced-4d58-89fa-f3dd3ebaf968 None None] keystone_authtoken.www_authenticate_uri = http://192.168.122.135/identity {{(pid=75401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 18:51:54 devstack cinder-volume[75401]: DEBUG oslo_service.backend._eventlet.service [None req-257b8688-1ced-4d58-89fa-f3dd3ebaf968 None None] cache.backend = dogpile.cache.null {{(pid=75401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 18:51:54 devstack cinder-volume[75401]: DEBUG oslo_service.backend._eventlet.service [None req-257b8688-1ced-4d58-89fa-f3dd3ebaf968 None None] cache.backend_argument = **** {{(pid=75401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 18:51:54 devstack cinder-volume[75401]: DEBUG oslo_service.backend._eventlet.service [None req-257b8688-1ced-4d58-89fa-f3dd3ebaf968 None None] cache.backend_expiration_time = None {{(pid=75401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 18:51:54 devstack cinder-volume[75401]: DEBUG oslo_service.backend._eventlet.service [None req-257b8688-1ced-4d58-89fa-f3dd3ebaf968 None None] cache.config_prefix = cache.oslo {{(pid=75401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 18:51:54 devstack cinder-volume[75401]: DEBUG oslo_service.backend._eventlet.service [None req-257b8688-1ced-4d58-89fa-f3dd3ebaf968 None None] cache.debug_cache_backend = False {{(pid=75401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 18:51:54 devstack cinder-volume[75401]: DEBUG oslo_service.backend._eventlet.service [None req-257b8688-1ced-4d58-89fa-f3dd3ebaf968 None None] cache.enable_retry_client = False {{(pid=75401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 18:51:54 devstack cinder-volume[75401]: DEBUG oslo_service.backend._eventlet.service [None req-257b8688-1ced-4d58-89fa-f3dd3ebaf968 None None] cache.enable_socket_keepalive = False {{(pid=75401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 18:51:54 devstack cinder-volume[75401]: DEBUG oslo_service.backend._eventlet.service [None req-257b8688-1ced-4d58-89fa-f3dd3ebaf968 None None] cache.enabled = False {{(pid=75401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 18:51:54 devstack cinder-volume[75401]: DEBUG oslo_service.backend._eventlet.service [None req-257b8688-1ced-4d58-89fa-f3dd3ebaf968 None None] cache.enforce_fips_mode = False {{(pid=75401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 18:51:54 devstack cinder-volume[75401]: DEBUG oslo_service.backend._eventlet.service [None req-257b8688-1ced-4d58-89fa-f3dd3ebaf968 None None] cache.expiration_time = 600 {{(pid=75401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 18:51:54 devstack cinder-volume[75401]: DEBUG oslo_service.backend._eventlet.service [None req-257b8688-1ced-4d58-89fa-f3dd3ebaf968 None None] cache.hashclient_dead_timeout = 60.0 {{(pid=75401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 18:51:54 devstack cinder-volume[75401]: DEBUG oslo_service.backend._eventlet.service [None req-257b8688-1ced-4d58-89fa-f3dd3ebaf968 None None] cache.hashclient_retry_attempts = 2 {{(pid=75401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 18:51:54 devstack cinder-volume[75401]: DEBUG oslo_service.backend._eventlet.service [None req-257b8688-1ced-4d58-89fa-f3dd3ebaf968 None None] cache.hashclient_retry_timeout = 1.0 {{(pid=75401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 18:51:54 devstack cinder-volume[75401]: DEBUG oslo_service.backend._eventlet.service [None req-257b8688-1ced-4d58-89fa-f3dd3ebaf968 None None] cache.memcache_dead_retry = 300 {{(pid=75401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 18:51:54 devstack cinder-volume[75401]: DEBUG oslo_service.backend._eventlet.service [None req-257b8688-1ced-4d58-89fa-f3dd3ebaf968 None None] cache.memcache_pool_connection_get_timeout = 10 {{(pid=75401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 18:51:54 devstack cinder-volume[75401]: DEBUG oslo_service.backend._eventlet.service [None req-257b8688-1ced-4d58-89fa-f3dd3ebaf968 None None] cache.memcache_pool_flush_on_reconnect = False {{(pid=75401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 18:51:54 devstack cinder-volume[75401]: DEBUG oslo_service.backend._eventlet.service [None req-257b8688-1ced-4d58-89fa-f3dd3ebaf968 None None] cache.memcache_pool_maxsize = 10 {{(pid=75401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 18:51:54 devstack cinder-volume[75401]: DEBUG oslo_service.backend._eventlet.service [None req-257b8688-1ced-4d58-89fa-f3dd3ebaf968 None None] cache.memcache_pool_unused_timeout = 60 {{(pid=75401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 18:51:54 devstack cinder-volume[75401]: DEBUG oslo_service.backend._eventlet.service [None req-257b8688-1ced-4d58-89fa-f3dd3ebaf968 None None] cache.memcache_sasl_enabled = False {{(pid=75401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 18:51:54 devstack cinder-volume[75401]: DEBUG oslo_service.backend._eventlet.service [None req-257b8688-1ced-4d58-89fa-f3dd3ebaf968 None None] cache.memcache_servers = ['localhost:11211'] {{(pid=75401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 18:51:54 devstack cinder-volume[75401]: DEBUG oslo_service.backend._eventlet.service [None req-257b8688-1ced-4d58-89fa-f3dd3ebaf968 None None] cache.password = **** {{(pid=75401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 18:51:54 devstack cinder-volume[75401]: DEBUG oslo_service.backend._eventlet.service [None req-257b8688-1ced-4d58-89fa-f3dd3ebaf968 None None] cache.proxies = [] {{(pid=75401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 18:51:54 devstack cinder-volume[75401]: DEBUG oslo_service.backend._eventlet.service [None req-257b8688-1ced-4d58-89fa-f3dd3ebaf968 None None] cache.redis_db = 0 {{(pid=75401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 18:51:54 devstack cinder-volume[75401]: DEBUG oslo_service.backend._eventlet.service [None req-257b8688-1ced-4d58-89fa-f3dd3ebaf968 None None] cache.redis_sentinel_service_name = mymaster {{(pid=75401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 18:51:54 devstack cinder-volume[75401]: DEBUG oslo_service.backend._eventlet.service [None req-257b8688-1ced-4d58-89fa-f3dd3ebaf968 None None] cache.redis_sentinels = ['localhost:26379'] {{(pid=75401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 18:51:54 devstack cinder-volume[75401]: DEBUG oslo_service.backend._eventlet.service [None req-257b8688-1ced-4d58-89fa-f3dd3ebaf968 None None] cache.redis_server = localhost:6379 {{(pid=75401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 18:51:54 devstack cinder-volume[75401]: DEBUG oslo_service.backend._eventlet.service [None req-257b8688-1ced-4d58-89fa-f3dd3ebaf968 None None] cache.retry_attempts = 2 {{(pid=75401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 18:51:54 devstack cinder-volume[75401]: DEBUG oslo_service.backend._eventlet.service [None req-257b8688-1ced-4d58-89fa-f3dd3ebaf968 None None] cache.retry_delay = 0.0 {{(pid=75401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 18:51:54 devstack cinder-volume[75401]: DEBUG oslo_service.backend._eventlet.service [None req-257b8688-1ced-4d58-89fa-f3dd3ebaf968 None None] cache.socket_keepalive_count = 1 {{(pid=75401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 18:51:54 devstack cinder-volume[75401]: DEBUG oslo_service.backend._eventlet.service [None req-257b8688-1ced-4d58-89fa-f3dd3ebaf968 None None] cache.socket_keepalive_idle = 1 {{(pid=75401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 18:51:54 devstack cinder-volume[75401]: DEBUG oslo_service.backend._eventlet.service [None req-257b8688-1ced-4d58-89fa-f3dd3ebaf968 None None] cache.socket_keepalive_interval = 1 {{(pid=75401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 18:51:54 devstack cinder-volume[75401]: DEBUG oslo_service.backend._eventlet.service [None req-257b8688-1ced-4d58-89fa-f3dd3ebaf968 None None] cache.socket_timeout = 1.0 {{(pid=75401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 18:51:54 devstack cinder-volume[75401]: DEBUG oslo_service.backend._eventlet.service [None req-257b8688-1ced-4d58-89fa-f3dd3ebaf968 None None] cache.tls_allowed_ciphers = None {{(pid=75401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 18:51:54 devstack cinder-volume[75401]: DEBUG oslo_service.backend._eventlet.service [None req-257b8688-1ced-4d58-89fa-f3dd3ebaf968 None None] cache.tls_cafile = None {{(pid=75401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 18:51:54 devstack cinder-volume[75401]: DEBUG oslo_service.backend._eventlet.service [None req-257b8688-1ced-4d58-89fa-f3dd3ebaf968 None None] cache.tls_certfile = None {{(pid=75401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 18:51:54 devstack cinder-volume[75401]: DEBUG oslo_service.backend._eventlet.service [None req-257b8688-1ced-4d58-89fa-f3dd3ebaf968 None None] cache.tls_enabled = False {{(pid=75401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 18:51:54 devstack cinder-volume[75401]: DEBUG oslo_service.backend._eventlet.service [None req-257b8688-1ced-4d58-89fa-f3dd3ebaf968 None None] cache.tls_keyfile = None {{(pid=75401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 18:51:54 devstack cinder-volume[75401]: DEBUG oslo_service.backend._eventlet.service [None req-257b8688-1ced-4d58-89fa-f3dd3ebaf968 None None] cache.username = None {{(pid=75401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 18:51:54 devstack cinder-volume[75401]: DEBUG oslo_service.backend._eventlet.service [None req-257b8688-1ced-4d58-89fa-f3dd3ebaf968 None None] coordination.backend_url = **** {{(pid=75401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 18:51:54 devstack cinder-volume[75401]: DEBUG oslo_service.backend._eventlet.service [None req-257b8688-1ced-4d58-89fa-f3dd3ebaf968 None None] database.asyncio_connection = **** {{(pid=75401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 18:51:54 devstack cinder-volume[75401]: DEBUG oslo_service.backend._eventlet.service [None req-257b8688-1ced-4d58-89fa-f3dd3ebaf968 None None] database.asyncio_slave_connection = **** {{(pid=75401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 18:51:54 devstack cinder-volume[75401]: DEBUG oslo_service.backend._eventlet.service [None req-257b8688-1ced-4d58-89fa-f3dd3ebaf968 None None] database.backend = sqlalchemy {{(pid=75401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 18:51:54 devstack cinder-volume[75401]: DEBUG oslo_service.backend._eventlet.service [None req-257b8688-1ced-4d58-89fa-f3dd3ebaf968 None None] database.connection = **** {{(pid=75401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 18:51:54 devstack cinder-volume[75401]: DEBUG oslo_service.backend._eventlet.service [None req-257b8688-1ced-4d58-89fa-f3dd3ebaf968 None None] database.connection_debug = 0 {{(pid=75401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 18:51:54 devstack cinder-volume[75401]: DEBUG oslo_service.backend._eventlet.service [None req-257b8688-1ced-4d58-89fa-f3dd3ebaf968 None None] database.connection_parameters = {{(pid=75401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 18:51:54 devstack cinder-volume[75401]: DEBUG oslo_service.backend._eventlet.service [None req-257b8688-1ced-4d58-89fa-f3dd3ebaf968 None None] database.connection_recycle_time = 3600 {{(pid=75401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 18:51:54 devstack cinder-volume[75401]: DEBUG oslo_service.backend._eventlet.service [None req-257b8688-1ced-4d58-89fa-f3dd3ebaf968 None None] database.connection_trace = False {{(pid=75401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 18:51:54 devstack cinder-volume[75401]: DEBUG oslo_service.backend._eventlet.service [None req-257b8688-1ced-4d58-89fa-f3dd3ebaf968 None None] database.db_inc_retry_interval = True {{(pid=75401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 18:51:54 devstack cinder-volume[75401]: DEBUG oslo_service.backend._eventlet.service [None req-257b8688-1ced-4d58-89fa-f3dd3ebaf968 None None] database.db_max_retries = 20 {{(pid=75401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 18:51:54 devstack cinder-volume[75401]: DEBUG oslo_service.backend._eventlet.service [None req-257b8688-1ced-4d58-89fa-f3dd3ebaf968 None None] database.db_max_retry_interval = 10 {{(pid=75401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 18:51:54 devstack cinder-volume[75401]: DEBUG oslo_service.backend._eventlet.service [None req-257b8688-1ced-4d58-89fa-f3dd3ebaf968 None None] database.db_retry_interval = 1 {{(pid=75401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 18:51:54 devstack cinder-volume[75401]: DEBUG oslo_service.backend._eventlet.service [None req-257b8688-1ced-4d58-89fa-f3dd3ebaf968 None None] database.max_overflow = 50 {{(pid=75401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 18:51:54 devstack cinder-volume[75401]: DEBUG oslo_service.backend._eventlet.service [None req-257b8688-1ced-4d58-89fa-f3dd3ebaf968 None None] database.max_pool_size = 5 {{(pid=75401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 18:51:54 devstack cinder-volume[75401]: DEBUG oslo_service.backend._eventlet.service [None req-257b8688-1ced-4d58-89fa-f3dd3ebaf968 None None] database.max_retries = 10 {{(pid=75401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 18:51:54 devstack cinder-volume[75401]: DEBUG oslo_service.backend._eventlet.service [None req-257b8688-1ced-4d58-89fa-f3dd3ebaf968 None None] database.mysql_sql_mode = TRADITIONAL {{(pid=75401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 18:51:54 devstack cinder-volume[75401]: DEBUG oslo_service.backend._eventlet.service [None req-257b8688-1ced-4d58-89fa-f3dd3ebaf968 None None] database.mysql_wsrep_sync_wait = None {{(pid=75401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 18:51:54 devstack cinder-volume[75401]: DEBUG oslo_service.backend._eventlet.service [None req-257b8688-1ced-4d58-89fa-f3dd3ebaf968 None None] database.pool_timeout = None {{(pid=75401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 18:51:54 devstack cinder-volume[75401]: DEBUG oslo_service.backend._eventlet.service [None req-257b8688-1ced-4d58-89fa-f3dd3ebaf968 None None] database.retry_interval = 10 {{(pid=75401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 18:51:54 devstack cinder-volume[75401]: DEBUG oslo_service.backend._eventlet.service [None req-257b8688-1ced-4d58-89fa-f3dd3ebaf968 None None] database.slave_connection = **** {{(pid=75401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 18:51:54 devstack cinder-volume[75401]: DEBUG oslo_service.backend._eventlet.service [None req-257b8688-1ced-4d58-89fa-f3dd3ebaf968 None None] database.sqlite_synchronous = True {{(pid=75401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 18:51:54 devstack cinder-volume[75401]: DEBUG oslo_service.backend._eventlet.service [None req-257b8688-1ced-4d58-89fa-f3dd3ebaf968 None None] database.synchronous_reader = True {{(pid=75401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 18:51:54 devstack cinder-volume[75401]: DEBUG oslo_service.backend._eventlet.service [None req-257b8688-1ced-4d58-89fa-f3dd3ebaf968 None None] database.use_db_reconnect = False {{(pid=75401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 18:51:54 devstack cinder-volume[75401]: DEBUG oslo_service.backend._eventlet.service [None req-257b8688-1ced-4d58-89fa-f3dd3ebaf968 None None] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=75401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 18:51:54 devstack cinder-volume[75401]: DEBUG oslo_service.backend._eventlet.service [None req-257b8688-1ced-4d58-89fa-f3dd3ebaf968 None None] oslo_messaging_metrics.metrics_enabled = False {{(pid=75401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 18:51:54 devstack cinder-volume[75401]: DEBUG oslo_service.backend._eventlet.service [None req-257b8688-1ced-4d58-89fa-f3dd3ebaf968 None None] oslo_messaging_metrics.metrics_process_name = {{(pid=75401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 18:51:54 devstack cinder-volume[75401]: DEBUG oslo_service.backend._eventlet.service [None req-257b8688-1ced-4d58-89fa-f3dd3ebaf968 None None] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=75401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 18:51:54 devstack cinder-volume[75401]: DEBUG oslo_service.backend._eventlet.service [None req-257b8688-1ced-4d58-89fa-f3dd3ebaf968 None None] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=75401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 18:51:54 devstack cinder-volume[75401]: DEBUG oslo_service.backend._eventlet.service [None req-257b8688-1ced-4d58-89fa-f3dd3ebaf968 None None] profiler.connection_string = messaging:// {{(pid=75401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 18:51:54 devstack cinder-volume[75401]: DEBUG oslo_service.backend._eventlet.service [None req-257b8688-1ced-4d58-89fa-f3dd3ebaf968 None None] profiler.enabled = False {{(pid=75401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 18:51:54 devstack cinder-volume[75401]: DEBUG oslo_service.backend._eventlet.service [None req-257b8688-1ced-4d58-89fa-f3dd3ebaf968 None None] profiler.es_doc_type = notification {{(pid=75401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 18:51:54 devstack cinder-volume[75401]: DEBUG oslo_service.backend._eventlet.service [None req-257b8688-1ced-4d58-89fa-f3dd3ebaf968 None None] profiler.es_scroll_size = 10000 {{(pid=75401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 18:51:54 devstack cinder-volume[75401]: DEBUG oslo_service.backend._eventlet.service [None req-257b8688-1ced-4d58-89fa-f3dd3ebaf968 None None] profiler.es_scroll_time = 2m {{(pid=75401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 18:51:54 devstack cinder-volume[75401]: DEBUG oslo_service.backend._eventlet.service [None req-257b8688-1ced-4d58-89fa-f3dd3ebaf968 None None] profiler.filter_error_trace = False {{(pid=75401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 18:51:54 devstack cinder-volume[75401]: DEBUG oslo_service.backend._eventlet.service [None req-257b8688-1ced-4d58-89fa-f3dd3ebaf968 None None] profiler.hmac_keys = **** {{(pid=75401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 18:51:54 devstack cinder-volume[75401]: DEBUG oslo_service.backend._eventlet.service [None req-257b8688-1ced-4d58-89fa-f3dd3ebaf968 None None] profiler.sentinel_service_name = mymaster {{(pid=75401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 18:51:54 devstack cinder-volume[75401]: DEBUG oslo_service.backend._eventlet.service [None req-257b8688-1ced-4d58-89fa-f3dd3ebaf968 None None] profiler.socket_timeout = 0.1 {{(pid=75401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 18:51:54 devstack cinder-volume[75401]: DEBUG oslo_service.backend._eventlet.service [None req-257b8688-1ced-4d58-89fa-f3dd3ebaf968 None None] profiler.trace_requests = False {{(pid=75401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 18:51:54 devstack cinder-volume[75401]: DEBUG oslo_service.backend._eventlet.service [None req-257b8688-1ced-4d58-89fa-f3dd3ebaf968 None None] profiler.trace_sqlalchemy = False {{(pid=75401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 18:51:54 devstack cinder-volume[75401]: DEBUG oslo_service.backend._eventlet.service [None req-257b8688-1ced-4d58-89fa-f3dd3ebaf968 None None] profiler_jaeger.process_tags = {} {{(pid=75401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 18:51:54 devstack cinder-volume[75401]: DEBUG oslo_service.backend._eventlet.service [None req-257b8688-1ced-4d58-89fa-f3dd3ebaf968 None None] profiler_jaeger.service_name_prefix = None {{(pid=75401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 18:51:54 devstack cinder-volume[75401]: DEBUG oslo_service.backend._eventlet.service [None req-257b8688-1ced-4d58-89fa-f3dd3ebaf968 None None] profiler_otlp.service_name_prefix = None {{(pid=75401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 18:51:54 devstack cinder-volume[75401]: DEBUG oslo_service.backend._eventlet.service [None req-257b8688-1ced-4d58-89fa-f3dd3ebaf968 None None] oslo_policy.enforce_new_defaults = False {{(pid=75401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 18:51:54 devstack cinder-volume[75401]: WARNING oslo_config.cfg [None req-257b8688-1ced-4d58-89fa-f3dd3ebaf968 None None] Deprecated: Option "enforce_scope" from group "oslo_policy" is deprecated for removal (This configuration was added temporarily to facilitate a smooth transition to the new RBAC. OpenStack will always enforce scope checks. This configuration option is deprecated and will be removed in the 2025.2 cycle.). Its value may be silently ignored in the future. Apr 29 18:51:54 devstack cinder-volume[75401]: DEBUG oslo_service.backend._eventlet.service [None req-257b8688-1ced-4d58-89fa-f3dd3ebaf968 None None] oslo_policy.enforce_scope = False {{(pid=75401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 18:51:54 devstack cinder-volume[75401]: DEBUG oslo_service.backend._eventlet.service [None req-257b8688-1ced-4d58-89fa-f3dd3ebaf968 None None] oslo_policy.policy_default_rule = default {{(pid=75401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 18:51:54 devstack cinder-volume[75401]: DEBUG oslo_service.backend._eventlet.service [None req-257b8688-1ced-4d58-89fa-f3dd3ebaf968 None None] oslo_policy.policy_dirs = ['policy.d'] {{(pid=75401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 18:51:54 devstack cinder-volume[75401]: DEBUG oslo_service.backend._eventlet.service [None req-257b8688-1ced-4d58-89fa-f3dd3ebaf968 None None] oslo_policy.policy_file = policy.yaml {{(pid=75401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 18:51:54 devstack cinder-volume[75401]: DEBUG oslo_service.backend._eventlet.service [None req-257b8688-1ced-4d58-89fa-f3dd3ebaf968 None None] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=75401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 18:51:54 devstack cinder-volume[75401]: DEBUG oslo_service.backend._eventlet.service [None req-257b8688-1ced-4d58-89fa-f3dd3ebaf968 None None] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=75401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 18:51:54 devstack cinder-volume[75401]: DEBUG oslo_service.backend._eventlet.service [None req-257b8688-1ced-4d58-89fa-f3dd3ebaf968 None None] oslo_policy.remote_ssl_client_crt_file = None {{(pid=75401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 18:51:54 devstack cinder-volume[75401]: DEBUG oslo_service.backend._eventlet.service [None req-257b8688-1ced-4d58-89fa-f3dd3ebaf968 None None] oslo_policy.remote_ssl_client_key_file = None {{(pid=75401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 18:51:54 devstack cinder-volume[75401]: DEBUG oslo_service.backend._eventlet.service [None req-257b8688-1ced-4d58-89fa-f3dd3ebaf968 None None] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=75401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 18:51:54 devstack cinder-volume[75401]: DEBUG oslo_service.backend._eventlet.service [None req-257b8688-1ced-4d58-89fa-f3dd3ebaf968 None None] oslo_policy.remote_timeout = 60.0 {{(pid=75401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 18:51:54 devstack cinder-volume[75401]: DEBUG oslo_service.backend._eventlet.service [None req-257b8688-1ced-4d58-89fa-f3dd3ebaf968 None None] privsep_osbrick.capabilities = [21, 2] {{(pid=75401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 18:51:54 devstack cinder-volume[75401]: DEBUG oslo_service.backend._eventlet.service [None req-257b8688-1ced-4d58-89fa-f3dd3ebaf968 None None] privsep_osbrick.group = None {{(pid=75401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 18:51:54 devstack cinder-volume[75401]: DEBUG oslo_service.backend._eventlet.service [None req-257b8688-1ced-4d58-89fa-f3dd3ebaf968 None None] privsep_osbrick.helper_command = None {{(pid=75401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 18:51:54 devstack cinder-volume[75401]: DEBUG oslo_service.backend._eventlet.service [None req-257b8688-1ced-4d58-89fa-f3dd3ebaf968 None None] privsep_osbrick.log_daemon_traceback = False {{(pid=75401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 18:51:54 devstack cinder-volume[75401]: DEBUG oslo_service.backend._eventlet.service [None req-257b8688-1ced-4d58-89fa-f3dd3ebaf968 None None] privsep_osbrick.logger_name = brick_privsep_hide_output {{(pid=75401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 18:51:54 devstack cinder-volume[75401]: DEBUG oslo_service.backend._eventlet.service [None req-257b8688-1ced-4d58-89fa-f3dd3ebaf968 None None] privsep_osbrick.thread_pool_size = 4 {{(pid=75401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 18:51:54 devstack cinder-volume[75401]: DEBUG oslo_service.backend._eventlet.service [None req-257b8688-1ced-4d58-89fa-f3dd3ebaf968 None None] privsep_osbrick.user = None {{(pid=75401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 18:51:54 devstack cinder-volume[75401]: DEBUG oslo_service.backend._eventlet.service [None req-257b8688-1ced-4d58-89fa-f3dd3ebaf968 None None] cinder_sys_admin.capabilities = [0, 1, 2, 3, 12, 21] {{(pid=75401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 18:51:54 devstack cinder-volume[75401]: DEBUG oslo_service.backend._eventlet.service [None req-257b8688-1ced-4d58-89fa-f3dd3ebaf968 None None] cinder_sys_admin.group = None {{(pid=75401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 18:51:54 devstack cinder-volume[75401]: DEBUG oslo_service.backend._eventlet.service [None req-257b8688-1ced-4d58-89fa-f3dd3ebaf968 None None] cinder_sys_admin.helper_command = None {{(pid=75401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 18:51:54 devstack cinder-volume[75401]: DEBUG oslo_service.backend._eventlet.service [None req-257b8688-1ced-4d58-89fa-f3dd3ebaf968 None None] cinder_sys_admin.log_daemon_traceback = False {{(pid=75401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 18:51:54 devstack cinder-volume[75401]: DEBUG oslo_service.backend._eventlet.service [None req-257b8688-1ced-4d58-89fa-f3dd3ebaf968 None None] cinder_sys_admin.logger_name = oslo_privsep.daemon {{(pid=75401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 18:51:54 devstack cinder-volume[75401]: DEBUG oslo_service.backend._eventlet.service [None req-257b8688-1ced-4d58-89fa-f3dd3ebaf968 None None] cinder_sys_admin.thread_pool_size = 4 {{(pid=75401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 18:51:54 devstack cinder-volume[75401]: DEBUG oslo_service.backend._eventlet.service [None req-257b8688-1ced-4d58-89fa-f3dd3ebaf968 None None] cinder_sys_admin.user = None {{(pid=75401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 18:51:54 devstack cinder-volume[75401]: DEBUG oslo_service.backend._eventlet.service [None req-257b8688-1ced-4d58-89fa-f3dd3ebaf968 None None] service_user.auth_section = None {{(pid=75401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 18:51:54 devstack cinder-volume[75401]: DEBUG oslo_service.backend._eventlet.service [None req-257b8688-1ced-4d58-89fa-f3dd3ebaf968 None None] service_user.auth_type = password {{(pid=75401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 18:51:54 devstack cinder-volume[75401]: DEBUG oslo_service.backend._eventlet.service [None req-257b8688-1ced-4d58-89fa-f3dd3ebaf968 None None] service_user.cafile = None {{(pid=75401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 18:51:54 devstack cinder-volume[75401]: DEBUG oslo_service.backend._eventlet.service [None req-257b8688-1ced-4d58-89fa-f3dd3ebaf968 None None] service_user.certfile = None {{(pid=75401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 18:51:54 devstack cinder-volume[75401]: DEBUG oslo_service.backend._eventlet.service [None req-257b8688-1ced-4d58-89fa-f3dd3ebaf968 None None] service_user.collect_timing = False {{(pid=75401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 18:51:54 devstack cinder-volume[75401]: DEBUG oslo_service.backend._eventlet.service [None req-257b8688-1ced-4d58-89fa-f3dd3ebaf968 None None] service_user.insecure = False {{(pid=75401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 18:51:54 devstack cinder-volume[75401]: DEBUG oslo_service.backend._eventlet.service [None req-257b8688-1ced-4d58-89fa-f3dd3ebaf968 None None] service_user.keyfile = None {{(pid=75401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 18:51:54 devstack cinder-volume[75401]: DEBUG oslo_service.backend._eventlet.service [None req-257b8688-1ced-4d58-89fa-f3dd3ebaf968 None None] service_user.send_service_user_token = True {{(pid=75401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 18:51:54 devstack cinder-volume[75401]: DEBUG oslo_service.backend._eventlet.service [None req-257b8688-1ced-4d58-89fa-f3dd3ebaf968 None None] service_user.split_loggers = False {{(pid=75401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 18:51:54 devstack cinder-volume[75401]: DEBUG oslo_service.backend._eventlet.service [None req-257b8688-1ced-4d58-89fa-f3dd3ebaf968 None None] service_user.timeout = None {{(pid=75401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 18:51:54 devstack cinder-volume[75401]: DEBUG oslo_service.backend._eventlet.service [None req-257b8688-1ced-4d58-89fa-f3dd3ebaf968 None None] glance.auth_section = None {{(pid=75401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 18:51:54 devstack cinder-volume[75401]: DEBUG oslo_service.backend._eventlet.service [None req-257b8688-1ced-4d58-89fa-f3dd3ebaf968 None None] glance.auth_type = password {{(pid=75401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 18:51:54 devstack cinder-volume[75401]: DEBUG oslo_service.backend._eventlet.service [None req-257b8688-1ced-4d58-89fa-f3dd3ebaf968 None None] glance.cafile = /opt/stack/data/ca-bundle.pem {{(pid=75401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 18:51:54 devstack cinder-volume[75401]: DEBUG oslo_service.backend._eventlet.service [None req-257b8688-1ced-4d58-89fa-f3dd3ebaf968 None None] glance.certfile = None {{(pid=75401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 18:51:54 devstack cinder-volume[75401]: DEBUG oslo_service.backend._eventlet.service [None req-257b8688-1ced-4d58-89fa-f3dd3ebaf968 None None] glance.collect_timing = False {{(pid=75401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 18:51:54 devstack cinder-volume[75401]: DEBUG oslo_service.backend._eventlet.service [None req-257b8688-1ced-4d58-89fa-f3dd3ebaf968 None None] glance.insecure = False {{(pid=75401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 18:51:54 devstack cinder-volume[75401]: DEBUG oslo_service.backend._eventlet.service [None req-257b8688-1ced-4d58-89fa-f3dd3ebaf968 None None] glance.keyfile = None {{(pid=75401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 18:51:54 devstack cinder-volume[75401]: DEBUG oslo_service.backend._eventlet.service [None req-257b8688-1ced-4d58-89fa-f3dd3ebaf968 None None] glance.region_name = None {{(pid=75401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 18:51:54 devstack cinder-volume[75401]: DEBUG oslo_service.backend._eventlet.service [None req-257b8688-1ced-4d58-89fa-f3dd3ebaf968 None None] glance.split_loggers = False {{(pid=75401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 18:51:54 devstack cinder-volume[75401]: DEBUG oslo_service.backend._eventlet.service [None req-257b8688-1ced-4d58-89fa-f3dd3ebaf968 None None] glance.timeout = None {{(pid=75401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 18:51:54 devstack cinder-volume[75401]: DEBUG oslo_service.backend._eventlet.service [None req-257b8688-1ced-4d58-89fa-f3dd3ebaf968 None None] backend_defaults.backend_availability_zone = None {{(pid=75401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 18:51:54 devstack cinder-volume[75401]: DEBUG oslo_service.backend._eventlet.service [None req-257b8688-1ced-4d58-89fa-f3dd3ebaf968 None None] backend_defaults.backend_native_threads_pool_size = 20 {{(pid=75401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 18:51:54 devstack cinder-volume[75401]: DEBUG oslo_service.backend._eventlet.service [None req-257b8688-1ced-4d58-89fa-f3dd3ebaf968 None None] backend_defaults.backup_use_temp_snapshot = False {{(pid=75401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 18:51:54 devstack cinder-volume[75401]: DEBUG oslo_service.backend._eventlet.service [None req-257b8688-1ced-4d58-89fa-f3dd3ebaf968 None None] backend_defaults.chap_password = **** {{(pid=75401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 18:51:54 devstack cinder-volume[75401]: DEBUG oslo_service.backend._eventlet.service [None req-257b8688-1ced-4d58-89fa-f3dd3ebaf968 None None] backend_defaults.chap_username = {{(pid=75401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 18:51:54 devstack cinder-volume[75401]: DEBUG oslo_service.backend._eventlet.service [None req-257b8688-1ced-4d58-89fa-f3dd3ebaf968 None None] backend_defaults.chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=75401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 18:51:54 devstack cinder-volume[75401]: DEBUG oslo_service.backend._eventlet.service [None req-257b8688-1ced-4d58-89fa-f3dd3ebaf968 None None] backend_defaults.disk_geometry = None {{(pid=75401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 18:51:54 devstack cinder-volume[75401]: DEBUG oslo_service.backend._eventlet.service [None req-257b8688-1ced-4d58-89fa-f3dd3ebaf968 None None] backend_defaults.driver_client_cert = None {{(pid=75401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 18:51:54 devstack cinder-volume[75401]: DEBUG oslo_service.backend._eventlet.service [None req-257b8688-1ced-4d58-89fa-f3dd3ebaf968 None None] backend_defaults.driver_client_cert_key = None {{(pid=75401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 18:51:54 devstack cinder-volume[75401]: DEBUG oslo_service.backend._eventlet.service [None req-257b8688-1ced-4d58-89fa-f3dd3ebaf968 None None] backend_defaults.driver_data_namespace = None {{(pid=75401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 18:51:54 devstack cinder-volume[75401]: DEBUG oslo_service.backend._eventlet.service [None req-257b8688-1ced-4d58-89fa-f3dd3ebaf968 None None] backend_defaults.driver_ssl_cert_path = None {{(pid=75401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 18:51:54 devstack cinder-volume[75401]: DEBUG oslo_service.backend._eventlet.service [None req-257b8688-1ced-4d58-89fa-f3dd3ebaf968 None None] backend_defaults.driver_ssl_cert_verify = False {{(pid=75401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 18:51:54 devstack cinder-volume[75401]: DEBUG oslo_service.backend._eventlet.service [None req-257b8688-1ced-4d58-89fa-f3dd3ebaf968 None None] backend_defaults.driver_use_ssl = False {{(pid=75401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 18:51:54 devstack cinder-volume[75401]: DEBUG oslo_service.backend._eventlet.service [None req-257b8688-1ced-4d58-89fa-f3dd3ebaf968 None None] backend_defaults.enable_unsupported_driver = False {{(pid=75401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 18:51:54 devstack cinder-volume[75401]: DEBUG oslo_service.backend._eventlet.service [None req-257b8688-1ced-4d58-89fa-f3dd3ebaf968 None None] backend_defaults.enforce_multipath_for_image_xfer = False {{(pid=75401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 18:51:54 devstack cinder-volume[75401]: DEBUG oslo_service.backend._eventlet.service [None req-257b8688-1ced-4d58-89fa-f3dd3ebaf968 None None] backend_defaults.extra_capabilities = {} {{(pid=75401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 18:51:54 devstack cinder-volume[75401]: DEBUG oslo_service.backend._eventlet.service [None req-257b8688-1ced-4d58-89fa-f3dd3ebaf968 None None] backend_defaults.filter_function = None {{(pid=75401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 18:51:54 devstack cinder-volume[75401]: DEBUG oslo_service.backend._eventlet.service [None req-257b8688-1ced-4d58-89fa-f3dd3ebaf968 None None] backend_defaults.goodness_function = None {{(pid=75401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 18:51:54 devstack cinder-volume[75401]: DEBUG oslo_service.backend._eventlet.service [None req-257b8688-1ced-4d58-89fa-f3dd3ebaf968 None None] backend_defaults.image_upload_use_cinder_backend = False {{(pid=75401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 18:51:54 devstack cinder-volume[75401]: DEBUG oslo_service.backend._eventlet.service [None req-257b8688-1ced-4d58-89fa-f3dd3ebaf968 None None] backend_defaults.image_upload_use_internal_tenant = False {{(pid=75401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 18:51:54 devstack cinder-volume[75401]: DEBUG oslo_service.backend._eventlet.service [None req-257b8688-1ced-4d58-89fa-f3dd3ebaf968 None None] backend_defaults.image_volume_cache_enabled = False {{(pid=75401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 18:51:54 devstack cinder-volume[75401]: DEBUG oslo_service.backend._eventlet.service [None req-257b8688-1ced-4d58-89fa-f3dd3ebaf968 None None] backend_defaults.image_volume_cache_max_count = 0 {{(pid=75401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 18:51:54 devstack cinder-volume[75401]: DEBUG oslo_service.backend._eventlet.service [None req-257b8688-1ced-4d58-89fa-f3dd3ebaf968 None None] backend_defaults.image_volume_cache_max_size_gb = 0 {{(pid=75401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 18:51:54 devstack cinder-volume[75401]: DEBUG oslo_service.backend._eventlet.service [None req-257b8688-1ced-4d58-89fa-f3dd3ebaf968 None None] backend_defaults.iscsi_target_flags = {{(pid=75401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 18:51:54 devstack cinder-volume[75401]: DEBUG oslo_service.backend._eventlet.service [None req-257b8688-1ced-4d58-89fa-f3dd3ebaf968 None None] backend_defaults.iscsi_write_cache = on {{(pid=75401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 18:51:54 devstack cinder-volume[75401]: DEBUG oslo_service.backend._eventlet.service [None req-257b8688-1ced-4d58-89fa-f3dd3ebaf968 None None] backend_defaults.iser_helper = tgtadm {{(pid=75401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 18:51:54 devstack cinder-volume[75401]: DEBUG oslo_service.backend._eventlet.service [None req-257b8688-1ced-4d58-89fa-f3dd3ebaf968 None None] backend_defaults.iser_ip_address = 192.168.122.135 {{(pid=75401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 18:51:54 devstack cinder-volume[75401]: DEBUG oslo_service.backend._eventlet.service [None req-257b8688-1ced-4d58-89fa-f3dd3ebaf968 None None] backend_defaults.iser_port = 3260 {{(pid=75401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 18:51:54 devstack cinder-volume[75401]: DEBUG oslo_service.backend._eventlet.service [None req-257b8688-1ced-4d58-89fa-f3dd3ebaf968 None None] backend_defaults.iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=75401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 18:51:54 devstack cinder-volume[75401]: DEBUG oslo_service.backend._eventlet.service [None req-257b8688-1ced-4d58-89fa-f3dd3ebaf968 None None] backend_defaults.lvm_conf_file = /etc/cinder/lvm.conf {{(pid=75401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 18:51:54 devstack cinder-volume[75401]: DEBUG oslo_service.backend._eventlet.service [None req-257b8688-1ced-4d58-89fa-f3dd3ebaf968 None None] backend_defaults.lvm_mirrors = 0 {{(pid=75401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 18:51:54 devstack cinder-volume[75401]: DEBUG oslo_service.backend._eventlet.service [None req-257b8688-1ced-4d58-89fa-f3dd3ebaf968 None None] backend_defaults.lvm_share_target = False {{(pid=75401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 18:51:54 devstack cinder-volume[75401]: DEBUG oslo_service.backend._eventlet.service [None req-257b8688-1ced-4d58-89fa-f3dd3ebaf968 None None] backend_defaults.lvm_suppress_fd_warnings = False {{(pid=75401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 18:51:54 devstack cinder-volume[75401]: DEBUG oslo_service.backend._eventlet.service [None req-257b8688-1ced-4d58-89fa-f3dd3ebaf968 None None] backend_defaults.lvm_type = auto {{(pid=75401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 18:51:54 devstack cinder-volume[75401]: DEBUG oslo_service.backend._eventlet.service [None req-257b8688-1ced-4d58-89fa-f3dd3ebaf968 None None] backend_defaults.max_over_subscription_ratio = 20.0 {{(pid=75401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 18:51:54 devstack cinder-volume[75401]: DEBUG oslo_service.backend._eventlet.service [None req-257b8688-1ced-4d58-89fa-f3dd3ebaf968 None None] backend_defaults.num_iser_scan_tries = 3 {{(pid=75401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 18:51:54 devstack cinder-volume[75401]: DEBUG oslo_service.backend._eventlet.service [None req-257b8688-1ced-4d58-89fa-f3dd3ebaf968 None None] backend_defaults.num_shell_tries = 3 {{(pid=75401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 18:51:54 devstack cinder-volume[75401]: DEBUG oslo_service.backend._eventlet.service [None req-257b8688-1ced-4d58-89fa-f3dd3ebaf968 None None] backend_defaults.num_volume_device_scan_tries = 3 {{(pid=75401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 18:51:54 devstack cinder-volume[75401]: DEBUG oslo_service.backend._eventlet.service [None req-257b8688-1ced-4d58-89fa-f3dd3ebaf968 None None] backend_defaults.nvmeof_conn_info_version = 1 {{(pid=75401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 18:51:54 devstack cinder-volume[75401]: DEBUG oslo_service.backend._eventlet.service [None req-257b8688-1ced-4d58-89fa-f3dd3ebaf968 None None] backend_defaults.nvmet_ns_id = 10 {{(pid=75401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 18:51:54 devstack cinder-volume[75401]: DEBUG oslo_service.backend._eventlet.service [None req-257b8688-1ced-4d58-89fa-f3dd3ebaf968 None None] backend_defaults.nvmet_port_id = 1 {{(pid=75401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 18:51:54 devstack cinder-volume[75401]: DEBUG oslo_service.backend._eventlet.service [None req-257b8688-1ced-4d58-89fa-f3dd3ebaf968 None None] backend_defaults.replication_device = **** {{(pid=75401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 18:51:54 devstack cinder-volume[75401]: DEBUG oslo_service.backend._eventlet.service [None req-257b8688-1ced-4d58-89fa-f3dd3ebaf968 None None] backend_defaults.report_discard_supported = False {{(pid=75401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 18:51:54 devstack cinder-volume[75401]: DEBUG oslo_service.backend._eventlet.service [None req-257b8688-1ced-4d58-89fa-f3dd3ebaf968 None None] backend_defaults.reserved_percentage = 0 {{(pid=75401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 18:51:54 devstack cinder-volume[75401]: DEBUG oslo_service.backend._eventlet.service [None req-257b8688-1ced-4d58-89fa-f3dd3ebaf968 None None] backend_defaults.scst_target_driver = iscsi {{(pid=75401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 18:51:54 devstack cinder-volume[75401]: DEBUG oslo_service.backend._eventlet.service [None req-257b8688-1ced-4d58-89fa-f3dd3ebaf968 None None] backend_defaults.scst_target_iqn_name = None {{(pid=75401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 18:51:54 devstack cinder-volume[75401]: DEBUG oslo_service.backend._eventlet.service [None req-257b8688-1ced-4d58-89fa-f3dd3ebaf968 None None] backend_defaults.storage_protocol = iSCSI {{(pid=75401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 18:51:54 devstack cinder-volume[75401]: DEBUG oslo_service.backend._eventlet.service [None req-257b8688-1ced-4d58-89fa-f3dd3ebaf968 None None] backend_defaults.suppress_requests_ssl_warnings = False {{(pid=75401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 18:51:54 devstack cinder-volume[75401]: DEBUG oslo_service.backend._eventlet.service [None req-257b8688-1ced-4d58-89fa-f3dd3ebaf968 None None] backend_defaults.target_helper = tgtadm {{(pid=75401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 18:51:54 devstack cinder-volume[75401]: DEBUG oslo_service.backend._eventlet.service [None req-257b8688-1ced-4d58-89fa-f3dd3ebaf968 None None] backend_defaults.target_ip_address = 192.168.122.135 {{(pid=75401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 18:51:54 devstack cinder-volume[75401]: DEBUG oslo_service.backend._eventlet.service [None req-257b8688-1ced-4d58-89fa-f3dd3ebaf968 None None] backend_defaults.target_port = 3260 {{(pid=75401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 18:51:54 devstack cinder-volume[75401]: DEBUG oslo_service.backend._eventlet.service [None req-257b8688-1ced-4d58-89fa-f3dd3ebaf968 None None] backend_defaults.target_prefix = iqn.2010-10.org.openstack: {{(pid=75401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 18:51:54 devstack cinder-volume[75401]: DEBUG oslo_service.backend._eventlet.service [None req-257b8688-1ced-4d58-89fa-f3dd3ebaf968 None None] backend_defaults.target_protocol = iscsi {{(pid=75401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 18:51:54 devstack cinder-volume[75401]: DEBUG oslo_service.backend._eventlet.service [None req-257b8688-1ced-4d58-89fa-f3dd3ebaf968 None None] backend_defaults.target_secondary_ip_addresses = [] {{(pid=75401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 18:51:54 devstack cinder-volume[75401]: DEBUG oslo_service.backend._eventlet.service [None req-257b8688-1ced-4d58-89fa-f3dd3ebaf968 None None] backend_defaults.trace_flags = None {{(pid=75401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 18:51:54 devstack cinder-volume[75401]: DEBUG oslo_service.backend._eventlet.service [None req-257b8688-1ced-4d58-89fa-f3dd3ebaf968 None None] backend_defaults.unique_fqdn_network = True {{(pid=75401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 18:51:54 devstack cinder-volume[75401]: DEBUG oslo_service.backend._eventlet.service [None req-257b8688-1ced-4d58-89fa-f3dd3ebaf968 None None] backend_defaults.use_chap_auth = False {{(pid=75401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 18:51:54 devstack cinder-volume[75401]: DEBUG oslo_service.backend._eventlet.service [None req-257b8688-1ced-4d58-89fa-f3dd3ebaf968 None None] backend_defaults.use_multipath_for_image_xfer = False {{(pid=75401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 18:51:54 devstack cinder-volume[75401]: DEBUG oslo_service.backend._eventlet.service [None req-257b8688-1ced-4d58-89fa-f3dd3ebaf968 None None] backend_defaults.volume_backend_name = None {{(pid=75401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 18:51:54 devstack cinder-volume[75401]: DEBUG oslo_service.backend._eventlet.service [None req-257b8688-1ced-4d58-89fa-f3dd3ebaf968 None None] backend_defaults.volume_clear = zero {{(pid=75401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 18:51:54 devstack cinder-volume[75401]: DEBUG oslo_service.backend._eventlet.service [None req-257b8688-1ced-4d58-89fa-f3dd3ebaf968 None None] backend_defaults.volume_clear_ionice = None {{(pid=75401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 18:51:54 devstack cinder-volume[75401]: DEBUG oslo_service.backend._eventlet.service [None req-257b8688-1ced-4d58-89fa-f3dd3ebaf968 None None] backend_defaults.volume_clear_size = 0 {{(pid=75401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 18:51:54 devstack cinder-volume[75401]: DEBUG oslo_service.backend._eventlet.service [None req-257b8688-1ced-4d58-89fa-f3dd3ebaf968 None None] backend_defaults.volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=75401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 18:51:54 devstack cinder-volume[75401]: DEBUG oslo_service.backend._eventlet.service [None req-257b8688-1ced-4d58-89fa-f3dd3ebaf968 None None] backend_defaults.volume_copy_bps_limit = 0 {{(pid=75401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 18:51:54 devstack cinder-volume[75401]: DEBUG oslo_service.backend._eventlet.service [None req-257b8688-1ced-4d58-89fa-f3dd3ebaf968 None None] backend_defaults.volume_dd_blocksize = 1M {{(pid=75401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 18:51:54 devstack cinder-volume[75401]: DEBUG oslo_service.backend._eventlet.service [None req-257b8688-1ced-4d58-89fa-f3dd3ebaf968 None None] backend_defaults.volume_driver = cinder.volume.drivers.lvm.LVMVolumeDriver {{(pid=75401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 18:51:54 devstack cinder-volume[75401]: DEBUG oslo_service.backend._eventlet.service [None req-257b8688-1ced-4d58-89fa-f3dd3ebaf968 None None] backend_defaults.volume_group = cinder-volumes {{(pid=75401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 18:51:54 devstack cinder-volume[75401]: DEBUG oslo_service.backend._eventlet.service [None req-257b8688-1ced-4d58-89fa-f3dd3ebaf968 None None] backend_defaults.volumes_dir = /opt/stack/data/cinder/volumes {{(pid=75401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 18:51:54 devstack cinder-volume[75401]: DEBUG oslo_service.backend._eventlet.service [None req-257b8688-1ced-4d58-89fa-f3dd3ebaf968 None None] oslo_reports.file_event_handler = None {{(pid=75401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 18:51:54 devstack cinder-volume[75401]: DEBUG oslo_service.backend._eventlet.service [None req-257b8688-1ced-4d58-89fa-f3dd3ebaf968 None None] oslo_reports.file_event_handler_interval = 1 {{(pid=75401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 18:51:54 devstack cinder-volume[75401]: DEBUG oslo_service.backend._eventlet.service [None req-257b8688-1ced-4d58-89fa-f3dd3ebaf968 None None] oslo_reports.log_dir = None {{(pid=75401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 18:51:54 devstack cinder-volume[75401]: DEBUG oslo_service.backend._eventlet.service [None req-257b8688-1ced-4d58-89fa-f3dd3ebaf968 None None] lvmdriver-1.backend_availability_zone = None {{(pid=75401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 18:51:54 devstack cinder-volume[75401]: DEBUG oslo_service.backend._eventlet.service [None req-257b8688-1ced-4d58-89fa-f3dd3ebaf968 None None] lvmdriver-1.backend_host = None {{(pid=75401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 18:51:54 devstack cinder-volume[75401]: DEBUG oslo_service.backend._eventlet.service [None req-257b8688-1ced-4d58-89fa-f3dd3ebaf968 None None] lvmdriver-1.backend_native_threads_pool_size = None {{(pid=75401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 18:51:54 devstack cinder-volume[75401]: DEBUG oslo_service.backend._eventlet.service [None req-257b8688-1ced-4d58-89fa-f3dd3ebaf968 None None] lvmdriver-1.backup_use_temp_snapshot = None {{(pid=75401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 18:51:54 devstack cinder-volume[75401]: DEBUG oslo_service.backend._eventlet.service [None req-257b8688-1ced-4d58-89fa-f3dd3ebaf968 None None] lvmdriver-1.chap_password = **** {{(pid=75401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 18:51:54 devstack cinder-volume[75401]: DEBUG oslo_service.backend._eventlet.service [None req-257b8688-1ced-4d58-89fa-f3dd3ebaf968 None None] lvmdriver-1.chap_username = None {{(pid=75401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 18:51:54 devstack cinder-volume[75401]: DEBUG oslo_service.backend._eventlet.service [None req-257b8688-1ced-4d58-89fa-f3dd3ebaf968 None None] lvmdriver-1.chiscsi_conf = None {{(pid=75401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 18:51:54 devstack cinder-volume[75401]: DEBUG oslo_service.backend._eventlet.service [None req-257b8688-1ced-4d58-89fa-f3dd3ebaf968 None None] lvmdriver-1.disk_geometry = None {{(pid=75401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 18:51:54 devstack cinder-volume[75401]: DEBUG oslo_service.backend._eventlet.service [None req-257b8688-1ced-4d58-89fa-f3dd3ebaf968 None None] lvmdriver-1.driver_client_cert = None {{(pid=75401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 18:51:54 devstack cinder-volume[75401]: DEBUG oslo_service.backend._eventlet.service [None req-257b8688-1ced-4d58-89fa-f3dd3ebaf968 None None] lvmdriver-1.driver_client_cert_key = None {{(pid=75401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 18:51:54 devstack cinder-volume[75401]: DEBUG oslo_service.backend._eventlet.service [None req-257b8688-1ced-4d58-89fa-f3dd3ebaf968 None None] lvmdriver-1.driver_data_namespace = None {{(pid=75401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 18:51:54 devstack cinder-volume[75401]: DEBUG oslo_service.backend._eventlet.service [None req-257b8688-1ced-4d58-89fa-f3dd3ebaf968 None None] lvmdriver-1.driver_ssl_cert_path = None {{(pid=75401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 18:51:54 devstack cinder-volume[75401]: DEBUG oslo_service.backend._eventlet.service [None req-257b8688-1ced-4d58-89fa-f3dd3ebaf968 None None] lvmdriver-1.driver_ssl_cert_verify = None {{(pid=75401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 18:51:54 devstack cinder-volume[75401]: DEBUG oslo_service.backend._eventlet.service [None req-257b8688-1ced-4d58-89fa-f3dd3ebaf968 None None] lvmdriver-1.driver_use_ssl = None {{(pid=75401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 18:51:54 devstack cinder-volume[75401]: DEBUG oslo_service.backend._eventlet.service [None req-257b8688-1ced-4d58-89fa-f3dd3ebaf968 None None] lvmdriver-1.enable_unsupported_driver = None {{(pid=75401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 18:51:54 devstack cinder-volume[75401]: DEBUG oslo_service.backend._eventlet.service [None req-257b8688-1ced-4d58-89fa-f3dd3ebaf968 None None] lvmdriver-1.enforce_multipath_for_image_xfer = None {{(pid=75401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 18:51:54 devstack cinder-volume[75401]: DEBUG oslo_service.backend._eventlet.service [None req-257b8688-1ced-4d58-89fa-f3dd3ebaf968 None None] lvmdriver-1.extra_capabilities = None {{(pid=75401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 18:51:54 devstack cinder-volume[75401]: DEBUG oslo_service.backend._eventlet.service [None req-257b8688-1ced-4d58-89fa-f3dd3ebaf968 None None] lvmdriver-1.filter_function = None {{(pid=75401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 18:51:54 devstack cinder-volume[75401]: DEBUG oslo_service.backend._eventlet.service [None req-257b8688-1ced-4d58-89fa-f3dd3ebaf968 None None] lvmdriver-1.goodness_function = None {{(pid=75401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 18:51:54 devstack cinder-volume[75401]: DEBUG oslo_service.backend._eventlet.service [None req-257b8688-1ced-4d58-89fa-f3dd3ebaf968 None None] lvmdriver-1.image_upload_use_cinder_backend = None {{(pid=75401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 18:51:54 devstack cinder-volume[75401]: DEBUG oslo_service.backend._eventlet.service [None req-257b8688-1ced-4d58-89fa-f3dd3ebaf968 None None] lvmdriver-1.image_upload_use_internal_tenant = None {{(pid=75401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 18:51:54 devstack cinder-volume[75401]: DEBUG oslo_service.backend._eventlet.service [None req-257b8688-1ced-4d58-89fa-f3dd3ebaf968 None None] lvmdriver-1.image_volume_cache_enabled = True {{(pid=75401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 18:51:54 devstack cinder-volume[75401]: DEBUG oslo_service.backend._eventlet.service [None req-257b8688-1ced-4d58-89fa-f3dd3ebaf968 None None] lvmdriver-1.image_volume_cache_max_count = None {{(pid=75401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 18:51:54 devstack cinder-volume[75401]: DEBUG oslo_service.backend._eventlet.service [None req-257b8688-1ced-4d58-89fa-f3dd3ebaf968 None None] lvmdriver-1.image_volume_cache_max_size_gb = None {{(pid=75401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 18:51:54 devstack cinder-volume[75401]: DEBUG oslo_service.backend._eventlet.service [None req-257b8688-1ced-4d58-89fa-f3dd3ebaf968 None None] lvmdriver-1.iscsi_target_flags = None {{(pid=75401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 18:51:54 devstack cinder-volume[75401]: DEBUG oslo_service.backend._eventlet.service [None req-257b8688-1ced-4d58-89fa-f3dd3ebaf968 None None] lvmdriver-1.iscsi_write_cache = None {{(pid=75401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 18:51:54 devstack cinder-volume[75401]: DEBUG oslo_service.backend._eventlet.service [None req-257b8688-1ced-4d58-89fa-f3dd3ebaf968 None None] lvmdriver-1.iser_helper = None {{(pid=75401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 18:51:54 devstack cinder-volume[75401]: DEBUG oslo_service.backend._eventlet.service [None req-257b8688-1ced-4d58-89fa-f3dd3ebaf968 None None] lvmdriver-1.iser_ip_address = None {{(pid=75401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 18:51:54 devstack cinder-volume[75401]: DEBUG oslo_service.backend._eventlet.service [None req-257b8688-1ced-4d58-89fa-f3dd3ebaf968 None None] lvmdriver-1.iser_port = None {{(pid=75401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 18:51:54 devstack cinder-volume[75401]: DEBUG oslo_service.backend._eventlet.service [None req-257b8688-1ced-4d58-89fa-f3dd3ebaf968 None None] lvmdriver-1.iser_target_prefix = None {{(pid=75401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 18:51:54 devstack cinder-volume[75401]: DEBUG oslo_service.backend._eventlet.service [None req-257b8688-1ced-4d58-89fa-f3dd3ebaf968 None None] lvmdriver-1.lvm_conf_file = None {{(pid=75401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 18:51:54 devstack cinder-volume[75401]: DEBUG oslo_service.backend._eventlet.service [None req-257b8688-1ced-4d58-89fa-f3dd3ebaf968 None None] lvmdriver-1.lvm_mirrors = None {{(pid=75401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 18:51:54 devstack cinder-volume[75401]: DEBUG oslo_service.backend._eventlet.service [None req-257b8688-1ced-4d58-89fa-f3dd3ebaf968 None None] lvmdriver-1.lvm_share_target = None {{(pid=75401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 18:51:54 devstack cinder-volume[75401]: DEBUG oslo_service.backend._eventlet.service [None req-257b8688-1ced-4d58-89fa-f3dd3ebaf968 None None] lvmdriver-1.lvm_suppress_fd_warnings = None {{(pid=75401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 18:51:54 devstack cinder-volume[75401]: DEBUG oslo_service.backend._eventlet.service [None req-257b8688-1ced-4d58-89fa-f3dd3ebaf968 None None] lvmdriver-1.lvm_type = auto {{(pid=75401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 18:51:54 devstack cinder-volume[75401]: DEBUG oslo_service.backend._eventlet.service [None req-257b8688-1ced-4d58-89fa-f3dd3ebaf968 None None] lvmdriver-1.max_over_subscription_ratio = None {{(pid=75401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 18:51:54 devstack cinder-volume[75401]: DEBUG oslo_service.backend._eventlet.service [None req-257b8688-1ced-4d58-89fa-f3dd3ebaf968 None None] lvmdriver-1.num_iser_scan_tries = None {{(pid=75401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 18:51:54 devstack cinder-volume[75401]: DEBUG oslo_service.backend._eventlet.service [None req-257b8688-1ced-4d58-89fa-f3dd3ebaf968 None None] lvmdriver-1.num_shell_tries = None {{(pid=75401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 18:51:54 devstack cinder-volume[75401]: DEBUG oslo_service.backend._eventlet.service [None req-257b8688-1ced-4d58-89fa-f3dd3ebaf968 None None] lvmdriver-1.num_volume_device_scan_tries = None {{(pid=75401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 18:51:54 devstack cinder-volume[75401]: DEBUG oslo_service.backend._eventlet.service [None req-257b8688-1ced-4d58-89fa-f3dd3ebaf968 None None] lvmdriver-1.nvmeof_conn_info_version = None {{(pid=75401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 18:51:54 devstack cinder-volume[75401]: DEBUG oslo_service.backend._eventlet.service [None req-257b8688-1ced-4d58-89fa-f3dd3ebaf968 None None] lvmdriver-1.nvmet_ns_id = None {{(pid=75401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 18:51:54 devstack cinder-volume[75401]: DEBUG oslo_service.backend._eventlet.service [None req-257b8688-1ced-4d58-89fa-f3dd3ebaf968 None None] lvmdriver-1.nvmet_port_id = None {{(pid=75401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 18:51:54 devstack cinder-volume[75401]: DEBUG oslo_service.backend._eventlet.service [None req-257b8688-1ced-4d58-89fa-f3dd3ebaf968 None None] lvmdriver-1.replication_device = **** {{(pid=75401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 18:51:54 devstack cinder-volume[75401]: DEBUG oslo_service.backend._eventlet.service [None req-257b8688-1ced-4d58-89fa-f3dd3ebaf968 None None] lvmdriver-1.report_discard_supported = None {{(pid=75401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 18:51:54 devstack cinder-volume[75401]: DEBUG oslo_service.backend._eventlet.service [None req-257b8688-1ced-4d58-89fa-f3dd3ebaf968 None None] lvmdriver-1.reserved_percentage = None {{(pid=75401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 18:51:54 devstack cinder-volume[75401]: DEBUG oslo_service.backend._eventlet.service [None req-257b8688-1ced-4d58-89fa-f3dd3ebaf968 None None] lvmdriver-1.scst_target_driver = None {{(pid=75401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 18:51:54 devstack cinder-volume[75401]: DEBUG oslo_service.backend._eventlet.service [None req-257b8688-1ced-4d58-89fa-f3dd3ebaf968 None None] lvmdriver-1.scst_target_iqn_name = None {{(pid=75401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 18:51:54 devstack cinder-volume[75401]: DEBUG oslo_service.backend._eventlet.service [None req-257b8688-1ced-4d58-89fa-f3dd3ebaf968 None None] lvmdriver-1.storage_protocol = None {{(pid=75401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 18:51:54 devstack cinder-volume[75401]: DEBUG oslo_service.backend._eventlet.service [None req-257b8688-1ced-4d58-89fa-f3dd3ebaf968 None None] lvmdriver-1.suppress_requests_ssl_warnings = None {{(pid=75401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 18:51:54 devstack cinder-volume[75401]: DEBUG oslo_service.backend._eventlet.service [None req-257b8688-1ced-4d58-89fa-f3dd3ebaf968 None None] lvmdriver-1.target_helper = lioadm {{(pid=75401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 18:51:54 devstack cinder-volume[75401]: DEBUG oslo_service.backend._eventlet.service [None req-257b8688-1ced-4d58-89fa-f3dd3ebaf968 None None] lvmdriver-1.target_ip_address = None {{(pid=75401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 18:51:54 devstack cinder-volume[75401]: DEBUG oslo_service.backend._eventlet.service [None req-257b8688-1ced-4d58-89fa-f3dd3ebaf968 None None] lvmdriver-1.target_port = 3260 {{(pid=75401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 18:51:54 devstack cinder-volume[75401]: DEBUG oslo_service.backend._eventlet.service [None req-257b8688-1ced-4d58-89fa-f3dd3ebaf968 None None] lvmdriver-1.target_prefix = iqn.2010-10.org.openstack: {{(pid=75401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 18:51:54 devstack cinder-volume[75401]: DEBUG oslo_service.backend._eventlet.service [None req-257b8688-1ced-4d58-89fa-f3dd3ebaf968 None None] lvmdriver-1.target_protocol = iscsi {{(pid=75401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 18:51:54 devstack cinder-volume[75401]: DEBUG oslo_service.backend._eventlet.service [None req-257b8688-1ced-4d58-89fa-f3dd3ebaf968 None None] lvmdriver-1.target_secondary_ip_addresses = None {{(pid=75401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 18:51:54 devstack cinder-volume[75401]: DEBUG oslo_service.backend._eventlet.service [None req-257b8688-1ced-4d58-89fa-f3dd3ebaf968 None None] lvmdriver-1.trace_flags = None {{(pid=75401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 18:51:54 devstack cinder-volume[75401]: DEBUG oslo_service.backend._eventlet.service [None req-257b8688-1ced-4d58-89fa-f3dd3ebaf968 None None] lvmdriver-1.unique_fqdn_network = None {{(pid=75401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 18:51:54 devstack cinder-volume[75401]: DEBUG oslo_service.backend._eventlet.service [None req-257b8688-1ced-4d58-89fa-f3dd3ebaf968 None None] lvmdriver-1.use_chap_auth = None {{(pid=75401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 18:51:54 devstack cinder-volume[75401]: DEBUG oslo_service.backend._eventlet.service [None req-257b8688-1ced-4d58-89fa-f3dd3ebaf968 None None] lvmdriver-1.use_multipath_for_image_xfer = None {{(pid=75401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 18:51:54 devstack cinder-volume[75401]: DEBUG oslo_service.backend._eventlet.service [None req-257b8688-1ced-4d58-89fa-f3dd3ebaf968 None None] lvmdriver-1.volume_backend_name = lvmdriver-1 {{(pid=75401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 18:51:54 devstack cinder-volume[75401]: DEBUG oslo_service.backend._eventlet.service [None req-257b8688-1ced-4d58-89fa-f3dd3ebaf968 None None] lvmdriver-1.volume_clear = zero {{(pid=75401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 18:51:54 devstack cinder-volume[75401]: DEBUG oslo_service.backend._eventlet.service [None req-257b8688-1ced-4d58-89fa-f3dd3ebaf968 None None] lvmdriver-1.volume_clear_ionice = None {{(pid=75401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 18:51:54 devstack cinder-volume[75401]: DEBUG oslo_service.backend._eventlet.service [None req-257b8688-1ced-4d58-89fa-f3dd3ebaf968 None None] lvmdriver-1.volume_clear_size = None {{(pid=75401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 18:51:54 devstack cinder-volume[75401]: DEBUG oslo_service.backend._eventlet.service [None req-257b8688-1ced-4d58-89fa-f3dd3ebaf968 None None] lvmdriver-1.volume_copy_blkio_cgroup_name = None {{(pid=75401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 18:51:54 devstack cinder-volume[75401]: DEBUG oslo_service.backend._eventlet.service [None req-257b8688-1ced-4d58-89fa-f3dd3ebaf968 None None] lvmdriver-1.volume_copy_bps_limit = None {{(pid=75401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 18:51:54 devstack cinder-volume[75401]: DEBUG oslo_service.backend._eventlet.service [None req-257b8688-1ced-4d58-89fa-f3dd3ebaf968 None None] lvmdriver-1.volume_dd_blocksize = None {{(pid=75401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 18:51:54 devstack cinder-volume[75401]: DEBUG oslo_service.backend._eventlet.service [None req-257b8688-1ced-4d58-89fa-f3dd3ebaf968 None None] lvmdriver-1.volume_driver = cinder.volume.drivers.lvm.LVMVolumeDriver {{(pid=75401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 18:51:54 devstack cinder-volume[75401]: DEBUG oslo_service.backend._eventlet.service [None req-257b8688-1ced-4d58-89fa-f3dd3ebaf968 None None] lvmdriver-1.volume_group = stack-volumes-lvmdriver-1 {{(pid=75401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 18:51:54 devstack cinder-volume[75401]: DEBUG oslo_service.backend._eventlet.service [None req-257b8688-1ced-4d58-89fa-f3dd3ebaf968 None None] lvmdriver-1.volumes_dir = None {{(pid=75401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 18:51:54 devstack cinder-volume[75401]: DEBUG oslo_service.backend._eventlet.service [None req-257b8688-1ced-4d58-89fa-f3dd3ebaf968 None None] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=75401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 18:51:54 devstack cinder-volume[75401]: DEBUG oslo_service.backend._eventlet.service [None req-257b8688-1ced-4d58-89fa-f3dd3ebaf968 None None] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=75401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 18:51:54 devstack cinder-volume[75401]: DEBUG oslo_service.backend._eventlet.service [None req-257b8688-1ced-4d58-89fa-f3dd3ebaf968 None None] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=75401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 18:51:54 devstack cinder-volume[75401]: DEBUG oslo_service.backend._eventlet.service [None req-257b8688-1ced-4d58-89fa-f3dd3ebaf968 None None] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=75401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 18:51:54 devstack cinder-volume[75401]: DEBUG oslo_service.backend._eventlet.service [None req-257b8688-1ced-4d58-89fa-f3dd3ebaf968 None None] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=75401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 18:51:54 devstack cinder-volume[75401]: DEBUG oslo_service.backend._eventlet.service [None req-257b8688-1ced-4d58-89fa-f3dd3ebaf968 None None] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=75401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 18:51:54 devstack cinder-volume[75401]: DEBUG oslo_service.backend._eventlet.service [None req-257b8688-1ced-4d58-89fa-f3dd3ebaf968 None None] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=75401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 18:51:54 devstack cinder-volume[75401]: DEBUG oslo_service.backend._eventlet.service [None req-257b8688-1ced-4d58-89fa-f3dd3ebaf968 None None] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=75401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 18:51:54 devstack cinder-volume[75401]: DEBUG oslo_service.backend._eventlet.service [None req-257b8688-1ced-4d58-89fa-f3dd3ebaf968 None None] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=75401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 18:51:54 devstack cinder-volume[75401]: DEBUG oslo_service.backend._eventlet.service [None req-257b8688-1ced-4d58-89fa-f3dd3ebaf968 None None] oslo_messaging_rabbit.hostname = devstack {{(pid=75401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 18:51:54 devstack cinder-volume[75401]: DEBUG oslo_service.backend._eventlet.service [None req-257b8688-1ced-4d58-89fa-f3dd3ebaf968 None None] oslo_messaging_rabbit.kombu_compression = None {{(pid=75401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 18:51:54 devstack cinder-volume[75401]: DEBUG oslo_service.backend._eventlet.service [None req-257b8688-1ced-4d58-89fa-f3dd3ebaf968 None None] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=75401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 18:51:54 devstack cinder-volume[75401]: DEBUG oslo_service.backend._eventlet.service [None req-257b8688-1ced-4d58-89fa-f3dd3ebaf968 None None] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=75401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 18:51:54 devstack cinder-volume[75401]: DEBUG oslo_service.backend._eventlet.service [None req-257b8688-1ced-4d58-89fa-f3dd3ebaf968 None None] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=75401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 18:51:54 devstack cinder-volume[75401]: DEBUG oslo_service.backend._eventlet.service [None req-257b8688-1ced-4d58-89fa-f3dd3ebaf968 None None] oslo_messaging_rabbit.kombu_reconnect_splay = 0.0 {{(pid=75401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 18:51:54 devstack cinder-volume[75401]: DEBUG oslo_service.backend._eventlet.service [None req-257b8688-1ced-4d58-89fa-f3dd3ebaf968 None None] oslo_messaging_rabbit.processname = cinder-volume {{(pid=75401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 18:51:54 devstack cinder-volume[75401]: DEBUG oslo_service.backend._eventlet.service [None req-257b8688-1ced-4d58-89fa-f3dd3ebaf968 None None] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=75401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 18:51:54 devstack cinder-volume[75401]: DEBUG oslo_service.backend._eventlet.service [None req-257b8688-1ced-4d58-89fa-f3dd3ebaf968 None None] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=75401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 18:51:54 devstack cinder-volume[75401]: DEBUG oslo_service.backend._eventlet.service [None req-257b8688-1ced-4d58-89fa-f3dd3ebaf968 None None] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=75401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 18:51:54 devstack cinder-volume[75401]: DEBUG oslo_service.backend._eventlet.service [None req-257b8688-1ced-4d58-89fa-f3dd3ebaf968 None None] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=75401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 18:51:54 devstack cinder-volume[75401]: DEBUG oslo_service.backend._eventlet.service [None req-257b8688-1ced-4d58-89fa-f3dd3ebaf968 None None] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=75401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 18:51:54 devstack cinder-volume[75401]: DEBUG oslo_service.backend._eventlet.service [None req-257b8688-1ced-4d58-89fa-f3dd3ebaf968 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_bytes = 0 {{(pid=75401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 18:51:54 devstack cinder-volume[75401]: DEBUG oslo_service.backend._eventlet.service [None req-257b8688-1ced-4d58-89fa-f3dd3ebaf968 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_length = 0 {{(pid=75401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 18:51:54 devstack cinder-volume[75401]: DEBUG oslo_service.backend._eventlet.service [None req-257b8688-1ced-4d58-89fa-f3dd3ebaf968 None None] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=75401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 18:51:54 devstack cinder-volume[75401]: DEBUG oslo_service.backend._eventlet.service [None req-257b8688-1ced-4d58-89fa-f3dd3ebaf968 None None] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=75401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 18:51:54 devstack cinder-volume[75401]: DEBUG oslo_service.backend._eventlet.service [None req-257b8688-1ced-4d58-89fa-f3dd3ebaf968 None None] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=75401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 18:51:54 devstack cinder-volume[75401]: DEBUG oslo_service.backend._eventlet.service [None req-257b8688-1ced-4d58-89fa-f3dd3ebaf968 None None] oslo_messaging_rabbit.rabbit_stream_fanout = False {{(pid=75401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 18:51:54 devstack cinder-volume[75401]: DEBUG oslo_service.backend._eventlet.service [None req-257b8688-1ced-4d58-89fa-f3dd3ebaf968 None None] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=75401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 18:51:54 devstack cinder-volume[75401]: DEBUG oslo_service.backend._eventlet.service [None req-257b8688-1ced-4d58-89fa-f3dd3ebaf968 None None] oslo_messaging_rabbit.rabbit_transient_quorum_queue = False {{(pid=75401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 18:51:54 devstack cinder-volume[75401]: DEBUG oslo_service.backend._eventlet.service [None req-257b8688-1ced-4d58-89fa-f3dd3ebaf968 None None] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=75401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 18:51:54 devstack cinder-volume[75401]: DEBUG oslo_service.backend._eventlet.service [None req-257b8688-1ced-4d58-89fa-f3dd3ebaf968 None None] oslo_messaging_rabbit.ssl = False {{(pid=75401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 18:51:54 devstack cinder-volume[75401]: DEBUG oslo_service.backend._eventlet.service [None req-257b8688-1ced-4d58-89fa-f3dd3ebaf968 None None] oslo_messaging_rabbit.ssl_ca_file = {{(pid=75401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 18:51:54 devstack cinder-volume[75401]: DEBUG oslo_service.backend._eventlet.service [None req-257b8688-1ced-4d58-89fa-f3dd3ebaf968 None None] oslo_messaging_rabbit.ssl_cert_file = {{(pid=75401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 18:51:54 devstack cinder-volume[75401]: DEBUG oslo_service.backend._eventlet.service [None req-257b8688-1ced-4d58-89fa-f3dd3ebaf968 None None] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=75401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 18:51:54 devstack cinder-volume[75401]: DEBUG oslo_service.backend._eventlet.service [None req-257b8688-1ced-4d58-89fa-f3dd3ebaf968 None None] oslo_messaging_rabbit.ssl_key_file = {{(pid=75401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 18:51:54 devstack cinder-volume[75401]: DEBUG oslo_service.backend._eventlet.service [None req-257b8688-1ced-4d58-89fa-f3dd3ebaf968 None None] oslo_messaging_rabbit.ssl_version = {{(pid=75401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 18:51:54 devstack cinder-volume[75401]: DEBUG oslo_service.backend._eventlet.service [None req-257b8688-1ced-4d58-89fa-f3dd3ebaf968 None None] oslo_messaging_rabbit.use_queue_manager = False {{(pid=75401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 18:51:54 devstack cinder-volume[75401]: DEBUG oslo_service.backend._eventlet.service [None req-257b8688-1ced-4d58-89fa-f3dd3ebaf968 None None] oslo_messaging_notifications.driver = [] {{(pid=75401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 18:51:54 devstack cinder-volume[75401]: DEBUG oslo_service.backend._eventlet.service [None req-257b8688-1ced-4d58-89fa-f3dd3ebaf968 None None] oslo_messaging_notifications.retry = -1 {{(pid=75401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 18:51:54 devstack cinder-volume[75401]: DEBUG oslo_service.backend._eventlet.service [None req-257b8688-1ced-4d58-89fa-f3dd3ebaf968 None None] oslo_messaging_notifications.topics = ['notifications'] {{(pid=75401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 18:51:54 devstack cinder-volume[75401]: DEBUG oslo_service.backend._eventlet.service [None req-257b8688-1ced-4d58-89fa-f3dd3ebaf968 None None] oslo_messaging_notifications.transport_url = **** {{(pid=75401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 18:51:54 devstack cinder-volume[75401]: DEBUG oslo_service.backend._eventlet.service [None req-257b8688-1ced-4d58-89fa-f3dd3ebaf968 None None] key_manager.backend = cinder.keymgr.conf_key_mgr.ConfKeyManager {{(pid=75401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 18:51:54 devstack cinder-volume[75401]: DEBUG oslo_service.backend._eventlet.service [None req-257b8688-1ced-4d58-89fa-f3dd3ebaf968 None None] key_manager.fixed_key = **** {{(pid=75401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 18:51:54 devstack cinder-volume[75401]: DEBUG oslo_service.backend._eventlet.service [None req-257b8688-1ced-4d58-89fa-f3dd3ebaf968 None None] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=75401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 18:51:54 devstack cinder-volume[75401]: DEBUG oslo_service.backend._eventlet.service [None req-257b8688-1ced-4d58-89fa-f3dd3ebaf968 None None] barbican.barbican_api_version = None {{(pid=75401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 18:51:54 devstack cinder-volume[75401]: DEBUG oslo_service.backend._eventlet.service [None req-257b8688-1ced-4d58-89fa-f3dd3ebaf968 None None] barbican.barbican_endpoint = None {{(pid=75401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 18:51:54 devstack cinder-volume[75401]: DEBUG oslo_service.backend._eventlet.service [None req-257b8688-1ced-4d58-89fa-f3dd3ebaf968 None None] barbican.barbican_endpoint_type = public {{(pid=75401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 18:51:54 devstack cinder-volume[75401]: DEBUG oslo_service.backend._eventlet.service [None req-257b8688-1ced-4d58-89fa-f3dd3ebaf968 None None] barbican.barbican_region_name = None {{(pid=75401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 18:51:54 devstack cinder-volume[75401]: DEBUG oslo_service.backend._eventlet.service [None req-257b8688-1ced-4d58-89fa-f3dd3ebaf968 None None] barbican.cafile = None {{(pid=75401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 18:51:54 devstack cinder-volume[75401]: DEBUG oslo_service.backend._eventlet.service [None req-257b8688-1ced-4d58-89fa-f3dd3ebaf968 None None] barbican.certfile = None {{(pid=75401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 18:51:54 devstack cinder-volume[75401]: DEBUG oslo_service.backend._eventlet.service [None req-257b8688-1ced-4d58-89fa-f3dd3ebaf968 None None] barbican.collect_timing = False {{(pid=75401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 18:51:54 devstack cinder-volume[75401]: DEBUG oslo_service.backend._eventlet.service [None req-257b8688-1ced-4d58-89fa-f3dd3ebaf968 None None] barbican.insecure = False {{(pid=75401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 18:51:54 devstack cinder-volume[75401]: DEBUG oslo_service.backend._eventlet.service [None req-257b8688-1ced-4d58-89fa-f3dd3ebaf968 None None] barbican.keyfile = None {{(pid=75401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 18:51:54 devstack cinder-volume[75401]: DEBUG oslo_service.backend._eventlet.service [None req-257b8688-1ced-4d58-89fa-f3dd3ebaf968 None None] barbican.number_of_retries = 60 {{(pid=75401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 18:51:54 devstack cinder-volume[75401]: DEBUG oslo_service.backend._eventlet.service [None req-257b8688-1ced-4d58-89fa-f3dd3ebaf968 None None] barbican.retry_delay = 1 {{(pid=75401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 18:51:54 devstack cinder-volume[75401]: DEBUG oslo_service.backend._eventlet.service [None req-257b8688-1ced-4d58-89fa-f3dd3ebaf968 None None] barbican.send_service_user_token = False {{(pid=75401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 18:51:54 devstack cinder-volume[75401]: DEBUG oslo_service.backend._eventlet.service [None req-257b8688-1ced-4d58-89fa-f3dd3ebaf968 None None] barbican.split_loggers = False {{(pid=75401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 18:51:54 devstack cinder-volume[75401]: DEBUG oslo_service.backend._eventlet.service [None req-257b8688-1ced-4d58-89fa-f3dd3ebaf968 None None] barbican.timeout = None {{(pid=75401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 18:51:54 devstack cinder-volume[75401]: DEBUG oslo_service.backend._eventlet.service [None req-257b8688-1ced-4d58-89fa-f3dd3ebaf968 None None] barbican.verify_ssl = True {{(pid=75401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 18:51:54 devstack cinder-volume[75401]: DEBUG oslo_service.backend._eventlet.service [None req-257b8688-1ced-4d58-89fa-f3dd3ebaf968 None None] barbican.verify_ssl_path = None {{(pid=75401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 18:51:54 devstack cinder-volume[75401]: DEBUG oslo_service.backend._eventlet.service [None req-257b8688-1ced-4d58-89fa-f3dd3ebaf968 None None] barbican_service_user.auth_section = None {{(pid=75401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 18:51:54 devstack cinder-volume[75401]: DEBUG oslo_service.backend._eventlet.service [None req-257b8688-1ced-4d58-89fa-f3dd3ebaf968 None None] barbican_service_user.auth_type = None {{(pid=75401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 18:51:54 devstack cinder-volume[75401]: DEBUG oslo_service.backend._eventlet.service [None req-257b8688-1ced-4d58-89fa-f3dd3ebaf968 None None] barbican_service_user.cafile = None {{(pid=75401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 18:51:54 devstack cinder-volume[75401]: DEBUG oslo_service.backend._eventlet.service [None req-257b8688-1ced-4d58-89fa-f3dd3ebaf968 None None] barbican_service_user.certfile = None {{(pid=75401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 18:51:54 devstack cinder-volume[75401]: DEBUG oslo_service.backend._eventlet.service [None req-257b8688-1ced-4d58-89fa-f3dd3ebaf968 None None] barbican_service_user.collect_timing = False {{(pid=75401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 18:51:54 devstack cinder-volume[75401]: DEBUG oslo_service.backend._eventlet.service [None req-257b8688-1ced-4d58-89fa-f3dd3ebaf968 None None] barbican_service_user.insecure = False {{(pid=75401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 18:51:54 devstack cinder-volume[75401]: DEBUG oslo_service.backend._eventlet.service [None req-257b8688-1ced-4d58-89fa-f3dd3ebaf968 None None] barbican_service_user.keyfile = None {{(pid=75401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 18:51:54 devstack cinder-volume[75401]: DEBUG oslo_service.backend._eventlet.service [None req-257b8688-1ced-4d58-89fa-f3dd3ebaf968 None None] barbican_service_user.split_loggers = False {{(pid=75401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 18:51:54 devstack cinder-volume[75401]: DEBUG oslo_service.backend._eventlet.service [None req-257b8688-1ced-4d58-89fa-f3dd3ebaf968 None None] barbican_service_user.timeout = None {{(pid=75401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 18:51:54 devstack cinder-volume[75401]: DEBUG oslo_service.backend._eventlet.service [None req-257b8688-1ced-4d58-89fa-f3dd3ebaf968 None None] vault.approle_role_id = **** {{(pid=75401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 18:51:54 devstack cinder-volume[75401]: DEBUG oslo_service.backend._eventlet.service [None req-257b8688-1ced-4d58-89fa-f3dd3ebaf968 None None] vault.approle_secret_id = **** {{(pid=75401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 18:51:54 devstack cinder-volume[75401]: DEBUG oslo_service.backend._eventlet.service [None req-257b8688-1ced-4d58-89fa-f3dd3ebaf968 None None] vault.kv_mountpoint = secret {{(pid=75401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 18:51:54 devstack cinder-volume[75401]: DEBUG oslo_service.backend._eventlet.service [None req-257b8688-1ced-4d58-89fa-f3dd3ebaf968 None None] vault.kv_path = None {{(pid=75401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 18:51:54 devstack cinder-volume[75401]: DEBUG oslo_service.backend._eventlet.service [None req-257b8688-1ced-4d58-89fa-f3dd3ebaf968 None None] vault.kv_version = 2 {{(pid=75401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 18:51:54 devstack cinder-volume[75401]: DEBUG oslo_service.backend._eventlet.service [None req-257b8688-1ced-4d58-89fa-f3dd3ebaf968 None None] vault.namespace = None {{(pid=75401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 18:51:54 devstack cinder-volume[75401]: DEBUG oslo_service.backend._eventlet.service [None req-257b8688-1ced-4d58-89fa-f3dd3ebaf968 None None] vault.root_token_id = **** {{(pid=75401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 18:51:54 devstack cinder-volume[75401]: DEBUG oslo_service.backend._eventlet.service [None req-257b8688-1ced-4d58-89fa-f3dd3ebaf968 None None] vault.ssl_ca_crt_file = None {{(pid=75401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 18:51:54 devstack cinder-volume[75401]: DEBUG oslo_service.backend._eventlet.service [None req-257b8688-1ced-4d58-89fa-f3dd3ebaf968 None None] vault.timeout = 60.0 {{(pid=75401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 18:51:54 devstack cinder-volume[75401]: DEBUG oslo_service.backend._eventlet.service [None req-257b8688-1ced-4d58-89fa-f3dd3ebaf968 None None] vault.use_ssl = False {{(pid=75401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 18:51:54 devstack cinder-volume[75401]: DEBUG oslo_service.backend._eventlet.service [None req-257b8688-1ced-4d58-89fa-f3dd3ebaf968 None None] vault.vault_url = http://127.0.0.1:8200 {{(pid=75401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 18:51:54 devstack cinder-volume[75401]: DEBUG oslo_service.backend._eventlet.service [None req-257b8688-1ced-4d58-89fa-f3dd3ebaf968 None None] ******************************************************************************** {{(pid=75401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3013}} Apr 29 18:51:54 devstack cinder-volume[75577]: DEBUG oslo_concurrency.processutils [None req-108ed54b-9ee2-483e-ae17-f87d899e7dce None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings -o name stack-volumes-lvmdriver-1" returned: 0 in 0.843s {{(pid=75577) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 18:51:54 devstack cinder-volume[75577]: DEBUG oslo_concurrency.processutils [None req-108ed54b-9ee2-483e-ae17-f87d899e7dce None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=75577) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 18:51:54 devstack sudo[75581]: pam_unix(sudo:session): session closed for user root Apr 29 18:51:54 devstack sudo[75800]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Apr 29 18:51:54 devstack sudo[75800]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 18:51:55 devstack sudo[75800]: pam_unix(sudo:session): session closed for user root Apr 29 18:51:55 devstack cinder-volume[75577]: DEBUG oslo_concurrency.processutils [None req-108ed54b-9ee2-483e-ae17-f87d899e7dce None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 5 in 0.654s {{(pid=75577) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 18:51:55 devstack cinder-volume[75577]: DEBUG oslo_concurrency.processutils [None req-108ed54b-9ee2-483e-ae17-f87d899e7dce None None] 'sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool' failed. Not Retrying. {{(pid=75577) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Apr 29 18:51:55 devstack cinder-volume[75577]: INFO cinder.brick.local_dev.lvm [None req-108ed54b-9ee2-483e-ae17-f87d899e7dce None None] Logical Volume not found when querying LVM info. (vg_name=stack-volumes-lvmdriver-1, lv_name=stack-volumes-lvmdriver-1-pool Apr 29 18:51:55 devstack cinder-volume[75577]: DEBUG oslo_concurrency.processutils [None req-108ed54b-9ee2-483e-ae17-f87d899e7dce None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=75577) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 18:51:55 devstack cinder-volume[75577]: DEBUG oslo_concurrency.processutils [None req-108ed54b-9ee2-483e-ae17-f87d899e7dce None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.018s {{(pid=75577) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 18:51:55 devstack cinder-volume[75577]: DEBUG oslo_concurrency.processutils [None req-108ed54b-9ee2-483e-ae17-f87d899e7dce None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=75577) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 18:51:55 devstack sudo[76025]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Apr 29 18:51:55 devstack sudo[76025]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 18:51:56 devstack sudo[76025]: pam_unix(sudo:session): session closed for user root Apr 29 18:51:56 devstack cinder-volume[75577]: DEBUG oslo_concurrency.processutils [None req-108ed54b-9ee2-483e-ae17-f87d899e7dce None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.656s {{(pid=75577) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 18:51:56 devstack cinder-volume[75577]: DEBUG cinder.brick.local_dev.lvm [None req-108ed54b-9ee2-483e-ae17-f87d899e7dce None None] Creating thin pool 'stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool' with size 28.5g of total 30.0g {{(pid=75577) create_thin_pool /opt/stack/cinder/cinder/brick/local_dev/lvm.py:550}} Apr 29 18:51:56 devstack cinder-volume[75577]: DEBUG oslo_concurrency.processutils [None req-108ed54b-9ee2-483e-ae17-f87d899e7dce None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvcreate -T -L 28.5g stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=75577) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 18:51:56 devstack sudo[76149]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvcreate -T -L 28.5g stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Apr 29 18:51:56 devstack sudo[76149]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 18:51:57 devstack sudo[76149]: pam_unix(sudo:session): session closed for user root Apr 29 18:51:57 devstack cinder-volume[75577]: DEBUG oslo_concurrency.processutils [None req-108ed54b-9ee2-483e-ae17-f87d899e7dce None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvcreate -T -L 28.5g stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 1.068s {{(pid=75577) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 18:51:57 devstack cinder-volume[75577]: DEBUG oslo_concurrency.processutils [None req-108ed54b-9ee2-483e-ae17-f87d899e7dce None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=75577) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 18:51:57 devstack cinder-volume[75577]: DEBUG oslo_concurrency.processutils [None req-108ed54b-9ee2-483e-ae17-f87d899e7dce None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.026s {{(pid=75577) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 18:51:57 devstack cinder-volume[75577]: DEBUG oslo_concurrency.processutils [None req-108ed54b-9ee2-483e-ae17-f87d899e7dce None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf lvchange -a y --yes -K stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=75577) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 18:51:57 devstack sudo[76360]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf lvchange -a y --yes -K stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Apr 29 18:51:57 devstack sudo[76360]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 18:51:58 devstack sudo[76360]: pam_unix(sudo:session): session closed for user root Apr 29 18:51:58 devstack cinder-volume[75577]: DEBUG oslo_concurrency.processutils [None req-108ed54b-9ee2-483e-ae17-f87d899e7dce None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf lvchange -a y --yes -K stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.805s {{(pid=75577) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 18:51:58 devstack cinder-volume[75577]: DEBUG oslo_concurrency.processutils [None req-108ed54b-9ee2-483e-ae17-f87d899e7dce None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=75577) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 18:51:58 devstack cinder-volume[75577]: DEBUG oslo_concurrency.processutils [None req-108ed54b-9ee2-483e-ae17-f87d899e7dce None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.029s {{(pid=75577) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 18:51:58 devstack cinder-volume[75577]: DEBUG oslo_concurrency.processutils [None req-108ed54b-9ee2-483e-ae17-f87d899e7dce None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C pvs --noheadings --unit=g -o vg_name,name,size,free --separator | --nosuffix --ignoreskippedcluster {{(pid=75577) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 18:51:58 devstack sudo[76370]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C pvs --noheadings --unit=g -o vg_name,name,size,free --separator | --nosuffix --ignoreskippedcluster Apr 29 18:51:58 devstack sudo[76370]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 18:51:58 devstack sudo[76370]: pam_unix(sudo:session): session closed for user root Apr 29 18:51:58 devstack cinder-volume[75577]: DEBUG oslo_concurrency.processutils [None req-108ed54b-9ee2-483e-ae17-f87d899e7dce None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C pvs --noheadings --unit=g -o vg_name,name,size,free --separator | --nosuffix --ignoreskippedcluster" returned: 0 in 0.618s {{(pid=75577) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 18:51:58 devstack cinder-volume[75577]: DEBUG oslo_concurrency.processutils [None req-108ed54b-9ee2-483e-ae17-f87d899e7dce None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=75577) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 18:51:58 devstack sudo[76380]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Apr 29 18:51:58 devstack sudo[76380]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 18:51:59 devstack sudo[76380]: pam_unix(sudo:session): session closed for user root Apr 29 18:51:59 devstack cinder-volume[75577]: DEBUG oslo_concurrency.processutils [None req-108ed54b-9ee2-483e-ae17-f87d899e7dce None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.638s {{(pid=75577) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 18:51:59 devstack cinder-volume[75577]: DEBUG oslo_concurrency.processutils [None req-108ed54b-9ee2-483e-ae17-f87d899e7dce None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=75577) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 18:51:59 devstack sudo[76386]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Apr 29 18:51:59 devstack sudo[76386]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 18:52:00 devstack sudo[76386]: pam_unix(sudo:session): session closed for user root Apr 29 18:52:00 devstack cinder-volume[75577]: DEBUG oslo_concurrency.processutils [None req-108ed54b-9ee2-483e-ae17-f87d899e7dce None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.676s {{(pid=75577) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 18:52:00 devstack cinder-volume[75577]: DEBUG oslo_concurrency.processutils [None req-108ed54b-9ee2-483e-ae17-f87d899e7dce None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75577) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 18:52:00 devstack sudo[76391]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Apr 29 18:52:00 devstack sudo[76391]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 18:52:00 devstack sudo[76391]: pam_unix(sudo:session): session closed for user root Apr 29 18:52:00 devstack cinder-volume[75577]: DEBUG oslo_concurrency.processutils [None req-108ed54b-9ee2-483e-ae17-f87d899e7dce None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.688s {{(pid=75577) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 18:52:00 devstack cinder-volume[75577]: DEBUG oslo_concurrency.processutils [None req-108ed54b-9ee2-483e-ae17-f87d899e7dce None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=75577) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 18:52:00 devstack sudo[76396]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Apr 29 18:52:00 devstack sudo[76396]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 18:52:01 devstack sudo[76396]: pam_unix(sudo:session): session closed for user root Apr 29 18:52:01 devstack cinder-volume[75577]: DEBUG oslo_concurrency.processutils [None req-108ed54b-9ee2-483e-ae17-f87d899e7dce None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.830s {{(pid=75577) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 18:52:01 devstack cinder-volume[75577]: DEBUG oslo_concurrency.processutils [None req-108ed54b-9ee2-483e-ae17-f87d899e7dce None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=75577) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 18:52:01 devstack cinder-volume[75577]: DEBUG oslo_concurrency.processutils [None req-108ed54b-9ee2-483e-ae17-f87d899e7dce None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.016s {{(pid=75577) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 18:52:01 devstack cinder-volume[75577]: DEBUG oslo_concurrency.processutils [None req-108ed54b-9ee2-483e-ae17-f87d899e7dce None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=75577) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 18:52:01 devstack sudo[76405]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Apr 29 18:52:01 devstack sudo[76405]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 18:52:02 devstack sudo[76405]: pam_unix(sudo:session): session closed for user root Apr 29 18:52:02 devstack cinder-volume[75577]: DEBUG oslo_concurrency.processutils [None req-108ed54b-9ee2-483e-ae17-f87d899e7dce None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.938s {{(pid=75577) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 18:52:02 devstack cinder-volume[75577]: INFO cinder.volume.drivers.lvm [None req-108ed54b-9ee2-483e-ae17-f87d899e7dce None None] Enabling LVM thin provisioning by default because a thin pool exists. Apr 29 18:52:02 devstack cinder-volume[75577]: DEBUG oslo_concurrency.processutils [None req-108ed54b-9ee2-483e-ae17-f87d899e7dce None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=75577) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 18:52:02 devstack cinder-volume[75577]: DEBUG oslo_concurrency.processutils [None req-108ed54b-9ee2-483e-ae17-f87d899e7dce None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.018s {{(pid=75577) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 18:52:02 devstack cinder-volume[75577]: DEBUG oslo_concurrency.processutils [None req-108ed54b-9ee2-483e-ae17-f87d899e7dce None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=75577) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 18:52:02 devstack sudo[76416]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Apr 29 18:52:02 devstack sudo[76416]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 18:52:03 devstack sudo[76416]: pam_unix(sudo:session): session closed for user root Apr 29 18:52:03 devstack cinder-volume[75577]: DEBUG oslo_concurrency.processutils [None req-108ed54b-9ee2-483e-ae17-f87d899e7dce None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.705s {{(pid=75577) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 18:52:03 devstack cinder-volume[75577]: DEBUG cinder.volume.drivers.lvm [None req-108ed54b-9ee2-483e-ae17-f87d899e7dce None None] Updating volume stats {{(pid=75577) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:228}} Apr 29 18:52:03 devstack cinder-volume[75577]: DEBUG oslo_concurrency.processutils [None req-108ed54b-9ee2-483e-ae17-f87d899e7dce None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=75577) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 18:52:03 devstack sudo[76533]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Apr 29 18:52:03 devstack sudo[76533]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 18:52:03 devstack cinder-volume[75401]: DEBUG dbcounter [-] [75401] Writing DB stats cinder:SELECT=8,cinder:INSERT=1,cinder:UPDATE=1 {{(pid=75401) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Apr 29 18:52:04 devstack sudo[76533]: pam_unix(sudo:session): session closed for user root Apr 29 18:52:04 devstack cinder-volume[75577]: DEBUG oslo_concurrency.processutils [None req-108ed54b-9ee2-483e-ae17-f87d899e7dce None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.677s {{(pid=75577) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 18:52:04 devstack cinder-volume[75577]: DEBUG oslo_concurrency.processutils [None req-108ed54b-9ee2-483e-ae17-f87d899e7dce None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75577) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 18:52:04 devstack sudo[76674]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Apr 29 18:52:04 devstack sudo[76674]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 18:52:04 devstack sudo[76674]: pam_unix(sudo:session): session closed for user root Apr 29 18:52:04 devstack cinder-volume[75577]: DEBUG oslo_concurrency.processutils [None req-108ed54b-9ee2-483e-ae17-f87d899e7dce None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.638s {{(pid=75577) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 18:52:04 devstack cinder-volume[75577]: DEBUG oslo_concurrency.processutils [None req-108ed54b-9ee2-483e-ae17-f87d899e7dce None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=75577) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 18:52:04 devstack sudo[76678]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Apr 29 18:52:04 devstack sudo[76678]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 18:52:05 devstack sudo[76678]: pam_unix(sudo:session): session closed for user root Apr 29 18:52:05 devstack cinder-volume[75577]: DEBUG oslo_concurrency.processutils [None req-108ed54b-9ee2-483e-ae17-f87d899e7dce None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.672s {{(pid=75577) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 18:52:05 devstack cinder-volume[75577]: DEBUG oslo_concurrency.processutils [None req-108ed54b-9ee2-483e-ae17-f87d899e7dce None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75577) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 18:52:05 devstack sudo[76685]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Apr 29 18:52:05 devstack sudo[76685]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 18:52:05 devstack sudo[76685]: pam_unix(sudo:session): session closed for user root Apr 29 18:52:05 devstack cinder-volume[75577]: DEBUG oslo_concurrency.processutils [None req-108ed54b-9ee2-483e-ae17-f87d899e7dce None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.639s {{(pid=75577) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 18:52:05 devstack cinder-volume[75577]: INFO cinder.volume.driver [None req-108ed54b-9ee2-483e-ae17-f87d899e7dce None None] Driver hasn't implemented _init_vendor_properties() Apr 29 18:52:05 devstack cinder-volume[75577]: DEBUG cinder.volume.driver [None req-108ed54b-9ee2-483e-ae17-f87d899e7dce None None] Initialized capabilities list: {'volume_backend_name': 'lvmdriver-1', 'vendor_name': 'Open Source', 'driver_version': '3.0.0', 'storage_protocol': 'iSCSI', 'pools': [{'pool_name': 'lvmdriver-1', 'total_capacity_gb': 28.5, 'free_capacity_gb': 28.5, 'reserved_percentage': 0, 'location_info': 'LVMVolumeDriver:devstack:stack-volumes-lvmdriver-1:thin:0', 'QoS_support': False, 'provisioned_capacity_gb': 0.0, 'max_over_subscription_ratio': '20.0', 'thin_provisioning_support': True, 'thick_provisioning_support': False, 'total_volumes': 1, 'filter_function': None, 'goodness_function': None, 'multiattach': True, 'backend_state': 'up'}], 'shared_targets': False, 'sparse_copy_volume': True, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=75577) init_capabilities /opt/stack/cinder/cinder/volume/driver.py:873}} Apr 29 18:52:05 devstack cinder-volume[75577]: DEBUG oslo_db.sqlalchemy.engines [None req-108ed54b-9ee2-483e-ae17-f87d899e7dce None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=75577) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Apr 29 18:52:06 devstack cinder-volume[75577]: DEBUG dbcounter [-] [75577] Writer thread running {{(pid=75577) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}} Apr 29 18:52:06 devstack cinder-volume[75577]: DEBUG cinder.db.sqlalchemy.api [None req-108ed54b-9ee2-483e-ae17-f87d899e7dce None None] Building query based on filter {{(pid=75577) _process_snaps_filters /opt/stack/cinder/cinder/db/sqlalchemy/api.py:3943}} Apr 29 18:52:06 devstack cinder-volume[75577]: DEBUG cinder.image.image_utils [None req-108ed54b-9ee2-483e-ae17-f87d899e7dce None None] Configuration image_conversion_dir is None or the path doesn't exist. {{(pid=75577) cleanup_temporary_file /opt/stack/cinder/cinder/image/image_utils.py:1298}} Apr 29 18:52:06 devstack cinder-volume[75577]: INFO cinder.keymgr.migration [None req-84cbfc0c-2054-45ee-a5d3-8799e836bde2 None None] Not migrating encryption keys because the ConfKeyManager is still in use. Apr 29 18:52:06 devstack cinder-volume[75577]: DEBUG cinder.volume.drivers.lvm [None req-108ed54b-9ee2-483e-ae17-f87d899e7dce None None] Updating volume stats {{(pid=75577) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:228}} Apr 29 18:52:06 devstack cinder-volume[75577]: DEBUG oslo_concurrency.processutils [None req-108ed54b-9ee2-483e-ae17-f87d899e7dce None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=75577) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 18:52:06 devstack sudo[76689]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Apr 29 18:52:06 devstack sudo[76689]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 18:52:06 devstack sudo[76689]: pam_unix(sudo:session): session closed for user root Apr 29 18:52:06 devstack cinder-volume[75577]: DEBUG oslo_concurrency.processutils [None req-108ed54b-9ee2-483e-ae17-f87d899e7dce None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.605s {{(pid=75577) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 18:52:06 devstack cinder-volume[75577]: DEBUG oslo_concurrency.processutils [None req-108ed54b-9ee2-483e-ae17-f87d899e7dce None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75577) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 18:52:06 devstack sudo[76693]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Apr 29 18:52:06 devstack sudo[76693]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 18:52:07 devstack sudo[76693]: pam_unix(sudo:session): session closed for user root Apr 29 18:52:07 devstack cinder-volume[75577]: DEBUG oslo_concurrency.processutils [None req-108ed54b-9ee2-483e-ae17-f87d899e7dce None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.675s {{(pid=75577) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 18:52:07 devstack cinder-volume[75577]: DEBUG oslo_concurrency.processutils [None req-108ed54b-9ee2-483e-ae17-f87d899e7dce None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=75577) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 18:52:07 devstack sudo[76696]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Apr 29 18:52:07 devstack sudo[76696]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 18:52:07 devstack sudo[76696]: pam_unix(sudo:session): session closed for user root Apr 29 18:52:08 devstack cinder-volume[75577]: DEBUG oslo_concurrency.processutils [None req-108ed54b-9ee2-483e-ae17-f87d899e7dce None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.668s {{(pid=75577) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 18:52:08 devstack cinder-volume[75577]: DEBUG oslo_concurrency.processutils [None req-108ed54b-9ee2-483e-ae17-f87d899e7dce None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75577) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 18:52:08 devstack sudo[76704]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Apr 29 18:52:08 devstack sudo[76704]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 18:52:08 devstack sudo[76704]: pam_unix(sudo:session): session closed for user root Apr 29 18:52:08 devstack cinder-volume[75577]: DEBUG oslo_concurrency.processutils [None req-108ed54b-9ee2-483e-ae17-f87d899e7dce None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.631s {{(pid=75577) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 18:52:08 devstack cinder-volume[75577]: DEBUG cinder.manager [None req-108ed54b-9ee2-483e-ae17-f87d899e7dce None None] Notifying Schedulers of capabilities ... {{(pid=75577) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 29 18:52:08 devstack cinder-volume[75577]: INFO cinder.volume.manager [None req-108ed54b-9ee2-483e-ae17-f87d899e7dce None None] Driver initialization completed successfully. Apr 29 18:52:08 devstack cinder-volume[75577]: INFO cinder.manager [None req-108ed54b-9ee2-483e-ae17-f87d899e7dce None None] Initiating service 2 cleanup Apr 29 18:52:08 devstack cinder-volume[75577]: INFO cinder.manager [None req-108ed54b-9ee2-483e-ae17-f87d899e7dce None None] Service 2 cleanup completed. Apr 29 18:52:08 devstack cinder-volume[75577]: DEBUG cinder.service [None req-108ed54b-9ee2-483e-ae17-f87d899e7dce None None] Creating RPC server for service cinder-volume {{(pid=75577) start /opt/stack/cinder/cinder/service.py:231}} Apr 29 18:52:08 devstack cinder-volume[75577]: DEBUG cinder.service [None req-108ed54b-9ee2-483e-ae17-f87d899e7dce None None] Pinning object versions for RPC server serializer to 1.39 {{(pid=75577) start /opt/stack/cinder/cinder/service.py:237}} Apr 29 18:52:08 devstack cinder-volume[75577]: INFO cinder.volume.manager [None req-108ed54b-9ee2-483e-ae17-f87d899e7dce None None] Initializing RPC dependent components of volume driver LVMVolumeDriver (3.0.0) Apr 29 18:52:08 devstack cinder-volume[75577]: DEBUG cinder.volume.drivers.lvm [None req-108ed54b-9ee2-483e-ae17-f87d899e7dce None None] Updating volume stats {{(pid=75577) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:228}} Apr 29 18:52:08 devstack cinder-volume[75577]: DEBUG oslo_concurrency.processutils [None req-108ed54b-9ee2-483e-ae17-f87d899e7dce None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=75577) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 18:52:08 devstack sudo[76709]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Apr 29 18:52:08 devstack sudo[76709]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 18:52:09 devstack sudo[76709]: pam_unix(sudo:session): session closed for user root Apr 29 18:52:09 devstack cinder-volume[75577]: DEBUG oslo_concurrency.processutils [None req-108ed54b-9ee2-483e-ae17-f87d899e7dce None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.631s {{(pid=75577) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 18:52:09 devstack cinder-volume[75577]: DEBUG oslo_concurrency.processutils [None req-108ed54b-9ee2-483e-ae17-f87d899e7dce None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75577) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 18:52:09 devstack sudo[76713]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Apr 29 18:52:09 devstack sudo[76713]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 18:52:10 devstack sudo[76713]: pam_unix(sudo:session): session closed for user root Apr 29 18:52:10 devstack cinder-volume[75577]: DEBUG oslo_concurrency.processutils [None req-108ed54b-9ee2-483e-ae17-f87d899e7dce None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.619s {{(pid=75577) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 18:52:10 devstack cinder-volume[75577]: DEBUG oslo_concurrency.processutils [None req-108ed54b-9ee2-483e-ae17-f87d899e7dce None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=75577) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 18:52:10 devstack sudo[76731]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Apr 29 18:52:10 devstack sudo[76731]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 18:52:10 devstack sudo[76731]: pam_unix(sudo:session): session closed for user root Apr 29 18:52:10 devstack cinder-volume[75577]: DEBUG oslo_concurrency.processutils [None req-108ed54b-9ee2-483e-ae17-f87d899e7dce None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.585s {{(pid=75577) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 18:52:10 devstack cinder-volume[75577]: DEBUG oslo_concurrency.processutils [None req-108ed54b-9ee2-483e-ae17-f87d899e7dce None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75577) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 18:52:10 devstack sudo[76773]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Apr 29 18:52:10 devstack sudo[76773]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 18:52:11 devstack sudo[76773]: pam_unix(sudo:session): session closed for user root Apr 29 18:52:11 devstack cinder-volume[75577]: DEBUG oslo_concurrency.processutils [None req-108ed54b-9ee2-483e-ae17-f87d899e7dce None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.611s {{(pid=75577) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 18:52:11 devstack cinder-volume[75577]: INFO cinder.volume.manager [None req-108ed54b-9ee2-483e-ae17-f87d899e7dce None None] Driver post RPC initialization completed successfully. Apr 29 18:52:21 devstack cinder-volume[75577]: DEBUG dbcounter [-] [75577] Writing DB stats cinder:SELECT=4 {{(pid=75577) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Apr 29 18:52:21 devstack cinder-volume[75577]: DEBUG dbcounter [-] [75577] Writing DB stats cinder:SELECT=10,cinder:INSERT=1,cinder:UPDATE=2 {{(pid=75577) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Apr 29 18:53:03 devstack cinder-volume[75577]: DEBUG oslo_service.periodic_task [None req-acac24b6-cf27-4cfa-9bd0-cda7bff1e6e9 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=75577) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}} Apr 29 18:53:03 devstack cinder-volume[75577]: DEBUG cinder.volume.drivers.lvm [None req-acac24b6-cf27-4cfa-9bd0-cda7bff1e6e9 None None] Updating volume stats {{(pid=75577) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:228}} Apr 29 18:53:03 devstack cinder-volume[75577]: DEBUG oslo_concurrency.processutils [None req-acac24b6-cf27-4cfa-9bd0-cda7bff1e6e9 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=75577) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 18:53:03 devstack sudo[78412]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Apr 29 18:53:03 devstack sudo[78412]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 18:53:03 devstack sudo[78412]: pam_unix(sudo:session): session closed for user root Apr 29 18:53:03 devstack cinder-volume[75577]: DEBUG oslo_concurrency.processutils [None req-acac24b6-cf27-4cfa-9bd0-cda7bff1e6e9 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.644s {{(pid=75577) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 18:53:03 devstack cinder-volume[75577]: DEBUG oslo_concurrency.processutils [None req-acac24b6-cf27-4cfa-9bd0-cda7bff1e6e9 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75577) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 18:53:03 devstack sudo[78513]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Apr 29 18:53:03 devstack sudo[78513]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 18:53:04 devstack sudo[78513]: pam_unix(sudo:session): session closed for user root Apr 29 18:53:04 devstack cinder-volume[75577]: DEBUG oslo_concurrency.processutils [None req-acac24b6-cf27-4cfa-9bd0-cda7bff1e6e9 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.607s {{(pid=75577) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 18:53:04 devstack cinder-volume[75577]: DEBUG oslo_concurrency.processutils [None req-acac24b6-cf27-4cfa-9bd0-cda7bff1e6e9 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=75577) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 18:53:04 devstack sudo[78585]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Apr 29 18:53:04 devstack sudo[78585]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 18:53:05 devstack sudo[78585]: pam_unix(sudo:session): session closed for user root Apr 29 18:53:05 devstack cinder-volume[75577]: DEBUG oslo_concurrency.processutils [None req-acac24b6-cf27-4cfa-9bd0-cda7bff1e6e9 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.587s {{(pid=75577) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 18:53:05 devstack cinder-volume[75577]: DEBUG oslo_concurrency.processutils [None req-acac24b6-cf27-4cfa-9bd0-cda7bff1e6e9 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75577) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 18:53:05 devstack sudo[78631]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Apr 29 18:53:05 devstack sudo[78631]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 18:53:05 devstack sudo[78631]: pam_unix(sudo:session): session closed for user root Apr 29 18:53:05 devstack cinder-volume[75577]: DEBUG oslo_concurrency.processutils [None req-acac24b6-cf27-4cfa-9bd0-cda7bff1e6e9 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.610s {{(pid=75577) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 18:53:05 devstack cinder-volume[75577]: DEBUG cinder.manager [None req-acac24b6-cf27-4cfa-9bd0-cda7bff1e6e9 None None] Notifying Schedulers of capabilities ... {{(pid=75577) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 29 18:54:03 devstack cinder-volume[75577]: DEBUG oslo_service.periodic_task [None req-acac24b6-cf27-4cfa-9bd0-cda7bff1e6e9 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=75577) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}} Apr 29 18:54:03 devstack cinder-volume[75577]: DEBUG cinder.volume.drivers.lvm [None req-acac24b6-cf27-4cfa-9bd0-cda7bff1e6e9 None None] Updating volume stats {{(pid=75577) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:228}} Apr 29 18:54:03 devstack cinder-volume[75577]: DEBUG oslo_concurrency.processutils [None req-acac24b6-cf27-4cfa-9bd0-cda7bff1e6e9 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=75577) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 18:54:03 devstack sudo[81753]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Apr 29 18:54:03 devstack sudo[81753]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 18:54:03 devstack sudo[81753]: pam_unix(sudo:session): session closed for user root Apr 29 18:54:03 devstack cinder-volume[75577]: DEBUG oslo_concurrency.processutils [None req-acac24b6-cf27-4cfa-9bd0-cda7bff1e6e9 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.610s {{(pid=75577) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 18:54:03 devstack cinder-volume[75577]: DEBUG oslo_concurrency.processutils [None req-acac24b6-cf27-4cfa-9bd0-cda7bff1e6e9 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75577) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 18:54:03 devstack sudo[81772]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Apr 29 18:54:03 devstack sudo[81772]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 18:54:04 devstack sudo[81772]: pam_unix(sudo:session): session closed for user root Apr 29 18:54:04 devstack cinder-volume[75577]: DEBUG oslo_concurrency.processutils [None req-acac24b6-cf27-4cfa-9bd0-cda7bff1e6e9 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.575s {{(pid=75577) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 18:54:04 devstack cinder-volume[75577]: DEBUG oslo_concurrency.processutils [None req-acac24b6-cf27-4cfa-9bd0-cda7bff1e6e9 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=75577) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 18:54:04 devstack sudo[81775]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Apr 29 18:54:04 devstack sudo[81775]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 18:54:05 devstack sudo[81775]: pam_unix(sudo:session): session closed for user root Apr 29 18:54:05 devstack cinder-volume[75577]: DEBUG oslo_concurrency.processutils [None req-acac24b6-cf27-4cfa-9bd0-cda7bff1e6e9 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.584s {{(pid=75577) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 18:54:05 devstack cinder-volume[75577]: DEBUG oslo_concurrency.processutils [None req-acac24b6-cf27-4cfa-9bd0-cda7bff1e6e9 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75577) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 18:54:05 devstack sudo[81847]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Apr 29 18:54:05 devstack sudo[81847]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 18:54:05 devstack sudo[81847]: pam_unix(sudo:session): session closed for user root Apr 29 18:54:05 devstack cinder-volume[75577]: DEBUG oslo_concurrency.processutils [None req-acac24b6-cf27-4cfa-9bd0-cda7bff1e6e9 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.577s {{(pid=75577) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 18:54:05 devstack cinder-volume[75577]: DEBUG cinder.manager [None req-acac24b6-cf27-4cfa-9bd0-cda7bff1e6e9 None None] Notifying Schedulers of capabilities ... {{(pid=75577) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 29 18:54:21 devstack cinder-volume[75577]: DEBUG dbcounter [-] [75577] Writing DB stats cinder:SELECT=1 {{(pid=75577) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Apr 29 18:54:21 devstack cinder-volume[75577]: DEBUG dbcounter [-] [75577] Writing DB stats cinder:UPDATE=1 {{(pid=75577) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Apr 29 18:54:57 devstack cinder-volume[75401]: INFO oslo_service.backend._eventlet.service [None req-257b8688-1ced-4d58-89fa-f3dd3ebaf968 None None] Caught SIGTERM, stopping children Apr 29 18:54:57 devstack cinder-volume[75401]: DEBUG oslo_concurrency.lockutils [None req-257b8688-1ced-4d58-89fa-f3dd3ebaf968 None None] Acquiring lock "singleton_lock" {{(pid=75401) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:390}} Apr 29 18:54:57 devstack cinder-volume[75401]: DEBUG oslo_concurrency.lockutils [None req-257b8688-1ced-4d58-89fa-f3dd3ebaf968 None None] Acquired lock "singleton_lock" {{(pid=75401) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:393}} Apr 29 18:54:57 devstack cinder-volume[75401]: DEBUG oslo_concurrency.lockutils [None req-257b8688-1ced-4d58-89fa-f3dd3ebaf968 None None] Releasing lock "singleton_lock" {{(pid=75401) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:413}} Apr 29 18:54:57 devstack cinder-volume[75401]: DEBUG oslo_service.backend._eventlet.service [None req-257b8688-1ced-4d58-89fa-f3dd3ebaf968 None None] Stop services. {{(pid=75401) stop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:611}} Apr 29 18:54:57 devstack cinder-volume[75401]: DEBUG oslo_service.backend._eventlet.service [None req-257b8688-1ced-4d58-89fa-f3dd3ebaf968 None None] Killing children. {{(pid=75401) stop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:616}} Apr 29 18:54:57 devstack cinder-volume[75401]: INFO oslo_service.backend._eventlet.service [None req-257b8688-1ced-4d58-89fa-f3dd3ebaf968 None None] Waiting on 1 children to exit Apr 29 18:54:58 devstack cinder-volume[75577]: DEBUG oslo_concurrency.lockutils [None req-257b8688-1ced-4d58-89fa-f3dd3ebaf968 None None] Acquiring lock "singleton_lock" {{(pid=75577) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:390}} Apr 29 18:54:58 devstack cinder-volume[75577]: DEBUG oslo_concurrency.lockutils [None req-257b8688-1ced-4d58-89fa-f3dd3ebaf968 None None] Acquired lock "singleton_lock" {{(pid=75577) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:393}} Apr 29 18:54:58 devstack cinder-volume[75577]: DEBUG oslo_concurrency.lockutils [None req-257b8688-1ced-4d58-89fa-f3dd3ebaf968 None None] Releasing lock "singleton_lock" {{(pid=75577) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:413}} Apr 29 18:54:58 devstack cinder-volume[75577]: WARNING amqp [None req-257b8688-1ced-4d58-89fa-f3dd3ebaf968 None None] Received method (60, 30) during closing channel 1. This method will be ignored Apr 29 18:54:58 devstack cinder-volume[75577]: WARNING amqp [None req-257b8688-1ced-4d58-89fa-f3dd3ebaf968 None None] Received method (60, 30) during closing channel 1. This method will be ignored Apr 29 18:54:58 devstack cinder-volume[75401]: INFO oslo_service.backend._eventlet.service [None req-257b8688-1ced-4d58-89fa-f3dd3ebaf968 None None] Child 75577 exited with status 0 Apr 29 18:55:01 devstack cinder-volume[83263]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "singleton_lock" {{(pid=83263) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:390}} Apr 29 18:55:01 devstack cinder-volume[83263]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "singleton_lock" {{(pid=83263) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:393}} Apr 29 18:55:01 devstack cinder-volume[83263]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "singleton_lock" {{(pid=83263) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:413}} Apr 29 18:55:02 devstack cinder-volume[83263]: INFO dbcounter [None req-2bfcfe87-68cf-41a7-ba71-060aafe3ab31 None None] Registered counter for database cinder Apr 29 18:55:02 devstack cinder-volume[83263]: DEBUG oslo_db.sqlalchemy.engines [None req-2bfcfe87-68cf-41a7-ba71-060aafe3ab31 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=83263) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Apr 29 18:55:02 devstack cinder-volume[83263]: DEBUG dbcounter [-] [83263] Writer thread running {{(pid=83263) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}} Apr 29 18:55:02 devstack cinder-volume[83263]: INFO cinder.rpc [None req-2bfcfe87-68cf-41a7-ba71-060aafe3ab31 None None] Automatically selected cinder-scheduler objects version 1.39 as minimum service version. Apr 29 18:55:02 devstack cinder-volume[83263]: INFO cinder.rpc [None req-2bfcfe87-68cf-41a7-ba71-060aafe3ab31 None None] Automatically selected cinder-scheduler RPC version 3.12 as minimum service version. Apr 29 18:55:02 devstack cinder-volume[83263]: DEBUG oslo_db.sqlalchemy.engines [None req-2bfcfe87-68cf-41a7-ba71-060aafe3ab31 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=83263) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Apr 29 18:55:02 devstack cinder-volume[83263]: INFO cinder.volume.manager [None req-2bfcfe87-68cf-41a7-ba71-060aafe3ab31 None None] Determined volume DB was empty at startup. Apr 29 18:55:02 devstack cinder-volume[83263]: DEBUG cinder.volume.manager [None req-2bfcfe87-68cf-41a7-ba71-060aafe3ab31 None None] Cinder Volume DB check: vol_db_empty=True {{(pid=83263) __init__ /opt/stack/cinder/cinder/volume/manager.py:288}} Apr 29 18:55:02 devstack cinder-volume[83263]: INFO cinder.volume.manager [None req-2bfcfe87-68cf-41a7-ba71-060aafe3ab31 None None] Service not found for updating active_backend_id, assuming default for driver init. Apr 29 18:55:02 devstack cinder-volume[83263]: WARNING stevedore.named [None req-2bfcfe87-68cf-41a7-ba71-060aafe3ab31 None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Apr 29 18:55:02 devstack cinder-volume[83263]: WARNING castellan.key_manager [None req-2bfcfe87-68cf-41a7-ba71-060aafe3ab31 None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Apr 29 18:55:02 devstack cinder-volume[83263]: WARNING cinder.keymgr.conf_key_mgr [None req-2bfcfe87-68cf-41a7-ba71-060aafe3ab31 None None] This key manager is insecure and is not recommended for production deployments: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Apr 29 18:55:03 devstack cinder-volume[83263]: INFO cinder.volume.manager [None req-2bfcfe87-68cf-41a7-ba71-060aafe3ab31 None None] Image-volume cache disabled for host devstack@QuobyteHD. Apr 29 18:55:03 devstack cinder-volume[83263]: DEBUG oslo_db.sqlalchemy.engines [None req-2bfcfe87-68cf-41a7-ba71-060aafe3ab31 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=83263) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Apr 29 18:55:03 devstack cinder-volume[83263]: INFO oslo_service.backend._eventlet.service [None req-2bfcfe87-68cf-41a7-ba71-060aafe3ab31 None None] Starting 1 workers Apr 29 18:55:03 devstack cinder-volume[83263]: DEBUG oslo_service.backend._eventlet.service [None req-2bfcfe87-68cf-41a7-ba71-060aafe3ab31 None None] Started child 83881 {{(pid=83263) _start_child /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:491}} Apr 29 18:55:03 devstack cinder-volume[83263]: DEBUG oslo_service.backend._eventlet.service [None req-2bfcfe87-68cf-41a7-ba71-060aafe3ab31 None None] Full set of CONF: {{(pid=83263) wait /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:565}} Apr 29 18:55:03 devstack cinder-volume[83263]: DEBUG oslo_service.backend._eventlet.service [None req-2bfcfe87-68cf-41a7-ba71-060aafe3ab31 None None] ******************************************************************************** {{(pid=83263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2979}} Apr 29 18:55:03 devstack cinder-volume[83263]: DEBUG oslo_service.backend._eventlet.service [None req-2bfcfe87-68cf-41a7-ba71-060aafe3ab31 None None] Configuration options gathered from: {{(pid=83263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2980}} Apr 29 18:55:03 devstack cinder-volume[83263]: DEBUG oslo_service.backend._eventlet.service [None req-2bfcfe87-68cf-41a7-ba71-060aafe3ab31 None None] command line args: ['--config-file', '/etc/cinder/cinder.conf'] {{(pid=83263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2981}} Apr 29 18:55:03 devstack cinder-volume[83263]: DEBUG oslo_service.backend._eventlet.service [None req-2bfcfe87-68cf-41a7-ba71-060aafe3ab31 None None] config files: ['/etc/cinder/cinder.conf'] {{(pid=83263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2982}} Apr 29 18:55:03 devstack cinder-volume[83263]: DEBUG oslo_service.backend._eventlet.service [None req-2bfcfe87-68cf-41a7-ba71-060aafe3ab31 None None] ================================================================================ {{(pid=83263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2987}} Apr 29 18:55:03 devstack cinder-volume[83263]: DEBUG oslo_service.backend._eventlet.service [None req-2bfcfe87-68cf-41a7-ba71-060aafe3ab31 None None] allow_availability_zone_fallback = False {{(pid=83263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 18:55:03 devstack cinder-volume[83263]: DEBUG oslo_service.backend._eventlet.service [None req-2bfcfe87-68cf-41a7-ba71-060aafe3ab31 None None] allow_compression_on_image_upload = False {{(pid=83263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 18:55:03 devstack cinder-volume[83263]: DEBUG oslo_service.backend._eventlet.service [None req-2bfcfe87-68cf-41a7-ba71-060aafe3ab31 None None] allowed_direct_url_schemes = [] {{(pid=83263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 18:55:03 devstack cinder-volume[83263]: DEBUG oslo_service.backend._eventlet.service [None req-2bfcfe87-68cf-41a7-ba71-060aafe3ab31 None None] api_rate_limit = True {{(pid=83263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 18:55:03 devstack cinder-volume[83263]: DEBUG oslo_service.backend._eventlet.service [None req-2bfcfe87-68cf-41a7-ba71-060aafe3ab31 None None] auth_strategy = keystone {{(pid=83263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 18:55:03 devstack cinder-volume[83263]: DEBUG oslo_service.backend._eventlet.service [None req-2bfcfe87-68cf-41a7-ba71-060aafe3ab31 None None] backend_availability_zone = None {{(pid=83263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 18:55:03 devstack cinder-volume[83263]: DEBUG oslo_service.backend._eventlet.service [None req-2bfcfe87-68cf-41a7-ba71-060aafe3ab31 None None] backend_host = None {{(pid=83263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 18:55:03 devstack cinder-volume[83263]: DEBUG oslo_service.backend._eventlet.service [None req-2bfcfe87-68cf-41a7-ba71-060aafe3ab31 None None] backend_name = None {{(pid=83263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 18:55:03 devstack cinder-volume[83263]: DEBUG oslo_service.backend._eventlet.service [None req-2bfcfe87-68cf-41a7-ba71-060aafe3ab31 None None] backend_stats_polling_interval = 60 {{(pid=83263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 18:55:03 devstack cinder-volume[83263]: DEBUG oslo_service.backend._eventlet.service [None req-2bfcfe87-68cf-41a7-ba71-060aafe3ab31 None None] backup_api_class = cinder.backup.api.API {{(pid=83263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 18:55:03 devstack cinder-volume[83263]: DEBUG oslo_service.backend._eventlet.service [None req-2bfcfe87-68cf-41a7-ba71-060aafe3ab31 None None] backup_manager = cinder.backup.manager.BackupManager {{(pid=83263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 18:55:03 devstack cinder-volume[83263]: DEBUG oslo_service.backend._eventlet.service [None req-2bfcfe87-68cf-41a7-ba71-060aafe3ab31 None None] backup_name_template = backup-%s {{(pid=83263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 18:55:03 devstack cinder-volume[83263]: DEBUG oslo_service.backend._eventlet.service [None req-2bfcfe87-68cf-41a7-ba71-060aafe3ab31 None None] backup_use_same_host = False {{(pid=83263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 18:55:03 devstack cinder-volume[83263]: DEBUG oslo_service.backend._eventlet.service [None req-2bfcfe87-68cf-41a7-ba71-060aafe3ab31 None None] backup_use_temp_snapshot = False {{(pid=83263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 18:55:03 devstack cinder-volume[83263]: DEBUG oslo_service.backend._eventlet.service [None req-2bfcfe87-68cf-41a7-ba71-060aafe3ab31 None None] chap_password = **** {{(pid=83263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 18:55:03 devstack cinder-volume[83263]: DEBUG oslo_service.backend._eventlet.service [None req-2bfcfe87-68cf-41a7-ba71-060aafe3ab31 None None] chap_username = {{(pid=83263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 18:55:03 devstack cinder-volume[83263]: DEBUG oslo_service.backend._eventlet.service [None req-2bfcfe87-68cf-41a7-ba71-060aafe3ab31 None None] chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=83263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 18:55:03 devstack cinder-volume[83881]: INFO cinder.service [-] Starting cinder-volume node (version 28.0.0) Apr 29 18:55:03 devstack cinder-volume[83263]: DEBUG oslo_service.backend._eventlet.service [None req-2bfcfe87-68cf-41a7-ba71-060aafe3ab31 None None] cinder_internal_tenant_project_id = dece91964b24460f8d24561836f27c9f {{(pid=83263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 18:55:03 devstack cinder-volume[83263]: DEBUG oslo_service.backend._eventlet.service [None req-2bfcfe87-68cf-41a7-ba71-060aafe3ab31 None None] cinder_internal_tenant_user_id = 029d4e2c59b444a59d4282ffce967113 {{(pid=83263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 18:55:03 devstack cinder-volume[83263]: DEBUG oslo_service.backend._eventlet.service [None req-2bfcfe87-68cf-41a7-ba71-060aafe3ab31 None None] cluster = None {{(pid=83263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 18:55:03 devstack cinder-volume[83263]: DEBUG oslo_service.backend._eventlet.service [None req-2bfcfe87-68cf-41a7-ba71-060aafe3ab31 None None] compression_format = gzip {{(pid=83263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 18:55:03 devstack cinder-volume[83263]: DEBUG oslo_service.backend._eventlet.service [None req-2bfcfe87-68cf-41a7-ba71-060aafe3ab31 None None] compute_api_class = cinder.compute.nova.API {{(pid=83263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 18:55:03 devstack cinder-volume[83263]: DEBUG oslo_service.backend._eventlet.service [None req-2bfcfe87-68cf-41a7-ba71-060aafe3ab31 None None] config_dir = [] {{(pid=83263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 18:55:03 devstack cinder-volume[83263]: DEBUG oslo_service.backend._eventlet.service [None req-2bfcfe87-68cf-41a7-ba71-060aafe3ab31 None None] config_file = ['/etc/cinder/cinder.conf'] {{(pid=83263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 18:55:03 devstack cinder-volume[83263]: DEBUG oslo_service.backend._eventlet.service [None req-2bfcfe87-68cf-41a7-ba71-060aafe3ab31 None None] config_source = [] {{(pid=83263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 18:55:03 devstack cinder-volume[83263]: DEBUG oslo_service.backend._eventlet.service [None req-2bfcfe87-68cf-41a7-ba71-060aafe3ab31 None None] consistencygroup_api_class = cinder.consistencygroup.api.API {{(pid=83263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 18:55:03 devstack cinder-volume[83263]: DEBUG oslo_service.backend._eventlet.service [None req-2bfcfe87-68cf-41a7-ba71-060aafe3ab31 None None] control_exchange = openstack {{(pid=83263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 18:55:03 devstack cinder-volume[83263]: DEBUG oslo_service.backend._eventlet.service [None req-2bfcfe87-68cf-41a7-ba71-060aafe3ab31 None None] debug = True {{(pid=83263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 18:55:03 devstack cinder-volume[83263]: DEBUG oslo_service.backend._eventlet.service [None req-2bfcfe87-68cf-41a7-ba71-060aafe3ab31 None None] default_availability_zone = None {{(pid=83263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 18:55:03 devstack cinder-volume[83263]: DEBUG oslo_service.backend._eventlet.service [None req-2bfcfe87-68cf-41a7-ba71-060aafe3ab31 None None] default_group_type = None {{(pid=83263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 18:55:03 devstack cinder-volume[83263]: DEBUG oslo_service.backend._eventlet.service [None req-2bfcfe87-68cf-41a7-ba71-060aafe3ab31 None None] default_log_levels = ['amqp=WARN', 'boto=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO'] {{(pid=83263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 18:55:03 devstack cinder-volume[83263]: DEBUG oslo_service.backend._eventlet.service [None req-2bfcfe87-68cf-41a7-ba71-060aafe3ab31 None None] default_volume_type = QuobyteHD {{(pid=83263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 18:55:03 devstack cinder-volume[83263]: DEBUG oslo_service.backend._eventlet.service [None req-2bfcfe87-68cf-41a7-ba71-060aafe3ab31 None None] disk_geometry = None {{(pid=83263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 18:55:03 devstack cinder-volume[83263]: DEBUG oslo_service.backend._eventlet.service [None req-2bfcfe87-68cf-41a7-ba71-060aafe3ab31 None None] driver_client_cert = None {{(pid=83263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 18:55:03 devstack cinder-volume[83263]: DEBUG oslo_service.backend._eventlet.service [None req-2bfcfe87-68cf-41a7-ba71-060aafe3ab31 None None] driver_client_cert_key = None {{(pid=83263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 18:55:03 devstack cinder-volume[83263]: DEBUG oslo_service.backend._eventlet.service [None req-2bfcfe87-68cf-41a7-ba71-060aafe3ab31 None None] driver_data_namespace = None {{(pid=83263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 18:55:03 devstack cinder-volume[83263]: DEBUG oslo_service.backend._eventlet.service [None req-2bfcfe87-68cf-41a7-ba71-060aafe3ab31 None None] driver_ssl_cert_path = None {{(pid=83263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 18:55:03 devstack cinder-volume[83263]: DEBUG oslo_service.backend._eventlet.service [None req-2bfcfe87-68cf-41a7-ba71-060aafe3ab31 None None] driver_ssl_cert_verify = False {{(pid=83263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 18:55:03 devstack cinder-volume[83263]: DEBUG oslo_service.backend._eventlet.service [None req-2bfcfe87-68cf-41a7-ba71-060aafe3ab31 None None] driver_use_ssl = False {{(pid=83263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 18:55:03 devstack cinder-volume[83263]: DEBUG oslo_service.backend._eventlet.service [None req-2bfcfe87-68cf-41a7-ba71-060aafe3ab31 None None] enable_new_services = True {{(pid=83263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 18:55:03 devstack cinder-volume[83263]: DEBUG oslo_service.backend._eventlet.service [None req-2bfcfe87-68cf-41a7-ba71-060aafe3ab31 None None] enable_unsupported_driver = False {{(pid=83263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 18:55:03 devstack cinder-volume[83263]: DEBUG oslo_service.backend._eventlet.service [None req-2bfcfe87-68cf-41a7-ba71-060aafe3ab31 None None] enabled_backends = ['QuobyteHD'] {{(pid=83263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 18:55:03 devstack cinder-volume[83263]: DEBUG oslo_service.backend._eventlet.service [None req-2bfcfe87-68cf-41a7-ba71-060aafe3ab31 None None] enforce_multipath_for_image_xfer = False {{(pid=83263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 18:55:03 devstack cinder-volume[83263]: DEBUG oslo_service.backend._eventlet.service [None req-2bfcfe87-68cf-41a7-ba71-060aafe3ab31 None None] filter_function = None {{(pid=83263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 18:55:03 devstack cinder-volume[83263]: DEBUG oslo_service.backend._eventlet.service [None req-2bfcfe87-68cf-41a7-ba71-060aafe3ab31 None None] glance_api_insecure = False {{(pid=83263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 18:55:03 devstack cinder-volume[83263]: DEBUG oslo_service.backend._eventlet.service [None req-2bfcfe87-68cf-41a7-ba71-060aafe3ab31 None None] glance_api_servers = ['http://192.168.122.135/image'] {{(pid=83263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 18:55:03 devstack cinder-volume[83263]: DEBUG oslo_service.backend._eventlet.service [None req-2bfcfe87-68cf-41a7-ba71-060aafe3ab31 None None] glance_api_ssl_compression = False {{(pid=83263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 18:55:03 devstack cinder-volume[83263]: DEBUG oslo_service.backend._eventlet.service [None req-2bfcfe87-68cf-41a7-ba71-060aafe3ab31 None None] glance_ca_certificates_file = None {{(pid=83263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 18:55:03 devstack cinder-volume[83263]: DEBUG oslo_service.backend._eventlet.service [None req-2bfcfe87-68cf-41a7-ba71-060aafe3ab31 None None] glance_catalog_info = image:glance:publicURL {{(pid=83263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 18:55:03 devstack cinder-volume[83263]: DEBUG oslo_service.backend._eventlet.service [None req-2bfcfe87-68cf-41a7-ba71-060aafe3ab31 None None] glance_certfile = None {{(pid=83263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 18:55:03 devstack cinder-volume[83263]: DEBUG oslo_service.backend._eventlet.service [None req-2bfcfe87-68cf-41a7-ba71-060aafe3ab31 None None] glance_core_properties = ['checksum', 'container_format', 'disk_format', 'image_name', 'image_id', 'min_disk', 'min_ram', 'name', 'size'] {{(pid=83263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 18:55:03 devstack cinder-volume[83263]: DEBUG oslo_service.backend._eventlet.service [None req-2bfcfe87-68cf-41a7-ba71-060aafe3ab31 None None] glance_keyfile = None {{(pid=83263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 18:55:03 devstack cinder-volume[83263]: DEBUG oslo_service.backend._eventlet.service [None req-2bfcfe87-68cf-41a7-ba71-060aafe3ab31 None None] glance_num_retries = 3 {{(pid=83263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 18:55:03 devstack cinder-volume[83263]: DEBUG oslo_service.backend._eventlet.service [None req-2bfcfe87-68cf-41a7-ba71-060aafe3ab31 None None] glance_request_timeout = None {{(pid=83263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 18:55:03 devstack cinder-volume[83263]: DEBUG oslo_service.backend._eventlet.service [None req-2bfcfe87-68cf-41a7-ba71-060aafe3ab31 None None] goodness_function = None {{(pid=83263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 18:55:03 devstack cinder-volume[83263]: DEBUG oslo_service.backend._eventlet.service [None req-2bfcfe87-68cf-41a7-ba71-060aafe3ab31 None None] graceful_shutdown_timeout = 5 {{(pid=83263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 18:55:03 devstack cinder-volume[83263]: DEBUG oslo_service.backend._eventlet.service [None req-2bfcfe87-68cf-41a7-ba71-060aafe3ab31 None None] group_api_class = cinder.group.api.API {{(pid=83263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 18:55:03 devstack cinder-volume[83263]: DEBUG oslo_service.backend._eventlet.service [None req-2bfcfe87-68cf-41a7-ba71-060aafe3ab31 None None] host = devstack {{(pid=83263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 18:55:03 devstack cinder-volume[83263]: DEBUG oslo_service.backend._eventlet.service [None req-2bfcfe87-68cf-41a7-ba71-060aafe3ab31 None None] image_compress_on_upload = True {{(pid=83263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 18:55:03 devstack cinder-volume[83263]: DEBUG oslo_service.backend._eventlet.service [None req-2bfcfe87-68cf-41a7-ba71-060aafe3ab31 None None] image_conversion_address_space_limit = 1 {{(pid=83263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 18:55:03 devstack cinder-volume[83263]: DEBUG oslo_service.backend._eventlet.service [None req-2bfcfe87-68cf-41a7-ba71-060aafe3ab31 None None] image_conversion_cpu_limit = 60 {{(pid=83263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 18:55:03 devstack cinder-volume[83263]: DEBUG oslo_service.backend._eventlet.service [None req-2bfcfe87-68cf-41a7-ba71-060aafe3ab31 None None] image_conversion_dir = /opt/stack/data/cinder/conversion {{(pid=83263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 18:55:03 devstack cinder-volume[83263]: DEBUG oslo_service.backend._eventlet.service [None req-2bfcfe87-68cf-41a7-ba71-060aafe3ab31 None None] image_conversion_disable = False {{(pid=83263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 18:55:03 devstack cinder-volume[83263]: DEBUG oslo_service.backend._eventlet.service [None req-2bfcfe87-68cf-41a7-ba71-060aafe3ab31 None None] image_upload_use_cinder_backend = False {{(pid=83263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 18:55:03 devstack cinder-volume[83263]: DEBUG oslo_service.backend._eventlet.service [None req-2bfcfe87-68cf-41a7-ba71-060aafe3ab31 None None] image_upload_use_internal_tenant = False {{(pid=83263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 18:55:03 devstack cinder-volume[83263]: DEBUG oslo_service.backend._eventlet.service [None req-2bfcfe87-68cf-41a7-ba71-060aafe3ab31 None None] image_volume_cache_enabled = False {{(pid=83263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 18:55:03 devstack cinder-volume[83263]: DEBUG oslo_service.backend._eventlet.service [None req-2bfcfe87-68cf-41a7-ba71-060aafe3ab31 None None] image_volume_cache_max_count = 0 {{(pid=83263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 18:55:03 devstack cinder-volume[83263]: DEBUG oslo_service.backend._eventlet.service [None req-2bfcfe87-68cf-41a7-ba71-060aafe3ab31 None None] image_volume_cache_max_size_gb = 0 {{(pid=83263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 18:55:03 devstack cinder-volume[83263]: DEBUG oslo_service.backend._eventlet.service [None req-2bfcfe87-68cf-41a7-ba71-060aafe3ab31 None None] init_host_max_objects_retrieval = 0 {{(pid=83263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 18:55:03 devstack cinder-volume[83263]: DEBUG oslo_service.backend._eventlet.service [None req-2bfcfe87-68cf-41a7-ba71-060aafe3ab31 None None] instance_format = [instance: %(uuid)s] {{(pid=83263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 18:55:03 devstack cinder-volume[83263]: DEBUG oslo_service.backend._eventlet.service [None req-2bfcfe87-68cf-41a7-ba71-060aafe3ab31 None None] instance_uuid_format = [instance: %(uuid)s] {{(pid=83263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 18:55:03 devstack cinder-volume[83263]: DEBUG oslo_service.backend._eventlet.service [None req-2bfcfe87-68cf-41a7-ba71-060aafe3ab31 None None] iscsi_target_flags = {{(pid=83263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 18:55:03 devstack cinder-volume[83263]: DEBUG oslo_service.backend._eventlet.service [None req-2bfcfe87-68cf-41a7-ba71-060aafe3ab31 None None] iscsi_write_cache = on {{(pid=83263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 18:55:03 devstack cinder-volume[83263]: DEBUG oslo_service.backend._eventlet.service [None req-2bfcfe87-68cf-41a7-ba71-060aafe3ab31 None None] iser_helper = tgtadm {{(pid=83263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 18:55:03 devstack cinder-volume[83263]: DEBUG oslo_service.backend._eventlet.service [None req-2bfcfe87-68cf-41a7-ba71-060aafe3ab31 None None] iser_ip_address = 192.168.122.135 {{(pid=83263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 18:55:03 devstack cinder-volume[83263]: DEBUG oslo_service.backend._eventlet.service [None req-2bfcfe87-68cf-41a7-ba71-060aafe3ab31 None None] iser_port = 3260 {{(pid=83263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 18:55:03 devstack cinder-volume[83263]: DEBUG oslo_service.backend._eventlet.service [None req-2bfcfe87-68cf-41a7-ba71-060aafe3ab31 None None] iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=83263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 18:55:03 devstack cinder-volume[83263]: DEBUG oslo_service.backend._eventlet.service [None req-2bfcfe87-68cf-41a7-ba71-060aafe3ab31 None None] log_color = False {{(pid=83263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 18:55:03 devstack cinder-volume[83263]: DEBUG oslo_service.backend._eventlet.service [None req-2bfcfe87-68cf-41a7-ba71-060aafe3ab31 None None] log_config_append = None {{(pid=83263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 18:55:03 devstack cinder-volume[83263]: DEBUG oslo_service.backend._eventlet.service [None req-2bfcfe87-68cf-41a7-ba71-060aafe3ab31 None None] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=83263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 18:55:03 devstack cinder-volume[83263]: DEBUG oslo_service.backend._eventlet.service [None req-2bfcfe87-68cf-41a7-ba71-060aafe3ab31 None None] log_dir = None {{(pid=83263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 18:55:03 devstack cinder-volume[83263]: DEBUG oslo_service.backend._eventlet.service [None req-2bfcfe87-68cf-41a7-ba71-060aafe3ab31 None None] log_file = None {{(pid=83263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 18:55:03 devstack cinder-volume[83263]: DEBUG oslo_service.backend._eventlet.service [None req-2bfcfe87-68cf-41a7-ba71-060aafe3ab31 None None] log_options = True {{(pid=83263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 18:55:03 devstack cinder-volume[83263]: DEBUG oslo_service.backend._eventlet.service [None req-2bfcfe87-68cf-41a7-ba71-060aafe3ab31 None None] log_rotate_interval = 1 {{(pid=83263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 18:55:03 devstack cinder-volume[83263]: DEBUG oslo_service.backend._eventlet.service [None req-2bfcfe87-68cf-41a7-ba71-060aafe3ab31 None None] log_rotate_interval_type = days {{(pid=83263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 18:55:03 devstack cinder-volume[83263]: DEBUG oslo_service.backend._eventlet.service [None req-2bfcfe87-68cf-41a7-ba71-060aafe3ab31 None None] log_rotation_type = none {{(pid=83263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 18:55:03 devstack cinder-volume[83263]: DEBUG oslo_service.backend._eventlet.service [None req-2bfcfe87-68cf-41a7-ba71-060aafe3ab31 None None] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=83263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 18:55:03 devstack cinder-volume[83263]: DEBUG oslo_service.backend._eventlet.service [None req-2bfcfe87-68cf-41a7-ba71-060aafe3ab31 None None] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=83263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 18:55:03 devstack cinder-volume[83263]: DEBUG oslo_service.backend._eventlet.service [None req-2bfcfe87-68cf-41a7-ba71-060aafe3ab31 None None] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=83263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 18:55:03 devstack cinder-volume[83263]: DEBUG oslo_service.backend._eventlet.service [None req-2bfcfe87-68cf-41a7-ba71-060aafe3ab31 None None] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=83263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 18:55:03 devstack cinder-volume[83263]: DEBUG oslo_service.backend._eventlet.service [None req-2bfcfe87-68cf-41a7-ba71-060aafe3ab31 None None] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=83263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 18:55:03 devstack cinder-volume[83263]: DEBUG oslo_service.backend._eventlet.service [None req-2bfcfe87-68cf-41a7-ba71-060aafe3ab31 None None] max_age = 0 {{(pid=83263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 18:55:03 devstack cinder-volume[83263]: DEBUG oslo_service.backend._eventlet.service [None req-2bfcfe87-68cf-41a7-ba71-060aafe3ab31 None None] max_logfile_count = 30 {{(pid=83263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 18:55:03 devstack cinder-volume[83263]: DEBUG oslo_service.backend._eventlet.service [None req-2bfcfe87-68cf-41a7-ba71-060aafe3ab31 None None] max_logfile_size_mb = 200 {{(pid=83263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 18:55:03 devstack cinder-volume[83263]: DEBUG oslo_service.backend._eventlet.service [None req-2bfcfe87-68cf-41a7-ba71-060aafe3ab31 None None] max_over_subscription_ratio = 20.0 {{(pid=83263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 18:55:03 devstack cinder-volume[83263]: DEBUG oslo_service.backend._eventlet.service [None req-2bfcfe87-68cf-41a7-ba71-060aafe3ab31 None None] message_reap_interval = 86400 {{(pid=83263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 18:55:03 devstack cinder-volume[83263]: DEBUG oslo_service.backend._eventlet.service [None req-2bfcfe87-68cf-41a7-ba71-060aafe3ab31 None None] message_ttl = 2592000 {{(pid=83263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 18:55:03 devstack cinder-volume[83263]: DEBUG oslo_service.backend._eventlet.service [None req-2bfcfe87-68cf-41a7-ba71-060aafe3ab31 None None] migration_create_volume_timeout_secs = 300 {{(pid=83263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 18:55:03 devstack cinder-volume[83263]: DEBUG oslo_service.backend._eventlet.service [None req-2bfcfe87-68cf-41a7-ba71-060aafe3ab31 None None] monkey_patch = False {{(pid=83263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 18:55:03 devstack cinder-volume[83263]: DEBUG oslo_service.backend._eventlet.service [None req-2bfcfe87-68cf-41a7-ba71-060aafe3ab31 None None] monkey_patch_modules = [] {{(pid=83263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 18:55:03 devstack cinder-volume[83263]: DEBUG oslo_service.backend._eventlet.service [None req-2bfcfe87-68cf-41a7-ba71-060aafe3ab31 None None] my_ip = 192.168.122.135 {{(pid=83263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 18:55:03 devstack cinder-volume[83263]: DEBUG oslo_service.backend._eventlet.service [None req-2bfcfe87-68cf-41a7-ba71-060aafe3ab31 None None] no_snapshot_gb_quota = False {{(pid=83263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 18:55:03 devstack cinder-volume[83263]: DEBUG oslo_service.backend._eventlet.service [None req-2bfcfe87-68cf-41a7-ba71-060aafe3ab31 None None] num_iser_scan_tries = 3 {{(pid=83263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 18:55:03 devstack cinder-volume[83263]: DEBUG oslo_service.backend._eventlet.service [None req-2bfcfe87-68cf-41a7-ba71-060aafe3ab31 None None] num_shell_tries = 3 {{(pid=83263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 18:55:03 devstack cinder-volume[83263]: DEBUG oslo_service.backend._eventlet.service [None req-2bfcfe87-68cf-41a7-ba71-060aafe3ab31 None None] num_volume_device_scan_tries = 3 {{(pid=83263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 18:55:03 devstack cinder-volume[83263]: DEBUG oslo_service.backend._eventlet.service [None req-2bfcfe87-68cf-41a7-ba71-060aafe3ab31 None None] nvmeof_conn_info_version = 1 {{(pid=83263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 18:55:03 devstack cinder-volume[83263]: DEBUG oslo_service.backend._eventlet.service [None req-2bfcfe87-68cf-41a7-ba71-060aafe3ab31 None None] nvmet_ns_id = 10 {{(pid=83263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 18:55:03 devstack cinder-volume[83263]: DEBUG oslo_service.backend._eventlet.service [None req-2bfcfe87-68cf-41a7-ba71-060aafe3ab31 None None] nvmet_port_id = 1 {{(pid=83263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 18:55:03 devstack cinder-volume[83263]: DEBUG oslo_service.backend._eventlet.service [None req-2bfcfe87-68cf-41a7-ba71-060aafe3ab31 None None] osapi_max_limit = 1000 {{(pid=83263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 18:55:03 devstack cinder-volume[83263]: DEBUG oslo_service.backend._eventlet.service [None req-2bfcfe87-68cf-41a7-ba71-060aafe3ab31 None None] osapi_volume_ext_list = [] {{(pid=83263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 18:55:03 devstack cinder-volume[83263]: DEBUG oslo_service.backend._eventlet.service [None req-2bfcfe87-68cf-41a7-ba71-060aafe3ab31 None None] osapi_volume_extension = ['cinder.api.contrib.standard_extensions'] {{(pid=83263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 18:55:03 devstack cinder-volume[83263]: DEBUG oslo_service.backend._eventlet.service [None req-2bfcfe87-68cf-41a7-ba71-060aafe3ab31 None None] osapi_volume_listen = 0.0.0.0 {{(pid=83263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 18:55:03 devstack cinder-volume[83263]: DEBUG oslo_service.backend._eventlet.service [None req-2bfcfe87-68cf-41a7-ba71-060aafe3ab31 None None] osapi_volume_listen_port = 8776 {{(pid=83263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 18:55:03 devstack cinder-volume[83263]: DEBUG oslo_service.backend._eventlet.service [None req-2bfcfe87-68cf-41a7-ba71-060aafe3ab31 None None] osapi_volume_use_ssl = False {{(pid=83263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 18:55:03 devstack cinder-volume[83263]: DEBUG oslo_service.backend._eventlet.service [None req-2bfcfe87-68cf-41a7-ba71-060aafe3ab31 None None] osapi_volume_workers = 2 {{(pid=83263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 18:55:03 devstack cinder-volume[83263]: DEBUG oslo_service.backend._eventlet.service [None req-2bfcfe87-68cf-41a7-ba71-060aafe3ab31 None None] per_volume_size_limit = -1 {{(pid=83263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 18:55:03 devstack cinder-volume[83263]: DEBUG oslo_service.backend._eventlet.service [None req-2bfcfe87-68cf-41a7-ba71-060aafe3ab31 None None] periodic_fuzzy_delay = 60 {{(pid=83263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 18:55:03 devstack cinder-volume[83263]: DEBUG oslo_service.backend._eventlet.service [None req-2bfcfe87-68cf-41a7-ba71-060aafe3ab31 None None] periodic_interval = 60 {{(pid=83263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 18:55:03 devstack cinder-volume[83263]: DEBUG oslo_service.backend._eventlet.service [None req-2bfcfe87-68cf-41a7-ba71-060aafe3ab31 None None] project_id_regex = [0-9a-f\-]+ {{(pid=83263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 18:55:03 devstack cinder-volume[83263]: DEBUG oslo_service.backend._eventlet.service [None req-2bfcfe87-68cf-41a7-ba71-060aafe3ab31 None None] public_endpoint = None {{(pid=83263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 18:55:03 devstack cinder-volume[83263]: DEBUG oslo_service.backend._eventlet.service [None req-2bfcfe87-68cf-41a7-ba71-060aafe3ab31 None None] publish_errors = False {{(pid=83263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 18:55:03 devstack cinder-volume[83881]: INFO cinder.volume.manager [None req-0cd58edc-a702-49db-9c33-bc324ffadc9c None None] Starting volume driver QuobyteDriver (1.1.14) Apr 29 18:55:03 devstack cinder-volume[83881]: DEBUG cinder.volume.drivers.remotefs [None req-0cd58edc-a702-49db-9c33-bc324ffadc9c None None] NAS config: {'nas_secure_file_permissions': 'false', 'nas_secure_file_operations': 'false'} {{(pid=83881) do_setup /opt/stack/cinder/cinder/volume/drivers/remotefs.py:225}} Apr 29 18:55:03 devstack cinder-volume[83263]: DEBUG oslo_service.backend._eventlet.service [None req-2bfcfe87-68cf-41a7-ba71-060aafe3ab31 None None] quota_backup_gigabytes = 1000 {{(pid=83263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 18:55:03 devstack cinder-volume[83263]: DEBUG oslo_service.backend._eventlet.service [None req-2bfcfe87-68cf-41a7-ba71-060aafe3ab31 None None] quota_backups = 10 {{(pid=83263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 18:55:03 devstack cinder-volume[83263]: DEBUG oslo_service.backend._eventlet.service [None req-2bfcfe87-68cf-41a7-ba71-060aafe3ab31 None None] quota_driver = cinder.quota.DbQuotaDriver {{(pid=83263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 18:55:03 devstack cinder-volume[83263]: DEBUG oslo_service.backend._eventlet.service [None req-2bfcfe87-68cf-41a7-ba71-060aafe3ab31 None None] quota_gigabytes = 1000 {{(pid=83263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 18:55:03 devstack cinder-volume[83263]: DEBUG oslo_service.backend._eventlet.service [None req-2bfcfe87-68cf-41a7-ba71-060aafe3ab31 None None] quota_groups = 10 {{(pid=83263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 18:55:03 devstack cinder-volume[83263]: DEBUG oslo_service.backend._eventlet.service [None req-2bfcfe87-68cf-41a7-ba71-060aafe3ab31 None None] quota_snapshots = 10 {{(pid=83263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 18:55:03 devstack cinder-volume[83263]: DEBUG oslo_service.backend._eventlet.service [None req-2bfcfe87-68cf-41a7-ba71-060aafe3ab31 None None] quota_volumes = 10 {{(pid=83263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 18:55:03 devstack cinder-volume[83263]: DEBUG oslo_service.backend._eventlet.service [None req-2bfcfe87-68cf-41a7-ba71-060aafe3ab31 None None] rate_limit_burst = 0 {{(pid=83263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 18:55:03 devstack cinder-volume[83263]: DEBUG oslo_service.backend._eventlet.service [None req-2bfcfe87-68cf-41a7-ba71-060aafe3ab31 None None] rate_limit_except_level = CRITICAL {{(pid=83263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 18:55:03 devstack cinder-volume[83263]: DEBUG oslo_service.backend._eventlet.service [None req-2bfcfe87-68cf-41a7-ba71-060aafe3ab31 None None] rate_limit_interval = 0 {{(pid=83263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 18:55:03 devstack cinder-volume[83263]: DEBUG oslo_service.backend._eventlet.service [None req-2bfcfe87-68cf-41a7-ba71-060aafe3ab31 None None] reinit_driver_count = 3 {{(pid=83263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 18:55:03 devstack cinder-volume[83263]: DEBUG oslo_service.backend._eventlet.service [None req-2bfcfe87-68cf-41a7-ba71-060aafe3ab31 None None] replication_device = **** {{(pid=83263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 18:55:03 devstack cinder-volume[83263]: DEBUG oslo_service.backend._eventlet.service [None req-2bfcfe87-68cf-41a7-ba71-060aafe3ab31 None None] report_discard_supported = False {{(pid=83263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 18:55:03 devstack cinder-volume[83263]: DEBUG oslo_service.backend._eventlet.service [None req-2bfcfe87-68cf-41a7-ba71-060aafe3ab31 None None] report_interval = 120 {{(pid=83263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 18:55:03 devstack cinder-volume[83263]: DEBUG oslo_service.backend._eventlet.service [None req-2bfcfe87-68cf-41a7-ba71-060aafe3ab31 None None] reservation_clean_interval = 86400 {{(pid=83263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 18:55:03 devstack cinder-volume[83263]: DEBUG oslo_service.backend._eventlet.service [None req-2bfcfe87-68cf-41a7-ba71-060aafe3ab31 None None] reservation_expire = 86400 {{(pid=83263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 18:55:03 devstack cinder-volume[83263]: DEBUG oslo_service.backend._eventlet.service [None req-2bfcfe87-68cf-41a7-ba71-060aafe3ab31 None None] reserved_image_namespaces = [] {{(pid=83263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 18:55:03 devstack cinder-volume[83263]: DEBUG oslo_service.backend._eventlet.service [None req-2bfcfe87-68cf-41a7-ba71-060aafe3ab31 None None] reserved_percentage = 0 {{(pid=83263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 18:55:03 devstack cinder-volume[83263]: DEBUG oslo_service.backend._eventlet.service [None req-2bfcfe87-68cf-41a7-ba71-060aafe3ab31 None None] resource_query_filters_file = /etc/cinder/resource_filters.json {{(pid=83263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 18:55:03 devstack cinder-volume[83263]: DEBUG oslo_service.backend._eventlet.service [None req-2bfcfe87-68cf-41a7-ba71-060aafe3ab31 None None] rootwrap_config = /etc/cinder/rootwrap.conf {{(pid=83263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 18:55:03 devstack cinder-volume[83263]: DEBUG oslo_service.backend._eventlet.service [None req-2bfcfe87-68cf-41a7-ba71-060aafe3ab31 None None] rpc_response_timeout = 120 {{(pid=83263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 18:55:03 devstack cinder-volume[83263]: DEBUG oslo_service.backend._eventlet.service [None req-2bfcfe87-68cf-41a7-ba71-060aafe3ab31 None None] run_external_periodic_tasks = True {{(pid=83263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 18:55:03 devstack cinder-volume[83263]: DEBUG oslo_service.backend._eventlet.service [None req-2bfcfe87-68cf-41a7-ba71-060aafe3ab31 None None] scheduler_manager = cinder.scheduler.manager.SchedulerManager {{(pid=83263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 18:55:03 devstack cinder-volume[83263]: DEBUG oslo_service.backend._eventlet.service [None req-2bfcfe87-68cf-41a7-ba71-060aafe3ab31 None None] scst_target_driver = iscsi {{(pid=83263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 18:55:03 devstack cinder-volume[83263]: DEBUG oslo_service.backend._eventlet.service [None req-2bfcfe87-68cf-41a7-ba71-060aafe3ab31 None None] scst_target_iqn_name = None {{(pid=83263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 18:55:03 devstack cinder-volume[83263]: DEBUG oslo_service.backend._eventlet.service [None req-2bfcfe87-68cf-41a7-ba71-060aafe3ab31 None None] service_down_time = 720 {{(pid=83263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 18:55:03 devstack cinder-volume[83263]: DEBUG oslo_service.backend._eventlet.service [None req-2bfcfe87-68cf-41a7-ba71-060aafe3ab31 None None] shell_completion = None {{(pid=83263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 18:55:03 devstack cinder-volume[83263]: DEBUG oslo_service.backend._eventlet.service [None req-2bfcfe87-68cf-41a7-ba71-060aafe3ab31 None None] snapshot_name_template = snapshot-%s {{(pid=83263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 18:55:03 devstack cinder-volume[83263]: DEBUG oslo_service.backend._eventlet.service [None req-2bfcfe87-68cf-41a7-ba71-060aafe3ab31 None None] split_loggers = False {{(pid=83263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 18:55:03 devstack cinder-volume[83263]: DEBUG oslo_service.backend._eventlet.service [None req-2bfcfe87-68cf-41a7-ba71-060aafe3ab31 None None] state_path = /opt/stack/data/cinder {{(pid=83263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 18:55:03 devstack cinder-volume[83263]: DEBUG oslo_service.backend._eventlet.service [None req-2bfcfe87-68cf-41a7-ba71-060aafe3ab31 None None] storage_availability_zone = nova {{(pid=83263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 18:55:03 devstack cinder-volume[83263]: DEBUG oslo_service.backend._eventlet.service [None req-2bfcfe87-68cf-41a7-ba71-060aafe3ab31 None None] storage_protocol = iSCSI {{(pid=83263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 18:55:03 devstack cinder-volume[83263]: DEBUG oslo_service.backend._eventlet.service [None req-2bfcfe87-68cf-41a7-ba71-060aafe3ab31 None None] syslog_log_facility = LOG_USER {{(pid=83263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 18:55:03 devstack cinder-volume[83263]: DEBUG oslo_service.backend._eventlet.service [None req-2bfcfe87-68cf-41a7-ba71-060aafe3ab31 None None] target_helper = lioadm {{(pid=83263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 18:55:03 devstack cinder-volume[83263]: DEBUG oslo_service.backend._eventlet.service [None req-2bfcfe87-68cf-41a7-ba71-060aafe3ab31 None None] target_ip_address = 192.168.122.135 {{(pid=83263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 18:55:03 devstack cinder-volume[83263]: DEBUG oslo_service.backend._eventlet.service [None req-2bfcfe87-68cf-41a7-ba71-060aafe3ab31 None None] target_port = 3260 {{(pid=83263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 18:55:03 devstack cinder-volume[83263]: DEBUG oslo_service.backend._eventlet.service [None req-2bfcfe87-68cf-41a7-ba71-060aafe3ab31 None None] target_prefix = iqn.2010-10.org.openstack: {{(pid=83263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 18:55:03 devstack cinder-volume[83263]: DEBUG oslo_service.backend._eventlet.service [None req-2bfcfe87-68cf-41a7-ba71-060aafe3ab31 None None] target_protocol = iscsi {{(pid=83263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 18:55:03 devstack cinder-volume[83263]: DEBUG oslo_service.backend._eventlet.service [None req-2bfcfe87-68cf-41a7-ba71-060aafe3ab31 None None] target_secondary_ip_addresses = [] {{(pid=83263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 18:55:03 devstack cinder-volume[83263]: DEBUG oslo_service.backend._eventlet.service [None req-2bfcfe87-68cf-41a7-ba71-060aafe3ab31 None None] trace_flags = None {{(pid=83263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 18:55:03 devstack cinder-volume[83263]: DEBUG oslo_service.backend._eventlet.service [None req-2bfcfe87-68cf-41a7-ba71-060aafe3ab31 None None] transfer_api_class = cinder.transfer.api.API {{(pid=83263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 18:55:03 devstack cinder-volume[83263]: DEBUG oslo_service.backend._eventlet.service [None req-2bfcfe87-68cf-41a7-ba71-060aafe3ab31 None None] transport_url = **** {{(pid=83263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 18:55:03 devstack cinder-volume[83263]: DEBUG oslo_service.backend._eventlet.service [None req-2bfcfe87-68cf-41a7-ba71-060aafe3ab31 None None] until_refresh = 0 {{(pid=83263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 18:55:03 devstack cinder-volume[83263]: DEBUG oslo_service.backend._eventlet.service [None req-2bfcfe87-68cf-41a7-ba71-060aafe3ab31 None None] use_chap_auth = False {{(pid=83263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 18:55:03 devstack cinder-volume[83263]: DEBUG oslo_service.backend._eventlet.service [None req-2bfcfe87-68cf-41a7-ba71-060aafe3ab31 None None] use_default_quota_class = True {{(pid=83263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 18:55:03 devstack cinder-volume[83263]: DEBUG oslo_service.backend._eventlet.service [None req-2bfcfe87-68cf-41a7-ba71-060aafe3ab31 None None] use_journal = False {{(pid=83263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 18:55:03 devstack cinder-volume[83263]: DEBUG oslo_service.backend._eventlet.service [None req-2bfcfe87-68cf-41a7-ba71-060aafe3ab31 None None] use_json = False {{(pid=83263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 18:55:03 devstack cinder-volume[83263]: DEBUG oslo_service.backend._eventlet.service [None req-2bfcfe87-68cf-41a7-ba71-060aafe3ab31 None None] use_multipath_for_image_xfer = False {{(pid=83263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 18:55:03 devstack cinder-volume[83263]: DEBUG oslo_service.backend._eventlet.service [None req-2bfcfe87-68cf-41a7-ba71-060aafe3ab31 None None] use_stderr = False {{(pid=83263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 18:55:03 devstack cinder-volume[83263]: DEBUG oslo_service.backend._eventlet.service [None req-2bfcfe87-68cf-41a7-ba71-060aafe3ab31 None None] use_syslog = False {{(pid=83263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 18:55:03 devstack cinder-volume[83263]: DEBUG oslo_service.backend._eventlet.service [None req-2bfcfe87-68cf-41a7-ba71-060aafe3ab31 None None] verify_glance_signatures = enabled {{(pid=83263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 18:55:03 devstack cinder-volume[83263]: DEBUG oslo_service.backend._eventlet.service [None req-2bfcfe87-68cf-41a7-ba71-060aafe3ab31 None None] vmdk_allowed_types = ['streamOptimized', 'monolithicSparse'] {{(pid=83263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 18:55:03 devstack cinder-volume[83263]: DEBUG oslo_service.backend._eventlet.service [None req-2bfcfe87-68cf-41a7-ba71-060aafe3ab31 None None] volume_api_class = cinder.volume.api.API {{(pid=83263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 18:55:03 devstack cinder-volume[83263]: DEBUG oslo_service.backend._eventlet.service [None req-2bfcfe87-68cf-41a7-ba71-060aafe3ab31 None None] volume_backend_name = None {{(pid=83263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 18:55:03 devstack cinder-volume[83263]: DEBUG oslo_service.backend._eventlet.service [None req-2bfcfe87-68cf-41a7-ba71-060aafe3ab31 None None] volume_clear = zero {{(pid=83263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 18:55:03 devstack cinder-volume[83263]: DEBUG oslo_service.backend._eventlet.service [None req-2bfcfe87-68cf-41a7-ba71-060aafe3ab31 None None] volume_clear_ionice = None {{(pid=83263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 18:55:03 devstack cinder-volume[83263]: DEBUG oslo_service.backend._eventlet.service [None req-2bfcfe87-68cf-41a7-ba71-060aafe3ab31 None None] volume_clear_size = 0 {{(pid=83263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 18:55:03 devstack cinder-volume[83263]: DEBUG oslo_service.backend._eventlet.service [None req-2bfcfe87-68cf-41a7-ba71-060aafe3ab31 None None] volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=83263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 18:55:03 devstack cinder-volume[83263]: DEBUG oslo_service.backend._eventlet.service [None req-2bfcfe87-68cf-41a7-ba71-060aafe3ab31 None None] volume_copy_bps_limit = 0 {{(pid=83263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 18:55:03 devstack cinder-volume[83263]: DEBUG oslo_service.backend._eventlet.service [None req-2bfcfe87-68cf-41a7-ba71-060aafe3ab31 None None] volume_dd_blocksize = 1M {{(pid=83263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 18:55:03 devstack cinder-volume[83263]: DEBUG oslo_service.backend._eventlet.service [None req-2bfcfe87-68cf-41a7-ba71-060aafe3ab31 None None] volume_manager = cinder.volume.manager.VolumeManager {{(pid=83263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 18:55:03 devstack cinder-volume[83263]: DEBUG oslo_service.backend._eventlet.service [None req-2bfcfe87-68cf-41a7-ba71-060aafe3ab31 None None] volume_name_template = volume-%s {{(pid=83263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 18:55:03 devstack cinder-volume[83263]: DEBUG oslo_service.backend._eventlet.service [None req-2bfcfe87-68cf-41a7-ba71-060aafe3ab31 None None] volume_service_inithost_offload = False {{(pid=83263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 18:55:03 devstack cinder-volume[83263]: DEBUG oslo_service.backend._eventlet.service [None req-2bfcfe87-68cf-41a7-ba71-060aafe3ab31 None None] volume_usage_audit_period = month {{(pid=83263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 18:55:03 devstack cinder-volume[83263]: DEBUG oslo_service.backend._eventlet.service [None req-2bfcfe87-68cf-41a7-ba71-060aafe3ab31 None None] volumes_dir = /opt/stack/data/cinder/volumes {{(pid=83263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 18:55:03 devstack cinder-volume[83263]: DEBUG oslo_service.backend._eventlet.service [None req-2bfcfe87-68cf-41a7-ba71-060aafe3ab31 None None] zoning_mode = None {{(pid=83263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 18:55:03 devstack cinder-volume[83263]: DEBUG oslo_service.backend._eventlet.service [None req-2bfcfe87-68cf-41a7-ba71-060aafe3ab31 None None] os_brick.lightos_discovery_client_address = localhost {{(pid=83263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 18:55:03 devstack cinder-volume[83263]: DEBUG oslo_service.backend._eventlet.service [None req-2bfcfe87-68cf-41a7-ba71-060aafe3ab31 None None] os_brick.lightos_discovery_client_dir_path = /etc/discovery-client/discovery.d/ {{(pid=83263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 18:55:03 devstack cinder-volume[83263]: DEBUG oslo_service.backend._eventlet.service [None req-2bfcfe87-68cf-41a7-ba71-060aafe3ab31 None None] os_brick.lightos_discovery_client_port = 6060 {{(pid=83263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 18:55:03 devstack cinder-volume[83263]: DEBUG oslo_service.backend._eventlet.service [None req-2bfcfe87-68cf-41a7-ba71-060aafe3ab31 None None] os_brick.lock_path = /opt/stack/data/os_brick {{(pid=83263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 18:55:03 devstack cinder-volume[83263]: DEBUG oslo_service.backend._eventlet.service [None req-2bfcfe87-68cf-41a7-ba71-060aafe3ab31 None None] os_brick.wait_mpath_device_attempts = 4 {{(pid=83263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 18:55:03 devstack cinder-volume[83263]: DEBUG oslo_service.backend._eventlet.service [None req-2bfcfe87-68cf-41a7-ba71-060aafe3ab31 None None] os_brick.wait_mpath_device_interval = 1 {{(pid=83263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 18:55:03 devstack cinder-volume[83263]: DEBUG oslo_service.backend._eventlet.service [None req-2bfcfe87-68cf-41a7-ba71-060aafe3ab31 None None] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=83263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 18:55:03 devstack cinder-volume[83263]: DEBUG oslo_service.backend._eventlet.service [None req-2bfcfe87-68cf-41a7-ba71-060aafe3ab31 None None] oslo_concurrency.disable_process_locking = False {{(pid=83263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 18:55:03 devstack cinder-volume[83263]: DEBUG oslo_service.backend._eventlet.service [None req-2bfcfe87-68cf-41a7-ba71-060aafe3ab31 None None] oslo_concurrency.lock_path = /opt/stack/data/cinder {{(pid=83263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 18:55:03 devstack cinder-volume[83263]: DEBUG oslo_service.backend._eventlet.service [None req-2bfcfe87-68cf-41a7-ba71-060aafe3ab31 None None] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=83263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 18:55:03 devstack cinder-volume[83263]: DEBUG oslo_service.backend._eventlet.service [None req-2bfcfe87-68cf-41a7-ba71-060aafe3ab31 None None] keystone_authtoken.admin_password = **** {{(pid=83263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 18:55:03 devstack cinder-volume[83263]: DEBUG oslo_service.backend._eventlet.service [None req-2bfcfe87-68cf-41a7-ba71-060aafe3ab31 None None] keystone_authtoken.admin_tenant_name = admin {{(pid=83263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 18:55:03 devstack cinder-volume[83263]: DEBUG oslo_service.backend._eventlet.service [None req-2bfcfe87-68cf-41a7-ba71-060aafe3ab31 None None] keystone_authtoken.admin_token = **** {{(pid=83263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 18:55:03 devstack cinder-volume[83263]: DEBUG oslo_service.backend._eventlet.service [None req-2bfcfe87-68cf-41a7-ba71-060aafe3ab31 None None] keystone_authtoken.admin_user = None {{(pid=83263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 18:55:03 devstack cinder-volume[83263]: DEBUG oslo_service.backend._eventlet.service [None req-2bfcfe87-68cf-41a7-ba71-060aafe3ab31 None None] keystone_authtoken.auth_admin_prefix = {{(pid=83263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 18:55:03 devstack cinder-volume[83263]: DEBUG oslo_service.backend._eventlet.service [None req-2bfcfe87-68cf-41a7-ba71-060aafe3ab31 None None] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=83263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 18:55:03 devstack cinder-volume[83263]: DEBUG oslo_service.backend._eventlet.service [None req-2bfcfe87-68cf-41a7-ba71-060aafe3ab31 None None] keystone_authtoken.auth_port = 35357 {{(pid=83263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 18:55:03 devstack cinder-volume[83263]: DEBUG oslo_service.backend._eventlet.service [None req-2bfcfe87-68cf-41a7-ba71-060aafe3ab31 None None] keystone_authtoken.auth_protocol = https {{(pid=83263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 18:55:03 devstack cinder-volume[83263]: DEBUG oslo_service.backend._eventlet.service [None req-2bfcfe87-68cf-41a7-ba71-060aafe3ab31 None None] keystone_authtoken.auth_section = None {{(pid=83263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 18:55:03 devstack cinder-volume[83263]: DEBUG oslo_service.backend._eventlet.service [None req-2bfcfe87-68cf-41a7-ba71-060aafe3ab31 None None] keystone_authtoken.auth_type = password {{(pid=83263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 18:55:03 devstack cinder-volume[83263]: DEBUG oslo_service.backend._eventlet.service [None req-2bfcfe87-68cf-41a7-ba71-060aafe3ab31 None None] keystone_authtoken.auth_uri = None {{(pid=83263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 18:55:03 devstack cinder-volume[83263]: DEBUG oslo_service.backend._eventlet.service [None req-2bfcfe87-68cf-41a7-ba71-060aafe3ab31 None None] keystone_authtoken.auth_version = None {{(pid=83263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 18:55:03 devstack cinder-volume[83263]: DEBUG oslo_service.backend._eventlet.service [None req-2bfcfe87-68cf-41a7-ba71-060aafe3ab31 None None] keystone_authtoken.cache = None {{(pid=83263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 18:55:03 devstack cinder-volume[83263]: DEBUG oslo_service.backend._eventlet.service [None req-2bfcfe87-68cf-41a7-ba71-060aafe3ab31 None None] keystone_authtoken.cafile = /opt/stack/data/ca-bundle.pem {{(pid=83263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 18:55:03 devstack cinder-volume[83263]: DEBUG oslo_service.backend._eventlet.service [None req-2bfcfe87-68cf-41a7-ba71-060aafe3ab31 None None] keystone_authtoken.certfile = None {{(pid=83263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 18:55:03 devstack cinder-volume[83263]: DEBUG oslo_service.backend._eventlet.service [None req-2bfcfe87-68cf-41a7-ba71-060aafe3ab31 None None] keystone_authtoken.delay_auth_decision = False {{(pid=83263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 18:55:03 devstack cinder-volume[83263]: DEBUG oslo_service.backend._eventlet.service [None req-2bfcfe87-68cf-41a7-ba71-060aafe3ab31 None None] keystone_authtoken.enforce_token_bind = permissive {{(pid=83263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 18:55:03 devstack cinder-volume[83263]: DEBUG oslo_service.backend._eventlet.service [None req-2bfcfe87-68cf-41a7-ba71-060aafe3ab31 None None] keystone_authtoken.http_connect_timeout = None {{(pid=83263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 18:55:03 devstack cinder-volume[83263]: DEBUG oslo_service.backend._eventlet.service [None req-2bfcfe87-68cf-41a7-ba71-060aafe3ab31 None None] keystone_authtoken.http_request_max_retries = 3 {{(pid=83263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 18:55:03 devstack cinder-volume[83263]: DEBUG oslo_service.backend._eventlet.service [None req-2bfcfe87-68cf-41a7-ba71-060aafe3ab31 None None] keystone_authtoken.identity_uri = None {{(pid=83263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 18:55:03 devstack cinder-volume[83263]: DEBUG oslo_service.backend._eventlet.service [None req-2bfcfe87-68cf-41a7-ba71-060aafe3ab31 None None] keystone_authtoken.include_service_catalog = True {{(pid=83263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 18:55:03 devstack cinder-volume[83263]: DEBUG oslo_service.backend._eventlet.service [None req-2bfcfe87-68cf-41a7-ba71-060aafe3ab31 None None] keystone_authtoken.insecure = False {{(pid=83263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 18:55:03 devstack cinder-volume[83263]: DEBUG oslo_service.backend._eventlet.service [None req-2bfcfe87-68cf-41a7-ba71-060aafe3ab31 None None] keystone_authtoken.interface = public {{(pid=83263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 18:55:03 devstack cinder-volume[83263]: DEBUG oslo_service.backend._eventlet.service [None req-2bfcfe87-68cf-41a7-ba71-060aafe3ab31 None None] keystone_authtoken.keyfile = None {{(pid=83263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 18:55:03 devstack cinder-volume[83263]: DEBUG oslo_service.backend._eventlet.service [None req-2bfcfe87-68cf-41a7-ba71-060aafe3ab31 None None] keystone_authtoken.memcache_password = {{(pid=83263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 18:55:03 devstack cinder-volume[83263]: DEBUG oslo_service.backend._eventlet.service [None req-2bfcfe87-68cf-41a7-ba71-060aafe3ab31 None None] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=83263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 18:55:03 devstack cinder-volume[83263]: DEBUG oslo_service.backend._eventlet.service [None req-2bfcfe87-68cf-41a7-ba71-060aafe3ab31 None None] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=83263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 18:55:03 devstack cinder-volume[83263]: DEBUG oslo_service.backend._eventlet.service [None req-2bfcfe87-68cf-41a7-ba71-060aafe3ab31 None None] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=83263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 18:55:03 devstack cinder-volume[83263]: DEBUG oslo_service.backend._eventlet.service [None req-2bfcfe87-68cf-41a7-ba71-060aafe3ab31 None None] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=83263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 18:55:03 devstack cinder-volume[83263]: DEBUG oslo_service.backend._eventlet.service [None req-2bfcfe87-68cf-41a7-ba71-060aafe3ab31 None None] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=83263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 18:55:03 devstack cinder-volume[83263]: DEBUG oslo_service.backend._eventlet.service [None req-2bfcfe87-68cf-41a7-ba71-060aafe3ab31 None None] keystone_authtoken.memcache_sasl_enabled = False {{(pid=83263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 18:55:03 devstack cinder-volume[83263]: DEBUG oslo_service.backend._eventlet.service [None req-2bfcfe87-68cf-41a7-ba71-060aafe3ab31 None None] keystone_authtoken.memcache_secret_key = **** {{(pid=83263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 18:55:03 devstack cinder-volume[83263]: DEBUG oslo_service.backend._eventlet.service [None req-2bfcfe87-68cf-41a7-ba71-060aafe3ab31 None None] keystone_authtoken.memcache_security_strategy = None {{(pid=83263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 18:55:03 devstack cinder-volume[83263]: DEBUG oslo_service.backend._eventlet.service [None req-2bfcfe87-68cf-41a7-ba71-060aafe3ab31 None None] keystone_authtoken.memcache_tls_allowed_ciphers = None {{(pid=83263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 18:55:03 devstack cinder-volume[83263]: DEBUG oslo_service.backend._eventlet.service [None req-2bfcfe87-68cf-41a7-ba71-060aafe3ab31 None None] keystone_authtoken.memcache_tls_cafile = None {{(pid=83263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 18:55:03 devstack cinder-volume[83263]: DEBUG oslo_service.backend._eventlet.service [None req-2bfcfe87-68cf-41a7-ba71-060aafe3ab31 None None] keystone_authtoken.memcache_tls_certfile = None {{(pid=83263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 18:55:03 devstack cinder-volume[83263]: DEBUG oslo_service.backend._eventlet.service [None req-2bfcfe87-68cf-41a7-ba71-060aafe3ab31 None None] keystone_authtoken.memcache_tls_enabled = False {{(pid=83263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 18:55:03 devstack cinder-volume[83263]: DEBUG oslo_service.backend._eventlet.service [None req-2bfcfe87-68cf-41a7-ba71-060aafe3ab31 None None] keystone_authtoken.memcache_tls_keyfile = None {{(pid=83263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 18:55:03 devstack cinder-volume[83263]: DEBUG oslo_service.backend._eventlet.service [None req-2bfcfe87-68cf-41a7-ba71-060aafe3ab31 None None] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=83263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 18:55:03 devstack cinder-volume[83263]: DEBUG oslo_service.backend._eventlet.service [None req-2bfcfe87-68cf-41a7-ba71-060aafe3ab31 None None] keystone_authtoken.memcache_username = {{(pid=83263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 18:55:03 devstack cinder-volume[83263]: DEBUG oslo_service.backend._eventlet.service [None req-2bfcfe87-68cf-41a7-ba71-060aafe3ab31 None None] keystone_authtoken.memcached_servers = ['localhost:11211'] {{(pid=83263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 18:55:03 devstack cinder-volume[83263]: DEBUG oslo_service.backend._eventlet.service [None req-2bfcfe87-68cf-41a7-ba71-060aafe3ab31 None None] keystone_authtoken.region_name = None {{(pid=83263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 18:55:03 devstack cinder-volume[83263]: DEBUG oslo_service.backend._eventlet.service [None req-2bfcfe87-68cf-41a7-ba71-060aafe3ab31 None None] keystone_authtoken.service_token_roles = ['service'] {{(pid=83263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 18:55:03 devstack cinder-volume[83263]: DEBUG oslo_service.backend._eventlet.service [None req-2bfcfe87-68cf-41a7-ba71-060aafe3ab31 None None] keystone_authtoken.service_token_roles_required = False {{(pid=83263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 18:55:03 devstack cinder-volume[83263]: DEBUG oslo_service.backend._eventlet.service [None req-2bfcfe87-68cf-41a7-ba71-060aafe3ab31 None None] keystone_authtoken.service_type = None {{(pid=83263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 18:55:03 devstack cinder-volume[83263]: DEBUG oslo_service.backend._eventlet.service [None req-2bfcfe87-68cf-41a7-ba71-060aafe3ab31 None None] keystone_authtoken.token_cache_time = 300 {{(pid=83263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 18:55:03 devstack cinder-volume[83263]: DEBUG oslo_service.backend._eventlet.service [None req-2bfcfe87-68cf-41a7-ba71-060aafe3ab31 None None] keystone_authtoken.www_authenticate_uri = http://192.168.122.135/identity {{(pid=83263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 18:55:03 devstack cinder-volume[83263]: DEBUG oslo_service.backend._eventlet.service [None req-2bfcfe87-68cf-41a7-ba71-060aafe3ab31 None None] cache.backend = dogpile.cache.null {{(pid=83263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 18:55:03 devstack cinder-volume[83263]: DEBUG oslo_service.backend._eventlet.service [None req-2bfcfe87-68cf-41a7-ba71-060aafe3ab31 None None] cache.backend_argument = **** {{(pid=83263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 18:55:03 devstack cinder-volume[83263]: DEBUG oslo_service.backend._eventlet.service [None req-2bfcfe87-68cf-41a7-ba71-060aafe3ab31 None None] cache.backend_expiration_time = None {{(pid=83263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 18:55:03 devstack cinder-volume[83263]: DEBUG oslo_service.backend._eventlet.service [None req-2bfcfe87-68cf-41a7-ba71-060aafe3ab31 None None] cache.config_prefix = cache.oslo {{(pid=83263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 18:55:03 devstack cinder-volume[83263]: DEBUG oslo_service.backend._eventlet.service [None req-2bfcfe87-68cf-41a7-ba71-060aafe3ab31 None None] cache.debug_cache_backend = False {{(pid=83263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 18:55:03 devstack cinder-volume[83263]: DEBUG oslo_service.backend._eventlet.service [None req-2bfcfe87-68cf-41a7-ba71-060aafe3ab31 None None] cache.enable_retry_client = False {{(pid=83263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 18:55:03 devstack cinder-volume[83263]: DEBUG oslo_service.backend._eventlet.service [None req-2bfcfe87-68cf-41a7-ba71-060aafe3ab31 None None] cache.enable_socket_keepalive = False {{(pid=83263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 18:55:03 devstack cinder-volume[83263]: DEBUG oslo_service.backend._eventlet.service [None req-2bfcfe87-68cf-41a7-ba71-060aafe3ab31 None None] cache.enabled = False {{(pid=83263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 18:55:03 devstack cinder-volume[83263]: DEBUG oslo_service.backend._eventlet.service [None req-2bfcfe87-68cf-41a7-ba71-060aafe3ab31 None None] cache.enforce_fips_mode = False {{(pid=83263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 18:55:03 devstack cinder-volume[83263]: DEBUG oslo_service.backend._eventlet.service [None req-2bfcfe87-68cf-41a7-ba71-060aafe3ab31 None None] cache.expiration_time = 600 {{(pid=83263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 18:55:03 devstack cinder-volume[83263]: DEBUG oslo_service.backend._eventlet.service [None req-2bfcfe87-68cf-41a7-ba71-060aafe3ab31 None None] cache.hashclient_dead_timeout = 60.0 {{(pid=83263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 18:55:03 devstack cinder-volume[83263]: DEBUG oslo_service.backend._eventlet.service [None req-2bfcfe87-68cf-41a7-ba71-060aafe3ab31 None None] cache.hashclient_retry_attempts = 2 {{(pid=83263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 18:55:03 devstack cinder-volume[83263]: DEBUG oslo_service.backend._eventlet.service [None req-2bfcfe87-68cf-41a7-ba71-060aafe3ab31 None None] cache.hashclient_retry_timeout = 1.0 {{(pid=83263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 18:55:03 devstack cinder-volume[83263]: DEBUG oslo_service.backend._eventlet.service [None req-2bfcfe87-68cf-41a7-ba71-060aafe3ab31 None None] cache.memcache_dead_retry = 300 {{(pid=83263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 18:55:03 devstack cinder-volume[83263]: DEBUG oslo_service.backend._eventlet.service [None req-2bfcfe87-68cf-41a7-ba71-060aafe3ab31 None None] cache.memcache_pool_connection_get_timeout = 10 {{(pid=83263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 18:55:03 devstack cinder-volume[83263]: DEBUG oslo_service.backend._eventlet.service [None req-2bfcfe87-68cf-41a7-ba71-060aafe3ab31 None None] cache.memcache_pool_flush_on_reconnect = False {{(pid=83263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 18:55:03 devstack cinder-volume[83263]: DEBUG oslo_service.backend._eventlet.service [None req-2bfcfe87-68cf-41a7-ba71-060aafe3ab31 None None] cache.memcache_pool_maxsize = 10 {{(pid=83263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 18:55:03 devstack cinder-volume[83263]: DEBUG oslo_service.backend._eventlet.service [None req-2bfcfe87-68cf-41a7-ba71-060aafe3ab31 None None] cache.memcache_pool_unused_timeout = 60 {{(pid=83263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 18:55:03 devstack cinder-volume[83263]: DEBUG oslo_service.backend._eventlet.service [None req-2bfcfe87-68cf-41a7-ba71-060aafe3ab31 None None] cache.memcache_sasl_enabled = False {{(pid=83263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 18:55:03 devstack cinder-volume[83263]: DEBUG oslo_service.backend._eventlet.service [None req-2bfcfe87-68cf-41a7-ba71-060aafe3ab31 None None] cache.memcache_servers = ['localhost:11211'] {{(pid=83263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 18:55:03 devstack cinder-volume[83263]: DEBUG oslo_service.backend._eventlet.service [None req-2bfcfe87-68cf-41a7-ba71-060aafe3ab31 None None] cache.password = **** {{(pid=83263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 18:55:03 devstack cinder-volume[83263]: DEBUG oslo_service.backend._eventlet.service [None req-2bfcfe87-68cf-41a7-ba71-060aafe3ab31 None None] cache.proxies = [] {{(pid=83263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 18:55:03 devstack cinder-volume[83263]: DEBUG oslo_service.backend._eventlet.service [None req-2bfcfe87-68cf-41a7-ba71-060aafe3ab31 None None] cache.redis_db = 0 {{(pid=83263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 18:55:03 devstack cinder-volume[83263]: DEBUG oslo_service.backend._eventlet.service [None req-2bfcfe87-68cf-41a7-ba71-060aafe3ab31 None None] cache.redis_sentinel_service_name = mymaster {{(pid=83263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 18:55:03 devstack cinder-volume[83263]: DEBUG oslo_service.backend._eventlet.service [None req-2bfcfe87-68cf-41a7-ba71-060aafe3ab31 None None] cache.redis_sentinels = ['localhost:26379'] {{(pid=83263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 18:55:03 devstack cinder-volume[83263]: DEBUG oslo_service.backend._eventlet.service [None req-2bfcfe87-68cf-41a7-ba71-060aafe3ab31 None None] cache.redis_server = localhost:6379 {{(pid=83263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 18:55:03 devstack cinder-volume[83263]: DEBUG oslo_service.backend._eventlet.service [None req-2bfcfe87-68cf-41a7-ba71-060aafe3ab31 None None] cache.retry_attempts = 2 {{(pid=83263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 18:55:03 devstack cinder-volume[83263]: DEBUG oslo_service.backend._eventlet.service [None req-2bfcfe87-68cf-41a7-ba71-060aafe3ab31 None None] cache.retry_delay = 0.0 {{(pid=83263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 18:55:03 devstack cinder-volume[83263]: DEBUG oslo_service.backend._eventlet.service [None req-2bfcfe87-68cf-41a7-ba71-060aafe3ab31 None None] cache.socket_keepalive_count = 1 {{(pid=83263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 18:55:03 devstack cinder-volume[83263]: DEBUG oslo_service.backend._eventlet.service [None req-2bfcfe87-68cf-41a7-ba71-060aafe3ab31 None None] cache.socket_keepalive_idle = 1 {{(pid=83263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 18:55:03 devstack cinder-volume[83263]: DEBUG oslo_service.backend._eventlet.service [None req-2bfcfe87-68cf-41a7-ba71-060aafe3ab31 None None] cache.socket_keepalive_interval = 1 {{(pid=83263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 18:55:03 devstack cinder-volume[83263]: DEBUG oslo_service.backend._eventlet.service [None req-2bfcfe87-68cf-41a7-ba71-060aafe3ab31 None None] cache.socket_timeout = 1.0 {{(pid=83263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 18:55:03 devstack cinder-volume[83263]: DEBUG oslo_service.backend._eventlet.service [None req-2bfcfe87-68cf-41a7-ba71-060aafe3ab31 None None] cache.tls_allowed_ciphers = None {{(pid=83263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 18:55:03 devstack cinder-volume[83263]: DEBUG oslo_service.backend._eventlet.service [None req-2bfcfe87-68cf-41a7-ba71-060aafe3ab31 None None] cache.tls_cafile = None {{(pid=83263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 18:55:03 devstack cinder-volume[83263]: DEBUG oslo_service.backend._eventlet.service [None req-2bfcfe87-68cf-41a7-ba71-060aafe3ab31 None None] cache.tls_certfile = None {{(pid=83263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 18:55:03 devstack cinder-volume[83263]: DEBUG oslo_service.backend._eventlet.service [None req-2bfcfe87-68cf-41a7-ba71-060aafe3ab31 None None] cache.tls_enabled = False {{(pid=83263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 18:55:03 devstack cinder-volume[83263]: DEBUG oslo_service.backend._eventlet.service [None req-2bfcfe87-68cf-41a7-ba71-060aafe3ab31 None None] cache.tls_keyfile = None {{(pid=83263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 18:55:03 devstack cinder-volume[83263]: DEBUG oslo_service.backend._eventlet.service [None req-2bfcfe87-68cf-41a7-ba71-060aafe3ab31 None None] cache.username = None {{(pid=83263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 18:55:03 devstack cinder-volume[83263]: DEBUG oslo_service.backend._eventlet.service [None req-2bfcfe87-68cf-41a7-ba71-060aafe3ab31 None None] coordination.backend_url = **** {{(pid=83263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 18:55:03 devstack cinder-volume[83263]: DEBUG oslo_service.backend._eventlet.service [None req-2bfcfe87-68cf-41a7-ba71-060aafe3ab31 None None] database.asyncio_connection = **** {{(pid=83263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 18:55:03 devstack cinder-volume[83263]: DEBUG oslo_service.backend._eventlet.service [None req-2bfcfe87-68cf-41a7-ba71-060aafe3ab31 None None] database.asyncio_slave_connection = **** {{(pid=83263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 18:55:03 devstack cinder-volume[83263]: DEBUG oslo_service.backend._eventlet.service [None req-2bfcfe87-68cf-41a7-ba71-060aafe3ab31 None None] database.backend = sqlalchemy {{(pid=83263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 18:55:03 devstack cinder-volume[83263]: DEBUG oslo_service.backend._eventlet.service [None req-2bfcfe87-68cf-41a7-ba71-060aafe3ab31 None None] database.connection = **** {{(pid=83263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 18:55:03 devstack cinder-volume[83263]: DEBUG oslo_service.backend._eventlet.service [None req-2bfcfe87-68cf-41a7-ba71-060aafe3ab31 None None] database.connection_debug = 0 {{(pid=83263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 18:55:03 devstack cinder-volume[83263]: DEBUG oslo_service.backend._eventlet.service [None req-2bfcfe87-68cf-41a7-ba71-060aafe3ab31 None None] database.connection_parameters = {{(pid=83263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 18:55:03 devstack cinder-volume[83263]: DEBUG oslo_service.backend._eventlet.service [None req-2bfcfe87-68cf-41a7-ba71-060aafe3ab31 None None] database.connection_recycle_time = 3600 {{(pid=83263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 18:55:03 devstack cinder-volume[83263]: DEBUG oslo_service.backend._eventlet.service [None req-2bfcfe87-68cf-41a7-ba71-060aafe3ab31 None None] database.connection_trace = False {{(pid=83263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 18:55:03 devstack cinder-volume[83263]: DEBUG oslo_service.backend._eventlet.service [None req-2bfcfe87-68cf-41a7-ba71-060aafe3ab31 None None] database.db_inc_retry_interval = True {{(pid=83263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 18:55:03 devstack cinder-volume[83263]: DEBUG oslo_service.backend._eventlet.service [None req-2bfcfe87-68cf-41a7-ba71-060aafe3ab31 None None] database.db_max_retries = 20 {{(pid=83263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 18:55:03 devstack cinder-volume[83263]: DEBUG oslo_service.backend._eventlet.service [None req-2bfcfe87-68cf-41a7-ba71-060aafe3ab31 None None] database.db_max_retry_interval = 10 {{(pid=83263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 18:55:03 devstack cinder-volume[83263]: DEBUG oslo_service.backend._eventlet.service [None req-2bfcfe87-68cf-41a7-ba71-060aafe3ab31 None None] database.db_retry_interval = 1 {{(pid=83263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 18:55:03 devstack cinder-volume[83263]: DEBUG oslo_service.backend._eventlet.service [None req-2bfcfe87-68cf-41a7-ba71-060aafe3ab31 None None] database.max_overflow = 50 {{(pid=83263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 18:55:03 devstack cinder-volume[83263]: DEBUG oslo_service.backend._eventlet.service [None req-2bfcfe87-68cf-41a7-ba71-060aafe3ab31 None None] database.max_pool_size = 5 {{(pid=83263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 18:55:03 devstack cinder-volume[83263]: DEBUG oslo_service.backend._eventlet.service [None req-2bfcfe87-68cf-41a7-ba71-060aafe3ab31 None None] database.max_retries = 10 {{(pid=83263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 18:55:03 devstack cinder-volume[83263]: DEBUG oslo_service.backend._eventlet.service [None req-2bfcfe87-68cf-41a7-ba71-060aafe3ab31 None None] database.mysql_sql_mode = TRADITIONAL {{(pid=83263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 18:55:03 devstack cinder-volume[83263]: DEBUG oslo_service.backend._eventlet.service [None req-2bfcfe87-68cf-41a7-ba71-060aafe3ab31 None None] database.mysql_wsrep_sync_wait = None {{(pid=83263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 18:55:03 devstack cinder-volume[83263]: DEBUG oslo_service.backend._eventlet.service [None req-2bfcfe87-68cf-41a7-ba71-060aafe3ab31 None None] database.pool_timeout = None {{(pid=83263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 18:55:03 devstack cinder-volume[83263]: DEBUG oslo_service.backend._eventlet.service [None req-2bfcfe87-68cf-41a7-ba71-060aafe3ab31 None None] database.retry_interval = 10 {{(pid=83263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 18:55:03 devstack cinder-volume[83263]: DEBUG oslo_service.backend._eventlet.service [None req-2bfcfe87-68cf-41a7-ba71-060aafe3ab31 None None] database.slave_connection = **** {{(pid=83263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 18:55:03 devstack cinder-volume[83263]: DEBUG oslo_service.backend._eventlet.service [None req-2bfcfe87-68cf-41a7-ba71-060aafe3ab31 None None] database.sqlite_synchronous = True {{(pid=83263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 18:55:03 devstack cinder-volume[83263]: DEBUG oslo_service.backend._eventlet.service [None req-2bfcfe87-68cf-41a7-ba71-060aafe3ab31 None None] database.synchronous_reader = True {{(pid=83263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 18:55:03 devstack cinder-volume[83263]: DEBUG oslo_service.backend._eventlet.service [None req-2bfcfe87-68cf-41a7-ba71-060aafe3ab31 None None] database.use_db_reconnect = False {{(pid=83263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 18:55:03 devstack cinder-volume[83263]: DEBUG oslo_service.backend._eventlet.service [None req-2bfcfe87-68cf-41a7-ba71-060aafe3ab31 None None] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=83263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 18:55:03 devstack cinder-volume[83263]: DEBUG oslo_service.backend._eventlet.service [None req-2bfcfe87-68cf-41a7-ba71-060aafe3ab31 None None] oslo_messaging_metrics.metrics_enabled = False {{(pid=83263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 18:55:03 devstack cinder-volume[83263]: DEBUG oslo_service.backend._eventlet.service [None req-2bfcfe87-68cf-41a7-ba71-060aafe3ab31 None None] oslo_messaging_metrics.metrics_process_name = {{(pid=83263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 18:55:03 devstack cinder-volume[83263]: DEBUG oslo_service.backend._eventlet.service [None req-2bfcfe87-68cf-41a7-ba71-060aafe3ab31 None None] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=83263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 18:55:03 devstack cinder-volume[83263]: DEBUG oslo_service.backend._eventlet.service [None req-2bfcfe87-68cf-41a7-ba71-060aafe3ab31 None None] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=83263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 18:55:03 devstack cinder-volume[83263]: DEBUG oslo_service.backend._eventlet.service [None req-2bfcfe87-68cf-41a7-ba71-060aafe3ab31 None None] profiler.connection_string = messaging:// {{(pid=83263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 18:55:03 devstack cinder-volume[83263]: DEBUG oslo_service.backend._eventlet.service [None req-2bfcfe87-68cf-41a7-ba71-060aafe3ab31 None None] profiler.enabled = False {{(pid=83263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 18:55:03 devstack cinder-volume[83263]: DEBUG oslo_service.backend._eventlet.service [None req-2bfcfe87-68cf-41a7-ba71-060aafe3ab31 None None] profiler.es_doc_type = notification {{(pid=83263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 18:55:03 devstack cinder-volume[83263]: DEBUG oslo_service.backend._eventlet.service [None req-2bfcfe87-68cf-41a7-ba71-060aafe3ab31 None None] profiler.es_scroll_size = 10000 {{(pid=83263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 18:55:03 devstack cinder-volume[83263]: DEBUG oslo_service.backend._eventlet.service [None req-2bfcfe87-68cf-41a7-ba71-060aafe3ab31 None None] profiler.es_scroll_time = 2m {{(pid=83263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 18:55:03 devstack cinder-volume[83263]: DEBUG oslo_service.backend._eventlet.service [None req-2bfcfe87-68cf-41a7-ba71-060aafe3ab31 None None] profiler.filter_error_trace = False {{(pid=83263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 18:55:03 devstack cinder-volume[83263]: DEBUG oslo_service.backend._eventlet.service [None req-2bfcfe87-68cf-41a7-ba71-060aafe3ab31 None None] profiler.hmac_keys = **** {{(pid=83263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 18:55:03 devstack cinder-volume[83263]: DEBUG oslo_service.backend._eventlet.service [None req-2bfcfe87-68cf-41a7-ba71-060aafe3ab31 None None] profiler.sentinel_service_name = mymaster {{(pid=83263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 18:55:03 devstack cinder-volume[83263]: DEBUG oslo_service.backend._eventlet.service [None req-2bfcfe87-68cf-41a7-ba71-060aafe3ab31 None None] profiler.socket_timeout = 0.1 {{(pid=83263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 18:55:03 devstack cinder-volume[83263]: DEBUG oslo_service.backend._eventlet.service [None req-2bfcfe87-68cf-41a7-ba71-060aafe3ab31 None None] profiler.trace_requests = False {{(pid=83263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 18:55:03 devstack cinder-volume[83263]: DEBUG oslo_service.backend._eventlet.service [None req-2bfcfe87-68cf-41a7-ba71-060aafe3ab31 None None] profiler.trace_sqlalchemy = False {{(pid=83263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 18:55:03 devstack cinder-volume[83263]: DEBUG oslo_service.backend._eventlet.service [None req-2bfcfe87-68cf-41a7-ba71-060aafe3ab31 None None] profiler_jaeger.process_tags = {} {{(pid=83263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 18:55:03 devstack cinder-volume[83263]: DEBUG oslo_service.backend._eventlet.service [None req-2bfcfe87-68cf-41a7-ba71-060aafe3ab31 None None] profiler_jaeger.service_name_prefix = None {{(pid=83263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 18:55:03 devstack cinder-volume[83263]: DEBUG oslo_service.backend._eventlet.service [None req-2bfcfe87-68cf-41a7-ba71-060aafe3ab31 None None] profiler_otlp.service_name_prefix = None {{(pid=83263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 18:55:03 devstack cinder-volume[83263]: DEBUG oslo_service.backend._eventlet.service [None req-2bfcfe87-68cf-41a7-ba71-060aafe3ab31 None None] oslo_policy.enforce_new_defaults = False {{(pid=83263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 18:55:03 devstack cinder-volume[83263]: WARNING oslo_config.cfg [None req-2bfcfe87-68cf-41a7-ba71-060aafe3ab31 None None] Deprecated: Option "enforce_scope" from group "oslo_policy" is deprecated for removal (This configuration was added temporarily to facilitate a smooth transition to the new RBAC. OpenStack will always enforce scope checks. This configuration option is deprecated and will be removed in the 2025.2 cycle.). Its value may be silently ignored in the future. Apr 29 18:55:03 devstack cinder-volume[83263]: DEBUG oslo_service.backend._eventlet.service [None req-2bfcfe87-68cf-41a7-ba71-060aafe3ab31 None None] oslo_policy.enforce_scope = False {{(pid=83263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 18:55:03 devstack cinder-volume[83263]: DEBUG oslo_service.backend._eventlet.service [None req-2bfcfe87-68cf-41a7-ba71-060aafe3ab31 None None] oslo_policy.policy_default_rule = default {{(pid=83263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 18:55:03 devstack cinder-volume[83263]: DEBUG oslo_service.backend._eventlet.service [None req-2bfcfe87-68cf-41a7-ba71-060aafe3ab31 None None] oslo_policy.policy_dirs = ['policy.d'] {{(pid=83263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 18:55:03 devstack cinder-volume[83263]: DEBUG oslo_service.backend._eventlet.service [None req-2bfcfe87-68cf-41a7-ba71-060aafe3ab31 None None] oslo_policy.policy_file = policy.yaml {{(pid=83263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 18:55:03 devstack cinder-volume[83263]: DEBUG oslo_service.backend._eventlet.service [None req-2bfcfe87-68cf-41a7-ba71-060aafe3ab31 None None] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=83263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 18:55:03 devstack cinder-volume[83263]: DEBUG oslo_service.backend._eventlet.service [None req-2bfcfe87-68cf-41a7-ba71-060aafe3ab31 None None] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=83263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 18:55:03 devstack cinder-volume[83263]: DEBUG oslo_service.backend._eventlet.service [None req-2bfcfe87-68cf-41a7-ba71-060aafe3ab31 None None] oslo_policy.remote_ssl_client_crt_file = None {{(pid=83263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 18:55:03 devstack cinder-volume[83263]: DEBUG oslo_service.backend._eventlet.service [None req-2bfcfe87-68cf-41a7-ba71-060aafe3ab31 None None] oslo_policy.remote_ssl_client_key_file = None {{(pid=83263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 18:55:03 devstack cinder-volume[83263]: DEBUG oslo_service.backend._eventlet.service [None req-2bfcfe87-68cf-41a7-ba71-060aafe3ab31 None None] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=83263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 18:55:03 devstack cinder-volume[83263]: DEBUG oslo_service.backend._eventlet.service [None req-2bfcfe87-68cf-41a7-ba71-060aafe3ab31 None None] oslo_policy.remote_timeout = 60.0 {{(pid=83263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 18:55:03 devstack cinder-volume[83263]: DEBUG oslo_service.backend._eventlet.service [None req-2bfcfe87-68cf-41a7-ba71-060aafe3ab31 None None] privsep_osbrick.capabilities = [21, 2] {{(pid=83263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 18:55:03 devstack cinder-volume[83263]: DEBUG oslo_service.backend._eventlet.service [None req-2bfcfe87-68cf-41a7-ba71-060aafe3ab31 None None] privsep_osbrick.group = None {{(pid=83263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 18:55:03 devstack cinder-volume[83263]: DEBUG oslo_service.backend._eventlet.service [None req-2bfcfe87-68cf-41a7-ba71-060aafe3ab31 None None] privsep_osbrick.helper_command = None {{(pid=83263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 18:55:03 devstack cinder-volume[83263]: DEBUG oslo_service.backend._eventlet.service [None req-2bfcfe87-68cf-41a7-ba71-060aafe3ab31 None None] privsep_osbrick.log_daemon_traceback = False {{(pid=83263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 18:55:03 devstack cinder-volume[83263]: DEBUG oslo_service.backend._eventlet.service [None req-2bfcfe87-68cf-41a7-ba71-060aafe3ab31 None None] privsep_osbrick.logger_name = brick_privsep_hide_output {{(pid=83263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 18:55:03 devstack cinder-volume[83263]: DEBUG oslo_service.backend._eventlet.service [None req-2bfcfe87-68cf-41a7-ba71-060aafe3ab31 None None] privsep_osbrick.thread_pool_size = 4 {{(pid=83263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 18:55:03 devstack cinder-volume[83263]: DEBUG oslo_service.backend._eventlet.service [None req-2bfcfe87-68cf-41a7-ba71-060aafe3ab31 None None] privsep_osbrick.user = None {{(pid=83263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 18:55:03 devstack cinder-volume[83263]: DEBUG oslo_service.backend._eventlet.service [None req-2bfcfe87-68cf-41a7-ba71-060aafe3ab31 None None] cinder_sys_admin.capabilities = [0, 1, 2, 3, 12, 21] {{(pid=83263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 18:55:03 devstack cinder-volume[83263]: DEBUG oslo_service.backend._eventlet.service [None req-2bfcfe87-68cf-41a7-ba71-060aafe3ab31 None None] cinder_sys_admin.group = None {{(pid=83263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 18:55:03 devstack cinder-volume[83263]: DEBUG oslo_service.backend._eventlet.service [None req-2bfcfe87-68cf-41a7-ba71-060aafe3ab31 None None] cinder_sys_admin.helper_command = None {{(pid=83263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 18:55:03 devstack cinder-volume[83263]: DEBUG oslo_service.backend._eventlet.service [None req-2bfcfe87-68cf-41a7-ba71-060aafe3ab31 None None] cinder_sys_admin.log_daemon_traceback = False {{(pid=83263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 18:55:03 devstack cinder-volume[83263]: DEBUG oslo_service.backend._eventlet.service [None req-2bfcfe87-68cf-41a7-ba71-060aafe3ab31 None None] cinder_sys_admin.logger_name = oslo_privsep.daemon {{(pid=83263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 18:55:03 devstack cinder-volume[83263]: DEBUG oslo_service.backend._eventlet.service [None req-2bfcfe87-68cf-41a7-ba71-060aafe3ab31 None None] cinder_sys_admin.thread_pool_size = 4 {{(pid=83263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 18:55:03 devstack cinder-volume[83263]: DEBUG oslo_service.backend._eventlet.service [None req-2bfcfe87-68cf-41a7-ba71-060aafe3ab31 None None] cinder_sys_admin.user = None {{(pid=83263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 18:55:03 devstack cinder-volume[83263]: DEBUG oslo_service.backend._eventlet.service [None req-2bfcfe87-68cf-41a7-ba71-060aafe3ab31 None None] service_user.auth_section = None {{(pid=83263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 18:55:03 devstack cinder-volume[83263]: DEBUG oslo_service.backend._eventlet.service [None req-2bfcfe87-68cf-41a7-ba71-060aafe3ab31 None None] service_user.auth_type = password {{(pid=83263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 18:55:03 devstack cinder-volume[83263]: DEBUG oslo_service.backend._eventlet.service [None req-2bfcfe87-68cf-41a7-ba71-060aafe3ab31 None None] service_user.cafile = None {{(pid=83263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 18:55:03 devstack cinder-volume[83263]: DEBUG oslo_service.backend._eventlet.service [None req-2bfcfe87-68cf-41a7-ba71-060aafe3ab31 None None] service_user.certfile = None {{(pid=83263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 18:55:03 devstack cinder-volume[83263]: DEBUG oslo_service.backend._eventlet.service [None req-2bfcfe87-68cf-41a7-ba71-060aafe3ab31 None None] service_user.collect_timing = False {{(pid=83263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 18:55:03 devstack cinder-volume[83263]: DEBUG oslo_service.backend._eventlet.service [None req-2bfcfe87-68cf-41a7-ba71-060aafe3ab31 None None] service_user.insecure = False {{(pid=83263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 18:55:03 devstack cinder-volume[83263]: DEBUG oslo_service.backend._eventlet.service [None req-2bfcfe87-68cf-41a7-ba71-060aafe3ab31 None None] service_user.keyfile = None {{(pid=83263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 18:55:03 devstack cinder-volume[83263]: DEBUG oslo_service.backend._eventlet.service [None req-2bfcfe87-68cf-41a7-ba71-060aafe3ab31 None None] service_user.send_service_user_token = True {{(pid=83263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 18:55:03 devstack cinder-volume[83263]: DEBUG oslo_service.backend._eventlet.service [None req-2bfcfe87-68cf-41a7-ba71-060aafe3ab31 None None] service_user.split_loggers = False {{(pid=83263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 18:55:03 devstack cinder-volume[83263]: DEBUG oslo_service.backend._eventlet.service [None req-2bfcfe87-68cf-41a7-ba71-060aafe3ab31 None None] service_user.timeout = None {{(pid=83263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 18:55:03 devstack cinder-volume[83263]: DEBUG oslo_service.backend._eventlet.service [None req-2bfcfe87-68cf-41a7-ba71-060aafe3ab31 None None] glance.auth_section = None {{(pid=83263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 18:55:03 devstack cinder-volume[83263]: DEBUG oslo_service.backend._eventlet.service [None req-2bfcfe87-68cf-41a7-ba71-060aafe3ab31 None None] glance.auth_type = password {{(pid=83263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 18:55:03 devstack cinder-volume[83263]: DEBUG oslo_service.backend._eventlet.service [None req-2bfcfe87-68cf-41a7-ba71-060aafe3ab31 None None] glance.cafile = /opt/stack/data/ca-bundle.pem {{(pid=83263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 18:55:03 devstack cinder-volume[83263]: DEBUG oslo_service.backend._eventlet.service [None req-2bfcfe87-68cf-41a7-ba71-060aafe3ab31 None None] glance.certfile = None {{(pid=83263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 18:55:03 devstack cinder-volume[83263]: DEBUG oslo_service.backend._eventlet.service [None req-2bfcfe87-68cf-41a7-ba71-060aafe3ab31 None None] glance.collect_timing = False {{(pid=83263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 18:55:03 devstack cinder-volume[83263]: DEBUG oslo_service.backend._eventlet.service [None req-2bfcfe87-68cf-41a7-ba71-060aafe3ab31 None None] glance.insecure = False {{(pid=83263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 18:55:03 devstack cinder-volume[83263]: DEBUG oslo_service.backend._eventlet.service [None req-2bfcfe87-68cf-41a7-ba71-060aafe3ab31 None None] glance.keyfile = None {{(pid=83263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 18:55:03 devstack cinder-volume[83263]: DEBUG oslo_service.backend._eventlet.service [None req-2bfcfe87-68cf-41a7-ba71-060aafe3ab31 None None] glance.region_name = None {{(pid=83263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 18:55:03 devstack cinder-volume[83263]: DEBUG oslo_service.backend._eventlet.service [None req-2bfcfe87-68cf-41a7-ba71-060aafe3ab31 None None] glance.split_loggers = False {{(pid=83263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 18:55:03 devstack cinder-volume[83263]: DEBUG oslo_service.backend._eventlet.service [None req-2bfcfe87-68cf-41a7-ba71-060aafe3ab31 None None] glance.timeout = None {{(pid=83263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 18:55:03 devstack cinder-volume[83263]: DEBUG oslo_service.backend._eventlet.service [None req-2bfcfe87-68cf-41a7-ba71-060aafe3ab31 None None] backend_defaults.backend_availability_zone = None {{(pid=83263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 18:55:03 devstack cinder-volume[83263]: DEBUG oslo_service.backend._eventlet.service [None req-2bfcfe87-68cf-41a7-ba71-060aafe3ab31 None None] backend_defaults.backend_native_threads_pool_size = 20 {{(pid=83263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 18:55:03 devstack cinder-volume[83263]: DEBUG oslo_service.backend._eventlet.service [None req-2bfcfe87-68cf-41a7-ba71-060aafe3ab31 None None] backend_defaults.backup_use_temp_snapshot = False {{(pid=83263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 18:55:03 devstack cinder-volume[83263]: DEBUG oslo_service.backend._eventlet.service [None req-2bfcfe87-68cf-41a7-ba71-060aafe3ab31 None None] backend_defaults.chap_password = **** {{(pid=83263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 18:55:03 devstack cinder-volume[83263]: DEBUG oslo_service.backend._eventlet.service [None req-2bfcfe87-68cf-41a7-ba71-060aafe3ab31 None None] backend_defaults.chap_username = {{(pid=83263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 18:55:03 devstack cinder-volume[83263]: DEBUG oslo_service.backend._eventlet.service [None req-2bfcfe87-68cf-41a7-ba71-060aafe3ab31 None None] backend_defaults.chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=83263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 18:55:03 devstack cinder-volume[83881]: DEBUG cinder.volume.drivers.quobyte [None req-0cd58edc-a702-49db-9c33-bc324ffadc9c None None] nas_secure_file_* settings are false (ownership) and false (permissions). {{(pid=83881) set_nas_security_options /opt/stack/cinder/cinder/volume/drivers/quobyte.py:305}} Apr 29 18:55:03 devstack cinder-volume[83881]: WARNING cinder.volume.drivers.quobyte [None req-0cd58edc-a702-49db-9c33-bc324ffadc9c None None] The NAS file operations will be run as root, allowing root level access at the storage backend. Apr 29 18:55:03 devstack cinder-volume[83263]: DEBUG oslo_service.backend._eventlet.service [None req-2bfcfe87-68cf-41a7-ba71-060aafe3ab31 None None] backend_defaults.disk_geometry = None {{(pid=83263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 18:55:03 devstack cinder-volume[83263]: DEBUG oslo_service.backend._eventlet.service [None req-2bfcfe87-68cf-41a7-ba71-060aafe3ab31 None None] backend_defaults.driver_client_cert = None {{(pid=83263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 18:55:03 devstack cinder-volume[83263]: DEBUG oslo_service.backend._eventlet.service [None req-2bfcfe87-68cf-41a7-ba71-060aafe3ab31 None None] backend_defaults.driver_client_cert_key = None {{(pid=83263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 18:55:03 devstack cinder-volume[83263]: DEBUG oslo_service.backend._eventlet.service [None req-2bfcfe87-68cf-41a7-ba71-060aafe3ab31 None None] backend_defaults.driver_data_namespace = None {{(pid=83263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 18:55:03 devstack cinder-volume[83263]: DEBUG oslo_service.backend._eventlet.service [None req-2bfcfe87-68cf-41a7-ba71-060aafe3ab31 None None] backend_defaults.driver_ssl_cert_path = None {{(pid=83263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 18:55:03 devstack cinder-volume[83263]: DEBUG oslo_service.backend._eventlet.service [None req-2bfcfe87-68cf-41a7-ba71-060aafe3ab31 None None] backend_defaults.driver_ssl_cert_verify = False {{(pid=83263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 18:55:03 devstack cinder-volume[83263]: DEBUG oslo_service.backend._eventlet.service [None req-2bfcfe87-68cf-41a7-ba71-060aafe3ab31 None None] backend_defaults.driver_use_ssl = False {{(pid=83263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 18:55:03 devstack cinder-volume[83263]: DEBUG oslo_service.backend._eventlet.service [None req-2bfcfe87-68cf-41a7-ba71-060aafe3ab31 None None] backend_defaults.enable_unsupported_driver = False {{(pid=83263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 18:55:03 devstack cinder-volume[83881]: WARNING cinder.volume.drivers.quobyte [None req-0cd58edc-a702-49db-9c33-bc324ffadc9c None None] The NAS file permissions mode will be 666 (allowing other/world read & write access). Apr 29 18:55:03 devstack cinder-volume[83263]: DEBUG oslo_service.backend._eventlet.service [None req-2bfcfe87-68cf-41a7-ba71-060aafe3ab31 None None] backend_defaults.enforce_multipath_for_image_xfer = False {{(pid=83263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 18:55:03 devstack cinder-volume[83263]: DEBUG oslo_service.backend._eventlet.service [None req-2bfcfe87-68cf-41a7-ba71-060aafe3ab31 None None] backend_defaults.extra_capabilities = {} {{(pid=83263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 18:55:03 devstack cinder-volume[83263]: DEBUG oslo_service.backend._eventlet.service [None req-2bfcfe87-68cf-41a7-ba71-060aafe3ab31 None None] backend_defaults.filter_function = None {{(pid=83263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 18:55:03 devstack cinder-volume[83263]: DEBUG oslo_service.backend._eventlet.service [None req-2bfcfe87-68cf-41a7-ba71-060aafe3ab31 None None] backend_defaults.goodness_function = None {{(pid=83263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 18:55:03 devstack cinder-volume[83263]: DEBUG oslo_service.backend._eventlet.service [None req-2bfcfe87-68cf-41a7-ba71-060aafe3ab31 None None] backend_defaults.image_upload_use_cinder_backend = False {{(pid=83263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 18:55:03 devstack cinder-volume[83263]: DEBUG oslo_service.backend._eventlet.service [None req-2bfcfe87-68cf-41a7-ba71-060aafe3ab31 None None] backend_defaults.image_upload_use_internal_tenant = False {{(pid=83263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 18:55:03 devstack cinder-volume[83881]: DEBUG oslo_concurrency.processutils [None req-0cd58edc-a702-49db-9c33-bc324ffadc9c None None] Running cmd (subprocess): mount.quobyte {{(pid=83881) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 18:55:03 devstack cinder-volume[83263]: DEBUG oslo_service.backend._eventlet.service [None req-2bfcfe87-68cf-41a7-ba71-060aafe3ab31 None None] backend_defaults.image_volume_cache_enabled = False {{(pid=83263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 18:55:03 devstack cinder-volume[83263]: DEBUG oslo_service.backend._eventlet.service [None req-2bfcfe87-68cf-41a7-ba71-060aafe3ab31 None None] backend_defaults.image_volume_cache_max_count = 0 {{(pid=83263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 18:55:03 devstack cinder-volume[83263]: DEBUG oslo_service.backend._eventlet.service [None req-2bfcfe87-68cf-41a7-ba71-060aafe3ab31 None None] backend_defaults.image_volume_cache_max_size_gb = 0 {{(pid=83263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 18:55:03 devstack cinder-volume[83263]: DEBUG oslo_service.backend._eventlet.service [None req-2bfcfe87-68cf-41a7-ba71-060aafe3ab31 None None] backend_defaults.iscsi_target_flags = {{(pid=83263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 18:55:03 devstack cinder-volume[83263]: DEBUG oslo_service.backend._eventlet.service [None req-2bfcfe87-68cf-41a7-ba71-060aafe3ab31 None None] backend_defaults.iscsi_write_cache = on {{(pid=83263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 18:55:03 devstack cinder-volume[83263]: DEBUG oslo_service.backend._eventlet.service [None req-2bfcfe87-68cf-41a7-ba71-060aafe3ab31 None None] backend_defaults.iser_helper = tgtadm {{(pid=83263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 18:55:03 devstack cinder-volume[83263]: DEBUG oslo_service.backend._eventlet.service [None req-2bfcfe87-68cf-41a7-ba71-060aafe3ab31 None None] backend_defaults.iser_ip_address = 192.168.122.135 {{(pid=83263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 18:55:03 devstack cinder-volume[83263]: DEBUG oslo_service.backend._eventlet.service [None req-2bfcfe87-68cf-41a7-ba71-060aafe3ab31 None None] backend_defaults.iser_port = 3260 {{(pid=83263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 18:55:03 devstack cinder-volume[83263]: DEBUG oslo_service.backend._eventlet.service [None req-2bfcfe87-68cf-41a7-ba71-060aafe3ab31 None None] backend_defaults.iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=83263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 18:55:03 devstack cinder-volume[83263]: DEBUG oslo_service.backend._eventlet.service [None req-2bfcfe87-68cf-41a7-ba71-060aafe3ab31 None None] backend_defaults.max_over_subscription_ratio = 20.0 {{(pid=83263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 18:55:03 devstack cinder-volume[83263]: DEBUG oslo_service.backend._eventlet.service [None req-2bfcfe87-68cf-41a7-ba71-060aafe3ab31 None None] backend_defaults.nas_host = {{(pid=83263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 18:55:03 devstack cinder-volume[83263]: DEBUG oslo_service.backend._eventlet.service [None req-2bfcfe87-68cf-41a7-ba71-060aafe3ab31 None None] backend_defaults.nas_login = admin {{(pid=83263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 18:55:03 devstack cinder-volume[83263]: DEBUG oslo_service.backend._eventlet.service [None req-2bfcfe87-68cf-41a7-ba71-060aafe3ab31 None None] backend_defaults.nas_mount_options = None {{(pid=83263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 18:55:03 devstack cinder-volume[83263]: DEBUG oslo_service.backend._eventlet.service [None req-2bfcfe87-68cf-41a7-ba71-060aafe3ab31 None None] backend_defaults.nas_password = **** {{(pid=83263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 18:55:03 devstack cinder-volume[83263]: DEBUG oslo_service.backend._eventlet.service [None req-2bfcfe87-68cf-41a7-ba71-060aafe3ab31 None None] backend_defaults.nas_private_key = {{(pid=83263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 18:55:03 devstack cinder-volume[83263]: DEBUG oslo_service.backend._eventlet.service [None req-2bfcfe87-68cf-41a7-ba71-060aafe3ab31 None None] backend_defaults.nas_secure_file_operations = auto {{(pid=83263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 18:55:03 devstack cinder-volume[83263]: DEBUG oslo_service.backend._eventlet.service [None req-2bfcfe87-68cf-41a7-ba71-060aafe3ab31 None None] backend_defaults.nas_secure_file_permissions = auto {{(pid=83263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 18:55:03 devstack cinder-volume[83263]: DEBUG oslo_service.backend._eventlet.service [None req-2bfcfe87-68cf-41a7-ba71-060aafe3ab31 None None] backend_defaults.nas_share_path = {{(pid=83263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 18:55:03 devstack cinder-volume[83263]: DEBUG oslo_service.backend._eventlet.service [None req-2bfcfe87-68cf-41a7-ba71-060aafe3ab31 None None] backend_defaults.nas_ssh_port = 22 {{(pid=83263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 18:55:03 devstack cinder-volume[83263]: DEBUG oslo_service.backend._eventlet.service [None req-2bfcfe87-68cf-41a7-ba71-060aafe3ab31 None None] backend_defaults.nas_volume_prov_type = thin {{(pid=83263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 18:55:03 devstack cinder-volume[83263]: DEBUG oslo_service.backend._eventlet.service [None req-2bfcfe87-68cf-41a7-ba71-060aafe3ab31 None None] backend_defaults.num_iser_scan_tries = 3 {{(pid=83263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 18:55:03 devstack cinder-volume[83263]: DEBUG oslo_service.backend._eventlet.service [None req-2bfcfe87-68cf-41a7-ba71-060aafe3ab31 None None] backend_defaults.num_shell_tries = 3 {{(pid=83263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 18:55:03 devstack cinder-volume[83263]: DEBUG oslo_service.backend._eventlet.service [None req-2bfcfe87-68cf-41a7-ba71-060aafe3ab31 None None] backend_defaults.num_volume_device_scan_tries = 3 {{(pid=83263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 18:55:03 devstack cinder-volume[83263]: DEBUG oslo_service.backend._eventlet.service [None req-2bfcfe87-68cf-41a7-ba71-060aafe3ab31 None None] backend_defaults.nvmeof_conn_info_version = 1 {{(pid=83263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 18:55:03 devstack cinder-volume[83263]: DEBUG oslo_service.backend._eventlet.service [None req-2bfcfe87-68cf-41a7-ba71-060aafe3ab31 None None] backend_defaults.nvmet_ns_id = 10 {{(pid=83263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 18:55:03 devstack cinder-volume[83263]: DEBUG oslo_service.backend._eventlet.service [None req-2bfcfe87-68cf-41a7-ba71-060aafe3ab31 None None] backend_defaults.nvmet_port_id = 1 {{(pid=83263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 18:55:03 devstack cinder-volume[83263]: DEBUG oslo_service.backend._eventlet.service [None req-2bfcfe87-68cf-41a7-ba71-060aafe3ab31 None None] backend_defaults.quobyte_client_cfg = None {{(pid=83263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 18:55:03 devstack cinder-volume[83263]: DEBUG oslo_service.backend._eventlet.service [None req-2bfcfe87-68cf-41a7-ba71-060aafe3ab31 None None] backend_defaults.quobyte_mount_point_base = /opt/stack/data/cinder/mnt {{(pid=83263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 18:55:03 devstack cinder-volume[83263]: DEBUG oslo_service.backend._eventlet.service [None req-2bfcfe87-68cf-41a7-ba71-060aafe3ab31 None None] backend_defaults.quobyte_overlay_volumes = False {{(pid=83263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 18:55:03 devstack cinder-volume[83263]: DEBUG oslo_service.backend._eventlet.service [None req-2bfcfe87-68cf-41a7-ba71-060aafe3ab31 None None] backend_defaults.quobyte_qcow2_volumes = True {{(pid=83263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 18:55:03 devstack cinder-volume[83263]: DEBUG oslo_service.backend._eventlet.service [None req-2bfcfe87-68cf-41a7-ba71-060aafe3ab31 None None] backend_defaults.quobyte_sparsed_volumes = True {{(pid=83263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 18:55:03 devstack cinder-volume[83263]: DEBUG oslo_service.backend._eventlet.service [None req-2bfcfe87-68cf-41a7-ba71-060aafe3ab31 None None] backend_defaults.quobyte_volume_from_snapshot_cache = False {{(pid=83263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 18:55:03 devstack cinder-volume[83263]: DEBUG oslo_service.backend._eventlet.service [None req-2bfcfe87-68cf-41a7-ba71-060aafe3ab31 None None] backend_defaults.quobyte_volume_url = None {{(pid=83263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 18:55:03 devstack cinder-volume[83263]: DEBUG oslo_service.backend._eventlet.service [None req-2bfcfe87-68cf-41a7-ba71-060aafe3ab31 None None] backend_defaults.replication_device = **** {{(pid=83263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 18:55:03 devstack cinder-volume[83263]: DEBUG oslo_service.backend._eventlet.service [None req-2bfcfe87-68cf-41a7-ba71-060aafe3ab31 None None] backend_defaults.report_discard_supported = False {{(pid=83263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 18:55:03 devstack cinder-volume[83263]: DEBUG oslo_service.backend._eventlet.service [None req-2bfcfe87-68cf-41a7-ba71-060aafe3ab31 None None] backend_defaults.reserved_percentage = 0 {{(pid=83263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 18:55:03 devstack cinder-volume[83263]: DEBUG oslo_service.backend._eventlet.service [None req-2bfcfe87-68cf-41a7-ba71-060aafe3ab31 None None] backend_defaults.scst_target_driver = iscsi {{(pid=83263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 18:55:03 devstack cinder-volume[83263]: DEBUG oslo_service.backend._eventlet.service [None req-2bfcfe87-68cf-41a7-ba71-060aafe3ab31 None None] backend_defaults.scst_target_iqn_name = None {{(pid=83263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 18:55:03 devstack cinder-volume[83263]: DEBUG oslo_service.backend._eventlet.service [None req-2bfcfe87-68cf-41a7-ba71-060aafe3ab31 None None] backend_defaults.storage_protocol = iSCSI {{(pid=83263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 18:55:03 devstack cinder-volume[83263]: DEBUG oslo_service.backend._eventlet.service [None req-2bfcfe87-68cf-41a7-ba71-060aafe3ab31 None None] backend_defaults.suppress_requests_ssl_warnings = False {{(pid=83263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 18:55:03 devstack cinder-volume[83263]: DEBUG oslo_service.backend._eventlet.service [None req-2bfcfe87-68cf-41a7-ba71-060aafe3ab31 None None] backend_defaults.target_helper = tgtadm {{(pid=83263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 18:55:03 devstack cinder-volume[83263]: DEBUG oslo_service.backend._eventlet.service [None req-2bfcfe87-68cf-41a7-ba71-060aafe3ab31 None None] backend_defaults.target_ip_address = 192.168.122.135 {{(pid=83263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 18:55:03 devstack cinder-volume[83263]: DEBUG oslo_service.backend._eventlet.service [None req-2bfcfe87-68cf-41a7-ba71-060aafe3ab31 None None] backend_defaults.target_port = 3260 {{(pid=83263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 18:55:03 devstack cinder-volume[83263]: DEBUG oslo_service.backend._eventlet.service [None req-2bfcfe87-68cf-41a7-ba71-060aafe3ab31 None None] backend_defaults.target_prefix = iqn.2010-10.org.openstack: {{(pid=83263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 18:55:03 devstack cinder-volume[83263]: DEBUG oslo_service.backend._eventlet.service [None req-2bfcfe87-68cf-41a7-ba71-060aafe3ab31 None None] backend_defaults.target_protocol = iscsi {{(pid=83263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 18:55:03 devstack cinder-volume[83263]: DEBUG oslo_service.backend._eventlet.service [None req-2bfcfe87-68cf-41a7-ba71-060aafe3ab31 None None] backend_defaults.target_secondary_ip_addresses = [] {{(pid=83263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 18:55:03 devstack cinder-volume[83263]: DEBUG oslo_service.backend._eventlet.service [None req-2bfcfe87-68cf-41a7-ba71-060aafe3ab31 None None] backend_defaults.trace_flags = None {{(pid=83263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 18:55:03 devstack cinder-volume[83263]: DEBUG oslo_service.backend._eventlet.service [None req-2bfcfe87-68cf-41a7-ba71-060aafe3ab31 None None] backend_defaults.unique_fqdn_network = True {{(pid=83263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 18:55:03 devstack cinder-volume[83263]: DEBUG oslo_service.backend._eventlet.service [None req-2bfcfe87-68cf-41a7-ba71-060aafe3ab31 None None] backend_defaults.use_chap_auth = False {{(pid=83263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 18:55:03 devstack cinder-volume[83263]: DEBUG oslo_service.backend._eventlet.service [None req-2bfcfe87-68cf-41a7-ba71-060aafe3ab31 None None] backend_defaults.use_multipath_for_image_xfer = False {{(pid=83263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 18:55:03 devstack cinder-volume[83263]: DEBUG oslo_service.backend._eventlet.service [None req-2bfcfe87-68cf-41a7-ba71-060aafe3ab31 None None] backend_defaults.volume_backend_name = None {{(pid=83263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 18:55:03 devstack cinder-volume[83263]: DEBUG oslo_service.backend._eventlet.service [None req-2bfcfe87-68cf-41a7-ba71-060aafe3ab31 None None] backend_defaults.volume_clear = zero {{(pid=83263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 18:55:03 devstack cinder-volume[83263]: DEBUG oslo_service.backend._eventlet.service [None req-2bfcfe87-68cf-41a7-ba71-060aafe3ab31 None None] backend_defaults.volume_clear_ionice = None {{(pid=83263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 18:55:03 devstack cinder-volume[83263]: DEBUG oslo_service.backend._eventlet.service [None req-2bfcfe87-68cf-41a7-ba71-060aafe3ab31 None None] backend_defaults.volume_clear_size = 0 {{(pid=83263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 18:55:03 devstack cinder-volume[83263]: DEBUG oslo_service.backend._eventlet.service [None req-2bfcfe87-68cf-41a7-ba71-060aafe3ab31 None None] backend_defaults.volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=83263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 18:55:03 devstack cinder-volume[83263]: DEBUG oslo_service.backend._eventlet.service [None req-2bfcfe87-68cf-41a7-ba71-060aafe3ab31 None None] backend_defaults.volume_copy_bps_limit = 0 {{(pid=83263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 18:55:03 devstack cinder-volume[83263]: DEBUG oslo_service.backend._eventlet.service [None req-2bfcfe87-68cf-41a7-ba71-060aafe3ab31 None None] backend_defaults.volume_dd_blocksize = 1M {{(pid=83263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 18:55:03 devstack cinder-volume[83263]: DEBUG oslo_service.backend._eventlet.service [None req-2bfcfe87-68cf-41a7-ba71-060aafe3ab31 None None] backend_defaults.volume_driver = cinder.volume.drivers.lvm.LVMVolumeDriver {{(pid=83263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 18:55:03 devstack cinder-volume[83263]: DEBUG oslo_service.backend._eventlet.service [None req-2bfcfe87-68cf-41a7-ba71-060aafe3ab31 None None] backend_defaults.volumes_dir = /opt/stack/data/cinder/volumes {{(pid=83263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 18:55:03 devstack cinder-volume[83263]: DEBUG oslo_service.backend._eventlet.service [None req-2bfcfe87-68cf-41a7-ba71-060aafe3ab31 None None] oslo_reports.file_event_handler = None {{(pid=83263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 18:55:03 devstack cinder-volume[83263]: DEBUG oslo_service.backend._eventlet.service [None req-2bfcfe87-68cf-41a7-ba71-060aafe3ab31 None None] oslo_reports.file_event_handler_interval = 1 {{(pid=83263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 18:55:03 devstack cinder-volume[83263]: DEBUG oslo_service.backend._eventlet.service [None req-2bfcfe87-68cf-41a7-ba71-060aafe3ab31 None None] oslo_reports.log_dir = None {{(pid=83263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 18:55:03 devstack cinder-volume[83263]: DEBUG oslo_service.backend._eventlet.service [None req-2bfcfe87-68cf-41a7-ba71-060aafe3ab31 None None] QuobyteHD.backend_availability_zone = None {{(pid=83263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 18:55:03 devstack cinder-volume[83263]: DEBUG oslo_service.backend._eventlet.service [None req-2bfcfe87-68cf-41a7-ba71-060aafe3ab31 None None] QuobyteHD.backend_host = None {{(pid=83263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 18:55:03 devstack cinder-volume[83263]: DEBUG oslo_service.backend._eventlet.service [None req-2bfcfe87-68cf-41a7-ba71-060aafe3ab31 None None] QuobyteHD.backend_native_threads_pool_size = None {{(pid=83263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 18:55:03 devstack cinder-volume[83263]: DEBUG oslo_service.backend._eventlet.service [None req-2bfcfe87-68cf-41a7-ba71-060aafe3ab31 None None] QuobyteHD.backup_use_temp_snapshot = None {{(pid=83263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 18:55:03 devstack cinder-volume[83263]: DEBUG oslo_service.backend._eventlet.service [None req-2bfcfe87-68cf-41a7-ba71-060aafe3ab31 None None] QuobyteHD.chap_password = **** {{(pid=83263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 18:55:03 devstack cinder-volume[83263]: DEBUG oslo_service.backend._eventlet.service [None req-2bfcfe87-68cf-41a7-ba71-060aafe3ab31 None None] QuobyteHD.chap_username = None {{(pid=83263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 18:55:03 devstack cinder-volume[83263]: DEBUG oslo_service.backend._eventlet.service [None req-2bfcfe87-68cf-41a7-ba71-060aafe3ab31 None None] QuobyteHD.chiscsi_conf = None {{(pid=83263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 18:55:03 devstack cinder-volume[83263]: DEBUG oslo_service.backend._eventlet.service [None req-2bfcfe87-68cf-41a7-ba71-060aafe3ab31 None None] QuobyteHD.disk_geometry = None {{(pid=83263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 18:55:03 devstack cinder-volume[83263]: DEBUG oslo_service.backend._eventlet.service [None req-2bfcfe87-68cf-41a7-ba71-060aafe3ab31 None None] QuobyteHD.driver_client_cert = None {{(pid=83263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 18:55:03 devstack cinder-volume[83263]: DEBUG oslo_service.backend._eventlet.service [None req-2bfcfe87-68cf-41a7-ba71-060aafe3ab31 None None] QuobyteHD.driver_client_cert_key = None {{(pid=83263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 18:55:03 devstack cinder-volume[83263]: DEBUG oslo_service.backend._eventlet.service [None req-2bfcfe87-68cf-41a7-ba71-060aafe3ab31 None None] QuobyteHD.driver_data_namespace = None {{(pid=83263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 18:55:03 devstack cinder-volume[83263]: DEBUG oslo_service.backend._eventlet.service [None req-2bfcfe87-68cf-41a7-ba71-060aafe3ab31 None None] QuobyteHD.driver_ssl_cert_path = None {{(pid=83263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 18:55:03 devstack cinder-volume[83263]: DEBUG oslo_service.backend._eventlet.service [None req-2bfcfe87-68cf-41a7-ba71-060aafe3ab31 None None] QuobyteHD.driver_ssl_cert_verify = None {{(pid=83263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 18:55:03 devstack cinder-volume[83263]: DEBUG oslo_service.backend._eventlet.service [None req-2bfcfe87-68cf-41a7-ba71-060aafe3ab31 None None] QuobyteHD.driver_use_ssl = None {{(pid=83263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 18:55:03 devstack cinder-volume[83263]: DEBUG oslo_service.backend._eventlet.service [None req-2bfcfe87-68cf-41a7-ba71-060aafe3ab31 None None] QuobyteHD.enable_unsupported_driver = True {{(pid=83263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 18:55:03 devstack cinder-volume[83263]: DEBUG oslo_service.backend._eventlet.service [None req-2bfcfe87-68cf-41a7-ba71-060aafe3ab31 None None] QuobyteHD.enforce_multipath_for_image_xfer = None {{(pid=83263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 18:55:03 devstack cinder-volume[83263]: DEBUG oslo_service.backend._eventlet.service [None req-2bfcfe87-68cf-41a7-ba71-060aafe3ab31 None None] QuobyteHD.extra_capabilities = None {{(pid=83263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 18:55:03 devstack cinder-volume[83263]: DEBUG oslo_service.backend._eventlet.service [None req-2bfcfe87-68cf-41a7-ba71-060aafe3ab31 None None] QuobyteHD.filter_function = None {{(pid=83263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 18:55:03 devstack cinder-volume[83263]: DEBUG oslo_service.backend._eventlet.service [None req-2bfcfe87-68cf-41a7-ba71-060aafe3ab31 None None] QuobyteHD.goodness_function = None {{(pid=83263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 18:55:03 devstack cinder-volume[83263]: DEBUG oslo_service.backend._eventlet.service [None req-2bfcfe87-68cf-41a7-ba71-060aafe3ab31 None None] QuobyteHD.image_upload_use_cinder_backend = None {{(pid=83263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 18:55:03 devstack cinder-volume[83263]: DEBUG oslo_service.backend._eventlet.service [None req-2bfcfe87-68cf-41a7-ba71-060aafe3ab31 None None] QuobyteHD.image_upload_use_internal_tenant = None {{(pid=83263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 18:55:03 devstack cinder-volume[83263]: DEBUG oslo_service.backend._eventlet.service [None req-2bfcfe87-68cf-41a7-ba71-060aafe3ab31 None None] QuobyteHD.image_volume_cache_enabled = None {{(pid=83263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 18:55:03 devstack cinder-volume[83263]: DEBUG oslo_service.backend._eventlet.service [None req-2bfcfe87-68cf-41a7-ba71-060aafe3ab31 None None] QuobyteHD.image_volume_cache_max_count = None {{(pid=83263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 18:55:03 devstack cinder-volume[83263]: DEBUG oslo_service.backend._eventlet.service [None req-2bfcfe87-68cf-41a7-ba71-060aafe3ab31 None None] QuobyteHD.image_volume_cache_max_size_gb = None {{(pid=83263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 18:55:03 devstack cinder-volume[83263]: DEBUG oslo_service.backend._eventlet.service [None req-2bfcfe87-68cf-41a7-ba71-060aafe3ab31 None None] QuobyteHD.iscsi_target_flags = None {{(pid=83263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 18:55:03 devstack cinder-volume[83263]: DEBUG oslo_service.backend._eventlet.service [None req-2bfcfe87-68cf-41a7-ba71-060aafe3ab31 None None] QuobyteHD.iscsi_write_cache = None {{(pid=83263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 18:55:03 devstack cinder-volume[83263]: DEBUG oslo_service.backend._eventlet.service [None req-2bfcfe87-68cf-41a7-ba71-060aafe3ab31 None None] QuobyteHD.iser_helper = None {{(pid=83263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 18:55:03 devstack cinder-volume[83263]: DEBUG oslo_service.backend._eventlet.service [None req-2bfcfe87-68cf-41a7-ba71-060aafe3ab31 None None] QuobyteHD.iser_ip_address = None {{(pid=83263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 18:55:03 devstack cinder-volume[83263]: DEBUG oslo_service.backend._eventlet.service [None req-2bfcfe87-68cf-41a7-ba71-060aafe3ab31 None None] QuobyteHD.iser_port = None {{(pid=83263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 18:55:03 devstack cinder-volume[83263]: DEBUG oslo_service.backend._eventlet.service [None req-2bfcfe87-68cf-41a7-ba71-060aafe3ab31 None None] QuobyteHD.iser_target_prefix = None {{(pid=83263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 18:55:03 devstack cinder-volume[83263]: DEBUG oslo_service.backend._eventlet.service [None req-2bfcfe87-68cf-41a7-ba71-060aafe3ab31 None None] QuobyteHD.max_over_subscription_ratio = None {{(pid=83263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 18:55:03 devstack cinder-volume[83263]: DEBUG oslo_service.backend._eventlet.service [None req-2bfcfe87-68cf-41a7-ba71-060aafe3ab31 None None] QuobyteHD.nas_host = None {{(pid=83263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 18:55:03 devstack cinder-volume[83263]: DEBUG oslo_service.backend._eventlet.service [None req-2bfcfe87-68cf-41a7-ba71-060aafe3ab31 None None] QuobyteHD.nas_login = None {{(pid=83263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 18:55:03 devstack cinder-volume[83263]: DEBUG oslo_service.backend._eventlet.service [None req-2bfcfe87-68cf-41a7-ba71-060aafe3ab31 None None] QuobyteHD.nas_mount_options = None {{(pid=83263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 18:55:03 devstack cinder-volume[83263]: DEBUG oslo_service.backend._eventlet.service [None req-2bfcfe87-68cf-41a7-ba71-060aafe3ab31 None None] QuobyteHD.nas_password = **** {{(pid=83263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 18:55:03 devstack cinder-volume[83263]: DEBUG oslo_service.backend._eventlet.service [None req-2bfcfe87-68cf-41a7-ba71-060aafe3ab31 None None] QuobyteHD.nas_private_key = None {{(pid=83263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 18:55:03 devstack cinder-volume[83263]: DEBUG oslo_service.backend._eventlet.service [None req-2bfcfe87-68cf-41a7-ba71-060aafe3ab31 None None] QuobyteHD.nas_secure_file_operations = false {{(pid=83263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 18:55:03 devstack cinder-volume[83263]: DEBUG oslo_service.backend._eventlet.service [None req-2bfcfe87-68cf-41a7-ba71-060aafe3ab31 None None] QuobyteHD.nas_secure_file_permissions = false {{(pid=83263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 18:55:03 devstack cinder-volume[83263]: DEBUG oslo_service.backend._eventlet.service [None req-2bfcfe87-68cf-41a7-ba71-060aafe3ab31 None None] QuobyteHD.nas_share_path = None {{(pid=83263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 18:55:03 devstack cinder-volume[83263]: DEBUG oslo_service.backend._eventlet.service [None req-2bfcfe87-68cf-41a7-ba71-060aafe3ab31 None None] QuobyteHD.nas_ssh_port = None {{(pid=83263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 18:55:03 devstack cinder-volume[83263]: DEBUG oslo_service.backend._eventlet.service [None req-2bfcfe87-68cf-41a7-ba71-060aafe3ab31 None None] QuobyteHD.nas_volume_prov_type = None {{(pid=83263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 18:55:03 devstack cinder-volume[83263]: DEBUG oslo_service.backend._eventlet.service [None req-2bfcfe87-68cf-41a7-ba71-060aafe3ab31 None None] QuobyteHD.num_iser_scan_tries = None {{(pid=83263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 18:55:03 devstack cinder-volume[83263]: DEBUG oslo_service.backend._eventlet.service [None req-2bfcfe87-68cf-41a7-ba71-060aafe3ab31 None None] QuobyteHD.num_shell_tries = None {{(pid=83263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 18:55:03 devstack cinder-volume[83263]: DEBUG oslo_service.backend._eventlet.service [None req-2bfcfe87-68cf-41a7-ba71-060aafe3ab31 None None] QuobyteHD.num_volume_device_scan_tries = None {{(pid=83263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 18:55:03 devstack cinder-volume[83263]: DEBUG oslo_service.backend._eventlet.service [None req-2bfcfe87-68cf-41a7-ba71-060aafe3ab31 None None] QuobyteHD.nvmeof_conn_info_version = None {{(pid=83263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 18:55:03 devstack cinder-volume[83263]: DEBUG oslo_service.backend._eventlet.service [None req-2bfcfe87-68cf-41a7-ba71-060aafe3ab31 None None] QuobyteHD.nvmet_ns_id = None {{(pid=83263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 18:55:03 devstack cinder-volume[83263]: DEBUG oslo_service.backend._eventlet.service [None req-2bfcfe87-68cf-41a7-ba71-060aafe3ab31 None None] QuobyteHD.nvmet_port_id = None {{(pid=83263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 18:55:03 devstack cinder-volume[83263]: DEBUG oslo_service.backend._eventlet.service [None req-2bfcfe87-68cf-41a7-ba71-060aafe3ab31 None None] QuobyteHD.quobyte_client_cfg = /etc/quobyte/client-cinder.cfg {{(pid=83263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 18:55:03 devstack cinder-volume[83263]: DEBUG oslo_service.backend._eventlet.service [None req-2bfcfe87-68cf-41a7-ba71-060aafe3ab31 None None] QuobyteHD.quobyte_mount_point_base = None {{(pid=83263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 18:55:03 devstack cinder-volume[83263]: DEBUG oslo_service.backend._eventlet.service [None req-2bfcfe87-68cf-41a7-ba71-060aafe3ab31 None None] QuobyteHD.quobyte_overlay_volumes = None {{(pid=83263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 18:55:03 devstack cinder-volume[83263]: DEBUG oslo_service.backend._eventlet.service [None req-2bfcfe87-68cf-41a7-ba71-060aafe3ab31 None None] QuobyteHD.quobyte_qcow2_volumes = None {{(pid=83263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 18:55:03 devstack cinder-volume[83263]: DEBUG oslo_service.backend._eventlet.service [None req-2bfcfe87-68cf-41a7-ba71-060aafe3ab31 None None] QuobyteHD.quobyte_sparsed_volumes = None {{(pid=83263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 18:55:03 devstack cinder-volume[83263]: DEBUG oslo_service.backend._eventlet.service [None req-2bfcfe87-68cf-41a7-ba71-060aafe3ab31 None None] QuobyteHD.quobyte_volume_from_snapshot_cache = None {{(pid=83263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 18:55:03 devstack cinder-volume[83263]: DEBUG oslo_service.backend._eventlet.service [None req-2bfcfe87-68cf-41a7-ba71-060aafe3ab31 None None] QuobyteHD.quobyte_volume_url = quobyte://osci02.corp.quobyte.com/cinder-vol-34312b00-dd6d-45bb-af98-75855cea8e48 {{(pid=83263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 18:55:03 devstack cinder-volume[83263]: DEBUG oslo_service.backend._eventlet.service [None req-2bfcfe87-68cf-41a7-ba71-060aafe3ab31 None None] QuobyteHD.replication_device = **** {{(pid=83263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 18:55:03 devstack cinder-volume[83263]: DEBUG oslo_service.backend._eventlet.service [None req-2bfcfe87-68cf-41a7-ba71-060aafe3ab31 None None] QuobyteHD.report_discard_supported = None {{(pid=83263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 18:55:03 devstack cinder-volume[83263]: DEBUG oslo_service.backend._eventlet.service [None req-2bfcfe87-68cf-41a7-ba71-060aafe3ab31 None None] QuobyteHD.reserved_percentage = None {{(pid=83263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 18:55:03 devstack cinder-volume[83263]: DEBUG oslo_service.backend._eventlet.service [None req-2bfcfe87-68cf-41a7-ba71-060aafe3ab31 None None] QuobyteHD.scst_target_driver = None {{(pid=83263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 18:55:03 devstack cinder-volume[83263]: DEBUG oslo_service.backend._eventlet.service [None req-2bfcfe87-68cf-41a7-ba71-060aafe3ab31 None None] QuobyteHD.scst_target_iqn_name = None {{(pid=83263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 18:55:03 devstack cinder-volume[83263]: DEBUG oslo_service.backend._eventlet.service [None req-2bfcfe87-68cf-41a7-ba71-060aafe3ab31 None None] QuobyteHD.storage_protocol = None {{(pid=83263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 18:55:03 devstack cinder-volume[83263]: DEBUG oslo_service.backend._eventlet.service [None req-2bfcfe87-68cf-41a7-ba71-060aafe3ab31 None None] QuobyteHD.suppress_requests_ssl_warnings = None {{(pid=83263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 18:55:03 devstack cinder-volume[83263]: DEBUG oslo_service.backend._eventlet.service [None req-2bfcfe87-68cf-41a7-ba71-060aafe3ab31 None None] QuobyteHD.target_helper = None {{(pid=83263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 18:55:03 devstack cinder-volume[83263]: DEBUG oslo_service.backend._eventlet.service [None req-2bfcfe87-68cf-41a7-ba71-060aafe3ab31 None None] QuobyteHD.target_ip_address = None {{(pid=83263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 18:55:03 devstack cinder-volume[83263]: DEBUG oslo_service.backend._eventlet.service [None req-2bfcfe87-68cf-41a7-ba71-060aafe3ab31 None None] QuobyteHD.target_port = None {{(pid=83263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 18:55:03 devstack cinder-volume[83263]: DEBUG oslo_service.backend._eventlet.service [None req-2bfcfe87-68cf-41a7-ba71-060aafe3ab31 None None] QuobyteHD.target_prefix = None {{(pid=83263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 18:55:03 devstack cinder-volume[83263]: DEBUG oslo_service.backend._eventlet.service [None req-2bfcfe87-68cf-41a7-ba71-060aafe3ab31 None None] QuobyteHD.target_protocol = None {{(pid=83263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 18:55:03 devstack cinder-volume[83263]: DEBUG oslo_service.backend._eventlet.service [None req-2bfcfe87-68cf-41a7-ba71-060aafe3ab31 None None] QuobyteHD.target_secondary_ip_addresses = None {{(pid=83263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 18:55:03 devstack cinder-volume[83263]: DEBUG oslo_service.backend._eventlet.service [None req-2bfcfe87-68cf-41a7-ba71-060aafe3ab31 None None] QuobyteHD.trace_flags = None {{(pid=83263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 18:55:03 devstack cinder-volume[83263]: DEBUG oslo_service.backend._eventlet.service [None req-2bfcfe87-68cf-41a7-ba71-060aafe3ab31 None None] QuobyteHD.unique_fqdn_network = None {{(pid=83263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 18:55:03 devstack cinder-volume[83263]: DEBUG oslo_service.backend._eventlet.service [None req-2bfcfe87-68cf-41a7-ba71-060aafe3ab31 None None] QuobyteHD.use_chap_auth = None {{(pid=83263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 18:55:03 devstack cinder-volume[83263]: DEBUG oslo_service.backend._eventlet.service [None req-2bfcfe87-68cf-41a7-ba71-060aafe3ab31 None None] QuobyteHD.use_multipath_for_image_xfer = None {{(pid=83263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 18:55:03 devstack cinder-volume[83263]: DEBUG oslo_service.backend._eventlet.service [None req-2bfcfe87-68cf-41a7-ba71-060aafe3ab31 None None] QuobyteHD.volume_backend_name = QuobyteHD {{(pid=83263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 18:55:03 devstack cinder-volume[83263]: DEBUG oslo_service.backend._eventlet.service [None req-2bfcfe87-68cf-41a7-ba71-060aafe3ab31 None None] QuobyteHD.volume_clear = None {{(pid=83263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 18:55:03 devstack cinder-volume[83263]: DEBUG oslo_service.backend._eventlet.service [None req-2bfcfe87-68cf-41a7-ba71-060aafe3ab31 None None] QuobyteHD.volume_clear_ionice = None {{(pid=83263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 18:55:03 devstack cinder-volume[83263]: DEBUG oslo_service.backend._eventlet.service [None req-2bfcfe87-68cf-41a7-ba71-060aafe3ab31 None None] QuobyteHD.volume_clear_size = None {{(pid=83263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 18:55:03 devstack cinder-volume[83263]: DEBUG oslo_service.backend._eventlet.service [None req-2bfcfe87-68cf-41a7-ba71-060aafe3ab31 None None] QuobyteHD.volume_copy_blkio_cgroup_name = None {{(pid=83263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 18:55:03 devstack cinder-volume[83263]: DEBUG oslo_service.backend._eventlet.service [None req-2bfcfe87-68cf-41a7-ba71-060aafe3ab31 None None] QuobyteHD.volume_copy_bps_limit = None {{(pid=83263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 18:55:03 devstack cinder-volume[83263]: DEBUG oslo_service.backend._eventlet.service [None req-2bfcfe87-68cf-41a7-ba71-060aafe3ab31 None None] QuobyteHD.volume_dd_blocksize = None {{(pid=83263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 18:55:03 devstack cinder-volume[83263]: DEBUG oslo_service.backend._eventlet.service [None req-2bfcfe87-68cf-41a7-ba71-060aafe3ab31 None None] QuobyteHD.volume_driver = cinder.volume.drivers.quobyte.QuobyteDriver {{(pid=83263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 18:55:03 devstack cinder-volume[83263]: DEBUG oslo_service.backend._eventlet.service [None req-2bfcfe87-68cf-41a7-ba71-060aafe3ab31 None None] QuobyteHD.volumes_dir = None {{(pid=83263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 18:55:03 devstack cinder-volume[83263]: DEBUG oslo_service.backend._eventlet.service [None req-2bfcfe87-68cf-41a7-ba71-060aafe3ab31 None None] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=83263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 18:55:03 devstack cinder-volume[83263]: DEBUG oslo_service.backend._eventlet.service [None req-2bfcfe87-68cf-41a7-ba71-060aafe3ab31 None None] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=83263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 18:55:03 devstack cinder-volume[83263]: DEBUG oslo_service.backend._eventlet.service [None req-2bfcfe87-68cf-41a7-ba71-060aafe3ab31 None None] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=83263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 18:55:03 devstack cinder-volume[83263]: DEBUG oslo_service.backend._eventlet.service [None req-2bfcfe87-68cf-41a7-ba71-060aafe3ab31 None None] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=83263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 18:55:03 devstack cinder-volume[83263]: DEBUG oslo_service.backend._eventlet.service [None req-2bfcfe87-68cf-41a7-ba71-060aafe3ab31 None None] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=83263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 18:55:03 devstack cinder-volume[83263]: DEBUG oslo_service.backend._eventlet.service [None req-2bfcfe87-68cf-41a7-ba71-060aafe3ab31 None None] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=83263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 18:55:03 devstack cinder-volume[83263]: DEBUG oslo_service.backend._eventlet.service [None req-2bfcfe87-68cf-41a7-ba71-060aafe3ab31 None None] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=83263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 18:55:03 devstack cinder-volume[83263]: DEBUG oslo_service.backend._eventlet.service [None req-2bfcfe87-68cf-41a7-ba71-060aafe3ab31 None None] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=83263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 18:55:03 devstack cinder-volume[83263]: DEBUG oslo_service.backend._eventlet.service [None req-2bfcfe87-68cf-41a7-ba71-060aafe3ab31 None None] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=83263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 18:55:03 devstack cinder-volume[83263]: DEBUG oslo_service.backend._eventlet.service [None req-2bfcfe87-68cf-41a7-ba71-060aafe3ab31 None None] oslo_messaging_rabbit.hostname = devstack {{(pid=83263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 18:55:03 devstack cinder-volume[83263]: DEBUG oslo_service.backend._eventlet.service [None req-2bfcfe87-68cf-41a7-ba71-060aafe3ab31 None None] oslo_messaging_rabbit.kombu_compression = None {{(pid=83263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 18:55:03 devstack cinder-volume[83263]: DEBUG oslo_service.backend._eventlet.service [None req-2bfcfe87-68cf-41a7-ba71-060aafe3ab31 None None] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=83263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 18:55:03 devstack cinder-volume[83263]: DEBUG oslo_service.backend._eventlet.service [None req-2bfcfe87-68cf-41a7-ba71-060aafe3ab31 None None] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=83263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 18:55:03 devstack cinder-volume[83263]: DEBUG oslo_service.backend._eventlet.service [None req-2bfcfe87-68cf-41a7-ba71-060aafe3ab31 None None] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=83263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 18:55:03 devstack cinder-volume[83263]: DEBUG oslo_service.backend._eventlet.service [None req-2bfcfe87-68cf-41a7-ba71-060aafe3ab31 None None] oslo_messaging_rabbit.kombu_reconnect_splay = 0.0 {{(pid=83263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 18:55:03 devstack cinder-volume[83263]: DEBUG oslo_service.backend._eventlet.service [None req-2bfcfe87-68cf-41a7-ba71-060aafe3ab31 None None] oslo_messaging_rabbit.processname = cinder-volume {{(pid=83263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 18:55:03 devstack cinder-volume[83263]: DEBUG oslo_service.backend._eventlet.service [None req-2bfcfe87-68cf-41a7-ba71-060aafe3ab31 None None] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=83263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 18:55:03 devstack cinder-volume[83263]: DEBUG oslo_service.backend._eventlet.service [None req-2bfcfe87-68cf-41a7-ba71-060aafe3ab31 None None] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=83263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 18:55:03 devstack cinder-volume[83263]: DEBUG oslo_service.backend._eventlet.service [None req-2bfcfe87-68cf-41a7-ba71-060aafe3ab31 None None] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=83263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 18:55:03 devstack cinder-volume[83263]: DEBUG oslo_service.backend._eventlet.service [None req-2bfcfe87-68cf-41a7-ba71-060aafe3ab31 None None] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=83263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 18:55:03 devstack cinder-volume[83263]: DEBUG oslo_service.backend._eventlet.service [None req-2bfcfe87-68cf-41a7-ba71-060aafe3ab31 None None] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=83263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 18:55:03 devstack cinder-volume[83263]: DEBUG oslo_service.backend._eventlet.service [None req-2bfcfe87-68cf-41a7-ba71-060aafe3ab31 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_bytes = 0 {{(pid=83263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 18:55:03 devstack cinder-volume[83263]: DEBUG oslo_service.backend._eventlet.service [None req-2bfcfe87-68cf-41a7-ba71-060aafe3ab31 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_length = 0 {{(pid=83263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 18:55:03 devstack cinder-volume[83263]: DEBUG oslo_service.backend._eventlet.service [None req-2bfcfe87-68cf-41a7-ba71-060aafe3ab31 None None] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=83263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 18:55:03 devstack cinder-volume[83263]: DEBUG oslo_service.backend._eventlet.service [None req-2bfcfe87-68cf-41a7-ba71-060aafe3ab31 None None] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=83263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 18:55:03 devstack cinder-volume[83263]: DEBUG oslo_service.backend._eventlet.service [None req-2bfcfe87-68cf-41a7-ba71-060aafe3ab31 None None] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=83263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 18:55:03 devstack cinder-volume[83263]: DEBUG oslo_service.backend._eventlet.service [None req-2bfcfe87-68cf-41a7-ba71-060aafe3ab31 None None] oslo_messaging_rabbit.rabbit_stream_fanout = False {{(pid=83263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 18:55:03 devstack cinder-volume[83263]: DEBUG oslo_service.backend._eventlet.service [None req-2bfcfe87-68cf-41a7-ba71-060aafe3ab31 None None] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=83263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 18:55:03 devstack cinder-volume[83263]: DEBUG oslo_service.backend._eventlet.service [None req-2bfcfe87-68cf-41a7-ba71-060aafe3ab31 None None] oslo_messaging_rabbit.rabbit_transient_quorum_queue = False {{(pid=83263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 18:55:03 devstack cinder-volume[83263]: DEBUG oslo_service.backend._eventlet.service [None req-2bfcfe87-68cf-41a7-ba71-060aafe3ab31 None None] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=83263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 18:55:03 devstack cinder-volume[83263]: DEBUG oslo_service.backend._eventlet.service [None req-2bfcfe87-68cf-41a7-ba71-060aafe3ab31 None None] oslo_messaging_rabbit.ssl = False {{(pid=83263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 18:55:03 devstack cinder-volume[83263]: DEBUG oslo_service.backend._eventlet.service [None req-2bfcfe87-68cf-41a7-ba71-060aafe3ab31 None None] oslo_messaging_rabbit.ssl_ca_file = {{(pid=83263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 18:55:03 devstack cinder-volume[83263]: DEBUG oslo_service.backend._eventlet.service [None req-2bfcfe87-68cf-41a7-ba71-060aafe3ab31 None None] oslo_messaging_rabbit.ssl_cert_file = {{(pid=83263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 18:55:03 devstack cinder-volume[83263]: DEBUG oslo_service.backend._eventlet.service [None req-2bfcfe87-68cf-41a7-ba71-060aafe3ab31 None None] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=83263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 18:55:03 devstack cinder-volume[83263]: DEBUG oslo_service.backend._eventlet.service [None req-2bfcfe87-68cf-41a7-ba71-060aafe3ab31 None None] oslo_messaging_rabbit.ssl_key_file = {{(pid=83263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 18:55:03 devstack cinder-volume[83263]: DEBUG oslo_service.backend._eventlet.service [None req-2bfcfe87-68cf-41a7-ba71-060aafe3ab31 None None] oslo_messaging_rabbit.ssl_version = {{(pid=83263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 18:55:03 devstack cinder-volume[83263]: DEBUG oslo_service.backend._eventlet.service [None req-2bfcfe87-68cf-41a7-ba71-060aafe3ab31 None None] oslo_messaging_rabbit.use_queue_manager = False {{(pid=83263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 18:55:03 devstack cinder-volume[83263]: DEBUG oslo_service.backend._eventlet.service [None req-2bfcfe87-68cf-41a7-ba71-060aafe3ab31 None None] oslo_messaging_notifications.driver = [] {{(pid=83263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 18:55:03 devstack cinder-volume[83263]: DEBUG oslo_service.backend._eventlet.service [None req-2bfcfe87-68cf-41a7-ba71-060aafe3ab31 None None] oslo_messaging_notifications.retry = -1 {{(pid=83263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 18:55:03 devstack cinder-volume[83263]: DEBUG oslo_service.backend._eventlet.service [None req-2bfcfe87-68cf-41a7-ba71-060aafe3ab31 None None] oslo_messaging_notifications.topics = ['notifications'] {{(pid=83263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 18:55:03 devstack cinder-volume[83263]: DEBUG oslo_service.backend._eventlet.service [None req-2bfcfe87-68cf-41a7-ba71-060aafe3ab31 None None] oslo_messaging_notifications.transport_url = **** {{(pid=83263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 18:55:03 devstack cinder-volume[83263]: DEBUG oslo_service.backend._eventlet.service [None req-2bfcfe87-68cf-41a7-ba71-060aafe3ab31 None None] key_manager.backend = cinder.keymgr.conf_key_mgr.ConfKeyManager {{(pid=83263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 18:55:03 devstack cinder-volume[83263]: DEBUG oslo_service.backend._eventlet.service [None req-2bfcfe87-68cf-41a7-ba71-060aafe3ab31 None None] key_manager.fixed_key = **** {{(pid=83263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 18:55:03 devstack cinder-volume[83263]: DEBUG oslo_service.backend._eventlet.service [None req-2bfcfe87-68cf-41a7-ba71-060aafe3ab31 None None] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=83263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 18:55:03 devstack cinder-volume[83263]: DEBUG oslo_service.backend._eventlet.service [None req-2bfcfe87-68cf-41a7-ba71-060aafe3ab31 None None] barbican.barbican_api_version = None {{(pid=83263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 18:55:03 devstack cinder-volume[83263]: DEBUG oslo_service.backend._eventlet.service [None req-2bfcfe87-68cf-41a7-ba71-060aafe3ab31 None None] barbican.barbican_endpoint = None {{(pid=83263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 18:55:03 devstack cinder-volume[83263]: DEBUG oslo_service.backend._eventlet.service [None req-2bfcfe87-68cf-41a7-ba71-060aafe3ab31 None None] barbican.barbican_endpoint_type = public {{(pid=83263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 18:55:03 devstack cinder-volume[83263]: DEBUG oslo_service.backend._eventlet.service [None req-2bfcfe87-68cf-41a7-ba71-060aafe3ab31 None None] barbican.barbican_region_name = None {{(pid=83263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 18:55:03 devstack cinder-volume[83263]: DEBUG oslo_service.backend._eventlet.service [None req-2bfcfe87-68cf-41a7-ba71-060aafe3ab31 None None] barbican.cafile = None {{(pid=83263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 18:55:03 devstack cinder-volume[83263]: DEBUG oslo_service.backend._eventlet.service [None req-2bfcfe87-68cf-41a7-ba71-060aafe3ab31 None None] barbican.certfile = None {{(pid=83263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 18:55:03 devstack cinder-volume[83263]: DEBUG oslo_service.backend._eventlet.service [None req-2bfcfe87-68cf-41a7-ba71-060aafe3ab31 None None] barbican.collect_timing = False {{(pid=83263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 18:55:03 devstack cinder-volume[83263]: DEBUG oslo_service.backend._eventlet.service [None req-2bfcfe87-68cf-41a7-ba71-060aafe3ab31 None None] barbican.insecure = False {{(pid=83263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 18:55:03 devstack cinder-volume[83263]: DEBUG oslo_service.backend._eventlet.service [None req-2bfcfe87-68cf-41a7-ba71-060aafe3ab31 None None] barbican.keyfile = None {{(pid=83263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 18:55:03 devstack cinder-volume[83263]: DEBUG oslo_service.backend._eventlet.service [None req-2bfcfe87-68cf-41a7-ba71-060aafe3ab31 None None] barbican.number_of_retries = 60 {{(pid=83263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 18:55:03 devstack cinder-volume[83263]: DEBUG oslo_service.backend._eventlet.service [None req-2bfcfe87-68cf-41a7-ba71-060aafe3ab31 None None] barbican.retry_delay = 1 {{(pid=83263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 18:55:03 devstack cinder-volume[83263]: DEBUG oslo_service.backend._eventlet.service [None req-2bfcfe87-68cf-41a7-ba71-060aafe3ab31 None None] barbican.send_service_user_token = False {{(pid=83263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 18:55:03 devstack cinder-volume[83263]: DEBUG oslo_service.backend._eventlet.service [None req-2bfcfe87-68cf-41a7-ba71-060aafe3ab31 None None] barbican.split_loggers = False {{(pid=83263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 18:55:03 devstack cinder-volume[83263]: DEBUG oslo_service.backend._eventlet.service [None req-2bfcfe87-68cf-41a7-ba71-060aafe3ab31 None None] barbican.timeout = None {{(pid=83263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 18:55:03 devstack cinder-volume[83263]: DEBUG oslo_service.backend._eventlet.service [None req-2bfcfe87-68cf-41a7-ba71-060aafe3ab31 None None] barbican.verify_ssl = True {{(pid=83263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 18:55:03 devstack cinder-volume[83263]: DEBUG oslo_service.backend._eventlet.service [None req-2bfcfe87-68cf-41a7-ba71-060aafe3ab31 None None] barbican.verify_ssl_path = None {{(pid=83263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 18:55:03 devstack cinder-volume[83263]: DEBUG oslo_service.backend._eventlet.service [None req-2bfcfe87-68cf-41a7-ba71-060aafe3ab31 None None] barbican_service_user.auth_section = None {{(pid=83263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 18:55:03 devstack cinder-volume[83263]: DEBUG oslo_service.backend._eventlet.service [None req-2bfcfe87-68cf-41a7-ba71-060aafe3ab31 None None] barbican_service_user.auth_type = None {{(pid=83263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 18:55:03 devstack cinder-volume[83263]: DEBUG oslo_service.backend._eventlet.service [None req-2bfcfe87-68cf-41a7-ba71-060aafe3ab31 None None] barbican_service_user.cafile = None {{(pid=83263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 18:55:03 devstack cinder-volume[83263]: DEBUG oslo_service.backend._eventlet.service [None req-2bfcfe87-68cf-41a7-ba71-060aafe3ab31 None None] barbican_service_user.certfile = None {{(pid=83263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 18:55:03 devstack cinder-volume[83263]: DEBUG oslo_service.backend._eventlet.service [None req-2bfcfe87-68cf-41a7-ba71-060aafe3ab31 None None] barbican_service_user.collect_timing = False {{(pid=83263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 18:55:03 devstack cinder-volume[83263]: DEBUG oslo_service.backend._eventlet.service [None req-2bfcfe87-68cf-41a7-ba71-060aafe3ab31 None None] barbican_service_user.insecure = False {{(pid=83263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 18:55:03 devstack cinder-volume[83263]: DEBUG oslo_service.backend._eventlet.service [None req-2bfcfe87-68cf-41a7-ba71-060aafe3ab31 None None] barbican_service_user.keyfile = None {{(pid=83263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 18:55:03 devstack cinder-volume[83263]: DEBUG oslo_service.backend._eventlet.service [None req-2bfcfe87-68cf-41a7-ba71-060aafe3ab31 None None] barbican_service_user.split_loggers = False {{(pid=83263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 18:55:03 devstack cinder-volume[83263]: DEBUG oslo_service.backend._eventlet.service [None req-2bfcfe87-68cf-41a7-ba71-060aafe3ab31 None None] barbican_service_user.timeout = None {{(pid=83263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 18:55:03 devstack cinder-volume[83263]: DEBUG oslo_service.backend._eventlet.service [None req-2bfcfe87-68cf-41a7-ba71-060aafe3ab31 None None] vault.approle_role_id = **** {{(pid=83263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 18:55:03 devstack cinder-volume[83263]: DEBUG oslo_service.backend._eventlet.service [None req-2bfcfe87-68cf-41a7-ba71-060aafe3ab31 None None] vault.approle_secret_id = **** {{(pid=83263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 18:55:03 devstack cinder-volume[83263]: DEBUG oslo_service.backend._eventlet.service [None req-2bfcfe87-68cf-41a7-ba71-060aafe3ab31 None None] vault.kv_mountpoint = secret {{(pid=83263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 18:55:03 devstack cinder-volume[83263]: DEBUG oslo_service.backend._eventlet.service [None req-2bfcfe87-68cf-41a7-ba71-060aafe3ab31 None None] vault.kv_path = None {{(pid=83263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 18:55:03 devstack cinder-volume[83263]: DEBUG oslo_service.backend._eventlet.service [None req-2bfcfe87-68cf-41a7-ba71-060aafe3ab31 None None] vault.kv_version = 2 {{(pid=83263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 18:55:03 devstack cinder-volume[83263]: DEBUG oslo_service.backend._eventlet.service [None req-2bfcfe87-68cf-41a7-ba71-060aafe3ab31 None None] vault.namespace = None {{(pid=83263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 18:55:03 devstack cinder-volume[83263]: DEBUG oslo_service.backend._eventlet.service [None req-2bfcfe87-68cf-41a7-ba71-060aafe3ab31 None None] vault.root_token_id = **** {{(pid=83263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 18:55:03 devstack cinder-volume[83263]: DEBUG oslo_service.backend._eventlet.service [None req-2bfcfe87-68cf-41a7-ba71-060aafe3ab31 None None] vault.ssl_ca_crt_file = None {{(pid=83263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 18:55:03 devstack cinder-volume[83263]: DEBUG oslo_service.backend._eventlet.service [None req-2bfcfe87-68cf-41a7-ba71-060aafe3ab31 None None] vault.timeout = 60.0 {{(pid=83263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 18:55:03 devstack cinder-volume[83263]: DEBUG oslo_service.backend._eventlet.service [None req-2bfcfe87-68cf-41a7-ba71-060aafe3ab31 None None] vault.use_ssl = False {{(pid=83263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 18:55:03 devstack cinder-volume[83263]: DEBUG oslo_service.backend._eventlet.service [None req-2bfcfe87-68cf-41a7-ba71-060aafe3ab31 None None] vault.vault_url = http://127.0.0.1:8200 {{(pid=83263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 18:55:03 devstack cinder-volume[83263]: DEBUG oslo_service.backend._eventlet.service [None req-2bfcfe87-68cf-41a7-ba71-060aafe3ab31 None None] ******************************************************************************** {{(pid=83263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3013}} Apr 29 18:55:03 devstack quobyte-client[83896]: Reading configuration file: /etc/quobyte/client.cfg Apr 29 18:55:03 devstack quobyte-client[83896]: Invalid parameters found, error: missing mount point. Apr 29 18:55:03 devstack quobyte-client[83896]: Quobyte logging to journald, you can use 'journalctl QUOBYTE_MOUNTPOINT=' to display the log. Apr 29 18:55:03 devstack quobyte-client[83896]: Failed to parse all commandline parameters, please use -h/--help to see available options. Apr 29 18:55:03 devstack cinder-volume[83881]: DEBUG oslo_concurrency.processutils [None req-0cd58edc-a702-49db-9c33-bc324ffadc9c None None] CMD "mount.quobyte" returned: 1 in 0.122s {{(pid=83881) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 18:55:03 devstack cinder-volume[83881]: DEBUG oslo_concurrency.lockutils [None req-0cd58edc-a702-49db-9c33-bc324ffadc9c None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83881) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 18:55:03 devstack cinder-volume[83881]: DEBUG oslo_concurrency.lockutils [None req-0cd58edc-a702-49db-9c33-bc324ffadc9c None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83881) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 18:55:03 devstack cinder-volume[83881]: DEBUG cinder.volume.drivers.quobyte [None req-0cd58edc-a702-49db-9c33-bc324ffadc9c None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-34312b00-dd6d-45bb-af98-75855cea8e48': None} {{(pid=83881) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 18:55:03 devstack cinder-volume[83881]: INFO cinder.volume.drivers.quobyte [None req-0cd58edc-a702-49db-9c33-bc324ffadc9c None None] Mounting volume: osci02.corp.quobyte.com/cinder-vol-34312b00-dd6d-45bb-af98-75855cea8e48 ... Apr 29 18:55:03 devstack cinder-volume[83881]: DEBUG oslo_concurrency.processutils [None req-0cd58edc-a702-49db-9c33-bc324ffadc9c None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf mount.quobyte --disable-xattrs osci02.corp.quobyte.com/cinder-vol-34312b00-dd6d-45bb-af98-75855cea8e48 /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d -c /etc/quobyte/client-cinder.cfg {{(pid=83881) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 18:55:03 devstack sudo[83898]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf mount.quobyte --disable-xattrs osci02.corp.quobyte.com/cinder-vol-34312b00-dd6d-45bb-af98-75855cea8e48 /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d -c /etc/quobyte/client-cinder.cfg Apr 29 18:55:03 devstack sudo[83898]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 18:55:04 devstack sudo[83898]: pam_unix(sudo:session): session closed for user root Apr 29 18:55:04 devstack cinder-volume[83881]: DEBUG oslo_concurrency.processutils [None req-0cd58edc-a702-49db-9c33-bc324ffadc9c None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf mount.quobyte --disable-xattrs osci02.corp.quobyte.com/cinder-vol-34312b00-dd6d-45bb-af98-75855cea8e48 /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d -c /etc/quobyte/client-cinder.cfg" returned: 0 in 0.758s {{(pid=83881) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 18:55:04 devstack cinder-volume[83881]: INFO cinder.volume.drivers.quobyte [None req-0cd58edc-a702-49db-9c33-bc324ffadc9c None None] Mounting volume: osci02.corp.quobyte.com/cinder-vol-34312b00-dd6d-45bb-af98-75855cea8e48 succeeded Apr 29 18:55:04 devstack cinder-volume[83881]: DEBUG cinder.volume.drivers.quobyte [None req-0cd58edc-a702-49db-9c33-bc324ffadc9c None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-34312b00-dd6d-45bb-af98-75855cea8e48'] {{(pid=83881) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 18:55:04 devstack cinder-volume[83881]: DEBUG oslo_concurrency.lockutils [None req-0cd58edc-a702-49db-9c33-bc324ffadc9c None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.780s {{(pid=83881) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 18:55:04 devstack cinder-volume[83881]: DEBUG oslo_concurrency.processutils [None req-0cd58edc-a702-49db-9c33-bc324ffadc9c None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d {{(pid=83881) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 18:55:04 devstack sudo[83983]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d Apr 29 18:55:04 devstack sudo[83983]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 18:55:04 devstack sudo[83983]: pam_unix(sudo:session): session closed for user root Apr 29 18:55:04 devstack cinder-volume[83881]: DEBUG oslo_concurrency.processutils [None req-0cd58edc-a702-49db-9c33-bc324ffadc9c None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d" returned: 0 in 0.641s {{(pid=83881) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 18:55:04 devstack cinder-volume[83881]: INFO cinder.volume.driver [None req-0cd58edc-a702-49db-9c33-bc324ffadc9c None None] Driver hasn't implemented _init_vendor_properties() Apr 29 18:55:04 devstack cinder-volume[83881]: DEBUG cinder.volume.driver [None req-0cd58edc-a702-49db-9c33-bc324ffadc9c None None] Initialized capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.1.14', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1775.5280113220215, 'free_capacity_gb': 1775.5280113220215, 'reserved_percentage': 0, 'QoS_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=83881) init_capabilities /opt/stack/cinder/cinder/volume/driver.py:873}} Apr 29 18:55:04 devstack cinder-volume[83881]: DEBUG oslo_db.sqlalchemy.engines [None req-0cd58edc-a702-49db-9c33-bc324ffadc9c None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=83881) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Apr 29 18:55:04 devstack cinder-volume[83881]: DEBUG dbcounter [-] [83881] Writer thread running {{(pid=83881) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}} Apr 29 18:55:04 devstack cinder-volume[83881]: DEBUG cinder.db.sqlalchemy.api [None req-0cd58edc-a702-49db-9c33-bc324ffadc9c None None] Building query based on filter {{(pid=83881) _process_snaps_filters /opt/stack/cinder/cinder/db/sqlalchemy/api.py:3943}} Apr 29 18:55:04 devstack cinder-volume[83881]: DEBUG cinder.image.image_utils [None req-0cd58edc-a702-49db-9c33-bc324ffadc9c None None] Configuration image_conversion_dir is None or the path doesn't exist. {{(pid=83881) cleanup_temporary_file /opt/stack/cinder/cinder/image/image_utils.py:1298}} Apr 29 18:55:04 devstack cinder-volume[83881]: INFO cinder.keymgr.migration [None req-d3feaf01-8190-4b41-aefa-fb640ade1847 None None] Not migrating encryption keys because the ConfKeyManager is still in use. Apr 29 18:55:04 devstack cinder-volume[83881]: DEBUG oslo_concurrency.lockutils [None req-0cd58edc-a702-49db-9c33-bc324ffadc9c None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83881) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 18:55:04 devstack cinder-volume[83881]: DEBUG oslo_concurrency.lockutils [None req-0cd58edc-a702-49db-9c33-bc324ffadc9c None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83881) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 18:55:04 devstack cinder-volume[83881]: DEBUG cinder.volume.drivers.quobyte [None req-0cd58edc-a702-49db-9c33-bc324ffadc9c None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-34312b00-dd6d-45bb-af98-75855cea8e48': None} {{(pid=83881) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 18:55:04 devstack cinder-volume[83881]: DEBUG cinder.volume.drivers.quobyte [None req-0cd58edc-a702-49db-9c33-bc324ffadc9c None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-34312b00-dd6d-45bb-af98-75855cea8e48'] {{(pid=83881) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 18:55:04 devstack cinder-volume[83881]: DEBUG oslo_concurrency.lockutils [None req-0cd58edc-a702-49db-9c33-bc324ffadc9c None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=83881) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 18:55:04 devstack cinder-volume[83881]: DEBUG oslo_concurrency.processutils [None req-0cd58edc-a702-49db-9c33-bc324ffadc9c None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d {{(pid=83881) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 18:55:05 devstack sudo[84007]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d Apr 29 18:55:05 devstack sudo[84007]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 18:55:05 devstack sudo[84007]: pam_unix(sudo:session): session closed for user root Apr 29 18:55:05 devstack cinder-volume[83881]: DEBUG oslo_concurrency.processutils [None req-0cd58edc-a702-49db-9c33-bc324ffadc9c None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d" returned: 0 in 0.606s {{(pid=83881) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 18:55:05 devstack cinder-volume[83881]: DEBUG cinder.manager [None req-0cd58edc-a702-49db-9c33-bc324ffadc9c None None] Notifying Schedulers of capabilities ... {{(pid=83881) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 29 18:55:05 devstack cinder-volume[83881]: INFO cinder.volume.manager [None req-0cd58edc-a702-49db-9c33-bc324ffadc9c None None] Driver initialization completed successfully. Apr 29 18:55:05 devstack cinder-volume[83881]: INFO cinder.manager [None req-0cd58edc-a702-49db-9c33-bc324ffadc9c None None] Initiating service 3 cleanup Apr 29 18:55:05 devstack cinder-volume[83881]: INFO cinder.manager [None req-0cd58edc-a702-49db-9c33-bc324ffadc9c None None] Service 3 cleanup completed. Apr 29 18:55:05 devstack cinder-volume[83881]: DEBUG cinder.service [None req-0cd58edc-a702-49db-9c33-bc324ffadc9c None None] Creating RPC server for service cinder-volume {{(pid=83881) start /opt/stack/cinder/cinder/service.py:231}} Apr 29 18:55:05 devstack cinder-volume[83881]: DEBUG cinder.service [None req-0cd58edc-a702-49db-9c33-bc324ffadc9c None None] Pinning object versions for RPC server serializer to 1.39 {{(pid=83881) start /opt/stack/cinder/cinder/service.py:237}} Apr 29 18:55:05 devstack cinder-volume[83881]: INFO cinder.volume.manager [None req-0cd58edc-a702-49db-9c33-bc324ffadc9c None None] Initializing RPC dependent components of volume driver QuobyteDriver (1.1.14) Apr 29 18:55:05 devstack cinder-volume[83881]: DEBUG oslo_concurrency.lockutils [None req-0cd58edc-a702-49db-9c33-bc324ffadc9c None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83881) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 18:55:05 devstack cinder-volume[83881]: DEBUG oslo_concurrency.lockutils [None req-0cd58edc-a702-49db-9c33-bc324ffadc9c None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83881) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 18:55:05 devstack cinder-volume[83881]: DEBUG cinder.volume.drivers.quobyte [None req-0cd58edc-a702-49db-9c33-bc324ffadc9c None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-34312b00-dd6d-45bb-af98-75855cea8e48': None} {{(pid=83881) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 18:55:05 devstack cinder-volume[83881]: DEBUG cinder.volume.drivers.quobyte [None req-0cd58edc-a702-49db-9c33-bc324ffadc9c None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-34312b00-dd6d-45bb-af98-75855cea8e48'] {{(pid=83881) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 18:55:05 devstack cinder-volume[83881]: DEBUG oslo_concurrency.lockutils [None req-0cd58edc-a702-49db-9c33-bc324ffadc9c None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=83881) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 18:55:05 devstack cinder-volume[83881]: DEBUG oslo_concurrency.processutils [None req-0cd58edc-a702-49db-9c33-bc324ffadc9c None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d {{(pid=83881) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 18:55:05 devstack sudo[84029]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d Apr 29 18:55:05 devstack sudo[84029]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 18:55:06 devstack sudo[84029]: pam_unix(sudo:session): session closed for user root Apr 29 18:55:06 devstack cinder-volume[83881]: DEBUG oslo_concurrency.processutils [None req-0cd58edc-a702-49db-9c33-bc324ffadc9c None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d" returned: 0 in 0.685s {{(pid=83881) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 18:55:06 devstack cinder-volume[83881]: INFO cinder.volume.manager [None req-0cd58edc-a702-49db-9c33-bc324ffadc9c None None] Driver post RPC initialization completed successfully. Apr 29 18:55:08 devstack cinder-volume[83263]: INFO oslo_service.backend._eventlet.service [None req-2bfcfe87-68cf-41a7-ba71-060aafe3ab31 None None] Caught SIGTERM, stopping children Apr 29 18:55:08 devstack cinder-volume[83263]: DEBUG oslo_concurrency.lockutils [None req-2bfcfe87-68cf-41a7-ba71-060aafe3ab31 None None] Acquiring lock "singleton_lock" {{(pid=83263) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:390}} Apr 29 18:55:08 devstack cinder-volume[83263]: DEBUG oslo_concurrency.lockutils [None req-2bfcfe87-68cf-41a7-ba71-060aafe3ab31 None None] Acquired lock "singleton_lock" {{(pid=83263) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:393}} Apr 29 18:55:08 devstack cinder-volume[83263]: DEBUG oslo_concurrency.lockutils [None req-2bfcfe87-68cf-41a7-ba71-060aafe3ab31 None None] Releasing lock "singleton_lock" {{(pid=83263) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:413}} Apr 29 18:55:08 devstack cinder-volume[83263]: DEBUG oslo_service.backend._eventlet.service [None req-2bfcfe87-68cf-41a7-ba71-060aafe3ab31 None None] Stop services. {{(pid=83263) stop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:611}} Apr 29 18:55:08 devstack cinder-volume[83263]: DEBUG oslo_service.backend._eventlet.service [None req-2bfcfe87-68cf-41a7-ba71-060aafe3ab31 None None] Killing children. {{(pid=83263) stop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:616}} Apr 29 18:55:08 devstack cinder-volume[83263]: INFO oslo_service.backend._eventlet.service [None req-2bfcfe87-68cf-41a7-ba71-060aafe3ab31 None None] Waiting on 1 children to exit Apr 29 18:55:09 devstack cinder-volume[83881]: DEBUG oslo_concurrency.lockutils [None req-2bfcfe87-68cf-41a7-ba71-060aafe3ab31 None None] Acquiring lock "singleton_lock" {{(pid=83881) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:390}} Apr 29 18:55:09 devstack cinder-volume[83881]: DEBUG oslo_concurrency.lockutils [None req-2bfcfe87-68cf-41a7-ba71-060aafe3ab31 None None] Acquired lock "singleton_lock" {{(pid=83881) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:393}} Apr 29 18:55:09 devstack cinder-volume[83881]: DEBUG oslo_concurrency.lockutils [None req-2bfcfe87-68cf-41a7-ba71-060aafe3ab31 None None] Releasing lock "singleton_lock" {{(pid=83881) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:413}} Apr 29 18:55:09 devstack cinder-volume[83881]: WARNING amqp [None req-2bfcfe87-68cf-41a7-ba71-060aafe3ab31 None None] Received method (60, 30) during closing channel 1. This method will be ignored Apr 29 18:55:09 devstack cinder-volume[83881]: WARNING amqp [None req-2bfcfe87-68cf-41a7-ba71-060aafe3ab31 None None] Received method (60, 30) during closing channel 1. This method will be ignored Apr 29 18:55:09 devstack cinder-volume[83263]: INFO oslo_service.backend._eventlet.service [None req-2bfcfe87-68cf-41a7-ba71-060aafe3ab31 None None] Child 83881 exited with status 0 Apr 29 18:55:13 devstack cinder-volume[84210]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "singleton_lock" {{(pid=84210) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:390}} Apr 29 18:55:13 devstack cinder-volume[84210]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "singleton_lock" {{(pid=84210) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:393}} Apr 29 18:55:13 devstack cinder-volume[84210]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "singleton_lock" {{(pid=84210) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:413}} Apr 29 18:55:14 devstack cinder-volume[84210]: INFO dbcounter [None req-da7f399b-5856-43ac-bce2-fd2ffdedcdfb None None] Registered counter for database cinder Apr 29 18:55:14 devstack cinder-volume[84210]: DEBUG oslo_db.sqlalchemy.engines [None req-da7f399b-5856-43ac-bce2-fd2ffdedcdfb None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=84210) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Apr 29 18:55:14 devstack cinder-volume[84210]: DEBUG dbcounter [-] [84210] Writer thread running {{(pid=84210) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}} Apr 29 18:55:14 devstack cinder-volume[84210]: INFO cinder.rpc [None req-da7f399b-5856-43ac-bce2-fd2ffdedcdfb None None] Automatically selected cinder-scheduler objects version 1.39 as minimum service version. Apr 29 18:55:14 devstack cinder-volume[84210]: INFO cinder.rpc [None req-da7f399b-5856-43ac-bce2-fd2ffdedcdfb None None] Automatically selected cinder-scheduler RPC version 3.12 as minimum service version. Apr 29 18:55:14 devstack cinder-volume[84210]: DEBUG oslo_db.sqlalchemy.engines [None req-da7f399b-5856-43ac-bce2-fd2ffdedcdfb None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=84210) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Apr 29 18:55:14 devstack cinder-volume[84210]: INFO cinder.volume.manager [None req-da7f399b-5856-43ac-bce2-fd2ffdedcdfb None None] Determined volume DB was empty at startup. Apr 29 18:55:14 devstack cinder-volume[84210]: DEBUG cinder.volume.manager [None req-da7f399b-5856-43ac-bce2-fd2ffdedcdfb None None] Cinder Volume DB check: vol_db_empty=True {{(pid=84210) __init__ /opt/stack/cinder/cinder/volume/manager.py:288}} Apr 29 18:55:14 devstack cinder-volume[84210]: WARNING stevedore.named [None req-da7f399b-5856-43ac-bce2-fd2ffdedcdfb None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Apr 29 18:55:14 devstack cinder-volume[84210]: WARNING castellan.key_manager [None req-da7f399b-5856-43ac-bce2-fd2ffdedcdfb None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Apr 29 18:55:14 devstack cinder-volume[84210]: WARNING cinder.keymgr.conf_key_mgr [None req-da7f399b-5856-43ac-bce2-fd2ffdedcdfb None None] This key manager is insecure and is not recommended for production deployments: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Apr 29 18:55:14 devstack cinder-volume[84210]: INFO cinder.volume.manager [None req-da7f399b-5856-43ac-bce2-fd2ffdedcdfb None None] Image-volume cache disabled for host devstack@QuobyteHD. Apr 29 18:55:14 devstack cinder-volume[84210]: DEBUG oslo_db.sqlalchemy.engines [None req-da7f399b-5856-43ac-bce2-fd2ffdedcdfb None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=84210) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Apr 29 18:55:14 devstack cinder-volume[84210]: INFO oslo_service.backend._eventlet.service [None req-da7f399b-5856-43ac-bce2-fd2ffdedcdfb None None] Starting 1 workers Apr 29 18:55:14 devstack cinder-volume[84210]: DEBUG oslo_service.backend._eventlet.service [None req-da7f399b-5856-43ac-bce2-fd2ffdedcdfb None None] Started child 84538 {{(pid=84210) _start_child /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:491}} Apr 29 18:55:14 devstack cinder-volume[84210]: DEBUG oslo_service.backend._eventlet.service [None req-da7f399b-5856-43ac-bce2-fd2ffdedcdfb None None] Full set of CONF: {{(pid=84210) wait /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:565}} Apr 29 18:55:14 devstack cinder-volume[84210]: DEBUG oslo_service.backend._eventlet.service [None req-da7f399b-5856-43ac-bce2-fd2ffdedcdfb None None] ******************************************************************************** {{(pid=84210) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2979}} Apr 29 18:55:14 devstack cinder-volume[84210]: DEBUG oslo_service.backend._eventlet.service [None req-da7f399b-5856-43ac-bce2-fd2ffdedcdfb None None] Configuration options gathered from: {{(pid=84210) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2980}} Apr 29 18:55:14 devstack cinder-volume[84210]: DEBUG oslo_service.backend._eventlet.service [None req-da7f399b-5856-43ac-bce2-fd2ffdedcdfb None None] command line args: ['--config-file', '/etc/cinder/cinder.conf'] {{(pid=84210) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2981}} Apr 29 18:55:14 devstack cinder-volume[84210]: DEBUG oslo_service.backend._eventlet.service [None req-da7f399b-5856-43ac-bce2-fd2ffdedcdfb None None] config files: ['/etc/cinder/cinder.conf'] {{(pid=84210) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2982}} Apr 29 18:55:14 devstack cinder-volume[84210]: DEBUG oslo_service.backend._eventlet.service [None req-da7f399b-5856-43ac-bce2-fd2ffdedcdfb None None] ================================================================================ {{(pid=84210) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2987}} Apr 29 18:55:14 devstack cinder-volume[84210]: DEBUG oslo_service.backend._eventlet.service [None req-da7f399b-5856-43ac-bce2-fd2ffdedcdfb None None] allow_availability_zone_fallback = False {{(pid=84210) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 18:55:14 devstack cinder-volume[84210]: DEBUG oslo_service.backend._eventlet.service [None req-da7f399b-5856-43ac-bce2-fd2ffdedcdfb None None] allow_compression_on_image_upload = False {{(pid=84210) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 18:55:14 devstack cinder-volume[84210]: DEBUG oslo_service.backend._eventlet.service [None req-da7f399b-5856-43ac-bce2-fd2ffdedcdfb None None] allowed_direct_url_schemes = [] {{(pid=84210) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 18:55:14 devstack cinder-volume[84210]: DEBUG oslo_service.backend._eventlet.service [None req-da7f399b-5856-43ac-bce2-fd2ffdedcdfb None None] api_rate_limit = True {{(pid=84210) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 18:55:15 devstack cinder-volume[84210]: DEBUG oslo_service.backend._eventlet.service [None req-da7f399b-5856-43ac-bce2-fd2ffdedcdfb None None] auth_strategy = keystone {{(pid=84210) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 18:55:15 devstack cinder-volume[84210]: DEBUG oslo_service.backend._eventlet.service [None req-da7f399b-5856-43ac-bce2-fd2ffdedcdfb None None] backend_availability_zone = None {{(pid=84210) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 18:55:15 devstack cinder-volume[84210]: DEBUG oslo_service.backend._eventlet.service [None req-da7f399b-5856-43ac-bce2-fd2ffdedcdfb None None] backend_host = None {{(pid=84210) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 18:55:15 devstack cinder-volume[84210]: DEBUG oslo_service.backend._eventlet.service [None req-da7f399b-5856-43ac-bce2-fd2ffdedcdfb None None] backend_name = None {{(pid=84210) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 18:55:15 devstack cinder-volume[84210]: DEBUG oslo_service.backend._eventlet.service [None req-da7f399b-5856-43ac-bce2-fd2ffdedcdfb None None] backend_stats_polling_interval = 60 {{(pid=84210) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 18:55:15 devstack cinder-volume[84210]: DEBUG oslo_service.backend._eventlet.service [None req-da7f399b-5856-43ac-bce2-fd2ffdedcdfb None None] backup_api_class = cinder.backup.api.API {{(pid=84210) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 18:55:15 devstack cinder-volume[84210]: DEBUG oslo_service.backend._eventlet.service [None req-da7f399b-5856-43ac-bce2-fd2ffdedcdfb None None] backup_manager = cinder.backup.manager.BackupManager {{(pid=84210) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 18:55:15 devstack cinder-volume[84210]: DEBUG oslo_service.backend._eventlet.service [None req-da7f399b-5856-43ac-bce2-fd2ffdedcdfb None None] backup_name_template = backup-%s {{(pid=84210) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 18:55:15 devstack cinder-volume[84210]: DEBUG oslo_service.backend._eventlet.service [None req-da7f399b-5856-43ac-bce2-fd2ffdedcdfb None None] backup_use_same_host = False {{(pid=84210) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 18:55:15 devstack cinder-volume[84210]: DEBUG oslo_service.backend._eventlet.service [None req-da7f399b-5856-43ac-bce2-fd2ffdedcdfb None None] backup_use_temp_snapshot = False {{(pid=84210) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 18:55:15 devstack cinder-volume[84210]: DEBUG oslo_service.backend._eventlet.service [None req-da7f399b-5856-43ac-bce2-fd2ffdedcdfb None None] chap_password = **** {{(pid=84210) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 18:55:15 devstack cinder-volume[84210]: DEBUG oslo_service.backend._eventlet.service [None req-da7f399b-5856-43ac-bce2-fd2ffdedcdfb None None] chap_username = {{(pid=84210) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 18:55:15 devstack cinder-volume[84210]: DEBUG oslo_service.backend._eventlet.service [None req-da7f399b-5856-43ac-bce2-fd2ffdedcdfb None None] chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=84210) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 18:55:15 devstack cinder-volume[84210]: DEBUG oslo_service.backend._eventlet.service [None req-da7f399b-5856-43ac-bce2-fd2ffdedcdfb None None] cinder_internal_tenant_project_id = dece91964b24460f8d24561836f27c9f {{(pid=84210) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 18:55:15 devstack cinder-volume[84210]: DEBUG oslo_service.backend._eventlet.service [None req-da7f399b-5856-43ac-bce2-fd2ffdedcdfb None None] cinder_internal_tenant_user_id = 029d4e2c59b444a59d4282ffce967113 {{(pid=84210) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 18:55:15 devstack cinder-volume[84210]: DEBUG oslo_service.backend._eventlet.service [None req-da7f399b-5856-43ac-bce2-fd2ffdedcdfb None None] cluster = None {{(pid=84210) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 18:55:15 devstack cinder-volume[84210]: DEBUG oslo_service.backend._eventlet.service [None req-da7f399b-5856-43ac-bce2-fd2ffdedcdfb None None] compression_format = gzip {{(pid=84210) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 18:55:15 devstack cinder-volume[84210]: DEBUG oslo_service.backend._eventlet.service [None req-da7f399b-5856-43ac-bce2-fd2ffdedcdfb None None] compute_api_class = cinder.compute.nova.API {{(pid=84210) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 18:55:15 devstack cinder-volume[84210]: DEBUG oslo_service.backend._eventlet.service [None req-da7f399b-5856-43ac-bce2-fd2ffdedcdfb None None] config_dir = [] {{(pid=84210) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 18:55:15 devstack cinder-volume[84210]: DEBUG oslo_service.backend._eventlet.service [None req-da7f399b-5856-43ac-bce2-fd2ffdedcdfb None None] config_file = ['/etc/cinder/cinder.conf'] {{(pid=84210) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 18:55:15 devstack cinder-volume[84210]: DEBUG oslo_service.backend._eventlet.service [None req-da7f399b-5856-43ac-bce2-fd2ffdedcdfb None None] config_source = [] {{(pid=84210) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 18:55:15 devstack cinder-volume[84210]: DEBUG oslo_service.backend._eventlet.service [None req-da7f399b-5856-43ac-bce2-fd2ffdedcdfb None None] consistencygroup_api_class = cinder.consistencygroup.api.API {{(pid=84210) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 18:55:15 devstack cinder-volume[84538]: INFO cinder.service [-] Starting cinder-volume node (version 28.0.0) Apr 29 18:55:15 devstack cinder-volume[84210]: DEBUG oslo_service.backend._eventlet.service [None req-da7f399b-5856-43ac-bce2-fd2ffdedcdfb None None] control_exchange = openstack {{(pid=84210) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 18:55:15 devstack cinder-volume[84210]: DEBUG oslo_service.backend._eventlet.service [None req-da7f399b-5856-43ac-bce2-fd2ffdedcdfb None None] debug = True {{(pid=84210) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 18:55:15 devstack cinder-volume[84210]: DEBUG oslo_service.backend._eventlet.service [None req-da7f399b-5856-43ac-bce2-fd2ffdedcdfb None None] default_availability_zone = None {{(pid=84210) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 18:55:15 devstack cinder-volume[84210]: DEBUG oslo_service.backend._eventlet.service [None req-da7f399b-5856-43ac-bce2-fd2ffdedcdfb None None] default_group_type = None {{(pid=84210) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 18:55:15 devstack cinder-volume[84210]: DEBUG oslo_service.backend._eventlet.service [None req-da7f399b-5856-43ac-bce2-fd2ffdedcdfb None None] default_log_levels = ['amqp=WARN', 'boto=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO'] {{(pid=84210) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 18:55:15 devstack cinder-volume[84210]: DEBUG oslo_service.backend._eventlet.service [None req-da7f399b-5856-43ac-bce2-fd2ffdedcdfb None None] default_volume_type = QuobyteHD {{(pid=84210) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 18:55:15 devstack cinder-volume[84210]: DEBUG oslo_service.backend._eventlet.service [None req-da7f399b-5856-43ac-bce2-fd2ffdedcdfb None None] disk_geometry = None {{(pid=84210) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 18:55:15 devstack cinder-volume[84210]: DEBUG oslo_service.backend._eventlet.service [None req-da7f399b-5856-43ac-bce2-fd2ffdedcdfb None None] driver_client_cert = None {{(pid=84210) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 18:55:15 devstack cinder-volume[84210]: DEBUG oslo_service.backend._eventlet.service [None req-da7f399b-5856-43ac-bce2-fd2ffdedcdfb None None] driver_client_cert_key = None {{(pid=84210) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 18:55:15 devstack cinder-volume[84210]: DEBUG oslo_service.backend._eventlet.service [None req-da7f399b-5856-43ac-bce2-fd2ffdedcdfb None None] driver_data_namespace = None {{(pid=84210) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 18:55:15 devstack cinder-volume[84210]: DEBUG oslo_service.backend._eventlet.service [None req-da7f399b-5856-43ac-bce2-fd2ffdedcdfb None None] driver_ssl_cert_path = None {{(pid=84210) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 18:55:15 devstack cinder-volume[84210]: DEBUG oslo_service.backend._eventlet.service [None req-da7f399b-5856-43ac-bce2-fd2ffdedcdfb None None] driver_ssl_cert_verify = False {{(pid=84210) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 18:55:15 devstack cinder-volume[84210]: DEBUG oslo_service.backend._eventlet.service [None req-da7f399b-5856-43ac-bce2-fd2ffdedcdfb None None] driver_use_ssl = False {{(pid=84210) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 18:55:15 devstack cinder-volume[84210]: DEBUG oslo_service.backend._eventlet.service [None req-da7f399b-5856-43ac-bce2-fd2ffdedcdfb None None] enable_new_services = True {{(pid=84210) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 18:55:15 devstack cinder-volume[84210]: DEBUG oslo_service.backend._eventlet.service [None req-da7f399b-5856-43ac-bce2-fd2ffdedcdfb None None] enable_unsupported_driver = False {{(pid=84210) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 18:55:15 devstack cinder-volume[84210]: DEBUG oslo_service.backend._eventlet.service [None req-da7f399b-5856-43ac-bce2-fd2ffdedcdfb None None] enabled_backends = ['QuobyteHD'] {{(pid=84210) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 18:55:15 devstack cinder-volume[84210]: DEBUG oslo_service.backend._eventlet.service [None req-da7f399b-5856-43ac-bce2-fd2ffdedcdfb None None] enforce_multipath_for_image_xfer = False {{(pid=84210) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 18:55:15 devstack cinder-volume[84210]: DEBUG oslo_service.backend._eventlet.service [None req-da7f399b-5856-43ac-bce2-fd2ffdedcdfb None None] filter_function = None {{(pid=84210) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 18:55:15 devstack cinder-volume[84210]: DEBUG oslo_service.backend._eventlet.service [None req-da7f399b-5856-43ac-bce2-fd2ffdedcdfb None None] glance_api_insecure = False {{(pid=84210) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 18:55:15 devstack cinder-volume[84210]: DEBUG oslo_service.backend._eventlet.service [None req-da7f399b-5856-43ac-bce2-fd2ffdedcdfb None None] glance_api_servers = ['http://192.168.122.135/image'] {{(pid=84210) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 18:55:15 devstack cinder-volume[84210]: DEBUG oslo_service.backend._eventlet.service [None req-da7f399b-5856-43ac-bce2-fd2ffdedcdfb None None] glance_api_ssl_compression = False {{(pid=84210) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 18:55:15 devstack cinder-volume[84210]: DEBUG oslo_service.backend._eventlet.service [None req-da7f399b-5856-43ac-bce2-fd2ffdedcdfb None None] glance_ca_certificates_file = None {{(pid=84210) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 18:55:15 devstack cinder-volume[84210]: DEBUG oslo_service.backend._eventlet.service [None req-da7f399b-5856-43ac-bce2-fd2ffdedcdfb None None] glance_catalog_info = image:glance:publicURL {{(pid=84210) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 18:55:15 devstack cinder-volume[84210]: DEBUG oslo_service.backend._eventlet.service [None req-da7f399b-5856-43ac-bce2-fd2ffdedcdfb None None] glance_certfile = None {{(pid=84210) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 18:55:15 devstack cinder-volume[84210]: DEBUG oslo_service.backend._eventlet.service [None req-da7f399b-5856-43ac-bce2-fd2ffdedcdfb None None] glance_core_properties = ['checksum', 'container_format', 'disk_format', 'image_name', 'image_id', 'min_disk', 'min_ram', 'name', 'size'] {{(pid=84210) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 18:55:15 devstack cinder-volume[84210]: DEBUG oslo_service.backend._eventlet.service [None req-da7f399b-5856-43ac-bce2-fd2ffdedcdfb None None] glance_keyfile = None {{(pid=84210) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 18:55:15 devstack cinder-volume[84210]: DEBUG oslo_service.backend._eventlet.service [None req-da7f399b-5856-43ac-bce2-fd2ffdedcdfb None None] glance_num_retries = 3 {{(pid=84210) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 18:55:15 devstack cinder-volume[84210]: DEBUG oslo_service.backend._eventlet.service [None req-da7f399b-5856-43ac-bce2-fd2ffdedcdfb None None] glance_request_timeout = None {{(pid=84210) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 18:55:15 devstack cinder-volume[84210]: DEBUG oslo_service.backend._eventlet.service [None req-da7f399b-5856-43ac-bce2-fd2ffdedcdfb None None] goodness_function = None {{(pid=84210) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 18:55:15 devstack cinder-volume[84210]: DEBUG oslo_service.backend._eventlet.service [None req-da7f399b-5856-43ac-bce2-fd2ffdedcdfb None None] graceful_shutdown_timeout = 5 {{(pid=84210) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 18:55:15 devstack cinder-volume[84210]: DEBUG oslo_service.backend._eventlet.service [None req-da7f399b-5856-43ac-bce2-fd2ffdedcdfb None None] group_api_class = cinder.group.api.API {{(pid=84210) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 18:55:15 devstack cinder-volume[84210]: DEBUG oslo_service.backend._eventlet.service [None req-da7f399b-5856-43ac-bce2-fd2ffdedcdfb None None] host = devstack {{(pid=84210) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 18:55:15 devstack cinder-volume[84210]: DEBUG oslo_service.backend._eventlet.service [None req-da7f399b-5856-43ac-bce2-fd2ffdedcdfb None None] image_compress_on_upload = True {{(pid=84210) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 18:55:15 devstack cinder-volume[84210]: DEBUG oslo_service.backend._eventlet.service [None req-da7f399b-5856-43ac-bce2-fd2ffdedcdfb None None] image_conversion_address_space_limit = 1 {{(pid=84210) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 18:55:15 devstack cinder-volume[84210]: DEBUG oslo_service.backend._eventlet.service [None req-da7f399b-5856-43ac-bce2-fd2ffdedcdfb None None] image_conversion_cpu_limit = 60 {{(pid=84210) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 18:55:15 devstack cinder-volume[84210]: DEBUG oslo_service.backend._eventlet.service [None req-da7f399b-5856-43ac-bce2-fd2ffdedcdfb None None] image_conversion_dir = /opt/stack/data/cinder/conversion {{(pid=84210) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 18:55:15 devstack cinder-volume[84210]: DEBUG oslo_service.backend._eventlet.service [None req-da7f399b-5856-43ac-bce2-fd2ffdedcdfb None None] image_conversion_disable = False {{(pid=84210) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 18:55:15 devstack cinder-volume[84210]: DEBUG oslo_service.backend._eventlet.service [None req-da7f399b-5856-43ac-bce2-fd2ffdedcdfb None None] image_upload_use_cinder_backend = False {{(pid=84210) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 18:55:15 devstack cinder-volume[84210]: DEBUG oslo_service.backend._eventlet.service [None req-da7f399b-5856-43ac-bce2-fd2ffdedcdfb None None] image_upload_use_internal_tenant = False {{(pid=84210) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 18:55:15 devstack cinder-volume[84210]: DEBUG oslo_service.backend._eventlet.service [None req-da7f399b-5856-43ac-bce2-fd2ffdedcdfb None None] image_volume_cache_enabled = False {{(pid=84210) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 18:55:15 devstack cinder-volume[84210]: DEBUG oslo_service.backend._eventlet.service [None req-da7f399b-5856-43ac-bce2-fd2ffdedcdfb None None] image_volume_cache_max_count = 0 {{(pid=84210) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 18:55:15 devstack cinder-volume[84210]: DEBUG oslo_service.backend._eventlet.service [None req-da7f399b-5856-43ac-bce2-fd2ffdedcdfb None None] image_volume_cache_max_size_gb = 0 {{(pid=84210) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 18:55:15 devstack cinder-volume[84210]: DEBUG oslo_service.backend._eventlet.service [None req-da7f399b-5856-43ac-bce2-fd2ffdedcdfb None None] init_host_max_objects_retrieval = 0 {{(pid=84210) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 18:55:15 devstack cinder-volume[84210]: DEBUG oslo_service.backend._eventlet.service [None req-da7f399b-5856-43ac-bce2-fd2ffdedcdfb None None] instance_format = [instance: %(uuid)s] {{(pid=84210) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 18:55:15 devstack cinder-volume[84210]: DEBUG oslo_service.backend._eventlet.service [None req-da7f399b-5856-43ac-bce2-fd2ffdedcdfb None None] instance_uuid_format = [instance: %(uuid)s] {{(pid=84210) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 18:55:15 devstack cinder-volume[84210]: DEBUG oslo_service.backend._eventlet.service [None req-da7f399b-5856-43ac-bce2-fd2ffdedcdfb None None] iscsi_target_flags = {{(pid=84210) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 18:55:15 devstack cinder-volume[84210]: DEBUG oslo_service.backend._eventlet.service [None req-da7f399b-5856-43ac-bce2-fd2ffdedcdfb None None] iscsi_write_cache = on {{(pid=84210) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 18:55:15 devstack cinder-volume[84210]: DEBUG oslo_service.backend._eventlet.service [None req-da7f399b-5856-43ac-bce2-fd2ffdedcdfb None None] iser_helper = tgtadm {{(pid=84210) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 18:55:15 devstack cinder-volume[84210]: DEBUG oslo_service.backend._eventlet.service [None req-da7f399b-5856-43ac-bce2-fd2ffdedcdfb None None] iser_ip_address = 192.168.122.135 {{(pid=84210) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 18:55:15 devstack cinder-volume[84210]: DEBUG oslo_service.backend._eventlet.service [None req-da7f399b-5856-43ac-bce2-fd2ffdedcdfb None None] iser_port = 3260 {{(pid=84210) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 18:55:15 devstack cinder-volume[84210]: DEBUG oslo_service.backend._eventlet.service [None req-da7f399b-5856-43ac-bce2-fd2ffdedcdfb None None] iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=84210) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 18:55:15 devstack cinder-volume[84210]: DEBUG oslo_service.backend._eventlet.service [None req-da7f399b-5856-43ac-bce2-fd2ffdedcdfb None None] log_color = False {{(pid=84210) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 18:55:15 devstack cinder-volume[84210]: DEBUG oslo_service.backend._eventlet.service [None req-da7f399b-5856-43ac-bce2-fd2ffdedcdfb None None] log_config_append = None {{(pid=84210) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 18:55:15 devstack cinder-volume[84210]: DEBUG oslo_service.backend._eventlet.service [None req-da7f399b-5856-43ac-bce2-fd2ffdedcdfb None None] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=84210) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 18:55:15 devstack cinder-volume[84210]: DEBUG oslo_service.backend._eventlet.service [None req-da7f399b-5856-43ac-bce2-fd2ffdedcdfb None None] log_dir = None {{(pid=84210) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 18:55:15 devstack cinder-volume[84210]: DEBUG oslo_service.backend._eventlet.service [None req-da7f399b-5856-43ac-bce2-fd2ffdedcdfb None None] log_file = None {{(pid=84210) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 18:55:15 devstack cinder-volume[84210]: DEBUG oslo_service.backend._eventlet.service [None req-da7f399b-5856-43ac-bce2-fd2ffdedcdfb None None] log_options = True {{(pid=84210) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 18:55:15 devstack cinder-volume[84210]: DEBUG oslo_service.backend._eventlet.service [None req-da7f399b-5856-43ac-bce2-fd2ffdedcdfb None None] log_rotate_interval = 1 {{(pid=84210) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 18:55:15 devstack cinder-volume[84210]: DEBUG oslo_service.backend._eventlet.service [None req-da7f399b-5856-43ac-bce2-fd2ffdedcdfb None None] log_rotate_interval_type = days {{(pid=84210) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 18:55:15 devstack cinder-volume[84210]: DEBUG oslo_service.backend._eventlet.service [None req-da7f399b-5856-43ac-bce2-fd2ffdedcdfb None None] log_rotation_type = none {{(pid=84210) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 18:55:15 devstack cinder-volume[84210]: DEBUG oslo_service.backend._eventlet.service [None req-da7f399b-5856-43ac-bce2-fd2ffdedcdfb None None] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=84210) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 18:55:15 devstack cinder-volume[84210]: DEBUG oslo_service.backend._eventlet.service [None req-da7f399b-5856-43ac-bce2-fd2ffdedcdfb None None] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=84210) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 18:55:15 devstack cinder-volume[84210]: DEBUG oslo_service.backend._eventlet.service [None req-da7f399b-5856-43ac-bce2-fd2ffdedcdfb None None] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=84210) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 18:55:15 devstack cinder-volume[84210]: DEBUG oslo_service.backend._eventlet.service [None req-da7f399b-5856-43ac-bce2-fd2ffdedcdfb None None] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=84210) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 18:55:15 devstack cinder-volume[84210]: DEBUG oslo_service.backend._eventlet.service [None req-da7f399b-5856-43ac-bce2-fd2ffdedcdfb None None] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=84210) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 18:55:15 devstack cinder-volume[84210]: DEBUG oslo_service.backend._eventlet.service [None req-da7f399b-5856-43ac-bce2-fd2ffdedcdfb None None] max_age = 0 {{(pid=84210) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 18:55:15 devstack cinder-volume[84210]: DEBUG oslo_service.backend._eventlet.service [None req-da7f399b-5856-43ac-bce2-fd2ffdedcdfb None None] max_logfile_count = 30 {{(pid=84210) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 18:55:15 devstack cinder-volume[84210]: DEBUG oslo_service.backend._eventlet.service [None req-da7f399b-5856-43ac-bce2-fd2ffdedcdfb None None] max_logfile_size_mb = 200 {{(pid=84210) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 18:55:15 devstack cinder-volume[84210]: DEBUG oslo_service.backend._eventlet.service [None req-da7f399b-5856-43ac-bce2-fd2ffdedcdfb None None] max_over_subscription_ratio = 20.0 {{(pid=84210) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 18:55:15 devstack cinder-volume[84210]: DEBUG oslo_service.backend._eventlet.service [None req-da7f399b-5856-43ac-bce2-fd2ffdedcdfb None None] message_reap_interval = 86400 {{(pid=84210) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 18:55:15 devstack cinder-volume[84210]: DEBUG oslo_service.backend._eventlet.service [None req-da7f399b-5856-43ac-bce2-fd2ffdedcdfb None None] message_ttl = 2592000 {{(pid=84210) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 18:55:15 devstack cinder-volume[84210]: DEBUG oslo_service.backend._eventlet.service [None req-da7f399b-5856-43ac-bce2-fd2ffdedcdfb None None] migration_create_volume_timeout_secs = 300 {{(pid=84210) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 18:55:15 devstack cinder-volume[84210]: DEBUG oslo_service.backend._eventlet.service [None req-da7f399b-5856-43ac-bce2-fd2ffdedcdfb None None] monkey_patch = False {{(pid=84210) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 18:55:15 devstack cinder-volume[84210]: DEBUG oslo_service.backend._eventlet.service [None req-da7f399b-5856-43ac-bce2-fd2ffdedcdfb None None] monkey_patch_modules = [] {{(pid=84210) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 18:55:15 devstack cinder-volume[84210]: DEBUG oslo_service.backend._eventlet.service [None req-da7f399b-5856-43ac-bce2-fd2ffdedcdfb None None] my_ip = 192.168.122.135 {{(pid=84210) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 18:55:15 devstack cinder-volume[84210]: DEBUG oslo_service.backend._eventlet.service [None req-da7f399b-5856-43ac-bce2-fd2ffdedcdfb None None] no_snapshot_gb_quota = False {{(pid=84210) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 18:55:15 devstack cinder-volume[84210]: DEBUG oslo_service.backend._eventlet.service [None req-da7f399b-5856-43ac-bce2-fd2ffdedcdfb None None] num_iser_scan_tries = 3 {{(pid=84210) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 18:55:15 devstack cinder-volume[84210]: DEBUG oslo_service.backend._eventlet.service [None req-da7f399b-5856-43ac-bce2-fd2ffdedcdfb None None] num_shell_tries = 3 {{(pid=84210) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 18:55:15 devstack cinder-volume[84210]: DEBUG oslo_service.backend._eventlet.service [None req-da7f399b-5856-43ac-bce2-fd2ffdedcdfb None None] num_volume_device_scan_tries = 3 {{(pid=84210) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 18:55:15 devstack cinder-volume[84210]: DEBUG oslo_service.backend._eventlet.service [None req-da7f399b-5856-43ac-bce2-fd2ffdedcdfb None None] nvmeof_conn_info_version = 1 {{(pid=84210) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 18:55:15 devstack cinder-volume[84210]: DEBUG oslo_service.backend._eventlet.service [None req-da7f399b-5856-43ac-bce2-fd2ffdedcdfb None None] nvmet_ns_id = 10 {{(pid=84210) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 18:55:15 devstack cinder-volume[84210]: DEBUG oslo_service.backend._eventlet.service [None req-da7f399b-5856-43ac-bce2-fd2ffdedcdfb None None] nvmet_port_id = 1 {{(pid=84210) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 18:55:15 devstack cinder-volume[84210]: DEBUG oslo_service.backend._eventlet.service [None req-da7f399b-5856-43ac-bce2-fd2ffdedcdfb None None] osapi_max_limit = 1000 {{(pid=84210) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 18:55:15 devstack cinder-volume[84210]: DEBUG oslo_service.backend._eventlet.service [None req-da7f399b-5856-43ac-bce2-fd2ffdedcdfb None None] osapi_volume_ext_list = [] {{(pid=84210) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 18:55:15 devstack cinder-volume[84210]: DEBUG oslo_service.backend._eventlet.service [None req-da7f399b-5856-43ac-bce2-fd2ffdedcdfb None None] osapi_volume_extension = ['cinder.api.contrib.standard_extensions'] {{(pid=84210) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 18:55:15 devstack cinder-volume[84210]: DEBUG oslo_service.backend._eventlet.service [None req-da7f399b-5856-43ac-bce2-fd2ffdedcdfb None None] osapi_volume_listen = 0.0.0.0 {{(pid=84210) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 18:55:15 devstack cinder-volume[84210]: DEBUG oslo_service.backend._eventlet.service [None req-da7f399b-5856-43ac-bce2-fd2ffdedcdfb None None] osapi_volume_listen_port = 8776 {{(pid=84210) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 18:55:15 devstack cinder-volume[84210]: DEBUG oslo_service.backend._eventlet.service [None req-da7f399b-5856-43ac-bce2-fd2ffdedcdfb None None] osapi_volume_use_ssl = False {{(pid=84210) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 18:55:15 devstack cinder-volume[84210]: DEBUG oslo_service.backend._eventlet.service [None req-da7f399b-5856-43ac-bce2-fd2ffdedcdfb None None] osapi_volume_workers = 2 {{(pid=84210) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 18:55:15 devstack cinder-volume[84210]: DEBUG oslo_service.backend._eventlet.service [None req-da7f399b-5856-43ac-bce2-fd2ffdedcdfb None None] per_volume_size_limit = -1 {{(pid=84210) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 18:55:15 devstack cinder-volume[84210]: DEBUG oslo_service.backend._eventlet.service [None req-da7f399b-5856-43ac-bce2-fd2ffdedcdfb None None] periodic_fuzzy_delay = 60 {{(pid=84210) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 18:55:15 devstack cinder-volume[84210]: DEBUG oslo_service.backend._eventlet.service [None req-da7f399b-5856-43ac-bce2-fd2ffdedcdfb None None] periodic_interval = 60 {{(pid=84210) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 18:55:15 devstack cinder-volume[84210]: DEBUG oslo_service.backend._eventlet.service [None req-da7f399b-5856-43ac-bce2-fd2ffdedcdfb None None] project_id_regex = [0-9a-f\-]+ {{(pid=84210) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 18:55:15 devstack cinder-volume[84210]: DEBUG oslo_service.backend._eventlet.service [None req-da7f399b-5856-43ac-bce2-fd2ffdedcdfb None None] public_endpoint = None {{(pid=84210) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 18:55:15 devstack cinder-volume[84210]: DEBUG oslo_service.backend._eventlet.service [None req-da7f399b-5856-43ac-bce2-fd2ffdedcdfb None None] publish_errors = False {{(pid=84210) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 18:55:15 devstack cinder-volume[84210]: DEBUG oslo_service.backend._eventlet.service [None req-da7f399b-5856-43ac-bce2-fd2ffdedcdfb None None] quota_backup_gigabytes = 1000 {{(pid=84210) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 18:55:15 devstack cinder-volume[84210]: DEBUG oslo_service.backend._eventlet.service [None req-da7f399b-5856-43ac-bce2-fd2ffdedcdfb None None] quota_backups = 10 {{(pid=84210) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 18:55:15 devstack cinder-volume[84210]: DEBUG oslo_service.backend._eventlet.service [None req-da7f399b-5856-43ac-bce2-fd2ffdedcdfb None None] quota_driver = cinder.quota.DbQuotaDriver {{(pid=84210) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 18:55:15 devstack cinder-volume[84210]: DEBUG oslo_service.backend._eventlet.service [None req-da7f399b-5856-43ac-bce2-fd2ffdedcdfb None None] quota_gigabytes = 1000 {{(pid=84210) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 18:55:15 devstack cinder-volume[84210]: DEBUG oslo_service.backend._eventlet.service [None req-da7f399b-5856-43ac-bce2-fd2ffdedcdfb None None] quota_groups = 10 {{(pid=84210) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 18:55:15 devstack cinder-volume[84210]: DEBUG oslo_service.backend._eventlet.service [None req-da7f399b-5856-43ac-bce2-fd2ffdedcdfb None None] quota_snapshots = 10 {{(pid=84210) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 18:55:15 devstack cinder-volume[84210]: DEBUG oslo_service.backend._eventlet.service [None req-da7f399b-5856-43ac-bce2-fd2ffdedcdfb None None] quota_volumes = 10 {{(pid=84210) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 18:55:15 devstack cinder-volume[84210]: DEBUG oslo_service.backend._eventlet.service [None req-da7f399b-5856-43ac-bce2-fd2ffdedcdfb None None] rate_limit_burst = 0 {{(pid=84210) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 18:55:15 devstack cinder-volume[84210]: DEBUG oslo_service.backend._eventlet.service [None req-da7f399b-5856-43ac-bce2-fd2ffdedcdfb None None] rate_limit_except_level = CRITICAL {{(pid=84210) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 18:55:15 devstack cinder-volume[84210]: DEBUG oslo_service.backend._eventlet.service [None req-da7f399b-5856-43ac-bce2-fd2ffdedcdfb None None] rate_limit_interval = 0 {{(pid=84210) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 18:55:15 devstack cinder-volume[84210]: DEBUG oslo_service.backend._eventlet.service [None req-da7f399b-5856-43ac-bce2-fd2ffdedcdfb None None] reinit_driver_count = 3 {{(pid=84210) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 18:55:15 devstack cinder-volume[84210]: DEBUG oslo_service.backend._eventlet.service [None req-da7f399b-5856-43ac-bce2-fd2ffdedcdfb None None] replication_device = **** {{(pid=84210) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 18:55:15 devstack cinder-volume[84210]: DEBUG oslo_service.backend._eventlet.service [None req-da7f399b-5856-43ac-bce2-fd2ffdedcdfb None None] report_discard_supported = False {{(pid=84210) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 18:55:15 devstack cinder-volume[84210]: DEBUG oslo_service.backend._eventlet.service [None req-da7f399b-5856-43ac-bce2-fd2ffdedcdfb None None] report_interval = 120 {{(pid=84210) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 18:55:15 devstack cinder-volume[84210]: DEBUG oslo_service.backend._eventlet.service [None req-da7f399b-5856-43ac-bce2-fd2ffdedcdfb None None] reservation_clean_interval = 86400 {{(pid=84210) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 18:55:15 devstack cinder-volume[84210]: DEBUG oslo_service.backend._eventlet.service [None req-da7f399b-5856-43ac-bce2-fd2ffdedcdfb None None] reservation_expire = 86400 {{(pid=84210) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 18:55:15 devstack cinder-volume[84210]: DEBUG oslo_service.backend._eventlet.service [None req-da7f399b-5856-43ac-bce2-fd2ffdedcdfb None None] reserved_image_namespaces = [] {{(pid=84210) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 18:55:15 devstack cinder-volume[84210]: DEBUG oslo_service.backend._eventlet.service [None req-da7f399b-5856-43ac-bce2-fd2ffdedcdfb None None] reserved_percentage = 0 {{(pid=84210) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 18:55:15 devstack cinder-volume[84210]: DEBUG oslo_service.backend._eventlet.service [None req-da7f399b-5856-43ac-bce2-fd2ffdedcdfb None None] resource_query_filters_file = /etc/cinder/resource_filters.json {{(pid=84210) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 18:55:15 devstack cinder-volume[84210]: DEBUG oslo_service.backend._eventlet.service [None req-da7f399b-5856-43ac-bce2-fd2ffdedcdfb None None] rootwrap_config = /etc/cinder/rootwrap.conf {{(pid=84210) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 18:55:15 devstack cinder-volume[84210]: DEBUG oslo_service.backend._eventlet.service [None req-da7f399b-5856-43ac-bce2-fd2ffdedcdfb None None] rpc_response_timeout = 120 {{(pid=84210) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 18:55:15 devstack cinder-volume[84210]: DEBUG oslo_service.backend._eventlet.service [None req-da7f399b-5856-43ac-bce2-fd2ffdedcdfb None None] run_external_periodic_tasks = True {{(pid=84210) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 18:55:15 devstack cinder-volume[84210]: DEBUG oslo_service.backend._eventlet.service [None req-da7f399b-5856-43ac-bce2-fd2ffdedcdfb None None] scheduler_manager = cinder.scheduler.manager.SchedulerManager {{(pid=84210) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 18:55:15 devstack cinder-volume[84210]: DEBUG oslo_service.backend._eventlet.service [None req-da7f399b-5856-43ac-bce2-fd2ffdedcdfb None None] scst_target_driver = iscsi {{(pid=84210) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 18:55:15 devstack cinder-volume[84210]: DEBUG oslo_service.backend._eventlet.service [None req-da7f399b-5856-43ac-bce2-fd2ffdedcdfb None None] scst_target_iqn_name = None {{(pid=84210) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 18:55:15 devstack cinder-volume[84210]: DEBUG oslo_service.backend._eventlet.service [None req-da7f399b-5856-43ac-bce2-fd2ffdedcdfb None None] service_down_time = 720 {{(pid=84210) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 18:55:15 devstack cinder-volume[84210]: DEBUG oslo_service.backend._eventlet.service [None req-da7f399b-5856-43ac-bce2-fd2ffdedcdfb None None] shell_completion = None {{(pid=84210) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 18:55:15 devstack cinder-volume[84210]: DEBUG oslo_service.backend._eventlet.service [None req-da7f399b-5856-43ac-bce2-fd2ffdedcdfb None None] snapshot_name_template = snapshot-%s {{(pid=84210) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 18:55:15 devstack cinder-volume[84210]: DEBUG oslo_service.backend._eventlet.service [None req-da7f399b-5856-43ac-bce2-fd2ffdedcdfb None None] split_loggers = False {{(pid=84210) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 18:55:15 devstack cinder-volume[84210]: DEBUG oslo_service.backend._eventlet.service [None req-da7f399b-5856-43ac-bce2-fd2ffdedcdfb None None] state_path = /opt/stack/data/cinder {{(pid=84210) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 18:55:15 devstack cinder-volume[84210]: DEBUG oslo_service.backend._eventlet.service [None req-da7f399b-5856-43ac-bce2-fd2ffdedcdfb None None] storage_availability_zone = nova {{(pid=84210) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 18:55:15 devstack cinder-volume[84210]: DEBUG oslo_service.backend._eventlet.service [None req-da7f399b-5856-43ac-bce2-fd2ffdedcdfb None None] storage_protocol = iSCSI {{(pid=84210) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 18:55:15 devstack cinder-volume[84210]: DEBUG oslo_service.backend._eventlet.service [None req-da7f399b-5856-43ac-bce2-fd2ffdedcdfb None None] syslog_log_facility = LOG_USER {{(pid=84210) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 18:55:15 devstack cinder-volume[84210]: DEBUG oslo_service.backend._eventlet.service [None req-da7f399b-5856-43ac-bce2-fd2ffdedcdfb None None] target_helper = lioadm {{(pid=84210) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 18:55:15 devstack cinder-volume[84210]: DEBUG oslo_service.backend._eventlet.service [None req-da7f399b-5856-43ac-bce2-fd2ffdedcdfb None None] target_ip_address = 192.168.122.135 {{(pid=84210) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 18:55:15 devstack cinder-volume[84210]: DEBUG oslo_service.backend._eventlet.service [None req-da7f399b-5856-43ac-bce2-fd2ffdedcdfb None None] target_port = 3260 {{(pid=84210) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 18:55:15 devstack cinder-volume[84210]: DEBUG oslo_service.backend._eventlet.service [None req-da7f399b-5856-43ac-bce2-fd2ffdedcdfb None None] target_prefix = iqn.2010-10.org.openstack: {{(pid=84210) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 18:55:15 devstack cinder-volume[84210]: DEBUG oslo_service.backend._eventlet.service [None req-da7f399b-5856-43ac-bce2-fd2ffdedcdfb None None] target_protocol = iscsi {{(pid=84210) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 18:55:15 devstack cinder-volume[84210]: DEBUG oslo_service.backend._eventlet.service [None req-da7f399b-5856-43ac-bce2-fd2ffdedcdfb None None] target_secondary_ip_addresses = [] {{(pid=84210) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 18:55:15 devstack cinder-volume[84210]: DEBUG oslo_service.backend._eventlet.service [None req-da7f399b-5856-43ac-bce2-fd2ffdedcdfb None None] trace_flags = None {{(pid=84210) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 18:55:15 devstack cinder-volume[84210]: DEBUG oslo_service.backend._eventlet.service [None req-da7f399b-5856-43ac-bce2-fd2ffdedcdfb None None] transfer_api_class = cinder.transfer.api.API {{(pid=84210) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 18:55:15 devstack cinder-volume[84210]: DEBUG oslo_service.backend._eventlet.service [None req-da7f399b-5856-43ac-bce2-fd2ffdedcdfb None None] transport_url = **** {{(pid=84210) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 18:55:15 devstack cinder-volume[84210]: DEBUG oslo_service.backend._eventlet.service [None req-da7f399b-5856-43ac-bce2-fd2ffdedcdfb None None] until_refresh = 0 {{(pid=84210) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 18:55:15 devstack cinder-volume[84210]: DEBUG oslo_service.backend._eventlet.service [None req-da7f399b-5856-43ac-bce2-fd2ffdedcdfb None None] use_chap_auth = False {{(pid=84210) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 18:55:15 devstack cinder-volume[84210]: DEBUG oslo_service.backend._eventlet.service [None req-da7f399b-5856-43ac-bce2-fd2ffdedcdfb None None] use_default_quota_class = True {{(pid=84210) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 18:55:15 devstack cinder-volume[84210]: DEBUG oslo_service.backend._eventlet.service [None req-da7f399b-5856-43ac-bce2-fd2ffdedcdfb None None] use_journal = False {{(pid=84210) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 18:55:15 devstack cinder-volume[84210]: DEBUG oslo_service.backend._eventlet.service [None req-da7f399b-5856-43ac-bce2-fd2ffdedcdfb None None] use_json = False {{(pid=84210) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 18:55:15 devstack cinder-volume[84210]: DEBUG oslo_service.backend._eventlet.service [None req-da7f399b-5856-43ac-bce2-fd2ffdedcdfb None None] use_multipath_for_image_xfer = False {{(pid=84210) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 18:55:15 devstack cinder-volume[84210]: DEBUG oslo_service.backend._eventlet.service [None req-da7f399b-5856-43ac-bce2-fd2ffdedcdfb None None] use_stderr = False {{(pid=84210) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 18:55:15 devstack cinder-volume[84210]: DEBUG oslo_service.backend._eventlet.service [None req-da7f399b-5856-43ac-bce2-fd2ffdedcdfb None None] use_syslog = False {{(pid=84210) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 18:55:15 devstack cinder-volume[84210]: DEBUG oslo_service.backend._eventlet.service [None req-da7f399b-5856-43ac-bce2-fd2ffdedcdfb None None] verify_glance_signatures = enabled {{(pid=84210) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 18:55:15 devstack cinder-volume[84210]: DEBUG oslo_service.backend._eventlet.service [None req-da7f399b-5856-43ac-bce2-fd2ffdedcdfb None None] vmdk_allowed_types = ['streamOptimized', 'monolithicSparse'] {{(pid=84210) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 18:55:15 devstack cinder-volume[84210]: DEBUG oslo_service.backend._eventlet.service [None req-da7f399b-5856-43ac-bce2-fd2ffdedcdfb None None] volume_api_class = cinder.volume.api.API {{(pid=84210) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 18:55:15 devstack cinder-volume[84210]: DEBUG oslo_service.backend._eventlet.service [None req-da7f399b-5856-43ac-bce2-fd2ffdedcdfb None None] volume_backend_name = None {{(pid=84210) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 18:55:15 devstack cinder-volume[84210]: DEBUG oslo_service.backend._eventlet.service [None req-da7f399b-5856-43ac-bce2-fd2ffdedcdfb None None] volume_clear = zero {{(pid=84210) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 18:55:15 devstack cinder-volume[84210]: DEBUG oslo_service.backend._eventlet.service [None req-da7f399b-5856-43ac-bce2-fd2ffdedcdfb None None] volume_clear_ionice = None {{(pid=84210) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 18:55:15 devstack cinder-volume[84210]: DEBUG oslo_service.backend._eventlet.service [None req-da7f399b-5856-43ac-bce2-fd2ffdedcdfb None None] volume_clear_size = 0 {{(pid=84210) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 18:55:15 devstack cinder-volume[84210]: DEBUG oslo_service.backend._eventlet.service [None req-da7f399b-5856-43ac-bce2-fd2ffdedcdfb None None] volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=84210) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 18:55:15 devstack cinder-volume[84210]: DEBUG oslo_service.backend._eventlet.service [None req-da7f399b-5856-43ac-bce2-fd2ffdedcdfb None None] volume_copy_bps_limit = 0 {{(pid=84210) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 18:55:15 devstack cinder-volume[84210]: DEBUG oslo_service.backend._eventlet.service [None req-da7f399b-5856-43ac-bce2-fd2ffdedcdfb None None] volume_dd_blocksize = 1M {{(pid=84210) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 18:55:15 devstack cinder-volume[84538]: INFO cinder.volume.manager [None req-d910280d-c21e-4448-95b2-3d8d86e46e7b None None] Starting volume driver QuobyteDriver (1.1.14) Apr 29 18:55:15 devstack cinder-volume[84210]: DEBUG oslo_service.backend._eventlet.service [None req-da7f399b-5856-43ac-bce2-fd2ffdedcdfb None None] volume_manager = cinder.volume.manager.VolumeManager {{(pid=84210) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 18:55:15 devstack cinder-volume[84538]: DEBUG cinder.volume.drivers.remotefs [None req-d910280d-c21e-4448-95b2-3d8d86e46e7b None None] NAS config: {'nas_secure_file_permissions': 'false', 'nas_secure_file_operations': 'false'} {{(pid=84538) do_setup /opt/stack/cinder/cinder/volume/drivers/remotefs.py:225}} Apr 29 18:55:15 devstack cinder-volume[84210]: DEBUG oslo_service.backend._eventlet.service [None req-da7f399b-5856-43ac-bce2-fd2ffdedcdfb None None] volume_name_template = volume-%s {{(pid=84210) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 18:55:15 devstack cinder-volume[84210]: DEBUG oslo_service.backend._eventlet.service [None req-da7f399b-5856-43ac-bce2-fd2ffdedcdfb None None] volume_service_inithost_offload = False {{(pid=84210) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 18:55:15 devstack cinder-volume[84210]: DEBUG oslo_service.backend._eventlet.service [None req-da7f399b-5856-43ac-bce2-fd2ffdedcdfb None None] volume_usage_audit_period = month {{(pid=84210) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 18:55:15 devstack cinder-volume[84210]: DEBUG oslo_service.backend._eventlet.service [None req-da7f399b-5856-43ac-bce2-fd2ffdedcdfb None None] volumes_dir = /opt/stack/data/cinder/volumes {{(pid=84210) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 18:55:15 devstack cinder-volume[84210]: DEBUG oslo_service.backend._eventlet.service [None req-da7f399b-5856-43ac-bce2-fd2ffdedcdfb None None] zoning_mode = None {{(pid=84210) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 18:55:15 devstack cinder-volume[84210]: DEBUG oslo_service.backend._eventlet.service [None req-da7f399b-5856-43ac-bce2-fd2ffdedcdfb None None] os_brick.lightos_discovery_client_address = localhost {{(pid=84210) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 18:55:15 devstack cinder-volume[84210]: DEBUG oslo_service.backend._eventlet.service [None req-da7f399b-5856-43ac-bce2-fd2ffdedcdfb None None] os_brick.lightos_discovery_client_dir_path = /etc/discovery-client/discovery.d/ {{(pid=84210) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 18:55:15 devstack cinder-volume[84210]: DEBUG oslo_service.backend._eventlet.service [None req-da7f399b-5856-43ac-bce2-fd2ffdedcdfb None None] os_brick.lightos_discovery_client_port = 6060 {{(pid=84210) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 18:55:15 devstack cinder-volume[84210]: DEBUG oslo_service.backend._eventlet.service [None req-da7f399b-5856-43ac-bce2-fd2ffdedcdfb None None] os_brick.lock_path = /opt/stack/data/os_brick {{(pid=84210) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 18:55:15 devstack cinder-volume[84210]: DEBUG oslo_service.backend._eventlet.service [None req-da7f399b-5856-43ac-bce2-fd2ffdedcdfb None None] os_brick.wait_mpath_device_attempts = 4 {{(pid=84210) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 18:55:15 devstack cinder-volume[84210]: DEBUG oslo_service.backend._eventlet.service [None req-da7f399b-5856-43ac-bce2-fd2ffdedcdfb None None] os_brick.wait_mpath_device_interval = 1 {{(pid=84210) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 18:55:15 devstack cinder-volume[84210]: DEBUG oslo_service.backend._eventlet.service [None req-da7f399b-5856-43ac-bce2-fd2ffdedcdfb None None] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=84210) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 18:55:15 devstack cinder-volume[84210]: DEBUG oslo_service.backend._eventlet.service [None req-da7f399b-5856-43ac-bce2-fd2ffdedcdfb None None] oslo_concurrency.disable_process_locking = False {{(pid=84210) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 18:55:15 devstack cinder-volume[84210]: DEBUG oslo_service.backend._eventlet.service [None req-da7f399b-5856-43ac-bce2-fd2ffdedcdfb None None] oslo_concurrency.lock_path = /opt/stack/data/cinder {{(pid=84210) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 18:55:15 devstack cinder-volume[84210]: DEBUG oslo_service.backend._eventlet.service [None req-da7f399b-5856-43ac-bce2-fd2ffdedcdfb None None] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=84210) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 18:55:15 devstack cinder-volume[84210]: DEBUG oslo_service.backend._eventlet.service [None req-da7f399b-5856-43ac-bce2-fd2ffdedcdfb None None] keystone_authtoken.admin_password = **** {{(pid=84210) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 18:55:15 devstack cinder-volume[84210]: DEBUG oslo_service.backend._eventlet.service [None req-da7f399b-5856-43ac-bce2-fd2ffdedcdfb None None] keystone_authtoken.admin_tenant_name = admin {{(pid=84210) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 18:55:15 devstack cinder-volume[84210]: DEBUG oslo_service.backend._eventlet.service [None req-da7f399b-5856-43ac-bce2-fd2ffdedcdfb None None] keystone_authtoken.admin_token = **** {{(pid=84210) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 18:55:15 devstack cinder-volume[84210]: DEBUG oslo_service.backend._eventlet.service [None req-da7f399b-5856-43ac-bce2-fd2ffdedcdfb None None] keystone_authtoken.admin_user = None {{(pid=84210) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 18:55:15 devstack cinder-volume[84210]: DEBUG oslo_service.backend._eventlet.service [None req-da7f399b-5856-43ac-bce2-fd2ffdedcdfb None None] keystone_authtoken.auth_admin_prefix = {{(pid=84210) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 18:55:15 devstack cinder-volume[84210]: DEBUG oslo_service.backend._eventlet.service [None req-da7f399b-5856-43ac-bce2-fd2ffdedcdfb None None] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=84210) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 18:55:15 devstack cinder-volume[84210]: DEBUG oslo_service.backend._eventlet.service [None req-da7f399b-5856-43ac-bce2-fd2ffdedcdfb None None] keystone_authtoken.auth_port = 35357 {{(pid=84210) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 18:55:15 devstack cinder-volume[84210]: DEBUG oslo_service.backend._eventlet.service [None req-da7f399b-5856-43ac-bce2-fd2ffdedcdfb None None] keystone_authtoken.auth_protocol = https {{(pid=84210) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 18:55:15 devstack cinder-volume[84210]: DEBUG oslo_service.backend._eventlet.service [None req-da7f399b-5856-43ac-bce2-fd2ffdedcdfb None None] keystone_authtoken.auth_section = None {{(pid=84210) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 18:55:15 devstack cinder-volume[84210]: DEBUG oslo_service.backend._eventlet.service [None req-da7f399b-5856-43ac-bce2-fd2ffdedcdfb None None] keystone_authtoken.auth_type = password {{(pid=84210) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 18:55:15 devstack cinder-volume[84210]: DEBUG oslo_service.backend._eventlet.service [None req-da7f399b-5856-43ac-bce2-fd2ffdedcdfb None None] keystone_authtoken.auth_uri = None {{(pid=84210) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 18:55:15 devstack cinder-volume[84210]: DEBUG oslo_service.backend._eventlet.service [None req-da7f399b-5856-43ac-bce2-fd2ffdedcdfb None None] keystone_authtoken.auth_version = None {{(pid=84210) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 18:55:15 devstack cinder-volume[84210]: DEBUG oslo_service.backend._eventlet.service [None req-da7f399b-5856-43ac-bce2-fd2ffdedcdfb None None] keystone_authtoken.cache = None {{(pid=84210) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 18:55:15 devstack cinder-volume[84210]: DEBUG oslo_service.backend._eventlet.service [None req-da7f399b-5856-43ac-bce2-fd2ffdedcdfb None None] keystone_authtoken.cafile = /opt/stack/data/ca-bundle.pem {{(pid=84210) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 18:55:15 devstack cinder-volume[84210]: DEBUG oslo_service.backend._eventlet.service [None req-da7f399b-5856-43ac-bce2-fd2ffdedcdfb None None] keystone_authtoken.certfile = None {{(pid=84210) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 18:55:15 devstack cinder-volume[84210]: DEBUG oslo_service.backend._eventlet.service [None req-da7f399b-5856-43ac-bce2-fd2ffdedcdfb None None] keystone_authtoken.delay_auth_decision = False {{(pid=84210) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 18:55:15 devstack cinder-volume[84210]: DEBUG oslo_service.backend._eventlet.service [None req-da7f399b-5856-43ac-bce2-fd2ffdedcdfb None None] keystone_authtoken.enforce_token_bind = permissive {{(pid=84210) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 18:55:15 devstack cinder-volume[84210]: DEBUG oslo_service.backend._eventlet.service [None req-da7f399b-5856-43ac-bce2-fd2ffdedcdfb None None] keystone_authtoken.http_connect_timeout = None {{(pid=84210) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 18:55:15 devstack cinder-volume[84210]: DEBUG oslo_service.backend._eventlet.service [None req-da7f399b-5856-43ac-bce2-fd2ffdedcdfb None None] keystone_authtoken.http_request_max_retries = 3 {{(pid=84210) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 18:55:15 devstack cinder-volume[84210]: DEBUG oslo_service.backend._eventlet.service [None req-da7f399b-5856-43ac-bce2-fd2ffdedcdfb None None] keystone_authtoken.identity_uri = None {{(pid=84210) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 18:55:15 devstack cinder-volume[84210]: DEBUG oslo_service.backend._eventlet.service [None req-da7f399b-5856-43ac-bce2-fd2ffdedcdfb None None] keystone_authtoken.include_service_catalog = True {{(pid=84210) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 18:55:15 devstack cinder-volume[84210]: DEBUG oslo_service.backend._eventlet.service [None req-da7f399b-5856-43ac-bce2-fd2ffdedcdfb None None] keystone_authtoken.insecure = False {{(pid=84210) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 18:55:15 devstack cinder-volume[84210]: DEBUG oslo_service.backend._eventlet.service [None req-da7f399b-5856-43ac-bce2-fd2ffdedcdfb None None] keystone_authtoken.interface = public {{(pid=84210) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 18:55:15 devstack cinder-volume[84210]: DEBUG oslo_service.backend._eventlet.service [None req-da7f399b-5856-43ac-bce2-fd2ffdedcdfb None None] keystone_authtoken.keyfile = None {{(pid=84210) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 18:55:15 devstack cinder-volume[84210]: DEBUG oslo_service.backend._eventlet.service [None req-da7f399b-5856-43ac-bce2-fd2ffdedcdfb None None] keystone_authtoken.memcache_password = {{(pid=84210) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 18:55:15 devstack cinder-volume[84210]: DEBUG oslo_service.backend._eventlet.service [None req-da7f399b-5856-43ac-bce2-fd2ffdedcdfb None None] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=84210) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 18:55:15 devstack cinder-volume[84210]: DEBUG oslo_service.backend._eventlet.service [None req-da7f399b-5856-43ac-bce2-fd2ffdedcdfb None None] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=84210) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 18:55:15 devstack cinder-volume[84210]: DEBUG oslo_service.backend._eventlet.service [None req-da7f399b-5856-43ac-bce2-fd2ffdedcdfb None None] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=84210) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 18:55:15 devstack cinder-volume[84210]: DEBUG oslo_service.backend._eventlet.service [None req-da7f399b-5856-43ac-bce2-fd2ffdedcdfb None None] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=84210) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 18:55:15 devstack cinder-volume[84210]: DEBUG oslo_service.backend._eventlet.service [None req-da7f399b-5856-43ac-bce2-fd2ffdedcdfb None None] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=84210) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 18:55:15 devstack cinder-volume[84210]: DEBUG oslo_service.backend._eventlet.service [None req-da7f399b-5856-43ac-bce2-fd2ffdedcdfb None None] keystone_authtoken.memcache_sasl_enabled = False {{(pid=84210) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 18:55:15 devstack cinder-volume[84210]: DEBUG oslo_service.backend._eventlet.service [None req-da7f399b-5856-43ac-bce2-fd2ffdedcdfb None None] keystone_authtoken.memcache_secret_key = **** {{(pid=84210) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 18:55:15 devstack cinder-volume[84210]: DEBUG oslo_service.backend._eventlet.service [None req-da7f399b-5856-43ac-bce2-fd2ffdedcdfb None None] keystone_authtoken.memcache_security_strategy = None {{(pid=84210) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 18:55:15 devstack cinder-volume[84210]: DEBUG oslo_service.backend._eventlet.service [None req-da7f399b-5856-43ac-bce2-fd2ffdedcdfb None None] keystone_authtoken.memcache_tls_allowed_ciphers = None {{(pid=84210) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 18:55:15 devstack cinder-volume[84210]: DEBUG oslo_service.backend._eventlet.service [None req-da7f399b-5856-43ac-bce2-fd2ffdedcdfb None None] keystone_authtoken.memcache_tls_cafile = None {{(pid=84210) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 18:55:15 devstack cinder-volume[84210]: DEBUG oslo_service.backend._eventlet.service [None req-da7f399b-5856-43ac-bce2-fd2ffdedcdfb None None] keystone_authtoken.memcache_tls_certfile = None {{(pid=84210) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 18:55:15 devstack cinder-volume[84210]: DEBUG oslo_service.backend._eventlet.service [None req-da7f399b-5856-43ac-bce2-fd2ffdedcdfb None None] keystone_authtoken.memcache_tls_enabled = False {{(pid=84210) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 18:55:15 devstack cinder-volume[84210]: DEBUG oslo_service.backend._eventlet.service [None req-da7f399b-5856-43ac-bce2-fd2ffdedcdfb None None] keystone_authtoken.memcache_tls_keyfile = None {{(pid=84210) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 18:55:15 devstack cinder-volume[84210]: DEBUG oslo_service.backend._eventlet.service [None req-da7f399b-5856-43ac-bce2-fd2ffdedcdfb None None] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=84210) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 18:55:15 devstack cinder-volume[84210]: DEBUG oslo_service.backend._eventlet.service [None req-da7f399b-5856-43ac-bce2-fd2ffdedcdfb None None] keystone_authtoken.memcache_username = {{(pid=84210) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 18:55:15 devstack cinder-volume[84210]: DEBUG oslo_service.backend._eventlet.service [None req-da7f399b-5856-43ac-bce2-fd2ffdedcdfb None None] keystone_authtoken.memcached_servers = ['localhost:11211'] {{(pid=84210) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 18:55:15 devstack cinder-volume[84210]: DEBUG oslo_service.backend._eventlet.service [None req-da7f399b-5856-43ac-bce2-fd2ffdedcdfb None None] keystone_authtoken.region_name = None {{(pid=84210) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 18:55:15 devstack cinder-volume[84210]: DEBUG oslo_service.backend._eventlet.service [None req-da7f399b-5856-43ac-bce2-fd2ffdedcdfb None None] keystone_authtoken.service_token_roles = ['service'] {{(pid=84210) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 18:55:15 devstack cinder-volume[84210]: DEBUG oslo_service.backend._eventlet.service [None req-da7f399b-5856-43ac-bce2-fd2ffdedcdfb None None] keystone_authtoken.service_token_roles_required = False {{(pid=84210) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 18:55:15 devstack cinder-volume[84210]: DEBUG oslo_service.backend._eventlet.service [None req-da7f399b-5856-43ac-bce2-fd2ffdedcdfb None None] keystone_authtoken.service_type = None {{(pid=84210) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 18:55:15 devstack cinder-volume[84210]: DEBUG oslo_service.backend._eventlet.service [None req-da7f399b-5856-43ac-bce2-fd2ffdedcdfb None None] keystone_authtoken.token_cache_time = 300 {{(pid=84210) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 18:55:15 devstack cinder-volume[84210]: DEBUG oslo_service.backend._eventlet.service [None req-da7f399b-5856-43ac-bce2-fd2ffdedcdfb None None] keystone_authtoken.www_authenticate_uri = http://192.168.122.135/identity {{(pid=84210) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 18:55:15 devstack cinder-volume[84210]: DEBUG oslo_service.backend._eventlet.service [None req-da7f399b-5856-43ac-bce2-fd2ffdedcdfb None None] cache.backend = dogpile.cache.null {{(pid=84210) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 18:55:15 devstack cinder-volume[84210]: DEBUG oslo_service.backend._eventlet.service [None req-da7f399b-5856-43ac-bce2-fd2ffdedcdfb None None] cache.backend_argument = **** {{(pid=84210) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 18:55:15 devstack cinder-volume[84210]: DEBUG oslo_service.backend._eventlet.service [None req-da7f399b-5856-43ac-bce2-fd2ffdedcdfb None None] cache.backend_expiration_time = None {{(pid=84210) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 18:55:15 devstack cinder-volume[84210]: DEBUG oslo_service.backend._eventlet.service [None req-da7f399b-5856-43ac-bce2-fd2ffdedcdfb None None] cache.config_prefix = cache.oslo {{(pid=84210) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 18:55:15 devstack cinder-volume[84210]: DEBUG oslo_service.backend._eventlet.service [None req-da7f399b-5856-43ac-bce2-fd2ffdedcdfb None None] cache.debug_cache_backend = False {{(pid=84210) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 18:55:15 devstack cinder-volume[84210]: DEBUG oslo_service.backend._eventlet.service [None req-da7f399b-5856-43ac-bce2-fd2ffdedcdfb None None] cache.enable_retry_client = False {{(pid=84210) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 18:55:15 devstack cinder-volume[84210]: DEBUG oslo_service.backend._eventlet.service [None req-da7f399b-5856-43ac-bce2-fd2ffdedcdfb None None] cache.enable_socket_keepalive = False {{(pid=84210) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 18:55:15 devstack cinder-volume[84210]: DEBUG oslo_service.backend._eventlet.service [None req-da7f399b-5856-43ac-bce2-fd2ffdedcdfb None None] cache.enabled = False {{(pid=84210) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 18:55:15 devstack cinder-volume[84210]: DEBUG oslo_service.backend._eventlet.service [None req-da7f399b-5856-43ac-bce2-fd2ffdedcdfb None None] cache.enforce_fips_mode = False {{(pid=84210) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 18:55:15 devstack cinder-volume[84210]: DEBUG oslo_service.backend._eventlet.service [None req-da7f399b-5856-43ac-bce2-fd2ffdedcdfb None None] cache.expiration_time = 600 {{(pid=84210) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 18:55:15 devstack cinder-volume[84210]: DEBUG oslo_service.backend._eventlet.service [None req-da7f399b-5856-43ac-bce2-fd2ffdedcdfb None None] cache.hashclient_dead_timeout = 60.0 {{(pid=84210) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 18:55:15 devstack cinder-volume[84210]: DEBUG oslo_service.backend._eventlet.service [None req-da7f399b-5856-43ac-bce2-fd2ffdedcdfb None None] cache.hashclient_retry_attempts = 2 {{(pid=84210) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 18:55:15 devstack cinder-volume[84210]: DEBUG oslo_service.backend._eventlet.service [None req-da7f399b-5856-43ac-bce2-fd2ffdedcdfb None None] cache.hashclient_retry_timeout = 1.0 {{(pid=84210) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 18:55:15 devstack cinder-volume[84210]: DEBUG oslo_service.backend._eventlet.service [None req-da7f399b-5856-43ac-bce2-fd2ffdedcdfb None None] cache.memcache_dead_retry = 300 {{(pid=84210) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 18:55:15 devstack cinder-volume[84210]: DEBUG oslo_service.backend._eventlet.service [None req-da7f399b-5856-43ac-bce2-fd2ffdedcdfb None None] cache.memcache_pool_connection_get_timeout = 10 {{(pid=84210) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 18:55:15 devstack cinder-volume[84210]: DEBUG oslo_service.backend._eventlet.service [None req-da7f399b-5856-43ac-bce2-fd2ffdedcdfb None None] cache.memcache_pool_flush_on_reconnect = False {{(pid=84210) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 18:55:15 devstack cinder-volume[84210]: DEBUG oslo_service.backend._eventlet.service [None req-da7f399b-5856-43ac-bce2-fd2ffdedcdfb None None] cache.memcache_pool_maxsize = 10 {{(pid=84210) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 18:55:15 devstack cinder-volume[84210]: DEBUG oslo_service.backend._eventlet.service [None req-da7f399b-5856-43ac-bce2-fd2ffdedcdfb None None] cache.memcache_pool_unused_timeout = 60 {{(pid=84210) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 18:55:15 devstack cinder-volume[84210]: DEBUG oslo_service.backend._eventlet.service [None req-da7f399b-5856-43ac-bce2-fd2ffdedcdfb None None] cache.memcache_sasl_enabled = False {{(pid=84210) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 18:55:15 devstack cinder-volume[84210]: DEBUG oslo_service.backend._eventlet.service [None req-da7f399b-5856-43ac-bce2-fd2ffdedcdfb None None] cache.memcache_servers = ['localhost:11211'] {{(pid=84210) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 18:55:15 devstack cinder-volume[84210]: DEBUG oslo_service.backend._eventlet.service [None req-da7f399b-5856-43ac-bce2-fd2ffdedcdfb None None] cache.password = **** {{(pid=84210) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 18:55:15 devstack cinder-volume[84210]: DEBUG oslo_service.backend._eventlet.service [None req-da7f399b-5856-43ac-bce2-fd2ffdedcdfb None None] cache.proxies = [] {{(pid=84210) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 18:55:15 devstack cinder-volume[84210]: DEBUG oslo_service.backend._eventlet.service [None req-da7f399b-5856-43ac-bce2-fd2ffdedcdfb None None] cache.redis_db = 0 {{(pid=84210) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 18:55:15 devstack cinder-volume[84210]: DEBUG oslo_service.backend._eventlet.service [None req-da7f399b-5856-43ac-bce2-fd2ffdedcdfb None None] cache.redis_sentinel_service_name = mymaster {{(pid=84210) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 18:55:15 devstack cinder-volume[84210]: DEBUG oslo_service.backend._eventlet.service [None req-da7f399b-5856-43ac-bce2-fd2ffdedcdfb None None] cache.redis_sentinels = ['localhost:26379'] {{(pid=84210) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 18:55:15 devstack cinder-volume[84210]: DEBUG oslo_service.backend._eventlet.service [None req-da7f399b-5856-43ac-bce2-fd2ffdedcdfb None None] cache.redis_server = localhost:6379 {{(pid=84210) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 18:55:15 devstack cinder-volume[84210]: DEBUG oslo_service.backend._eventlet.service [None req-da7f399b-5856-43ac-bce2-fd2ffdedcdfb None None] cache.retry_attempts = 2 {{(pid=84210) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 18:55:15 devstack cinder-volume[84210]: DEBUG oslo_service.backend._eventlet.service [None req-da7f399b-5856-43ac-bce2-fd2ffdedcdfb None None] cache.retry_delay = 0.0 {{(pid=84210) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 18:55:15 devstack cinder-volume[84210]: DEBUG oslo_service.backend._eventlet.service [None req-da7f399b-5856-43ac-bce2-fd2ffdedcdfb None None] cache.socket_keepalive_count = 1 {{(pid=84210) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 18:55:15 devstack cinder-volume[84210]: DEBUG oslo_service.backend._eventlet.service [None req-da7f399b-5856-43ac-bce2-fd2ffdedcdfb None None] cache.socket_keepalive_idle = 1 {{(pid=84210) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 18:55:15 devstack cinder-volume[84210]: DEBUG oslo_service.backend._eventlet.service [None req-da7f399b-5856-43ac-bce2-fd2ffdedcdfb None None] cache.socket_keepalive_interval = 1 {{(pid=84210) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 18:55:15 devstack cinder-volume[84210]: DEBUG oslo_service.backend._eventlet.service [None req-da7f399b-5856-43ac-bce2-fd2ffdedcdfb None None] cache.socket_timeout = 1.0 {{(pid=84210) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 18:55:15 devstack cinder-volume[84210]: DEBUG oslo_service.backend._eventlet.service [None req-da7f399b-5856-43ac-bce2-fd2ffdedcdfb None None] cache.tls_allowed_ciphers = None {{(pid=84210) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 18:55:15 devstack cinder-volume[84210]: DEBUG oslo_service.backend._eventlet.service [None req-da7f399b-5856-43ac-bce2-fd2ffdedcdfb None None] cache.tls_cafile = None {{(pid=84210) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 18:55:15 devstack cinder-volume[84210]: DEBUG oslo_service.backend._eventlet.service [None req-da7f399b-5856-43ac-bce2-fd2ffdedcdfb None None] cache.tls_certfile = None {{(pid=84210) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 18:55:15 devstack cinder-volume[84210]: DEBUG oslo_service.backend._eventlet.service [None req-da7f399b-5856-43ac-bce2-fd2ffdedcdfb None None] cache.tls_enabled = False {{(pid=84210) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 18:55:15 devstack cinder-volume[84210]: DEBUG oslo_service.backend._eventlet.service [None req-da7f399b-5856-43ac-bce2-fd2ffdedcdfb None None] cache.tls_keyfile = None {{(pid=84210) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 18:55:15 devstack cinder-volume[84210]: DEBUG oslo_service.backend._eventlet.service [None req-da7f399b-5856-43ac-bce2-fd2ffdedcdfb None None] cache.username = None {{(pid=84210) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 18:55:15 devstack cinder-volume[84210]: DEBUG oslo_service.backend._eventlet.service [None req-da7f399b-5856-43ac-bce2-fd2ffdedcdfb None None] coordination.backend_url = **** {{(pid=84210) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 18:55:15 devstack cinder-volume[84210]: DEBUG oslo_service.backend._eventlet.service [None req-da7f399b-5856-43ac-bce2-fd2ffdedcdfb None None] database.asyncio_connection = **** {{(pid=84210) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 18:55:15 devstack cinder-volume[84210]: DEBUG oslo_service.backend._eventlet.service [None req-da7f399b-5856-43ac-bce2-fd2ffdedcdfb None None] database.asyncio_slave_connection = **** {{(pid=84210) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 18:55:15 devstack cinder-volume[84210]: DEBUG oslo_service.backend._eventlet.service [None req-da7f399b-5856-43ac-bce2-fd2ffdedcdfb None None] database.backend = sqlalchemy {{(pid=84210) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 18:55:15 devstack cinder-volume[84210]: DEBUG oslo_service.backend._eventlet.service [None req-da7f399b-5856-43ac-bce2-fd2ffdedcdfb None None] database.connection = **** {{(pid=84210) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 18:55:15 devstack cinder-volume[84210]: DEBUG oslo_service.backend._eventlet.service [None req-da7f399b-5856-43ac-bce2-fd2ffdedcdfb None None] database.connection_debug = 0 {{(pid=84210) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 18:55:15 devstack cinder-volume[84210]: DEBUG oslo_service.backend._eventlet.service [None req-da7f399b-5856-43ac-bce2-fd2ffdedcdfb None None] database.connection_parameters = {{(pid=84210) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 18:55:15 devstack cinder-volume[84210]: DEBUG oslo_service.backend._eventlet.service [None req-da7f399b-5856-43ac-bce2-fd2ffdedcdfb None None] database.connection_recycle_time = 3600 {{(pid=84210) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 18:55:15 devstack cinder-volume[84210]: DEBUG oslo_service.backend._eventlet.service [None req-da7f399b-5856-43ac-bce2-fd2ffdedcdfb None None] database.connection_trace = False {{(pid=84210) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 18:55:15 devstack cinder-volume[84210]: DEBUG oslo_service.backend._eventlet.service [None req-da7f399b-5856-43ac-bce2-fd2ffdedcdfb None None] database.db_inc_retry_interval = True {{(pid=84210) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 18:55:15 devstack cinder-volume[84210]: DEBUG oslo_service.backend._eventlet.service [None req-da7f399b-5856-43ac-bce2-fd2ffdedcdfb None None] database.db_max_retries = 20 {{(pid=84210) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 18:55:15 devstack cinder-volume[84210]: DEBUG oslo_service.backend._eventlet.service [None req-da7f399b-5856-43ac-bce2-fd2ffdedcdfb None None] database.db_max_retry_interval = 10 {{(pid=84210) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 18:55:15 devstack cinder-volume[84210]: DEBUG oslo_service.backend._eventlet.service [None req-da7f399b-5856-43ac-bce2-fd2ffdedcdfb None None] database.db_retry_interval = 1 {{(pid=84210) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 18:55:15 devstack cinder-volume[84210]: DEBUG oslo_service.backend._eventlet.service [None req-da7f399b-5856-43ac-bce2-fd2ffdedcdfb None None] database.max_overflow = 50 {{(pid=84210) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 18:55:15 devstack cinder-volume[84210]: DEBUG oslo_service.backend._eventlet.service [None req-da7f399b-5856-43ac-bce2-fd2ffdedcdfb None None] database.max_pool_size = 5 {{(pid=84210) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 18:55:15 devstack cinder-volume[84210]: DEBUG oslo_service.backend._eventlet.service [None req-da7f399b-5856-43ac-bce2-fd2ffdedcdfb None None] database.max_retries = 10 {{(pid=84210) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 18:55:15 devstack cinder-volume[84210]: DEBUG oslo_service.backend._eventlet.service [None req-da7f399b-5856-43ac-bce2-fd2ffdedcdfb None None] database.mysql_sql_mode = TRADITIONAL {{(pid=84210) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 18:55:15 devstack cinder-volume[84210]: DEBUG oslo_service.backend._eventlet.service [None req-da7f399b-5856-43ac-bce2-fd2ffdedcdfb None None] database.mysql_wsrep_sync_wait = None {{(pid=84210) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 18:55:15 devstack cinder-volume[84210]: DEBUG oslo_service.backend._eventlet.service [None req-da7f399b-5856-43ac-bce2-fd2ffdedcdfb None None] database.pool_timeout = None {{(pid=84210) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 18:55:15 devstack cinder-volume[84210]: DEBUG oslo_service.backend._eventlet.service [None req-da7f399b-5856-43ac-bce2-fd2ffdedcdfb None None] database.retry_interval = 10 {{(pid=84210) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 18:55:15 devstack cinder-volume[84210]: DEBUG oslo_service.backend._eventlet.service [None req-da7f399b-5856-43ac-bce2-fd2ffdedcdfb None None] database.slave_connection = **** {{(pid=84210) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 18:55:15 devstack cinder-volume[84210]: DEBUG oslo_service.backend._eventlet.service [None req-da7f399b-5856-43ac-bce2-fd2ffdedcdfb None None] database.sqlite_synchronous = True {{(pid=84210) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 18:55:15 devstack cinder-volume[84210]: DEBUG oslo_service.backend._eventlet.service [None req-da7f399b-5856-43ac-bce2-fd2ffdedcdfb None None] database.synchronous_reader = True {{(pid=84210) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 18:55:15 devstack cinder-volume[84210]: DEBUG oslo_service.backend._eventlet.service [None req-da7f399b-5856-43ac-bce2-fd2ffdedcdfb None None] database.use_db_reconnect = False {{(pid=84210) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 18:55:15 devstack cinder-volume[84210]: DEBUG oslo_service.backend._eventlet.service [None req-da7f399b-5856-43ac-bce2-fd2ffdedcdfb None None] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=84210) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 18:55:15 devstack cinder-volume[84210]: DEBUG oslo_service.backend._eventlet.service [None req-da7f399b-5856-43ac-bce2-fd2ffdedcdfb None None] oslo_messaging_metrics.metrics_enabled = False {{(pid=84210) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 18:55:15 devstack cinder-volume[84210]: DEBUG oslo_service.backend._eventlet.service [None req-da7f399b-5856-43ac-bce2-fd2ffdedcdfb None None] oslo_messaging_metrics.metrics_process_name = {{(pid=84210) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 18:55:15 devstack cinder-volume[84210]: DEBUG oslo_service.backend._eventlet.service [None req-da7f399b-5856-43ac-bce2-fd2ffdedcdfb None None] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=84210) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 18:55:15 devstack cinder-volume[84210]: DEBUG oslo_service.backend._eventlet.service [None req-da7f399b-5856-43ac-bce2-fd2ffdedcdfb None None] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=84210) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 18:55:15 devstack cinder-volume[84210]: DEBUG oslo_service.backend._eventlet.service [None req-da7f399b-5856-43ac-bce2-fd2ffdedcdfb None None] profiler.connection_string = messaging:// {{(pid=84210) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 18:55:15 devstack cinder-volume[84210]: DEBUG oslo_service.backend._eventlet.service [None req-da7f399b-5856-43ac-bce2-fd2ffdedcdfb None None] profiler.enabled = False {{(pid=84210) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 18:55:15 devstack cinder-volume[84210]: DEBUG oslo_service.backend._eventlet.service [None req-da7f399b-5856-43ac-bce2-fd2ffdedcdfb None None] profiler.es_doc_type = notification {{(pid=84210) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 18:55:15 devstack cinder-volume[84210]: DEBUG oslo_service.backend._eventlet.service [None req-da7f399b-5856-43ac-bce2-fd2ffdedcdfb None None] profiler.es_scroll_size = 10000 {{(pid=84210) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 18:55:15 devstack cinder-volume[84210]: DEBUG oslo_service.backend._eventlet.service [None req-da7f399b-5856-43ac-bce2-fd2ffdedcdfb None None] profiler.es_scroll_time = 2m {{(pid=84210) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 18:55:15 devstack cinder-volume[84210]: DEBUG oslo_service.backend._eventlet.service [None req-da7f399b-5856-43ac-bce2-fd2ffdedcdfb None None] profiler.filter_error_trace = False {{(pid=84210) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 18:55:15 devstack cinder-volume[84210]: DEBUG oslo_service.backend._eventlet.service [None req-da7f399b-5856-43ac-bce2-fd2ffdedcdfb None None] profiler.hmac_keys = **** {{(pid=84210) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 18:55:15 devstack cinder-volume[84210]: DEBUG oslo_service.backend._eventlet.service [None req-da7f399b-5856-43ac-bce2-fd2ffdedcdfb None None] profiler.sentinel_service_name = mymaster {{(pid=84210) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 18:55:15 devstack cinder-volume[84210]: DEBUG oslo_service.backend._eventlet.service [None req-da7f399b-5856-43ac-bce2-fd2ffdedcdfb None None] profiler.socket_timeout = 0.1 {{(pid=84210) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 18:55:15 devstack cinder-volume[84210]: DEBUG oslo_service.backend._eventlet.service [None req-da7f399b-5856-43ac-bce2-fd2ffdedcdfb None None] profiler.trace_requests = False {{(pid=84210) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 18:55:15 devstack cinder-volume[84210]: DEBUG oslo_service.backend._eventlet.service [None req-da7f399b-5856-43ac-bce2-fd2ffdedcdfb None None] profiler.trace_sqlalchemy = False {{(pid=84210) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 18:55:15 devstack cinder-volume[84210]: DEBUG oslo_service.backend._eventlet.service [None req-da7f399b-5856-43ac-bce2-fd2ffdedcdfb None None] profiler_jaeger.process_tags = {} {{(pid=84210) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 18:55:15 devstack cinder-volume[84210]: DEBUG oslo_service.backend._eventlet.service [None req-da7f399b-5856-43ac-bce2-fd2ffdedcdfb None None] profiler_jaeger.service_name_prefix = None {{(pid=84210) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 18:55:15 devstack cinder-volume[84210]: DEBUG oslo_service.backend._eventlet.service [None req-da7f399b-5856-43ac-bce2-fd2ffdedcdfb None None] profiler_otlp.service_name_prefix = None {{(pid=84210) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 18:55:15 devstack cinder-volume[84210]: DEBUG oslo_service.backend._eventlet.service [None req-da7f399b-5856-43ac-bce2-fd2ffdedcdfb None None] oslo_policy.enforce_new_defaults = False {{(pid=84210) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 18:55:15 devstack cinder-volume[84210]: WARNING oslo_config.cfg [None req-da7f399b-5856-43ac-bce2-fd2ffdedcdfb None None] Deprecated: Option "enforce_scope" from group "oslo_policy" is deprecated for removal (This configuration was added temporarily to facilitate a smooth transition to the new RBAC. OpenStack will always enforce scope checks. This configuration option is deprecated and will be removed in the 2025.2 cycle.). Its value may be silently ignored in the future. Apr 29 18:55:15 devstack cinder-volume[84210]: DEBUG oslo_service.backend._eventlet.service [None req-da7f399b-5856-43ac-bce2-fd2ffdedcdfb None None] oslo_policy.enforce_scope = False {{(pid=84210) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 18:55:15 devstack cinder-volume[84210]: DEBUG oslo_service.backend._eventlet.service [None req-da7f399b-5856-43ac-bce2-fd2ffdedcdfb None None] oslo_policy.policy_default_rule = default {{(pid=84210) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 18:55:15 devstack cinder-volume[84210]: DEBUG oslo_service.backend._eventlet.service [None req-da7f399b-5856-43ac-bce2-fd2ffdedcdfb None None] oslo_policy.policy_dirs = ['policy.d'] {{(pid=84210) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 18:55:15 devstack cinder-volume[84210]: DEBUG oslo_service.backend._eventlet.service [None req-da7f399b-5856-43ac-bce2-fd2ffdedcdfb None None] oslo_policy.policy_file = policy.yaml {{(pid=84210) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 18:55:15 devstack cinder-volume[84210]: DEBUG oslo_service.backend._eventlet.service [None req-da7f399b-5856-43ac-bce2-fd2ffdedcdfb None None] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=84210) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 18:55:15 devstack cinder-volume[84210]: DEBUG oslo_service.backend._eventlet.service [None req-da7f399b-5856-43ac-bce2-fd2ffdedcdfb None None] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=84210) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 18:55:15 devstack cinder-volume[84210]: DEBUG oslo_service.backend._eventlet.service [None req-da7f399b-5856-43ac-bce2-fd2ffdedcdfb None None] oslo_policy.remote_ssl_client_crt_file = None {{(pid=84210) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 18:55:15 devstack cinder-volume[84210]: DEBUG oslo_service.backend._eventlet.service [None req-da7f399b-5856-43ac-bce2-fd2ffdedcdfb None None] oslo_policy.remote_ssl_client_key_file = None {{(pid=84210) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 18:55:15 devstack cinder-volume[84210]: DEBUG oslo_service.backend._eventlet.service [None req-da7f399b-5856-43ac-bce2-fd2ffdedcdfb None None] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=84210) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 18:55:15 devstack cinder-volume[84210]: DEBUG oslo_service.backend._eventlet.service [None req-da7f399b-5856-43ac-bce2-fd2ffdedcdfb None None] oslo_policy.remote_timeout = 60.0 {{(pid=84210) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 18:55:15 devstack cinder-volume[84210]: DEBUG oslo_service.backend._eventlet.service [None req-da7f399b-5856-43ac-bce2-fd2ffdedcdfb None None] privsep_osbrick.capabilities = [21, 2] {{(pid=84210) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 18:55:15 devstack cinder-volume[84210]: DEBUG oslo_service.backend._eventlet.service [None req-da7f399b-5856-43ac-bce2-fd2ffdedcdfb None None] privsep_osbrick.group = None {{(pid=84210) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 18:55:15 devstack cinder-volume[84210]: DEBUG oslo_service.backend._eventlet.service [None req-da7f399b-5856-43ac-bce2-fd2ffdedcdfb None None] privsep_osbrick.helper_command = None {{(pid=84210) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 18:55:15 devstack cinder-volume[84210]: DEBUG oslo_service.backend._eventlet.service [None req-da7f399b-5856-43ac-bce2-fd2ffdedcdfb None None] privsep_osbrick.log_daemon_traceback = False {{(pid=84210) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 18:55:15 devstack cinder-volume[84210]: DEBUG oslo_service.backend._eventlet.service [None req-da7f399b-5856-43ac-bce2-fd2ffdedcdfb None None] privsep_osbrick.logger_name = brick_privsep_hide_output {{(pid=84210) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 18:55:15 devstack cinder-volume[84210]: DEBUG oslo_service.backend._eventlet.service [None req-da7f399b-5856-43ac-bce2-fd2ffdedcdfb None None] privsep_osbrick.thread_pool_size = 4 {{(pid=84210) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 18:55:15 devstack cinder-volume[84210]: DEBUG oslo_service.backend._eventlet.service [None req-da7f399b-5856-43ac-bce2-fd2ffdedcdfb None None] privsep_osbrick.user = None {{(pid=84210) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 18:55:15 devstack cinder-volume[84210]: DEBUG oslo_service.backend._eventlet.service [None req-da7f399b-5856-43ac-bce2-fd2ffdedcdfb None None] cinder_sys_admin.capabilities = [0, 1, 2, 3, 12, 21] {{(pid=84210) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 18:55:15 devstack cinder-volume[84210]: DEBUG oslo_service.backend._eventlet.service [None req-da7f399b-5856-43ac-bce2-fd2ffdedcdfb None None] cinder_sys_admin.group = None {{(pid=84210) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 18:55:15 devstack cinder-volume[84210]: DEBUG oslo_service.backend._eventlet.service [None req-da7f399b-5856-43ac-bce2-fd2ffdedcdfb None None] cinder_sys_admin.helper_command = None {{(pid=84210) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 18:55:15 devstack cinder-volume[84210]: DEBUG oslo_service.backend._eventlet.service [None req-da7f399b-5856-43ac-bce2-fd2ffdedcdfb None None] cinder_sys_admin.log_daemon_traceback = False {{(pid=84210) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 18:55:15 devstack cinder-volume[84210]: DEBUG oslo_service.backend._eventlet.service [None req-da7f399b-5856-43ac-bce2-fd2ffdedcdfb None None] cinder_sys_admin.logger_name = oslo_privsep.daemon {{(pid=84210) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 18:55:15 devstack cinder-volume[84210]: DEBUG oslo_service.backend._eventlet.service [None req-da7f399b-5856-43ac-bce2-fd2ffdedcdfb None None] cinder_sys_admin.thread_pool_size = 4 {{(pid=84210) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 18:55:15 devstack cinder-volume[84210]: DEBUG oslo_service.backend._eventlet.service [None req-da7f399b-5856-43ac-bce2-fd2ffdedcdfb None None] cinder_sys_admin.user = None {{(pid=84210) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 18:55:15 devstack cinder-volume[84210]: DEBUG oslo_service.backend._eventlet.service [None req-da7f399b-5856-43ac-bce2-fd2ffdedcdfb None None] service_user.auth_section = None {{(pid=84210) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 18:55:15 devstack cinder-volume[84210]: DEBUG oslo_service.backend._eventlet.service [None req-da7f399b-5856-43ac-bce2-fd2ffdedcdfb None None] service_user.auth_type = password {{(pid=84210) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 18:55:15 devstack cinder-volume[84210]: DEBUG oslo_service.backend._eventlet.service [None req-da7f399b-5856-43ac-bce2-fd2ffdedcdfb None None] service_user.cafile = None {{(pid=84210) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 18:55:15 devstack cinder-volume[84210]: DEBUG oslo_service.backend._eventlet.service [None req-da7f399b-5856-43ac-bce2-fd2ffdedcdfb None None] service_user.certfile = None {{(pid=84210) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 18:55:15 devstack cinder-volume[84210]: DEBUG oslo_service.backend._eventlet.service [None req-da7f399b-5856-43ac-bce2-fd2ffdedcdfb None None] service_user.collect_timing = False {{(pid=84210) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 18:55:15 devstack cinder-volume[84210]: DEBUG oslo_service.backend._eventlet.service [None req-da7f399b-5856-43ac-bce2-fd2ffdedcdfb None None] service_user.insecure = False {{(pid=84210) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 18:55:15 devstack cinder-volume[84210]: DEBUG oslo_service.backend._eventlet.service [None req-da7f399b-5856-43ac-bce2-fd2ffdedcdfb None None] service_user.keyfile = None {{(pid=84210) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 18:55:15 devstack cinder-volume[84210]: DEBUG oslo_service.backend._eventlet.service [None req-da7f399b-5856-43ac-bce2-fd2ffdedcdfb None None] service_user.send_service_user_token = True {{(pid=84210) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 18:55:15 devstack cinder-volume[84210]: DEBUG oslo_service.backend._eventlet.service [None req-da7f399b-5856-43ac-bce2-fd2ffdedcdfb None None] service_user.split_loggers = False {{(pid=84210) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 18:55:15 devstack cinder-volume[84210]: DEBUG oslo_service.backend._eventlet.service [None req-da7f399b-5856-43ac-bce2-fd2ffdedcdfb None None] service_user.timeout = None {{(pid=84210) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 18:55:15 devstack cinder-volume[84210]: DEBUG oslo_service.backend._eventlet.service [None req-da7f399b-5856-43ac-bce2-fd2ffdedcdfb None None] glance.auth_section = None {{(pid=84210) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 18:55:15 devstack cinder-volume[84210]: DEBUG oslo_service.backend._eventlet.service [None req-da7f399b-5856-43ac-bce2-fd2ffdedcdfb None None] glance.auth_type = password {{(pid=84210) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 18:55:15 devstack cinder-volume[84210]: DEBUG oslo_service.backend._eventlet.service [None req-da7f399b-5856-43ac-bce2-fd2ffdedcdfb None None] glance.cafile = /opt/stack/data/ca-bundle.pem {{(pid=84210) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 18:55:15 devstack cinder-volume[84210]: DEBUG oslo_service.backend._eventlet.service [None req-da7f399b-5856-43ac-bce2-fd2ffdedcdfb None None] glance.certfile = None {{(pid=84210) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 18:55:15 devstack cinder-volume[84210]: DEBUG oslo_service.backend._eventlet.service [None req-da7f399b-5856-43ac-bce2-fd2ffdedcdfb None None] glance.collect_timing = False {{(pid=84210) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 18:55:15 devstack cinder-volume[84210]: DEBUG oslo_service.backend._eventlet.service [None req-da7f399b-5856-43ac-bce2-fd2ffdedcdfb None None] glance.insecure = False {{(pid=84210) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 18:55:15 devstack cinder-volume[84210]: DEBUG oslo_service.backend._eventlet.service [None req-da7f399b-5856-43ac-bce2-fd2ffdedcdfb None None] glance.keyfile = None {{(pid=84210) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 18:55:15 devstack cinder-volume[84210]: DEBUG oslo_service.backend._eventlet.service [None req-da7f399b-5856-43ac-bce2-fd2ffdedcdfb None None] glance.region_name = None {{(pid=84210) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 18:55:15 devstack cinder-volume[84210]: DEBUG oslo_service.backend._eventlet.service [None req-da7f399b-5856-43ac-bce2-fd2ffdedcdfb None None] glance.split_loggers = False {{(pid=84210) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 18:55:15 devstack cinder-volume[84210]: DEBUG oslo_service.backend._eventlet.service [None req-da7f399b-5856-43ac-bce2-fd2ffdedcdfb None None] glance.timeout = None {{(pid=84210) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 18:55:15 devstack cinder-volume[84210]: DEBUG oslo_service.backend._eventlet.service [None req-da7f399b-5856-43ac-bce2-fd2ffdedcdfb None None] backend_defaults.backend_availability_zone = None {{(pid=84210) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 18:55:15 devstack cinder-volume[84210]: DEBUG oslo_service.backend._eventlet.service [None req-da7f399b-5856-43ac-bce2-fd2ffdedcdfb None None] backend_defaults.backend_native_threads_pool_size = 20 {{(pid=84210) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 18:55:15 devstack cinder-volume[84210]: DEBUG oslo_service.backend._eventlet.service [None req-da7f399b-5856-43ac-bce2-fd2ffdedcdfb None None] backend_defaults.backup_use_temp_snapshot = False {{(pid=84210) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 18:55:15 devstack cinder-volume[84210]: DEBUG oslo_service.backend._eventlet.service [None req-da7f399b-5856-43ac-bce2-fd2ffdedcdfb None None] backend_defaults.chap_password = **** {{(pid=84210) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 18:55:15 devstack cinder-volume[84210]: DEBUG oslo_service.backend._eventlet.service [None req-da7f399b-5856-43ac-bce2-fd2ffdedcdfb None None] backend_defaults.chap_username = {{(pid=84210) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 18:55:15 devstack cinder-volume[84210]: DEBUG oslo_service.backend._eventlet.service [None req-da7f399b-5856-43ac-bce2-fd2ffdedcdfb None None] backend_defaults.chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=84210) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 18:55:15 devstack cinder-volume[84210]: DEBUG oslo_service.backend._eventlet.service [None req-da7f399b-5856-43ac-bce2-fd2ffdedcdfb None None] backend_defaults.disk_geometry = None {{(pid=84210) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 18:55:15 devstack cinder-volume[84210]: DEBUG oslo_service.backend._eventlet.service [None req-da7f399b-5856-43ac-bce2-fd2ffdedcdfb None None] backend_defaults.driver_client_cert = None {{(pid=84210) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 18:55:15 devstack cinder-volume[84210]: DEBUG oslo_service.backend._eventlet.service [None req-da7f399b-5856-43ac-bce2-fd2ffdedcdfb None None] backend_defaults.driver_client_cert_key = None {{(pid=84210) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 18:55:15 devstack cinder-volume[84210]: DEBUG oslo_service.backend._eventlet.service [None req-da7f399b-5856-43ac-bce2-fd2ffdedcdfb None None] backend_defaults.driver_data_namespace = None {{(pid=84210) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 18:55:15 devstack cinder-volume[84210]: DEBUG oslo_service.backend._eventlet.service [None req-da7f399b-5856-43ac-bce2-fd2ffdedcdfb None None] backend_defaults.driver_ssl_cert_path = None {{(pid=84210) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 18:55:15 devstack cinder-volume[84210]: DEBUG oslo_service.backend._eventlet.service [None req-da7f399b-5856-43ac-bce2-fd2ffdedcdfb None None] backend_defaults.driver_ssl_cert_verify = False {{(pid=84210) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 18:55:15 devstack cinder-volume[84210]: DEBUG oslo_service.backend._eventlet.service [None req-da7f399b-5856-43ac-bce2-fd2ffdedcdfb None None] backend_defaults.driver_use_ssl = False {{(pid=84210) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 18:55:15 devstack cinder-volume[84210]: DEBUG oslo_service.backend._eventlet.service [None req-da7f399b-5856-43ac-bce2-fd2ffdedcdfb None None] backend_defaults.enable_unsupported_driver = False {{(pid=84210) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 18:55:15 devstack cinder-volume[84210]: DEBUG oslo_service.backend._eventlet.service [None req-da7f399b-5856-43ac-bce2-fd2ffdedcdfb None None] backend_defaults.enforce_multipath_for_image_xfer = False {{(pid=84210) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 18:55:15 devstack cinder-volume[84210]: DEBUG oslo_service.backend._eventlet.service [None req-da7f399b-5856-43ac-bce2-fd2ffdedcdfb None None] backend_defaults.extra_capabilities = {} {{(pid=84210) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 18:55:15 devstack cinder-volume[84210]: DEBUG oslo_service.backend._eventlet.service [None req-da7f399b-5856-43ac-bce2-fd2ffdedcdfb None None] backend_defaults.filter_function = None {{(pid=84210) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 18:55:15 devstack cinder-volume[84210]: DEBUG oslo_service.backend._eventlet.service [None req-da7f399b-5856-43ac-bce2-fd2ffdedcdfb None None] backend_defaults.goodness_function = None {{(pid=84210) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 18:55:15 devstack cinder-volume[84210]: DEBUG oslo_service.backend._eventlet.service [None req-da7f399b-5856-43ac-bce2-fd2ffdedcdfb None None] backend_defaults.image_upload_use_cinder_backend = False {{(pid=84210) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 18:55:15 devstack cinder-volume[84538]: DEBUG cinder.volume.drivers.quobyte [None req-d910280d-c21e-4448-95b2-3d8d86e46e7b None None] nas_secure_file_* settings are false (ownership) and false (permissions). {{(pid=84538) set_nas_security_options /opt/stack/cinder/cinder/volume/drivers/quobyte.py:305}} Apr 29 18:55:15 devstack cinder-volume[84538]: WARNING cinder.volume.drivers.quobyte [None req-d910280d-c21e-4448-95b2-3d8d86e46e7b None None] The NAS file operations will be run as root, allowing root level access at the storage backend. Apr 29 18:55:15 devstack cinder-volume[84538]: WARNING cinder.volume.drivers.quobyte [None req-d910280d-c21e-4448-95b2-3d8d86e46e7b None None] The NAS file permissions mode will be 666 (allowing other/world read & write access). Apr 29 18:55:15 devstack cinder-volume[84210]: DEBUG oslo_service.backend._eventlet.service [None req-da7f399b-5856-43ac-bce2-fd2ffdedcdfb None None] backend_defaults.image_upload_use_internal_tenant = False {{(pid=84210) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 18:55:15 devstack cinder-volume[84210]: DEBUG oslo_service.backend._eventlet.service [None req-da7f399b-5856-43ac-bce2-fd2ffdedcdfb None None] backend_defaults.image_volume_cache_enabled = False {{(pid=84210) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 18:55:15 devstack cinder-volume[84210]: DEBUG oslo_service.backend._eventlet.service [None req-da7f399b-5856-43ac-bce2-fd2ffdedcdfb None None] backend_defaults.image_volume_cache_max_count = 0 {{(pid=84210) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 18:55:15 devstack cinder-volume[84210]: DEBUG oslo_service.backend._eventlet.service [None req-da7f399b-5856-43ac-bce2-fd2ffdedcdfb None None] backend_defaults.image_volume_cache_max_size_gb = 0 {{(pid=84210) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 18:55:15 devstack cinder-volume[84210]: DEBUG oslo_service.backend._eventlet.service [None req-da7f399b-5856-43ac-bce2-fd2ffdedcdfb None None] backend_defaults.iscsi_target_flags = {{(pid=84210) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 18:55:15 devstack cinder-volume[84210]: DEBUG oslo_service.backend._eventlet.service [None req-da7f399b-5856-43ac-bce2-fd2ffdedcdfb None None] backend_defaults.iscsi_write_cache = on {{(pid=84210) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 18:55:15 devstack cinder-volume[84210]: DEBUG oslo_service.backend._eventlet.service [None req-da7f399b-5856-43ac-bce2-fd2ffdedcdfb None None] backend_defaults.iser_helper = tgtadm {{(pid=84210) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 18:55:15 devstack cinder-volume[84210]: DEBUG oslo_service.backend._eventlet.service [None req-da7f399b-5856-43ac-bce2-fd2ffdedcdfb None None] backend_defaults.iser_ip_address = 192.168.122.135 {{(pid=84210) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 18:55:15 devstack cinder-volume[84210]: DEBUG oslo_service.backend._eventlet.service [None req-da7f399b-5856-43ac-bce2-fd2ffdedcdfb None None] backend_defaults.iser_port = 3260 {{(pid=84210) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 18:55:15 devstack cinder-volume[84210]: DEBUG oslo_service.backend._eventlet.service [None req-da7f399b-5856-43ac-bce2-fd2ffdedcdfb None None] backend_defaults.iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=84210) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 18:55:15 devstack cinder-volume[84210]: DEBUG oslo_service.backend._eventlet.service [None req-da7f399b-5856-43ac-bce2-fd2ffdedcdfb None None] backend_defaults.max_over_subscription_ratio = 20.0 {{(pid=84210) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 18:55:15 devstack cinder-volume[84538]: DEBUG oslo_concurrency.processutils [None req-d910280d-c21e-4448-95b2-3d8d86e46e7b None None] Running cmd (subprocess): mount.quobyte {{(pid=84538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 18:55:15 devstack cinder-volume[84210]: DEBUG oslo_service.backend._eventlet.service [None req-da7f399b-5856-43ac-bce2-fd2ffdedcdfb None None] backend_defaults.nas_host = {{(pid=84210) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 18:55:15 devstack cinder-volume[84210]: DEBUG oslo_service.backend._eventlet.service [None req-da7f399b-5856-43ac-bce2-fd2ffdedcdfb None None] backend_defaults.nas_login = admin {{(pid=84210) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 18:55:15 devstack cinder-volume[84210]: DEBUG oslo_service.backend._eventlet.service [None req-da7f399b-5856-43ac-bce2-fd2ffdedcdfb None None] backend_defaults.nas_mount_options = None {{(pid=84210) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 18:55:15 devstack cinder-volume[84210]: DEBUG oslo_service.backend._eventlet.service [None req-da7f399b-5856-43ac-bce2-fd2ffdedcdfb None None] backend_defaults.nas_password = **** {{(pid=84210) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 18:55:15 devstack cinder-volume[84210]: DEBUG oslo_service.backend._eventlet.service [None req-da7f399b-5856-43ac-bce2-fd2ffdedcdfb None None] backend_defaults.nas_private_key = {{(pid=84210) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 18:55:15 devstack cinder-volume[84210]: DEBUG oslo_service.backend._eventlet.service [None req-da7f399b-5856-43ac-bce2-fd2ffdedcdfb None None] backend_defaults.nas_secure_file_operations = auto {{(pid=84210) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 18:55:15 devstack cinder-volume[84210]: DEBUG oslo_service.backend._eventlet.service [None req-da7f399b-5856-43ac-bce2-fd2ffdedcdfb None None] backend_defaults.nas_secure_file_permissions = auto {{(pid=84210) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 18:55:15 devstack cinder-volume[84210]: DEBUG oslo_service.backend._eventlet.service [None req-da7f399b-5856-43ac-bce2-fd2ffdedcdfb None None] backend_defaults.nas_share_path = {{(pid=84210) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 18:55:15 devstack cinder-volume[84210]: DEBUG oslo_service.backend._eventlet.service [None req-da7f399b-5856-43ac-bce2-fd2ffdedcdfb None None] backend_defaults.nas_ssh_port = 22 {{(pid=84210) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 18:55:15 devstack cinder-volume[84210]: DEBUG oslo_service.backend._eventlet.service [None req-da7f399b-5856-43ac-bce2-fd2ffdedcdfb None None] backend_defaults.nas_volume_prov_type = thin {{(pid=84210) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 18:55:15 devstack cinder-volume[84210]: DEBUG oslo_service.backend._eventlet.service [None req-da7f399b-5856-43ac-bce2-fd2ffdedcdfb None None] backend_defaults.num_iser_scan_tries = 3 {{(pid=84210) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 18:55:15 devstack cinder-volume[84210]: DEBUG oslo_service.backend._eventlet.service [None req-da7f399b-5856-43ac-bce2-fd2ffdedcdfb None None] backend_defaults.num_shell_tries = 3 {{(pid=84210) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 18:55:15 devstack cinder-volume[84210]: DEBUG oslo_service.backend._eventlet.service [None req-da7f399b-5856-43ac-bce2-fd2ffdedcdfb None None] backend_defaults.num_volume_device_scan_tries = 3 {{(pid=84210) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 18:55:15 devstack cinder-volume[84210]: DEBUG oslo_service.backend._eventlet.service [None req-da7f399b-5856-43ac-bce2-fd2ffdedcdfb None None] backend_defaults.nvmeof_conn_info_version = 1 {{(pid=84210) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 18:55:15 devstack cinder-volume[84210]: DEBUG oslo_service.backend._eventlet.service [None req-da7f399b-5856-43ac-bce2-fd2ffdedcdfb None None] backend_defaults.nvmet_ns_id = 10 {{(pid=84210) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 18:55:15 devstack cinder-volume[84210]: DEBUG oslo_service.backend._eventlet.service [None req-da7f399b-5856-43ac-bce2-fd2ffdedcdfb None None] backend_defaults.nvmet_port_id = 1 {{(pid=84210) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 18:55:15 devstack cinder-volume[84210]: DEBUG oslo_service.backend._eventlet.service [None req-da7f399b-5856-43ac-bce2-fd2ffdedcdfb None None] backend_defaults.quobyte_client_cfg = None {{(pid=84210) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 18:55:15 devstack cinder-volume[84210]: DEBUG oslo_service.backend._eventlet.service [None req-da7f399b-5856-43ac-bce2-fd2ffdedcdfb None None] backend_defaults.quobyte_mount_point_base = /opt/stack/data/cinder/mnt {{(pid=84210) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 18:55:15 devstack cinder-volume[84210]: DEBUG oslo_service.backend._eventlet.service [None req-da7f399b-5856-43ac-bce2-fd2ffdedcdfb None None] backend_defaults.quobyte_overlay_volumes = False {{(pid=84210) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 18:55:15 devstack cinder-volume[84210]: DEBUG oslo_service.backend._eventlet.service [None req-da7f399b-5856-43ac-bce2-fd2ffdedcdfb None None] backend_defaults.quobyte_qcow2_volumes = True {{(pid=84210) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 18:55:15 devstack cinder-volume[84210]: DEBUG oslo_service.backend._eventlet.service [None req-da7f399b-5856-43ac-bce2-fd2ffdedcdfb None None] backend_defaults.quobyte_sparsed_volumes = True {{(pid=84210) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 18:55:15 devstack cinder-volume[84210]: DEBUG oslo_service.backend._eventlet.service [None req-da7f399b-5856-43ac-bce2-fd2ffdedcdfb None None] backend_defaults.quobyte_volume_from_snapshot_cache = False {{(pid=84210) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 18:55:15 devstack cinder-volume[84210]: DEBUG oslo_service.backend._eventlet.service [None req-da7f399b-5856-43ac-bce2-fd2ffdedcdfb None None] backend_defaults.quobyte_volume_url = None {{(pid=84210) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 18:55:15 devstack cinder-volume[84210]: DEBUG oslo_service.backend._eventlet.service [None req-da7f399b-5856-43ac-bce2-fd2ffdedcdfb None None] backend_defaults.replication_device = **** {{(pid=84210) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 18:55:15 devstack cinder-volume[84210]: DEBUG oslo_service.backend._eventlet.service [None req-da7f399b-5856-43ac-bce2-fd2ffdedcdfb None None] backend_defaults.report_discard_supported = False {{(pid=84210) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 18:55:15 devstack cinder-volume[84210]: DEBUG oslo_service.backend._eventlet.service [None req-da7f399b-5856-43ac-bce2-fd2ffdedcdfb None None] backend_defaults.reserved_percentage = 0 {{(pid=84210) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 18:55:15 devstack cinder-volume[84210]: DEBUG oslo_service.backend._eventlet.service [None req-da7f399b-5856-43ac-bce2-fd2ffdedcdfb None None] backend_defaults.scst_target_driver = iscsi {{(pid=84210) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 18:55:15 devstack cinder-volume[84210]: DEBUG oslo_service.backend._eventlet.service [None req-da7f399b-5856-43ac-bce2-fd2ffdedcdfb None None] backend_defaults.scst_target_iqn_name = None {{(pid=84210) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 18:55:15 devstack cinder-volume[84210]: DEBUG oslo_service.backend._eventlet.service [None req-da7f399b-5856-43ac-bce2-fd2ffdedcdfb None None] backend_defaults.storage_protocol = iSCSI {{(pid=84210) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 18:55:15 devstack cinder-volume[84210]: DEBUG oslo_service.backend._eventlet.service [None req-da7f399b-5856-43ac-bce2-fd2ffdedcdfb None None] backend_defaults.suppress_requests_ssl_warnings = False {{(pid=84210) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 18:55:15 devstack cinder-volume[84210]: DEBUG oslo_service.backend._eventlet.service [None req-da7f399b-5856-43ac-bce2-fd2ffdedcdfb None None] backend_defaults.target_helper = tgtadm {{(pid=84210) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 18:55:15 devstack cinder-volume[84210]: DEBUG oslo_service.backend._eventlet.service [None req-da7f399b-5856-43ac-bce2-fd2ffdedcdfb None None] backend_defaults.target_ip_address = 192.168.122.135 {{(pid=84210) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 18:55:15 devstack cinder-volume[84210]: DEBUG oslo_service.backend._eventlet.service [None req-da7f399b-5856-43ac-bce2-fd2ffdedcdfb None None] backend_defaults.target_port = 3260 {{(pid=84210) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 18:55:15 devstack cinder-volume[84210]: DEBUG oslo_service.backend._eventlet.service [None req-da7f399b-5856-43ac-bce2-fd2ffdedcdfb None None] backend_defaults.target_prefix = iqn.2010-10.org.openstack: {{(pid=84210) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 18:55:15 devstack cinder-volume[84210]: DEBUG oslo_service.backend._eventlet.service [None req-da7f399b-5856-43ac-bce2-fd2ffdedcdfb None None] backend_defaults.target_protocol = iscsi {{(pid=84210) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 18:55:15 devstack cinder-volume[84210]: DEBUG oslo_service.backend._eventlet.service [None req-da7f399b-5856-43ac-bce2-fd2ffdedcdfb None None] backend_defaults.target_secondary_ip_addresses = [] {{(pid=84210) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 18:55:15 devstack cinder-volume[84210]: DEBUG oslo_service.backend._eventlet.service [None req-da7f399b-5856-43ac-bce2-fd2ffdedcdfb None None] backend_defaults.trace_flags = None {{(pid=84210) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 18:55:15 devstack cinder-volume[84210]: DEBUG oslo_service.backend._eventlet.service [None req-da7f399b-5856-43ac-bce2-fd2ffdedcdfb None None] backend_defaults.unique_fqdn_network = True {{(pid=84210) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 18:55:15 devstack cinder-volume[84210]: DEBUG oslo_service.backend._eventlet.service [None req-da7f399b-5856-43ac-bce2-fd2ffdedcdfb None None] backend_defaults.use_chap_auth = False {{(pid=84210) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 18:55:15 devstack cinder-volume[84210]: DEBUG oslo_service.backend._eventlet.service [None req-da7f399b-5856-43ac-bce2-fd2ffdedcdfb None None] backend_defaults.use_multipath_for_image_xfer = False {{(pid=84210) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 18:55:15 devstack cinder-volume[84210]: DEBUG oslo_service.backend._eventlet.service [None req-da7f399b-5856-43ac-bce2-fd2ffdedcdfb None None] backend_defaults.volume_backend_name = None {{(pid=84210) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 18:55:15 devstack cinder-volume[84210]: DEBUG oslo_service.backend._eventlet.service [None req-da7f399b-5856-43ac-bce2-fd2ffdedcdfb None None] backend_defaults.volume_clear = zero {{(pid=84210) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 18:55:15 devstack cinder-volume[84210]: DEBUG oslo_service.backend._eventlet.service [None req-da7f399b-5856-43ac-bce2-fd2ffdedcdfb None None] backend_defaults.volume_clear_ionice = None {{(pid=84210) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 18:55:15 devstack cinder-volume[84210]: DEBUG oslo_service.backend._eventlet.service [None req-da7f399b-5856-43ac-bce2-fd2ffdedcdfb None None] backend_defaults.volume_clear_size = 0 {{(pid=84210) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 18:55:15 devstack cinder-volume[84210]: DEBUG oslo_service.backend._eventlet.service [None req-da7f399b-5856-43ac-bce2-fd2ffdedcdfb None None] backend_defaults.volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=84210) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 18:55:15 devstack cinder-volume[84210]: DEBUG oslo_service.backend._eventlet.service [None req-da7f399b-5856-43ac-bce2-fd2ffdedcdfb None None] backend_defaults.volume_copy_bps_limit = 0 {{(pid=84210) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 18:55:15 devstack cinder-volume[84210]: DEBUG oslo_service.backend._eventlet.service [None req-da7f399b-5856-43ac-bce2-fd2ffdedcdfb None None] backend_defaults.volume_dd_blocksize = 1M {{(pid=84210) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 18:55:15 devstack cinder-volume[84210]: DEBUG oslo_service.backend._eventlet.service [None req-da7f399b-5856-43ac-bce2-fd2ffdedcdfb None None] backend_defaults.volume_driver = cinder.volume.drivers.lvm.LVMVolumeDriver {{(pid=84210) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 18:55:15 devstack cinder-volume[84210]: DEBUG oslo_service.backend._eventlet.service [None req-da7f399b-5856-43ac-bce2-fd2ffdedcdfb None None] backend_defaults.volumes_dir = /opt/stack/data/cinder/volumes {{(pid=84210) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 18:55:15 devstack cinder-volume[84210]: DEBUG oslo_service.backend._eventlet.service [None req-da7f399b-5856-43ac-bce2-fd2ffdedcdfb None None] oslo_reports.file_event_handler = None {{(pid=84210) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 18:55:15 devstack cinder-volume[84210]: DEBUG oslo_service.backend._eventlet.service [None req-da7f399b-5856-43ac-bce2-fd2ffdedcdfb None None] oslo_reports.file_event_handler_interval = 1 {{(pid=84210) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 18:55:15 devstack cinder-volume[84210]: DEBUG oslo_service.backend._eventlet.service [None req-da7f399b-5856-43ac-bce2-fd2ffdedcdfb None None] oslo_reports.log_dir = None {{(pid=84210) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 18:55:15 devstack cinder-volume[84210]: DEBUG oslo_service.backend._eventlet.service [None req-da7f399b-5856-43ac-bce2-fd2ffdedcdfb None None] QuobyteHD.backend_availability_zone = None {{(pid=84210) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 18:55:15 devstack cinder-volume[84210]: DEBUG oslo_service.backend._eventlet.service [None req-da7f399b-5856-43ac-bce2-fd2ffdedcdfb None None] QuobyteHD.backend_host = None {{(pid=84210) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 18:55:15 devstack cinder-volume[84210]: DEBUG oslo_service.backend._eventlet.service [None req-da7f399b-5856-43ac-bce2-fd2ffdedcdfb None None] QuobyteHD.backend_native_threads_pool_size = None {{(pid=84210) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 18:55:15 devstack cinder-volume[84210]: DEBUG oslo_service.backend._eventlet.service [None req-da7f399b-5856-43ac-bce2-fd2ffdedcdfb None None] QuobyteHD.backup_use_temp_snapshot = None {{(pid=84210) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 18:55:15 devstack cinder-volume[84210]: DEBUG oslo_service.backend._eventlet.service [None req-da7f399b-5856-43ac-bce2-fd2ffdedcdfb None None] QuobyteHD.chap_password = **** {{(pid=84210) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 18:55:15 devstack cinder-volume[84210]: DEBUG oslo_service.backend._eventlet.service [None req-da7f399b-5856-43ac-bce2-fd2ffdedcdfb None None] QuobyteHD.chap_username = None {{(pid=84210) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 18:55:15 devstack cinder-volume[84210]: DEBUG oslo_service.backend._eventlet.service [None req-da7f399b-5856-43ac-bce2-fd2ffdedcdfb None None] QuobyteHD.chiscsi_conf = None {{(pid=84210) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 18:55:15 devstack cinder-volume[84210]: DEBUG oslo_service.backend._eventlet.service [None req-da7f399b-5856-43ac-bce2-fd2ffdedcdfb None None] QuobyteHD.disk_geometry = None {{(pid=84210) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 18:55:15 devstack cinder-volume[84210]: DEBUG oslo_service.backend._eventlet.service [None req-da7f399b-5856-43ac-bce2-fd2ffdedcdfb None None] QuobyteHD.driver_client_cert = None {{(pid=84210) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 18:55:15 devstack cinder-volume[84210]: DEBUG oslo_service.backend._eventlet.service [None req-da7f399b-5856-43ac-bce2-fd2ffdedcdfb None None] QuobyteHD.driver_client_cert_key = None {{(pid=84210) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 18:55:15 devstack cinder-volume[84210]: DEBUG oslo_service.backend._eventlet.service [None req-da7f399b-5856-43ac-bce2-fd2ffdedcdfb None None] QuobyteHD.driver_data_namespace = None {{(pid=84210) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 18:55:15 devstack cinder-volume[84210]: DEBUG oslo_service.backend._eventlet.service [None req-da7f399b-5856-43ac-bce2-fd2ffdedcdfb None None] QuobyteHD.driver_ssl_cert_path = None {{(pid=84210) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 18:55:15 devstack cinder-volume[84210]: DEBUG oslo_service.backend._eventlet.service [None req-da7f399b-5856-43ac-bce2-fd2ffdedcdfb None None] QuobyteHD.driver_ssl_cert_verify = None {{(pid=84210) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 18:55:15 devstack cinder-volume[84210]: DEBUG oslo_service.backend._eventlet.service [None req-da7f399b-5856-43ac-bce2-fd2ffdedcdfb None None] QuobyteHD.driver_use_ssl = None {{(pid=84210) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 18:55:15 devstack cinder-volume[84210]: DEBUG oslo_service.backend._eventlet.service [None req-da7f399b-5856-43ac-bce2-fd2ffdedcdfb None None] QuobyteHD.enable_unsupported_driver = True {{(pid=84210) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 18:55:15 devstack cinder-volume[84210]: DEBUG oslo_service.backend._eventlet.service [None req-da7f399b-5856-43ac-bce2-fd2ffdedcdfb None None] QuobyteHD.enforce_multipath_for_image_xfer = None {{(pid=84210) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 18:55:15 devstack cinder-volume[84210]: DEBUG oslo_service.backend._eventlet.service [None req-da7f399b-5856-43ac-bce2-fd2ffdedcdfb None None] QuobyteHD.extra_capabilities = None {{(pid=84210) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 18:55:15 devstack cinder-volume[84210]: DEBUG oslo_service.backend._eventlet.service [None req-da7f399b-5856-43ac-bce2-fd2ffdedcdfb None None] QuobyteHD.filter_function = None {{(pid=84210) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 18:55:15 devstack cinder-volume[84210]: DEBUG oslo_service.backend._eventlet.service [None req-da7f399b-5856-43ac-bce2-fd2ffdedcdfb None None] QuobyteHD.goodness_function = None {{(pid=84210) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 18:55:15 devstack cinder-volume[84210]: DEBUG oslo_service.backend._eventlet.service [None req-da7f399b-5856-43ac-bce2-fd2ffdedcdfb None None] QuobyteHD.image_upload_use_cinder_backend = None {{(pid=84210) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 18:55:15 devstack cinder-volume[84210]: DEBUG oslo_service.backend._eventlet.service [None req-da7f399b-5856-43ac-bce2-fd2ffdedcdfb None None] QuobyteHD.image_upload_use_internal_tenant = None {{(pid=84210) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 18:55:15 devstack cinder-volume[84210]: DEBUG oslo_service.backend._eventlet.service [None req-da7f399b-5856-43ac-bce2-fd2ffdedcdfb None None] QuobyteHD.image_volume_cache_enabled = None {{(pid=84210) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 18:55:15 devstack cinder-volume[84210]: DEBUG oslo_service.backend._eventlet.service [None req-da7f399b-5856-43ac-bce2-fd2ffdedcdfb None None] QuobyteHD.image_volume_cache_max_count = None {{(pid=84210) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 18:55:15 devstack cinder-volume[84210]: DEBUG oslo_service.backend._eventlet.service [None req-da7f399b-5856-43ac-bce2-fd2ffdedcdfb None None] QuobyteHD.image_volume_cache_max_size_gb = None {{(pid=84210) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 18:55:15 devstack cinder-volume[84210]: DEBUG oslo_service.backend._eventlet.service [None req-da7f399b-5856-43ac-bce2-fd2ffdedcdfb None None] QuobyteHD.iscsi_target_flags = None {{(pid=84210) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 18:55:15 devstack cinder-volume[84210]: DEBUG oslo_service.backend._eventlet.service [None req-da7f399b-5856-43ac-bce2-fd2ffdedcdfb None None] QuobyteHD.iscsi_write_cache = None {{(pid=84210) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 18:55:15 devstack cinder-volume[84210]: DEBUG oslo_service.backend._eventlet.service [None req-da7f399b-5856-43ac-bce2-fd2ffdedcdfb None None] QuobyteHD.iser_helper = None {{(pid=84210) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 18:55:15 devstack cinder-volume[84210]: DEBUG oslo_service.backend._eventlet.service [None req-da7f399b-5856-43ac-bce2-fd2ffdedcdfb None None] QuobyteHD.iser_ip_address = None {{(pid=84210) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 18:55:15 devstack cinder-volume[84210]: DEBUG oslo_service.backend._eventlet.service [None req-da7f399b-5856-43ac-bce2-fd2ffdedcdfb None None] QuobyteHD.iser_port = None {{(pid=84210) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 18:55:15 devstack cinder-volume[84210]: DEBUG oslo_service.backend._eventlet.service [None req-da7f399b-5856-43ac-bce2-fd2ffdedcdfb None None] QuobyteHD.iser_target_prefix = None {{(pid=84210) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 18:55:15 devstack cinder-volume[84210]: DEBUG oslo_service.backend._eventlet.service [None req-da7f399b-5856-43ac-bce2-fd2ffdedcdfb None None] QuobyteHD.max_over_subscription_ratio = None {{(pid=84210) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 18:55:15 devstack cinder-volume[84210]: DEBUG oslo_service.backend._eventlet.service [None req-da7f399b-5856-43ac-bce2-fd2ffdedcdfb None None] QuobyteHD.nas_host = None {{(pid=84210) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 18:55:15 devstack cinder-volume[84210]: DEBUG oslo_service.backend._eventlet.service [None req-da7f399b-5856-43ac-bce2-fd2ffdedcdfb None None] QuobyteHD.nas_login = None {{(pid=84210) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 18:55:15 devstack cinder-volume[84210]: DEBUG oslo_service.backend._eventlet.service [None req-da7f399b-5856-43ac-bce2-fd2ffdedcdfb None None] QuobyteHD.nas_mount_options = None {{(pid=84210) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 18:55:15 devstack cinder-volume[84210]: DEBUG oslo_service.backend._eventlet.service [None req-da7f399b-5856-43ac-bce2-fd2ffdedcdfb None None] QuobyteHD.nas_password = **** {{(pid=84210) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 18:55:15 devstack cinder-volume[84210]: DEBUG oslo_service.backend._eventlet.service [None req-da7f399b-5856-43ac-bce2-fd2ffdedcdfb None None] QuobyteHD.nas_private_key = None {{(pid=84210) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 18:55:15 devstack cinder-volume[84210]: DEBUG oslo_service.backend._eventlet.service [None req-da7f399b-5856-43ac-bce2-fd2ffdedcdfb None None] QuobyteHD.nas_secure_file_operations = false {{(pid=84210) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 18:55:15 devstack cinder-volume[84210]: DEBUG oslo_service.backend._eventlet.service [None req-da7f399b-5856-43ac-bce2-fd2ffdedcdfb None None] QuobyteHD.nas_secure_file_permissions = false {{(pid=84210) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 18:55:15 devstack cinder-volume[84210]: DEBUG oslo_service.backend._eventlet.service [None req-da7f399b-5856-43ac-bce2-fd2ffdedcdfb None None] QuobyteHD.nas_share_path = None {{(pid=84210) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 18:55:15 devstack cinder-volume[84210]: DEBUG oslo_service.backend._eventlet.service [None req-da7f399b-5856-43ac-bce2-fd2ffdedcdfb None None] QuobyteHD.nas_ssh_port = None {{(pid=84210) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 18:55:15 devstack cinder-volume[84210]: DEBUG oslo_service.backend._eventlet.service [None req-da7f399b-5856-43ac-bce2-fd2ffdedcdfb None None] QuobyteHD.nas_volume_prov_type = None {{(pid=84210) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 18:55:15 devstack cinder-volume[84210]: DEBUG oslo_service.backend._eventlet.service [None req-da7f399b-5856-43ac-bce2-fd2ffdedcdfb None None] QuobyteHD.num_iser_scan_tries = None {{(pid=84210) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 18:55:15 devstack cinder-volume[84210]: DEBUG oslo_service.backend._eventlet.service [None req-da7f399b-5856-43ac-bce2-fd2ffdedcdfb None None] QuobyteHD.num_shell_tries = None {{(pid=84210) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 18:55:15 devstack cinder-volume[84210]: DEBUG oslo_service.backend._eventlet.service [None req-da7f399b-5856-43ac-bce2-fd2ffdedcdfb None None] QuobyteHD.num_volume_device_scan_tries = None {{(pid=84210) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 18:55:15 devstack cinder-volume[84210]: DEBUG oslo_service.backend._eventlet.service [None req-da7f399b-5856-43ac-bce2-fd2ffdedcdfb None None] QuobyteHD.nvmeof_conn_info_version = None {{(pid=84210) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 18:55:15 devstack cinder-volume[84210]: DEBUG oslo_service.backend._eventlet.service [None req-da7f399b-5856-43ac-bce2-fd2ffdedcdfb None None] QuobyteHD.nvmet_ns_id = None {{(pid=84210) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 18:55:15 devstack cinder-volume[84210]: DEBUG oslo_service.backend._eventlet.service [None req-da7f399b-5856-43ac-bce2-fd2ffdedcdfb None None] QuobyteHD.nvmet_port_id = None {{(pid=84210) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 18:55:15 devstack cinder-volume[84210]: DEBUG oslo_service.backend._eventlet.service [None req-da7f399b-5856-43ac-bce2-fd2ffdedcdfb None None] QuobyteHD.quobyte_client_cfg = /etc/quobyte/client-cinder.cfg {{(pid=84210) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 18:55:15 devstack cinder-volume[84210]: DEBUG oslo_service.backend._eventlet.service [None req-da7f399b-5856-43ac-bce2-fd2ffdedcdfb None None] QuobyteHD.quobyte_mount_point_base = None {{(pid=84210) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 18:55:15 devstack cinder-volume[84210]: DEBUG oslo_service.backend._eventlet.service [None req-da7f399b-5856-43ac-bce2-fd2ffdedcdfb None None] QuobyteHD.quobyte_overlay_volumes = None {{(pid=84210) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 18:55:15 devstack cinder-volume[84210]: DEBUG oslo_service.backend._eventlet.service [None req-da7f399b-5856-43ac-bce2-fd2ffdedcdfb None None] QuobyteHD.quobyte_qcow2_volumes = None {{(pid=84210) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 18:55:15 devstack cinder-volume[84210]: DEBUG oslo_service.backend._eventlet.service [None req-da7f399b-5856-43ac-bce2-fd2ffdedcdfb None None] QuobyteHD.quobyte_sparsed_volumes = None {{(pid=84210) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 18:55:15 devstack cinder-volume[84210]: DEBUG oslo_service.backend._eventlet.service [None req-da7f399b-5856-43ac-bce2-fd2ffdedcdfb None None] QuobyteHD.quobyte_volume_from_snapshot_cache = None {{(pid=84210) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 18:55:15 devstack cinder-volume[84210]: DEBUG oslo_service.backend._eventlet.service [None req-da7f399b-5856-43ac-bce2-fd2ffdedcdfb None None] QuobyteHD.quobyte_volume_url = quobyte://osci02.corp.quobyte.com/cinder-vol-34312b00-dd6d-45bb-af98-75855cea8e48 {{(pid=84210) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 18:55:15 devstack cinder-volume[84210]: DEBUG oslo_service.backend._eventlet.service [None req-da7f399b-5856-43ac-bce2-fd2ffdedcdfb None None] QuobyteHD.replication_device = **** {{(pid=84210) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 18:55:15 devstack cinder-volume[84210]: DEBUG oslo_service.backend._eventlet.service [None req-da7f399b-5856-43ac-bce2-fd2ffdedcdfb None None] QuobyteHD.report_discard_supported = None {{(pid=84210) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 18:55:15 devstack cinder-volume[84210]: DEBUG oslo_service.backend._eventlet.service [None req-da7f399b-5856-43ac-bce2-fd2ffdedcdfb None None] QuobyteHD.reserved_percentage = None {{(pid=84210) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 18:55:15 devstack cinder-volume[84210]: DEBUG oslo_service.backend._eventlet.service [None req-da7f399b-5856-43ac-bce2-fd2ffdedcdfb None None] QuobyteHD.scst_target_driver = None {{(pid=84210) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 18:55:15 devstack cinder-volume[84210]: DEBUG oslo_service.backend._eventlet.service [None req-da7f399b-5856-43ac-bce2-fd2ffdedcdfb None None] QuobyteHD.scst_target_iqn_name = None {{(pid=84210) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 18:55:15 devstack cinder-volume[84210]: DEBUG oslo_service.backend._eventlet.service [None req-da7f399b-5856-43ac-bce2-fd2ffdedcdfb None None] QuobyteHD.storage_protocol = None {{(pid=84210) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 18:55:15 devstack cinder-volume[84210]: DEBUG oslo_service.backend._eventlet.service [None req-da7f399b-5856-43ac-bce2-fd2ffdedcdfb None None] QuobyteHD.suppress_requests_ssl_warnings = None {{(pid=84210) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 18:55:15 devstack cinder-volume[84210]: DEBUG oslo_service.backend._eventlet.service [None req-da7f399b-5856-43ac-bce2-fd2ffdedcdfb None None] QuobyteHD.target_helper = None {{(pid=84210) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 18:55:15 devstack cinder-volume[84210]: DEBUG oslo_service.backend._eventlet.service [None req-da7f399b-5856-43ac-bce2-fd2ffdedcdfb None None] QuobyteHD.target_ip_address = None {{(pid=84210) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 18:55:15 devstack cinder-volume[84210]: DEBUG oslo_service.backend._eventlet.service [None req-da7f399b-5856-43ac-bce2-fd2ffdedcdfb None None] QuobyteHD.target_port = None {{(pid=84210) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 18:55:15 devstack cinder-volume[84210]: DEBUG oslo_service.backend._eventlet.service [None req-da7f399b-5856-43ac-bce2-fd2ffdedcdfb None None] QuobyteHD.target_prefix = None {{(pid=84210) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 18:55:15 devstack cinder-volume[84210]: DEBUG oslo_service.backend._eventlet.service [None req-da7f399b-5856-43ac-bce2-fd2ffdedcdfb None None] QuobyteHD.target_protocol = None {{(pid=84210) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 18:55:15 devstack cinder-volume[84210]: DEBUG oslo_service.backend._eventlet.service [None req-da7f399b-5856-43ac-bce2-fd2ffdedcdfb None None] QuobyteHD.target_secondary_ip_addresses = None {{(pid=84210) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 18:55:15 devstack cinder-volume[84210]: DEBUG oslo_service.backend._eventlet.service [None req-da7f399b-5856-43ac-bce2-fd2ffdedcdfb None None] QuobyteHD.trace_flags = None {{(pid=84210) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 18:55:15 devstack cinder-volume[84210]: DEBUG oslo_service.backend._eventlet.service [None req-da7f399b-5856-43ac-bce2-fd2ffdedcdfb None None] QuobyteHD.unique_fqdn_network = None {{(pid=84210) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 18:55:15 devstack cinder-volume[84210]: DEBUG oslo_service.backend._eventlet.service [None req-da7f399b-5856-43ac-bce2-fd2ffdedcdfb None None] QuobyteHD.use_chap_auth = None {{(pid=84210) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 18:55:15 devstack cinder-volume[84210]: DEBUG oslo_service.backend._eventlet.service [None req-da7f399b-5856-43ac-bce2-fd2ffdedcdfb None None] QuobyteHD.use_multipath_for_image_xfer = None {{(pid=84210) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 18:55:15 devstack cinder-volume[84210]: DEBUG oslo_service.backend._eventlet.service [None req-da7f399b-5856-43ac-bce2-fd2ffdedcdfb None None] QuobyteHD.volume_backend_name = QuobyteHD {{(pid=84210) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 18:55:15 devstack cinder-volume[84210]: DEBUG oslo_service.backend._eventlet.service [None req-da7f399b-5856-43ac-bce2-fd2ffdedcdfb None None] QuobyteHD.volume_clear = None {{(pid=84210) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 18:55:15 devstack cinder-volume[84210]: DEBUG oslo_service.backend._eventlet.service [None req-da7f399b-5856-43ac-bce2-fd2ffdedcdfb None None] QuobyteHD.volume_clear_ionice = None {{(pid=84210) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 18:55:15 devstack cinder-volume[84210]: DEBUG oslo_service.backend._eventlet.service [None req-da7f399b-5856-43ac-bce2-fd2ffdedcdfb None None] QuobyteHD.volume_clear_size = None {{(pid=84210) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 18:55:15 devstack cinder-volume[84210]: DEBUG oslo_service.backend._eventlet.service [None req-da7f399b-5856-43ac-bce2-fd2ffdedcdfb None None] QuobyteHD.volume_copy_blkio_cgroup_name = None {{(pid=84210) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 18:55:15 devstack cinder-volume[84210]: DEBUG oslo_service.backend._eventlet.service [None req-da7f399b-5856-43ac-bce2-fd2ffdedcdfb None None] QuobyteHD.volume_copy_bps_limit = None {{(pid=84210) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 18:55:15 devstack cinder-volume[84210]: DEBUG oslo_service.backend._eventlet.service [None req-da7f399b-5856-43ac-bce2-fd2ffdedcdfb None None] QuobyteHD.volume_dd_blocksize = None {{(pid=84210) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 18:55:15 devstack cinder-volume[84210]: DEBUG oslo_service.backend._eventlet.service [None req-da7f399b-5856-43ac-bce2-fd2ffdedcdfb None None] QuobyteHD.volume_driver = cinder.volume.drivers.quobyte.QuobyteDriver {{(pid=84210) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 18:55:15 devstack cinder-volume[84210]: DEBUG oslo_service.backend._eventlet.service [None req-da7f399b-5856-43ac-bce2-fd2ffdedcdfb None None] QuobyteHD.volumes_dir = None {{(pid=84210) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 18:55:15 devstack cinder-volume[84210]: DEBUG oslo_service.backend._eventlet.service [None req-da7f399b-5856-43ac-bce2-fd2ffdedcdfb None None] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=84210) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 18:55:15 devstack cinder-volume[84210]: DEBUG oslo_service.backend._eventlet.service [None req-da7f399b-5856-43ac-bce2-fd2ffdedcdfb None None] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=84210) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 18:55:15 devstack cinder-volume[84210]: DEBUG oslo_service.backend._eventlet.service [None req-da7f399b-5856-43ac-bce2-fd2ffdedcdfb None None] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=84210) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 18:55:15 devstack cinder-volume[84210]: DEBUG oslo_service.backend._eventlet.service [None req-da7f399b-5856-43ac-bce2-fd2ffdedcdfb None None] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=84210) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 18:55:15 devstack cinder-volume[84210]: DEBUG oslo_service.backend._eventlet.service [None req-da7f399b-5856-43ac-bce2-fd2ffdedcdfb None None] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=84210) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 18:55:15 devstack cinder-volume[84210]: DEBUG oslo_service.backend._eventlet.service [None req-da7f399b-5856-43ac-bce2-fd2ffdedcdfb None None] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=84210) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 18:55:15 devstack cinder-volume[84210]: DEBUG oslo_service.backend._eventlet.service [None req-da7f399b-5856-43ac-bce2-fd2ffdedcdfb None None] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=84210) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 18:55:15 devstack cinder-volume[84210]: DEBUG oslo_service.backend._eventlet.service [None req-da7f399b-5856-43ac-bce2-fd2ffdedcdfb None None] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=84210) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 18:55:15 devstack cinder-volume[84210]: DEBUG oslo_service.backend._eventlet.service [None req-da7f399b-5856-43ac-bce2-fd2ffdedcdfb None None] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=84210) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 18:55:15 devstack cinder-volume[84210]: DEBUG oslo_service.backend._eventlet.service [None req-da7f399b-5856-43ac-bce2-fd2ffdedcdfb None None] oslo_messaging_rabbit.hostname = devstack {{(pid=84210) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 18:55:15 devstack cinder-volume[84210]: DEBUG oslo_service.backend._eventlet.service [None req-da7f399b-5856-43ac-bce2-fd2ffdedcdfb None None] oslo_messaging_rabbit.kombu_compression = None {{(pid=84210) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 18:55:15 devstack cinder-volume[84210]: DEBUG oslo_service.backend._eventlet.service [None req-da7f399b-5856-43ac-bce2-fd2ffdedcdfb None None] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=84210) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 18:55:15 devstack cinder-volume[84210]: DEBUG oslo_service.backend._eventlet.service [None req-da7f399b-5856-43ac-bce2-fd2ffdedcdfb None None] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=84210) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 18:55:15 devstack cinder-volume[84210]: DEBUG oslo_service.backend._eventlet.service [None req-da7f399b-5856-43ac-bce2-fd2ffdedcdfb None None] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=84210) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 18:55:15 devstack cinder-volume[84210]: DEBUG oslo_service.backend._eventlet.service [None req-da7f399b-5856-43ac-bce2-fd2ffdedcdfb None None] oslo_messaging_rabbit.kombu_reconnect_splay = 0.0 {{(pid=84210) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 18:55:15 devstack cinder-volume[84210]: DEBUG oslo_service.backend._eventlet.service [None req-da7f399b-5856-43ac-bce2-fd2ffdedcdfb None None] oslo_messaging_rabbit.processname = cinder-volume {{(pid=84210) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 18:55:15 devstack cinder-volume[84210]: DEBUG oslo_service.backend._eventlet.service [None req-da7f399b-5856-43ac-bce2-fd2ffdedcdfb None None] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=84210) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 18:55:15 devstack cinder-volume[84210]: DEBUG oslo_service.backend._eventlet.service [None req-da7f399b-5856-43ac-bce2-fd2ffdedcdfb None None] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=84210) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 18:55:15 devstack cinder-volume[84210]: DEBUG oslo_service.backend._eventlet.service [None req-da7f399b-5856-43ac-bce2-fd2ffdedcdfb None None] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=84210) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 18:55:15 devstack cinder-volume[84210]: DEBUG oslo_service.backend._eventlet.service [None req-da7f399b-5856-43ac-bce2-fd2ffdedcdfb None None] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=84210) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 18:55:15 devstack cinder-volume[84210]: DEBUG oslo_service.backend._eventlet.service [None req-da7f399b-5856-43ac-bce2-fd2ffdedcdfb None None] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=84210) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 18:55:15 devstack cinder-volume[84210]: DEBUG oslo_service.backend._eventlet.service [None req-da7f399b-5856-43ac-bce2-fd2ffdedcdfb None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_bytes = 0 {{(pid=84210) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 18:55:15 devstack cinder-volume[84210]: DEBUG oslo_service.backend._eventlet.service [None req-da7f399b-5856-43ac-bce2-fd2ffdedcdfb None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_length = 0 {{(pid=84210) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 18:55:15 devstack cinder-volume[84210]: DEBUG oslo_service.backend._eventlet.service [None req-da7f399b-5856-43ac-bce2-fd2ffdedcdfb None None] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=84210) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 18:55:15 devstack cinder-volume[84210]: DEBUG oslo_service.backend._eventlet.service [None req-da7f399b-5856-43ac-bce2-fd2ffdedcdfb None None] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=84210) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 18:55:15 devstack cinder-volume[84210]: DEBUG oslo_service.backend._eventlet.service [None req-da7f399b-5856-43ac-bce2-fd2ffdedcdfb None None] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=84210) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 18:55:15 devstack cinder-volume[84210]: DEBUG oslo_service.backend._eventlet.service [None req-da7f399b-5856-43ac-bce2-fd2ffdedcdfb None None] oslo_messaging_rabbit.rabbit_stream_fanout = False {{(pid=84210) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 18:55:15 devstack cinder-volume[84210]: DEBUG oslo_service.backend._eventlet.service [None req-da7f399b-5856-43ac-bce2-fd2ffdedcdfb None None] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=84210) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 18:55:15 devstack cinder-volume[84210]: DEBUG oslo_service.backend._eventlet.service [None req-da7f399b-5856-43ac-bce2-fd2ffdedcdfb None None] oslo_messaging_rabbit.rabbit_transient_quorum_queue = False {{(pid=84210) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 18:55:15 devstack cinder-volume[84210]: DEBUG oslo_service.backend._eventlet.service [None req-da7f399b-5856-43ac-bce2-fd2ffdedcdfb None None] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=84210) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 18:55:15 devstack cinder-volume[84210]: DEBUG oslo_service.backend._eventlet.service [None req-da7f399b-5856-43ac-bce2-fd2ffdedcdfb None None] oslo_messaging_rabbit.ssl = False {{(pid=84210) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 18:55:15 devstack cinder-volume[84210]: DEBUG oslo_service.backend._eventlet.service [None req-da7f399b-5856-43ac-bce2-fd2ffdedcdfb None None] oslo_messaging_rabbit.ssl_ca_file = {{(pid=84210) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 18:55:15 devstack cinder-volume[84210]: DEBUG oslo_service.backend._eventlet.service [None req-da7f399b-5856-43ac-bce2-fd2ffdedcdfb None None] oslo_messaging_rabbit.ssl_cert_file = {{(pid=84210) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 18:55:15 devstack cinder-volume[84210]: DEBUG oslo_service.backend._eventlet.service [None req-da7f399b-5856-43ac-bce2-fd2ffdedcdfb None None] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=84210) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 18:55:15 devstack cinder-volume[84210]: DEBUG oslo_service.backend._eventlet.service [None req-da7f399b-5856-43ac-bce2-fd2ffdedcdfb None None] oslo_messaging_rabbit.ssl_key_file = {{(pid=84210) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 18:55:15 devstack cinder-volume[84210]: DEBUG oslo_service.backend._eventlet.service [None req-da7f399b-5856-43ac-bce2-fd2ffdedcdfb None None] oslo_messaging_rabbit.ssl_version = {{(pid=84210) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 18:55:15 devstack cinder-volume[84210]: DEBUG oslo_service.backend._eventlet.service [None req-da7f399b-5856-43ac-bce2-fd2ffdedcdfb None None] oslo_messaging_rabbit.use_queue_manager = False {{(pid=84210) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 18:55:15 devstack cinder-volume[84210]: DEBUG oslo_service.backend._eventlet.service [None req-da7f399b-5856-43ac-bce2-fd2ffdedcdfb None None] oslo_messaging_notifications.driver = [] {{(pid=84210) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 18:55:15 devstack cinder-volume[84210]: DEBUG oslo_service.backend._eventlet.service [None req-da7f399b-5856-43ac-bce2-fd2ffdedcdfb None None] oslo_messaging_notifications.retry = -1 {{(pid=84210) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 18:55:15 devstack cinder-volume[84210]: DEBUG oslo_service.backend._eventlet.service [None req-da7f399b-5856-43ac-bce2-fd2ffdedcdfb None None] oslo_messaging_notifications.topics = ['notifications'] {{(pid=84210) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 18:55:15 devstack cinder-volume[84210]: DEBUG oslo_service.backend._eventlet.service [None req-da7f399b-5856-43ac-bce2-fd2ffdedcdfb None None] oslo_messaging_notifications.transport_url = **** {{(pid=84210) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 18:55:15 devstack cinder-volume[84210]: DEBUG oslo_service.backend._eventlet.service [None req-da7f399b-5856-43ac-bce2-fd2ffdedcdfb None None] key_manager.backend = cinder.keymgr.conf_key_mgr.ConfKeyManager {{(pid=84210) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 18:55:15 devstack cinder-volume[84210]: DEBUG oslo_service.backend._eventlet.service [None req-da7f399b-5856-43ac-bce2-fd2ffdedcdfb None None] key_manager.fixed_key = **** {{(pid=84210) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 18:55:15 devstack quobyte-client[84540]: Reading configuration file: /etc/quobyte/client.cfg Apr 29 18:55:15 devstack quobyte-client[84540]: Invalid parameters found, error: missing mount point. Apr 29 18:55:15 devstack cinder-volume[84210]: DEBUG oslo_service.backend._eventlet.service [None req-da7f399b-5856-43ac-bce2-fd2ffdedcdfb None None] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=84210) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 18:55:15 devstack cinder-volume[84210]: DEBUG oslo_service.backend._eventlet.service [None req-da7f399b-5856-43ac-bce2-fd2ffdedcdfb None None] barbican.barbican_api_version = None {{(pid=84210) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 18:55:15 devstack cinder-volume[84210]: DEBUG oslo_service.backend._eventlet.service [None req-da7f399b-5856-43ac-bce2-fd2ffdedcdfb None None] barbican.barbican_endpoint = None {{(pid=84210) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 18:55:15 devstack quobyte-client[84540]: Quobyte logging to journald, you can use 'journalctl QUOBYTE_MOUNTPOINT=' to display the log. Apr 29 18:55:15 devstack cinder-volume[84210]: DEBUG oslo_service.backend._eventlet.service [None req-da7f399b-5856-43ac-bce2-fd2ffdedcdfb None None] barbican.barbican_endpoint_type = public {{(pid=84210) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 18:55:15 devstack quobyte-client[84540]: Failed to parse all commandline parameters, please use -h/--help to see available options. Apr 29 18:55:15 devstack cinder-volume[84210]: DEBUG oslo_service.backend._eventlet.service [None req-da7f399b-5856-43ac-bce2-fd2ffdedcdfb None None] barbican.barbican_region_name = None {{(pid=84210) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 18:55:15 devstack cinder-volume[84210]: DEBUG oslo_service.backend._eventlet.service [None req-da7f399b-5856-43ac-bce2-fd2ffdedcdfb None None] barbican.cafile = None {{(pid=84210) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 18:55:15 devstack cinder-volume[84210]: DEBUG oslo_service.backend._eventlet.service [None req-da7f399b-5856-43ac-bce2-fd2ffdedcdfb None None] barbican.certfile = None {{(pid=84210) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 18:55:15 devstack cinder-volume[84538]: DEBUG oslo_concurrency.processutils [None req-d910280d-c21e-4448-95b2-3d8d86e46e7b None None] CMD "mount.quobyte" returned: 1 in 0.127s {{(pid=84538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 18:55:15 devstack cinder-volume[84538]: DEBUG oslo_concurrency.lockutils [None req-d910280d-c21e-4448-95b2-3d8d86e46e7b None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 18:55:15 devstack cinder-volume[84538]: DEBUG oslo_concurrency.lockutils [None req-d910280d-c21e-4448-95b2-3d8d86e46e7b None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 18:55:15 devstack cinder-volume[84538]: DEBUG cinder.volume.drivers.quobyte [None req-d910280d-c21e-4448-95b2-3d8d86e46e7b None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-34312b00-dd6d-45bb-af98-75855cea8e48': None} {{(pid=84538) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 18:55:15 devstack cinder-volume[84210]: DEBUG oslo_service.backend._eventlet.service [None req-da7f399b-5856-43ac-bce2-fd2ffdedcdfb None None] barbican.collect_timing = False {{(pid=84210) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 18:55:15 devstack cinder-volume[84210]: DEBUG oslo_service.backend._eventlet.service [None req-da7f399b-5856-43ac-bce2-fd2ffdedcdfb None None] barbican.insecure = False {{(pid=84210) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 18:55:15 devstack cinder-volume[84210]: DEBUG oslo_service.backend._eventlet.service [None req-da7f399b-5856-43ac-bce2-fd2ffdedcdfb None None] barbican.keyfile = None {{(pid=84210) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 18:55:15 devstack cinder-volume[84210]: DEBUG oslo_service.backend._eventlet.service [None req-da7f399b-5856-43ac-bce2-fd2ffdedcdfb None None] barbican.number_of_retries = 60 {{(pid=84210) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 18:55:15 devstack cinder-volume[84210]: DEBUG oslo_service.backend._eventlet.service [None req-da7f399b-5856-43ac-bce2-fd2ffdedcdfb None None] barbican.retry_delay = 1 {{(pid=84210) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 18:55:15 devstack cinder-volume[84210]: DEBUG oslo_service.backend._eventlet.service [None req-da7f399b-5856-43ac-bce2-fd2ffdedcdfb None None] barbican.send_service_user_token = False {{(pid=84210) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 18:55:15 devstack cinder-volume[84210]: DEBUG oslo_service.backend._eventlet.service [None req-da7f399b-5856-43ac-bce2-fd2ffdedcdfb None None] barbican.split_loggers = False {{(pid=84210) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 18:55:15 devstack cinder-volume[84210]: DEBUG oslo_service.backend._eventlet.service [None req-da7f399b-5856-43ac-bce2-fd2ffdedcdfb None None] barbican.timeout = None {{(pid=84210) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 18:55:15 devstack cinder-volume[84210]: DEBUG oslo_service.backend._eventlet.service [None req-da7f399b-5856-43ac-bce2-fd2ffdedcdfb None None] barbican.verify_ssl = True {{(pid=84210) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 18:55:15 devstack cinder-volume[84210]: DEBUG oslo_service.backend._eventlet.service [None req-da7f399b-5856-43ac-bce2-fd2ffdedcdfb None None] barbican.verify_ssl_path = None {{(pid=84210) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 18:55:15 devstack cinder-volume[84210]: DEBUG oslo_service.backend._eventlet.service [None req-da7f399b-5856-43ac-bce2-fd2ffdedcdfb None None] barbican_service_user.auth_section = None {{(pid=84210) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 18:55:15 devstack cinder-volume[84210]: DEBUG oslo_service.backend._eventlet.service [None req-da7f399b-5856-43ac-bce2-fd2ffdedcdfb None None] barbican_service_user.auth_type = None {{(pid=84210) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 18:55:15 devstack cinder-volume[84210]: DEBUG oslo_service.backend._eventlet.service [None req-da7f399b-5856-43ac-bce2-fd2ffdedcdfb None None] barbican_service_user.cafile = None {{(pid=84210) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 18:55:15 devstack cinder-volume[84210]: DEBUG oslo_service.backend._eventlet.service [None req-da7f399b-5856-43ac-bce2-fd2ffdedcdfb None None] barbican_service_user.certfile = None {{(pid=84210) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 18:55:15 devstack cinder-volume[84210]: DEBUG oslo_service.backend._eventlet.service [None req-da7f399b-5856-43ac-bce2-fd2ffdedcdfb None None] barbican_service_user.collect_timing = False {{(pid=84210) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 18:55:15 devstack cinder-volume[84210]: DEBUG oslo_service.backend._eventlet.service [None req-da7f399b-5856-43ac-bce2-fd2ffdedcdfb None None] barbican_service_user.insecure = False {{(pid=84210) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 18:55:15 devstack cinder-volume[84210]: DEBUG oslo_service.backend._eventlet.service [None req-da7f399b-5856-43ac-bce2-fd2ffdedcdfb None None] barbican_service_user.keyfile = None {{(pid=84210) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 18:55:15 devstack cinder-volume[84210]: DEBUG oslo_service.backend._eventlet.service [None req-da7f399b-5856-43ac-bce2-fd2ffdedcdfb None None] barbican_service_user.split_loggers = False {{(pid=84210) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 18:55:15 devstack cinder-volume[84210]: DEBUG oslo_service.backend._eventlet.service [None req-da7f399b-5856-43ac-bce2-fd2ffdedcdfb None None] barbican_service_user.timeout = None {{(pid=84210) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 18:55:15 devstack cinder-volume[84210]: DEBUG oslo_service.backend._eventlet.service [None req-da7f399b-5856-43ac-bce2-fd2ffdedcdfb None None] vault.approle_role_id = **** {{(pid=84210) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 18:55:15 devstack cinder-volume[84210]: DEBUG oslo_service.backend._eventlet.service [None req-da7f399b-5856-43ac-bce2-fd2ffdedcdfb None None] vault.approle_secret_id = **** {{(pid=84210) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 18:55:15 devstack cinder-volume[84210]: DEBUG oslo_service.backend._eventlet.service [None req-da7f399b-5856-43ac-bce2-fd2ffdedcdfb None None] vault.kv_mountpoint = secret {{(pid=84210) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 18:55:15 devstack cinder-volume[84210]: DEBUG oslo_service.backend._eventlet.service [None req-da7f399b-5856-43ac-bce2-fd2ffdedcdfb None None] vault.kv_path = None {{(pid=84210) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 18:55:15 devstack cinder-volume[84210]: DEBUG oslo_service.backend._eventlet.service [None req-da7f399b-5856-43ac-bce2-fd2ffdedcdfb None None] vault.kv_version = 2 {{(pid=84210) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 18:55:15 devstack cinder-volume[84210]: DEBUG oslo_service.backend._eventlet.service [None req-da7f399b-5856-43ac-bce2-fd2ffdedcdfb None None] vault.namespace = None {{(pid=84210) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 18:55:15 devstack cinder-volume[84210]: DEBUG oslo_service.backend._eventlet.service [None req-da7f399b-5856-43ac-bce2-fd2ffdedcdfb None None] vault.root_token_id = **** {{(pid=84210) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 18:55:15 devstack cinder-volume[84210]: DEBUG oslo_service.backend._eventlet.service [None req-da7f399b-5856-43ac-bce2-fd2ffdedcdfb None None] vault.ssl_ca_crt_file = None {{(pid=84210) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 18:55:15 devstack cinder-volume[84210]: DEBUG oslo_service.backend._eventlet.service [None req-da7f399b-5856-43ac-bce2-fd2ffdedcdfb None None] vault.timeout = 60.0 {{(pid=84210) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 18:55:15 devstack cinder-volume[84210]: DEBUG oslo_service.backend._eventlet.service [None req-da7f399b-5856-43ac-bce2-fd2ffdedcdfb None None] vault.use_ssl = False {{(pid=84210) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 18:55:15 devstack cinder-volume[84210]: DEBUG oslo_service.backend._eventlet.service [None req-da7f399b-5856-43ac-bce2-fd2ffdedcdfb None None] vault.vault_url = http://127.0.0.1:8200 {{(pid=84210) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 18:55:15 devstack cinder-volume[84210]: DEBUG oslo_service.backend._eventlet.service [None req-da7f399b-5856-43ac-bce2-fd2ffdedcdfb None None] ******************************************************************************** {{(pid=84210) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3013}} Apr 29 18:55:15 devstack cinder-volume[84538]: DEBUG cinder.volume.drivers.quobyte [None req-d910280d-c21e-4448-95b2-3d8d86e46e7b None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-34312b00-dd6d-45bb-af98-75855cea8e48'] {{(pid=84538) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 18:55:15 devstack cinder-volume[84538]: DEBUG oslo_concurrency.lockutils [None req-d910280d-c21e-4448-95b2-3d8d86e46e7b None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.032s {{(pid=84538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 18:55:15 devstack cinder-volume[84538]: DEBUG oslo_concurrency.processutils [None req-d910280d-c21e-4448-95b2-3d8d86e46e7b None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d {{(pid=84538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 18:55:15 devstack sudo[84542]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d Apr 29 18:55:15 devstack sudo[84542]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 18:55:16 devstack sudo[84542]: pam_unix(sudo:session): session closed for user root Apr 29 18:55:16 devstack cinder-volume[84538]: DEBUG oslo_concurrency.processutils [None req-d910280d-c21e-4448-95b2-3d8d86e46e7b None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d" returned: 0 in 1.235s {{(pid=84538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 18:55:16 devstack cinder-volume[84538]: INFO cinder.volume.driver [None req-d910280d-c21e-4448-95b2-3d8d86e46e7b None None] Driver hasn't implemented _init_vendor_properties() Apr 29 18:55:16 devstack cinder-volume[84538]: DEBUG cinder.volume.driver [None req-d910280d-c21e-4448-95b2-3d8d86e46e7b None None] Initialized capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.1.14', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1775.5280113220215, 'free_capacity_gb': 1775.5280113220215, 'reserved_percentage': 0, 'QoS_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=84538) init_capabilities /opt/stack/cinder/cinder/volume/driver.py:873}} Apr 29 18:55:16 devstack cinder-volume[84538]: DEBUG oslo_db.sqlalchemy.engines [None req-d910280d-c21e-4448-95b2-3d8d86e46e7b None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=84538) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Apr 29 18:55:16 devstack cinder-volume[84538]: DEBUG dbcounter [-] [84538] Writer thread running {{(pid=84538) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}} Apr 29 18:55:16 devstack cinder-volume[84538]: DEBUG cinder.db.sqlalchemy.api [None req-d910280d-c21e-4448-95b2-3d8d86e46e7b None None] Building query based on filter {{(pid=84538) _process_snaps_filters /opt/stack/cinder/cinder/db/sqlalchemy/api.py:3943}} Apr 29 18:55:16 devstack cinder-volume[84538]: DEBUG cinder.image.image_utils [None req-d910280d-c21e-4448-95b2-3d8d86e46e7b None None] Configuration image_conversion_dir is None or the path doesn't exist. {{(pid=84538) cleanup_temporary_file /opt/stack/cinder/cinder/image/image_utils.py:1298}} Apr 29 18:55:16 devstack cinder-volume[84538]: DEBUG oslo_concurrency.lockutils [None req-d910280d-c21e-4448-95b2-3d8d86e46e7b None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 18:55:16 devstack cinder-volume[84538]: DEBUG oslo_concurrency.lockutils [None req-d910280d-c21e-4448-95b2-3d8d86e46e7b None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=84538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 18:55:16 devstack cinder-volume[84538]: DEBUG cinder.volume.drivers.quobyte [None req-d910280d-c21e-4448-95b2-3d8d86e46e7b None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-34312b00-dd6d-45bb-af98-75855cea8e48': None} {{(pid=84538) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 18:55:16 devstack cinder-volume[84538]: DEBUG cinder.volume.drivers.quobyte [None req-d910280d-c21e-4448-95b2-3d8d86e46e7b None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-34312b00-dd6d-45bb-af98-75855cea8e48'] {{(pid=84538) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 18:55:16 devstack cinder-volume[84538]: DEBUG oslo_concurrency.lockutils [None req-d910280d-c21e-4448-95b2-3d8d86e46e7b None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=84538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 18:55:16 devstack cinder-volume[84538]: DEBUG oslo_concurrency.processutils [None req-d910280d-c21e-4448-95b2-3d8d86e46e7b None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d {{(pid=84538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 18:55:16 devstack cinder-volume[84538]: INFO cinder.keymgr.migration [None req-a74a7cc1-6d3f-4f43-a61c-9d35e5cffdb9 None None] Not migrating encryption keys because the ConfKeyManager is still in use. Apr 29 18:55:16 devstack sudo[84554]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d Apr 29 18:55:16 devstack sudo[84554]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 18:55:17 devstack sudo[84554]: pam_unix(sudo:session): session closed for user root Apr 29 18:55:17 devstack cinder-volume[84538]: DEBUG oslo_concurrency.processutils [None req-d910280d-c21e-4448-95b2-3d8d86e46e7b None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d" returned: 0 in 0.562s {{(pid=84538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 18:55:17 devstack cinder-volume[84538]: DEBUG cinder.manager [None req-d910280d-c21e-4448-95b2-3d8d86e46e7b None None] Notifying Schedulers of capabilities ... {{(pid=84538) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 29 18:55:17 devstack cinder-volume[84538]: INFO cinder.volume.manager [None req-d910280d-c21e-4448-95b2-3d8d86e46e7b None None] Driver initialization completed successfully. Apr 29 18:55:17 devstack cinder-volume[84538]: INFO cinder.manager [None req-d910280d-c21e-4448-95b2-3d8d86e46e7b None None] Initiating service 3 cleanup Apr 29 18:55:17 devstack cinder-volume[84538]: INFO cinder.manager [None req-d910280d-c21e-4448-95b2-3d8d86e46e7b None None] Service 3 cleanup completed. Apr 29 18:55:17 devstack cinder-volume[84538]: DEBUG cinder.service [None req-d910280d-c21e-4448-95b2-3d8d86e46e7b None None] Creating RPC server for service cinder-volume {{(pid=84538) start /opt/stack/cinder/cinder/service.py:231}} Apr 29 18:55:17 devstack cinder-volume[84538]: DEBUG cinder.service [None req-d910280d-c21e-4448-95b2-3d8d86e46e7b None None] Pinning object versions for RPC server serializer to 1.39 {{(pid=84538) start /opt/stack/cinder/cinder/service.py:237}} Apr 29 18:55:17 devstack cinder-volume[84538]: INFO cinder.volume.manager [None req-d910280d-c21e-4448-95b2-3d8d86e46e7b None None] Initializing RPC dependent components of volume driver QuobyteDriver (1.1.14) Apr 29 18:55:17 devstack cinder-volume[84538]: DEBUG oslo_concurrency.lockutils [None req-d910280d-c21e-4448-95b2-3d8d86e46e7b None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 18:55:17 devstack cinder-volume[84538]: DEBUG oslo_concurrency.lockutils [None req-d910280d-c21e-4448-95b2-3d8d86e46e7b None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 18:55:17 devstack cinder-volume[84538]: DEBUG cinder.volume.drivers.quobyte [None req-d910280d-c21e-4448-95b2-3d8d86e46e7b None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-34312b00-dd6d-45bb-af98-75855cea8e48': None} {{(pid=84538) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 18:55:17 devstack cinder-volume[84538]: DEBUG cinder.volume.drivers.quobyte [None req-d910280d-c21e-4448-95b2-3d8d86e46e7b None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-34312b00-dd6d-45bb-af98-75855cea8e48'] {{(pid=84538) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 18:55:17 devstack cinder-volume[84538]: DEBUG oslo_concurrency.lockutils [None req-d910280d-c21e-4448-95b2-3d8d86e46e7b None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=84538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 18:55:17 devstack cinder-volume[84538]: DEBUG oslo_concurrency.processutils [None req-d910280d-c21e-4448-95b2-3d8d86e46e7b None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d {{(pid=84538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 18:55:17 devstack sudo[84558]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d Apr 29 18:55:17 devstack sudo[84558]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 18:55:18 devstack sudo[84558]: pam_unix(sudo:session): session closed for user root Apr 29 18:55:18 devstack cinder-volume[84538]: DEBUG oslo_concurrency.processutils [None req-d910280d-c21e-4448-95b2-3d8d86e46e7b None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d" returned: 0 in 0.687s {{(pid=84538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 18:55:18 devstack cinder-volume[84538]: INFO cinder.volume.manager [None req-d910280d-c21e-4448-95b2-3d8d86e46e7b None None] Driver post RPC initialization completed successfully. Apr 29 18:55:24 devstack cinder-volume[84210]: DEBUG dbcounter [-] [84210] Writing DB stats cinder:SELECT=5,cinder:UPDATE=1 {{(pid=84210) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Apr 29 18:55:27 devstack cinder-volume[84538]: DEBUG dbcounter [-] [84538] Writing DB stats cinder:SELECT=2 {{(pid=84538) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Apr 29 18:55:28 devstack cinder-volume[84538]: DEBUG dbcounter [-] [84538] Writing DB stats cinder:SELECT=8,cinder:UPDATE=1 {{(pid=84538) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Apr 29 18:56:25 devstack cinder-volume[84538]: DEBUG oslo_service.periodic_task [None req-a93183a6-1080-461c-84de-2fcb210d4f60 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=84538) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}} Apr 29 18:56:25 devstack cinder-volume[84538]: DEBUG oslo_concurrency.lockutils [None req-a93183a6-1080-461c-84de-2fcb210d4f60 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 18:56:25 devstack cinder-volume[84538]: DEBUG oslo_concurrency.lockutils [None req-a93183a6-1080-461c-84de-2fcb210d4f60 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.005s {{(pid=84538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 18:56:25 devstack cinder-volume[84538]: DEBUG cinder.volume.drivers.quobyte [None req-a93183a6-1080-461c-84de-2fcb210d4f60 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-34312b00-dd6d-45bb-af98-75855cea8e48': None} {{(pid=84538) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 18:56:25 devstack cinder-volume[84538]: DEBUG cinder.volume.drivers.quobyte [None req-a93183a6-1080-461c-84de-2fcb210d4f60 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-34312b00-dd6d-45bb-af98-75855cea8e48'] {{(pid=84538) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 18:56:25 devstack cinder-volume[84538]: DEBUG oslo_concurrency.lockutils [None req-a93183a6-1080-461c-84de-2fcb210d4f60 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.033s {{(pid=84538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 18:56:25 devstack cinder-volume[84538]: DEBUG oslo_concurrency.processutils [None req-a93183a6-1080-461c-84de-2fcb210d4f60 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d {{(pid=84538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 18:56:25 devstack sudo[85225]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d Apr 29 18:56:25 devstack sudo[85225]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 18:56:26 devstack sudo[85225]: pam_unix(sudo:session): session closed for user root Apr 29 18:56:27 devstack cinder-volume[84538]: DEBUG oslo_concurrency.processutils [None req-a93183a6-1080-461c-84de-2fcb210d4f60 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d" returned: 0 in 1.870s {{(pid=84538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 18:56:27 devstack cinder-volume[84538]: DEBUG cinder.manager [None req-a93183a6-1080-461c-84de-2fcb210d4f60 None None] Notifying Schedulers of capabilities ... {{(pid=84538) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 29 18:56:27 devstack cinder-volume[84538]: DEBUG cinder.volume.flows.manager.create_volume [None req-0cf7fe2a-4a7a-4a52-bc9d-b8d06f72aef1 tempest-DeleteServersTestJSON-1936124708 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84538) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Apr 29 18:56:27 devstack cinder-volume[84538]: DEBUG cinder.volume.manager [None req-0cf7fe2a-4a7a-4a52-bc9d-b8d06f72aef1 tempest-DeleteServersTestJSON-1936124708 None] Flow 'volume_create_manager' (b291c928-df6a-4571-a934-7674a228e9e9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84538) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 18:56:27 devstack cinder-volume[84538]: DEBUG cinder.volume.manager [None req-0cf7fe2a-4a7a-4a52-bc9d-b8d06f72aef1 tempest-DeleteServersTestJSON-1936124708 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3645178b-e71c-4b7d-a2db-a2ba16fb33b2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 18:56:27 devstack cinder-volume[84538]: DEBUG cinder.volume.manager [None req-0cf7fe2a-4a7a-4a52-bc9d-b8d06f72aef1 tempest-DeleteServersTestJSON-1936124708 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3645178b-e71c-4b7d-a2db-a2ba16fb33b2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-29T16:56:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-DeleteServersTestJSON-volume-1739999870',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a2f83cc4-e005-45d6-a4db-afb00dfef960,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8627e5e74009494daff2dd168a3b1d58',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T16:56:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T16:56:27Z,use_quota=True,user_id='a0df14a5f9a6447a91f3774b0b54f207',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(62b05900-93e3-4190-a88f-1d87324303d1),volume_type_id=62b05900-93e3-4190-a88f-1d87324303d1)' {{(pid=84538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 18:56:27 devstack cinder-volume[84538]: DEBUG cinder.volume.manager [None req-0cf7fe2a-4a7a-4a52-bc9d-b8d06f72aef1 tempest-DeleteServersTestJSON-1936124708 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2125a93f-fff4-476f-be1c-77777fa42735) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 18:56:27 devstack cinder-volume[84538]: DEBUG cinder.volume.manager [None req-0cf7fe2a-4a7a-4a52-bc9d-b8d06f72aef1 tempest-DeleteServersTestJSON-1936124708 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2125a93f-fff4-476f-be1c-77777fa42735) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 18:56:28 devstack cinder-volume[84538]: DEBUG cinder.volume.manager [None req-0cf7fe2a-4a7a-4a52-bc9d-b8d06f72aef1 tempest-DeleteServersTestJSON-1936124708 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (228d6c1f-7b85-4417-aa92-e67c27f4f47f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 18:56:28 devstack cinder-volume[84538]: DEBUG cinder.volume.manager [None req-0cf7fe2a-4a7a-4a52-bc9d-b8d06f72aef1 tempest-DeleteServersTestJSON-1936124708 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (228d6c1f-7b85-4417-aa92-e67c27f4f47f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a2f83cc4-e005-45d6-a4db-afb00dfef960', 'volume_name': 'volume-a2f83cc4-e005-45d6-a4db-afb00dfef960', 'volume_size': 1}' {{(pid=84538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 18:56:28 devstack cinder-volume[84538]: DEBUG cinder.volume.manager [None req-0cf7fe2a-4a7a-4a52-bc9d-b8d06f72aef1 tempest-DeleteServersTestJSON-1936124708 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b4832e9d-32c8-445f-be42-2b86709f793c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 18:56:28 devstack cinder-volume[84538]: DEBUG cinder.volume.manager [None req-0cf7fe2a-4a7a-4a52-bc9d-b8d06f72aef1 tempest-DeleteServersTestJSON-1936124708 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b4832e9d-32c8-445f-be42-2b86709f793c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 18:56:28 devstack cinder-volume[84538]: DEBUG cinder.volume.manager [None req-0cf7fe2a-4a7a-4a52-bc9d-b8d06f72aef1 tempest-DeleteServersTestJSON-1936124708 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6b3961b2-43ac-4a78-9ddd-a7a6db1c59c1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 18:56:28 devstack cinder-volume[84538]: INFO cinder.volume.flows.manager.create_volume [None req-0cf7fe2a-4a7a-4a52-bc9d-b8d06f72aef1 tempest-DeleteServersTestJSON-1936124708 None] Volume a2f83cc4-e005-45d6-a4db-afb00dfef960: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a2f83cc4-e005-45d6-a4db-afb00dfef960', 'volume_size': 1} Apr 29 18:56:28 devstack cinder-volume[84538]: DEBUG oslo_concurrency.lockutils [None req-0cf7fe2a-4a7a-4a52-bc9d-b8d06f72aef1 tempest-DeleteServersTestJSON-1936124708 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 18:56:28 devstack cinder-volume[84538]: DEBUG oslo_concurrency.lockutils [None req-0cf7fe2a-4a7a-4a52-bc9d-b8d06f72aef1 tempest-DeleteServersTestJSON-1936124708 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=84538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 18:56:28 devstack cinder-volume[84538]: DEBUG cinder.volume.drivers.quobyte [None req-0cf7fe2a-4a7a-4a52-bc9d-b8d06f72aef1 tempest-DeleteServersTestJSON-1936124708 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-29T16:56:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-DeleteServersTestJSON-volume-1739999870',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a2f83cc4-e005-45d6-a4db-afb00dfef960,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8627e5e74009494daff2dd168a3b1d58',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T16:56:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T16:56:27Z,use_quota=True,user_id='a0df14a5f9a6447a91f3774b0b54f207',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(62b05900-93e3-4190-a88f-1d87324303d1),volume_type_id=62b05900-93e3-4190-a88f-1d87324303d1)}" {{(pid=84538) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 29 18:56:28 devstack cinder-volume[84538]: DEBUG cinder.volume.drivers.remotefs [None req-0cf7fe2a-4a7a-4a52-bc9d-b8d06f72aef1 tempest-DeleteServersTestJSON-1936124708 None] Creating volume a2f83cc4-e005-45d6-a4db-afb00dfef960 {{(pid=84538) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 29 18:56:28 devstack cinder-volume[84538]: DEBUG oslo_concurrency.lockutils [None req-0cf7fe2a-4a7a-4a52-bc9d-b8d06f72aef1 tempest-DeleteServersTestJSON-1936124708 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 18:56:28 devstack cinder-volume[84538]: DEBUG oslo_concurrency.lockutils [None req-0cf7fe2a-4a7a-4a52-bc9d-b8d06f72aef1 tempest-DeleteServersTestJSON-1936124708 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.006s {{(pid=84538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 18:56:28 devstack cinder-volume[84538]: DEBUG cinder.volume.drivers.quobyte [None req-0cf7fe2a-4a7a-4a52-bc9d-b8d06f72aef1 tempest-DeleteServersTestJSON-1936124708 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-34312b00-dd6d-45bb-af98-75855cea8e48': None} {{(pid=84538) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 18:56:28 devstack cinder-volume[84538]: DEBUG cinder.volume.drivers.quobyte [None req-0cf7fe2a-4a7a-4a52-bc9d-b8d06f72aef1 tempest-DeleteServersTestJSON-1936124708 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-34312b00-dd6d-45bb-af98-75855cea8e48'] {{(pid=84538) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 18:56:28 devstack cinder-volume[84538]: DEBUG oslo_concurrency.lockutils [None req-0cf7fe2a-4a7a-4a52-bc9d-b8d06f72aef1 tempest-DeleteServersTestJSON-1936124708 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=84538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 18:56:28 devstack cinder-volume[84538]: DEBUG cinder.volume.drivers.quobyte [None req-0cf7fe2a-4a7a-4a52-bc9d-b8d06f72aef1 tempest-DeleteServersTestJSON-1936124708 None] Selected osci02.corp.quobyte.com/cinder-vol-34312b00-dd6d-45bb-af98-75855cea8e48 as target Quobyte volume. {{(pid=84538) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 29 18:56:28 devstack cinder-volume[84538]: INFO cinder.volume.drivers.remotefs [None req-0cf7fe2a-4a7a-4a52-bc9d-b8d06f72aef1 tempest-DeleteServersTestJSON-1936124708 None] casted to osci02.corp.quobyte.com/cinder-vol-34312b00-dd6d-45bb-af98-75855cea8e48 Apr 29 18:56:28 devstack cinder-volume[84538]: DEBUG oslo_concurrency.processutils [None req-0cf7fe2a-4a7a-4a52-bc9d-b8d06f72aef1 tempest-DeleteServersTestJSON-1936124708 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-a2f83cc4-e005-45d6-a4db-afb00dfef960 1073741824 {{(pid=84538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 18:56:28 devstack sudo[85239]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-a2f83cc4-e005-45d6-a4db-afb00dfef960 1073741824 Apr 29 18:56:28 devstack sudo[85239]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 18:56:30 devstack sudo[85239]: pam_unix(sudo:session): session closed for user root Apr 29 18:56:30 devstack cinder-volume[84538]: DEBUG oslo_concurrency.processutils [None req-0cf7fe2a-4a7a-4a52-bc9d-b8d06f72aef1 tempest-DeleteServersTestJSON-1936124708 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-a2f83cc4-e005-45d6-a4db-afb00dfef960 1073741824" returned: 0 in 2.389s {{(pid=84538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 18:56:30 devstack cinder-volume[84538]: DEBUG oslo_concurrency.processutils [None req-0cf7fe2a-4a7a-4a52-bc9d-b8d06f72aef1 tempest-DeleteServersTestJSON-1936124708 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-a2f83cc4-e005-45d6-a4db-afb00dfef960 {{(pid=84538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 18:56:30 devstack sudo[85581]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-a2f83cc4-e005-45d6-a4db-afb00dfef960 Apr 29 18:56:30 devstack sudo[85581]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 18:56:32 devstack sudo[85581]: pam_unix(sudo:session): session closed for user root Apr 29 18:56:32 devstack cinder-volume[84538]: DEBUG oslo_concurrency.processutils [None req-0cf7fe2a-4a7a-4a52-bc9d-b8d06f72aef1 tempest-DeleteServersTestJSON-1936124708 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-a2f83cc4-e005-45d6-a4db-afb00dfef960" returned: 0 in 1.609s {{(pid=84538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 18:56:32 devstack cinder-volume[84538]: DEBUG cinder.volume.drivers.quobyte [None req-0cf7fe2a-4a7a-4a52-bc9d-b8d06f72aef1 tempest-DeleteServersTestJSON-1936124708 None] <== create_volume: return (4172ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-34312b00-dd6d-45bb-af98-75855cea8e48'} {{(pid=84538) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 29 18:56:32 devstack cinder-volume[84538]: DEBUG oslo_concurrency.lockutils [None req-0cf7fe2a-4a7a-4a52-bc9d-b8d06f72aef1 tempest-DeleteServersTestJSON-1936124708 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 4.177s {{(pid=84538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 18:56:32 devstack cinder-volume[84538]: DEBUG cinder.volume.manager [None req-0cf7fe2a-4a7a-4a52-bc9d-b8d06f72aef1 tempest-DeleteServersTestJSON-1936124708 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6b3961b2-43ac-4a78-9ddd-a7a6db1c59c1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a2f83cc4-e005-45d6-a4db-afb00dfef960', 'volume_size': 1}' {{(pid=84538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 18:56:32 devstack cinder-volume[84538]: DEBUG cinder.volume.manager [None req-0cf7fe2a-4a7a-4a52-bc9d-b8d06f72aef1 tempest-DeleteServersTestJSON-1936124708 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b1332cfa-eef0-4646-a752-6442865a541b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 18:56:32 devstack cinder-volume[84538]: INFO cinder.volume.flows.manager.create_volume [None req-0cf7fe2a-4a7a-4a52-bc9d-b8d06f72aef1 tempest-DeleteServersTestJSON-1936124708 None] Volume volume-a2f83cc4-e005-45d6-a4db-afb00dfef960 (a2f83cc4-e005-45d6-a4db-afb00dfef960): created successfully Apr 29 18:56:32 devstack cinder-volume[84538]: DEBUG cinder.volume.manager [None req-0cf7fe2a-4a7a-4a52-bc9d-b8d06f72aef1 tempest-DeleteServersTestJSON-1936124708 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b1332cfa-eef0-4646-a752-6442865a541b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 18:56:32 devstack cinder-volume[84538]: DEBUG cinder.volume.manager [None req-0cf7fe2a-4a7a-4a52-bc9d-b8d06f72aef1 tempest-DeleteServersTestJSON-1936124708 None] Flow 'volume_create_manager' (b291c928-df6a-4571-a934-7674a228e9e9) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84538) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 18:56:32 devstack cinder-volume[84538]: INFO cinder.volume.manager [None req-0cf7fe2a-4a7a-4a52-bc9d-b8d06f72aef1 tempest-DeleteServersTestJSON-1936124708 None] Created volume successfully. Apr 29 18:56:42 devstack cinder-volume[84538]: DEBUG dbcounter [-] [84538] Writing DB stats cinder:SELECT=1,cinder:UPDATE=3,cinder:INSERT=1 {{(pid=84538) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Apr 29 18:56:42 devstack cinder-volume[84538]: DEBUG dbcounter [-] [84538] Writing DB stats cinder:UPDATE=3,cinder:SELECT=3,cinder:DELETE=1 {{(pid=84538) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Apr 29 18:56:44 devstack cinder-volume[84538]: WARNING py.warnings [req-baca0f72-e6b7-4262-befc-0a71e6a83e01 req-969b5066-afbf-41f3-96ef-12991078fbcc tempest-DeleteServersTestJSON-1936124708 None] /opt/stack/cinder/cinder/db/sqlalchemy/api.py:2470: SAWarning: SELECT statement has a cartesian product between FROM element(s) "volume_attachment", "volumes_1" and FROM element "volumes". Apply join condition(s) between each element to resolve. Apr 29 18:56:44 devstack cinder-volume[84538]: .first() Apr 29 18:56:44 devstack cinder-volume[84538]: Apr 29 18:56:44 devstack cinder-volume[84538]: DEBUG oslo_concurrency.lockutils [req-baca0f72-e6b7-4262-befc-0a71e6a83e01 req-969b5066-afbf-41f3-96ef-12991078fbcc tempest-DeleteServersTestJSON-1936124708 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=84538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 18:56:44 devstack cinder-volume[84538]: DEBUG oslo_concurrency.lockutils [req-baca0f72-e6b7-4262-befc-0a71e6a83e01 req-969b5066-afbf-41f3-96ef-12991078fbcc tempest-DeleteServersTestJSON-1936124708 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=84538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 18:56:44 devstack cinder-volume[84538]: INFO oslo.privsep.daemon [req-baca0f72-e6b7-4262-befc-0a71e6a83e01 req-969b5066-afbf-41f3-96ef-12991078fbcc tempest-DeleteServersTestJSON-1936124708 None] Running privsep helper: ['sudo', 'cinder-rootwrap', '/etc/cinder/rootwrap.conf', 'privsep-helper', '--config-file', '/etc/cinder/cinder.conf', '--privsep_context', 'cinder.privsep.sys_admin_pctxt', '--privsep_sock_path', '/tmp/tmppsd0k1rw/privsep.sock'] Apr 29 18:56:44 devstack sudo[85706]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf privsep-helper --config-file /etc/cinder/cinder.conf --privsep_context cinder.privsep.sys_admin_pctxt --privsep_sock_path /tmp/tmppsd0k1rw/privsep.sock Apr 29 18:56:44 devstack sudo[85706]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 18:56:47 devstack sudo[85706]: pam_unix(sudo:session): session closed for user root Apr 29 18:56:47 devstack cinder-volume[84538]: INFO oslo.privsep.daemon [req-baca0f72-e6b7-4262-befc-0a71e6a83e01 req-969b5066-afbf-41f3-96ef-12991078fbcc tempest-DeleteServersTestJSON-1936124708 None] Spawned new privsep daemon via rootwrap Apr 29 18:56:47 devstack cinder-volume[84538]: DEBUG oslo.privsep.daemon [req-baca0f72-e6b7-4262-befc-0a71e6a83e01 req-969b5066-afbf-41f3-96ef-12991078fbcc tempest-DeleteServersTestJSON-1936124708 None] Accepted privsep connection to /tmp/tmppsd0k1rw/privsep.sock {{(pid=84538) __init__ /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:418}} Apr 29 18:56:47 devstack cinder-volume[84538]: INFO oslo.privsep.daemon [-] privsep daemon starting Apr 29 18:56:47 devstack cinder-volume[84538]: INFO oslo.privsep.daemon [-] privsep process running with uid/gid: 0/0 Apr 29 18:56:47 devstack cinder-volume[84538]: INFO oslo.privsep.daemon [-] privsep process running with capabilities (eff/prm/inh): CAP_CHOWN|CAP_DAC_OVERRIDE|CAP_DAC_READ_SEARCH|CAP_FOWNER|CAP_NET_ADMIN|CAP_SYS_ADMIN/CAP_CHOWN|CAP_DAC_OVERRIDE|CAP_DAC_READ_SEARCH|CAP_FOWNER|CAP_NET_ADMIN|CAP_SYS_ADMIN/none Apr 29 18:56:47 devstack cinder-volume[84538]: INFO oslo.privsep.daemon [-] privsep daemon running as pid 85803 Apr 29 18:56:47 devstack cinder-volume[84538]: DEBUG oslo.privsep.daemon [-] privsep: reply[47184f25-6c40-42ed-a8b1-90f7afa71569]: (2,) {{(pid=85803) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 18:56:47 devstack cinder-volume[84538]: DEBUG oslo.privsep.daemon [-] privsep: reply[732fb414-f55d-44a5-99df-da918c6df6cd]: (4, 'qcow2') {{(pid=85803) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 18:56:47 devstack cinder-volume[84538]: DEBUG oslo_concurrency.processutils [req-baca0f72-e6b7-4262-befc-0a71e6a83e01 req-969b5066-afbf-41f3-96ef-12991078fbcc tempest-DeleteServersTestJSON-1936124708 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-a2f83cc4-e005-45d6-a4db-afb00dfef960 {{(pid=84538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 18:56:48 devstack sudo[85807]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-a2f83cc4-e005-45d6-a4db-afb00dfef960 Apr 29 18:56:48 devstack sudo[85807]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 18:56:49 devstack sudo[85807]: pam_unix(sudo:session): session closed for user root Apr 29 18:56:49 devstack cinder-volume[84538]: DEBUG oslo_concurrency.processutils [req-baca0f72-e6b7-4262-befc-0a71e6a83e01 req-969b5066-afbf-41f3-96ef-12991078fbcc tempest-DeleteServersTestJSON-1936124708 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-a2f83cc4-e005-45d6-a4db-afb00dfef960" returned: 0 in 1.683s {{(pid=84538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 18:56:49 devstack cinder-volume[84538]: DEBUG oslo_concurrency.lockutils [req-baca0f72-e6b7-4262-befc-0a71e6a83e01 req-969b5066-afbf-41f3-96ef-12991078fbcc tempest-DeleteServersTestJSON-1936124708 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 5.013s {{(pid=84538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 18:56:49 devstack cinder-volume[84538]: DEBUG cinder.volume.manager [req-baca0f72-e6b7-4262-befc-0a71e6a83e01 req-969b5066-afbf-41f3-96ef-12991078fbcc tempest-DeleteServersTestJSON-1936124708 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-34312b00-dd6d-45bb-af98-75855cea8e48', 'name': 'volume-a2f83cc4-e005-45d6-a4db-afb00dfef960', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'fa07d00b-a7c0-4c9b-b103-a175bde4c217', 'enforce_multipath': True} {{(pid=84538) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Apr 29 18:56:49 devstack cinder-volume[84538]: INFO cinder.volume.manager [req-baca0f72-e6b7-4262-befc-0a71e6a83e01 req-969b5066-afbf-41f3-96ef-12991078fbcc tempest-DeleteServersTestJSON-1936124708 None] attachment_update completed successfully. Apr 29 18:56:52 devstack cinder-volume[84538]: DEBUG cinder.volume.flows.manager.create_volume [req-d338abfb-6877-4ee4-9867-8ecba566a3ad req-33bc585f-829d-453d-9634-91e745104120 tempest-ServerBootFromVolumeStableRescueTest-1114355649 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84538) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Apr 29 18:56:52 devstack cinder-volume[84538]: DEBUG cinder.volume.manager [req-d338abfb-6877-4ee4-9867-8ecba566a3ad req-33bc585f-829d-453d-9634-91e745104120 tempest-ServerBootFromVolumeStableRescueTest-1114355649 None] Flow 'volume_create_manager' (d8afe26d-7106-48bc-ae6e-e3673e1ecc81) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84538) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 18:56:52 devstack cinder-volume[84538]: DEBUG cinder.volume.manager [req-d338abfb-6877-4ee4-9867-8ecba566a3ad req-33bc585f-829d-453d-9634-91e745104120 tempest-ServerBootFromVolumeStableRescueTest-1114355649 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (024d42a7-f596-48a5-a37b-b6652a49b8f1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 18:56:52 devstack cinder-volume[84538]: DEBUG cinder.volume.manager [req-d338abfb-6877-4ee4-9867-8ecba566a3ad req-33bc585f-829d-453d-9634-91e745104120 tempest-ServerBootFromVolumeStableRescueTest-1114355649 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (024d42a7-f596-48a5-a37b-b6652a49b8f1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-29T16:56:52Z,deleted=False,deleted_at=None,display_description='',display_name='f044c7fe-c128-44f8-90fd-1fc18628a30b-blank-vol',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a9fdc1fd-9378-4813-a351-15da1e3bc986,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='952a9a1064164a17a985a1b405951979',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T16:56:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T16:56:53Z,use_quota=True,user_id='98e810d72fd94fb0b0d586d7a18415b8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(62b05900-93e3-4190-a88f-1d87324303d1),volume_type_id=62b05900-93e3-4190-a88f-1d87324303d1)' {{(pid=84538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 18:56:52 devstack cinder-volume[84538]: DEBUG cinder.volume.manager [req-d338abfb-6877-4ee4-9867-8ecba566a3ad req-33bc585f-829d-453d-9634-91e745104120 tempest-ServerBootFromVolumeStableRescueTest-1114355649 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a07315ee-0583-430e-aa85-6dcd1dd354cb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 18:56:52 devstack cinder-volume[84538]: DEBUG cinder.volume.manager [req-d338abfb-6877-4ee4-9867-8ecba566a3ad req-33bc585f-829d-453d-9634-91e745104120 tempest-ServerBootFromVolumeStableRescueTest-1114355649 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a07315ee-0583-430e-aa85-6dcd1dd354cb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 18:56:52 devstack cinder-volume[84538]: DEBUG cinder.volume.manager [req-d338abfb-6877-4ee4-9867-8ecba566a3ad req-33bc585f-829d-453d-9634-91e745104120 tempest-ServerBootFromVolumeStableRescueTest-1114355649 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0ddc2dc7-1550-45e6-8f0c-bc64aa8d4fc6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 18:56:52 devstack cinder-volume[84538]: DEBUG cinder.volume.manager [req-d338abfb-6877-4ee4-9867-8ecba566a3ad req-33bc585f-829d-453d-9634-91e745104120 tempest-ServerBootFromVolumeStableRescueTest-1114355649 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0ddc2dc7-1550-45e6-8f0c-bc64aa8d4fc6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a9fdc1fd-9378-4813-a351-15da1e3bc986', 'volume_name': 'volume-a9fdc1fd-9378-4813-a351-15da1e3bc986', 'volume_size': 1}' {{(pid=84538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 18:56:52 devstack cinder-volume[84538]: DEBUG cinder.volume.manager [req-d338abfb-6877-4ee4-9867-8ecba566a3ad req-33bc585f-829d-453d-9634-91e745104120 tempest-ServerBootFromVolumeStableRescueTest-1114355649 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c3b1a72e-37ef-4214-8a58-cafb2ce34b04) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 18:56:52 devstack cinder-volume[84538]: DEBUG cinder.volume.manager [req-d338abfb-6877-4ee4-9867-8ecba566a3ad req-33bc585f-829d-453d-9634-91e745104120 tempest-ServerBootFromVolumeStableRescueTest-1114355649 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c3b1a72e-37ef-4214-8a58-cafb2ce34b04) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 18:56:52 devstack cinder-volume[84538]: DEBUG cinder.volume.manager [req-d338abfb-6877-4ee4-9867-8ecba566a3ad req-33bc585f-829d-453d-9634-91e745104120 tempest-ServerBootFromVolumeStableRescueTest-1114355649 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (071a2f8d-7b14-4b22-b2c7-43f8f6fc79bd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 18:56:52 devstack cinder-volume[84538]: INFO cinder.volume.flows.manager.create_volume [req-d338abfb-6877-4ee4-9867-8ecba566a3ad req-33bc585f-829d-453d-9634-91e745104120 tempest-ServerBootFromVolumeStableRescueTest-1114355649 None] Volume a9fdc1fd-9378-4813-a351-15da1e3bc986: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a9fdc1fd-9378-4813-a351-15da1e3bc986', 'volume_size': 1} Apr 29 18:56:52 devstack cinder-volume[84538]: DEBUG oslo_concurrency.lockutils [req-d338abfb-6877-4ee4-9867-8ecba566a3ad req-33bc585f-829d-453d-9634-91e745104120 tempest-ServerBootFromVolumeStableRescueTest-1114355649 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 18:56:52 devstack cinder-volume[84538]: DEBUG oslo_concurrency.lockutils [req-d338abfb-6877-4ee4-9867-8ecba566a3ad req-33bc585f-829d-453d-9634-91e745104120 tempest-ServerBootFromVolumeStableRescueTest-1114355649 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=84538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 18:56:52 devstack cinder-volume[84538]: DEBUG cinder.volume.drivers.quobyte [req-d338abfb-6877-4ee4-9867-8ecba566a3ad req-33bc585f-829d-453d-9634-91e745104120 tempest-ServerBootFromVolumeStableRescueTest-1114355649 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-29T16:56:52Z,deleted=False,deleted_at=None,display_description='',display_name='f044c7fe-c128-44f8-90fd-1fc18628a30b-blank-vol',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a9fdc1fd-9378-4813-a351-15da1e3bc986,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='952a9a1064164a17a985a1b405951979',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T16:56:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T16:56:53Z,use_quota=True,user_id='98e810d72fd94fb0b0d586d7a18415b8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(62b05900-93e3-4190-a88f-1d87324303d1),volume_type_id=62b05900-93e3-4190-a88f-1d87324303d1)}" {{(pid=84538) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 29 18:56:52 devstack cinder-volume[84538]: DEBUG cinder.volume.drivers.remotefs [req-d338abfb-6877-4ee4-9867-8ecba566a3ad req-33bc585f-829d-453d-9634-91e745104120 tempest-ServerBootFromVolumeStableRescueTest-1114355649 None] Creating volume a9fdc1fd-9378-4813-a351-15da1e3bc986 {{(pid=84538) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 29 18:56:52 devstack cinder-volume[84538]: DEBUG oslo_concurrency.lockutils [req-d338abfb-6877-4ee4-9867-8ecba566a3ad req-33bc585f-829d-453d-9634-91e745104120 tempest-ServerBootFromVolumeStableRescueTest-1114355649 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 18:56:52 devstack cinder-volume[84538]: DEBUG oslo_concurrency.lockutils [req-d338abfb-6877-4ee4-9867-8ecba566a3ad req-33bc585f-829d-453d-9634-91e745104120 tempest-ServerBootFromVolumeStableRescueTest-1114355649 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 18:56:52 devstack cinder-volume[84538]: DEBUG cinder.volume.drivers.quobyte [req-d338abfb-6877-4ee4-9867-8ecba566a3ad req-33bc585f-829d-453d-9634-91e745104120 tempest-ServerBootFromVolumeStableRescueTest-1114355649 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-34312b00-dd6d-45bb-af98-75855cea8e48': None} {{(pid=84538) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 18:56:52 devstack cinder-volume[84538]: DEBUG cinder.volume.drivers.quobyte [req-d338abfb-6877-4ee4-9867-8ecba566a3ad req-33bc585f-829d-453d-9634-91e745104120 tempest-ServerBootFromVolumeStableRescueTest-1114355649 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-34312b00-dd6d-45bb-af98-75855cea8e48'] {{(pid=84538) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 18:56:52 devstack cinder-volume[84538]: DEBUG oslo_concurrency.lockutils [req-d338abfb-6877-4ee4-9867-8ecba566a3ad req-33bc585f-829d-453d-9634-91e745104120 tempest-ServerBootFromVolumeStableRescueTest-1114355649 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=84538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 18:56:52 devstack cinder-volume[84538]: DEBUG cinder.volume.drivers.quobyte [req-d338abfb-6877-4ee4-9867-8ecba566a3ad req-33bc585f-829d-453d-9634-91e745104120 tempest-ServerBootFromVolumeStableRescueTest-1114355649 None] Selected osci02.corp.quobyte.com/cinder-vol-34312b00-dd6d-45bb-af98-75855cea8e48 as target Quobyte volume. {{(pid=84538) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 29 18:56:52 devstack cinder-volume[84538]: INFO cinder.volume.drivers.remotefs [req-d338abfb-6877-4ee4-9867-8ecba566a3ad req-33bc585f-829d-453d-9634-91e745104120 tempest-ServerBootFromVolumeStableRescueTest-1114355649 None] casted to osci02.corp.quobyte.com/cinder-vol-34312b00-dd6d-45bb-af98-75855cea8e48 Apr 29 18:56:52 devstack cinder-volume[84538]: DEBUG oslo_concurrency.processutils [req-d338abfb-6877-4ee4-9867-8ecba566a3ad req-33bc585f-829d-453d-9634-91e745104120 tempest-ServerBootFromVolumeStableRescueTest-1114355649 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-a9fdc1fd-9378-4813-a351-15da1e3bc986 1073741824 {{(pid=84538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 18:56:52 devstack sudo[86203]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-a9fdc1fd-9378-4813-a351-15da1e3bc986 1073741824 Apr 29 18:56:52 devstack sudo[86203]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 18:56:54 devstack sudo[86203]: pam_unix(sudo:session): session closed for user root Apr 29 18:56:54 devstack cinder-volume[84538]: DEBUG oslo_concurrency.processutils [req-d338abfb-6877-4ee4-9867-8ecba566a3ad req-33bc585f-829d-453d-9634-91e745104120 tempest-ServerBootFromVolumeStableRescueTest-1114355649 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-a9fdc1fd-9378-4813-a351-15da1e3bc986 1073741824" returned: 0 in 1.395s {{(pid=84538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 18:56:54 devstack cinder-volume[84538]: DEBUG oslo_concurrency.processutils [req-d338abfb-6877-4ee4-9867-8ecba566a3ad req-33bc585f-829d-453d-9634-91e745104120 tempest-ServerBootFromVolumeStableRescueTest-1114355649 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-a9fdc1fd-9378-4813-a351-15da1e3bc986 {{(pid=84538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 18:56:54 devstack sudo[86214]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-a9fdc1fd-9378-4813-a351-15da1e3bc986 Apr 29 18:56:54 devstack sudo[86214]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 18:56:55 devstack sudo[86214]: pam_unix(sudo:session): session closed for user root Apr 29 18:56:55 devstack cinder-volume[84538]: DEBUG oslo_concurrency.processutils [req-d338abfb-6877-4ee4-9867-8ecba566a3ad req-33bc585f-829d-453d-9634-91e745104120 tempest-ServerBootFromVolumeStableRescueTest-1114355649 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-a9fdc1fd-9378-4813-a351-15da1e3bc986" returned: 0 in 1.326s {{(pid=84538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 18:56:55 devstack cinder-volume[84538]: DEBUG cinder.volume.drivers.quobyte [req-d338abfb-6877-4ee4-9867-8ecba566a3ad req-33bc585f-829d-453d-9634-91e745104120 tempest-ServerBootFromVolumeStableRescueTest-1114355649 None] <== create_volume: return (2835ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-34312b00-dd6d-45bb-af98-75855cea8e48'} {{(pid=84538) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 29 18:56:55 devstack cinder-volume[84538]: DEBUG oslo_concurrency.lockutils [req-d338abfb-6877-4ee4-9867-8ecba566a3ad req-33bc585f-829d-453d-9634-91e745104120 tempest-ServerBootFromVolumeStableRescueTest-1114355649 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.839s {{(pid=84538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 18:56:55 devstack cinder-volume[84538]: DEBUG cinder.volume.manager [req-d338abfb-6877-4ee4-9867-8ecba566a3ad req-33bc585f-829d-453d-9634-91e745104120 tempest-ServerBootFromVolumeStableRescueTest-1114355649 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (071a2f8d-7b14-4b22-b2c7-43f8f6fc79bd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a9fdc1fd-9378-4813-a351-15da1e3bc986', 'volume_size': 1}' {{(pid=84538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 18:56:55 devstack cinder-volume[84538]: DEBUG cinder.volume.manager [req-d338abfb-6877-4ee4-9867-8ecba566a3ad req-33bc585f-829d-453d-9634-91e745104120 tempest-ServerBootFromVolumeStableRescueTest-1114355649 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f52b1655-3853-4d7a-8057-5292b4f91f76) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 18:56:55 devstack cinder-volume[84538]: INFO cinder.volume.flows.manager.create_volume [req-d338abfb-6877-4ee4-9867-8ecba566a3ad req-33bc585f-829d-453d-9634-91e745104120 tempest-ServerBootFromVolumeStableRescueTest-1114355649 None] Volume volume-a9fdc1fd-9378-4813-a351-15da1e3bc986 (a9fdc1fd-9378-4813-a351-15da1e3bc986): created successfully Apr 29 18:56:55 devstack cinder-volume[84538]: DEBUG cinder.volume.manager [req-d338abfb-6877-4ee4-9867-8ecba566a3ad req-33bc585f-829d-453d-9634-91e745104120 tempest-ServerBootFromVolumeStableRescueTest-1114355649 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f52b1655-3853-4d7a-8057-5292b4f91f76) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 18:56:55 devstack cinder-volume[84538]: DEBUG cinder.volume.manager [req-d338abfb-6877-4ee4-9867-8ecba566a3ad req-33bc585f-829d-453d-9634-91e745104120 tempest-ServerBootFromVolumeStableRescueTest-1114355649 None] Flow 'volume_create_manager' (d8afe26d-7106-48bc-ae6e-e3673e1ecc81) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84538) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 18:56:55 devstack cinder-volume[84538]: INFO cinder.volume.manager [req-d338abfb-6877-4ee4-9867-8ecba566a3ad req-33bc585f-829d-453d-9634-91e745104120 tempest-ServerBootFromVolumeStableRescueTest-1114355649 None] Created volume successfully. Apr 29 18:56:57 devstack cinder-volume[84538]: DEBUG oslo_concurrency.lockutils [req-d338abfb-6877-4ee4-9867-8ecba566a3ad req-f06b3263-572e-462b-a7c4-70c6fe291460 tempest-ServerBootFromVolumeStableRescueTest-1114355649 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=84538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 18:56:57 devstack cinder-volume[84538]: DEBUG oslo_concurrency.lockutils [req-d338abfb-6877-4ee4-9867-8ecba566a3ad req-f06b3263-572e-462b-a7c4-70c6fe291460 tempest-ServerBootFromVolumeStableRescueTest-1114355649 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.003s {{(pid=84538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 18:56:57 devstack cinder-volume[84538]: DEBUG oslo.privsep.daemon [-] privsep: reply[e16d084a-d9db-4a5b-b5d8-22f6d194ddef]: (4, 'qcow2') {{(pid=85803) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 18:56:57 devstack cinder-volume[84538]: DEBUG oslo_concurrency.processutils [req-d338abfb-6877-4ee4-9867-8ecba566a3ad req-f06b3263-572e-462b-a7c4-70c6fe291460 tempest-ServerBootFromVolumeStableRescueTest-1114355649 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-a9fdc1fd-9378-4813-a351-15da1e3bc986 {{(pid=84538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 18:56:57 devstack sudo[86236]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-a9fdc1fd-9378-4813-a351-15da1e3bc986 Apr 29 18:56:57 devstack sudo[86236]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 18:56:58 devstack sudo[86236]: pam_unix(sudo:session): session closed for user root Apr 29 18:56:58 devstack cinder-volume[84538]: DEBUG oslo_concurrency.processutils [req-d338abfb-6877-4ee4-9867-8ecba566a3ad req-f06b3263-572e-462b-a7c4-70c6fe291460 tempest-ServerBootFromVolumeStableRescueTest-1114355649 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-a9fdc1fd-9378-4813-a351-15da1e3bc986" returned: 0 in 1.749s {{(pid=84538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 18:56:58 devstack cinder-volume[84538]: DEBUG oslo_concurrency.lockutils [req-d338abfb-6877-4ee4-9867-8ecba566a3ad req-f06b3263-572e-462b-a7c4-70c6fe291460 tempest-ServerBootFromVolumeStableRescueTest-1114355649 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 1.856s {{(pid=84538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 18:56:59 devstack cinder-volume[84538]: DEBUG cinder.volume.manager [req-d338abfb-6877-4ee4-9867-8ecba566a3ad req-f06b3263-572e-462b-a7c4-70c6fe291460 tempest-ServerBootFromVolumeStableRescueTest-1114355649 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-34312b00-dd6d-45bb-af98-75855cea8e48', 'name': 'volume-a9fdc1fd-9378-4813-a351-15da1e3bc986', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '80426daa-2646-4970-a7b6-51b10b6106ea', 'enforce_multipath': True} {{(pid=84538) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Apr 29 18:56:59 devstack cinder-volume[84538]: INFO cinder.volume.manager [req-d338abfb-6877-4ee4-9867-8ecba566a3ad req-f06b3263-572e-462b-a7c4-70c6fe291460 tempest-ServerBootFromVolumeStableRescueTest-1114355649 None] attachment_update completed successfully. Apr 29 18:57:01 devstack cinder-volume[84538]: INFO cinder.volume.manager [req-7258b7d5-41d2-4a2a-824e-94c763f3a9a7 req-316f41a4-34c3-41fc-a427-6e75ffc32208 tempest-DeleteServersTestJSON-1936124708 None] Terminate volume connection completed successfully. Apr 29 18:57:01 devstack cinder-volume[84538]: DEBUG cinder.volume.manager [req-7258b7d5-41d2-4a2a-824e-94c763f3a9a7 req-316f41a4-34c3-41fc-a427-6e75ffc32208 tempest-DeleteServersTestJSON-1936124708 None] Deleting attachment fa07d00b-a7c0-4c9b-b103-a175bde4c217. {{(pid=84538) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Apr 29 18:57:06 devstack cinder-volume[84538]: DEBUG cinder.coordination [None req-07018324-ea5c-4248-8f34-6c3b364d1980 tempest-DeleteServersTestJSON-1936124708 None] Acquiring lock "cinder-a2f83cc4-e005-45d6-a4db-afb00dfef960-delete_volume" by "delete_volume" {{(pid=84538) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 18:57:06 devstack cinder-volume[84538]: DEBUG cinder.coordination [None req-07018324-ea5c-4248-8f34-6c3b364d1980 tempest-DeleteServersTestJSON-1936124708 None] Lock "cinder-a2f83cc4-e005-45d6-a4db-afb00dfef960-delete_volume" acquired by "delete_volume" :: waited 0.040s {{(pid=84538) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 18:57:06 devstack cinder-volume[84538]: DEBUG cinder.coordination [None req-07018324-ea5c-4248-8f34-6c3b364d1980 tempest-DeleteServersTestJSON-1936124708 None] Acquiring lock "cinder-quobyte-a2f83cc4-e005-45d6-a4db-afb00dfef960" by "delete_volume" {{(pid=84538) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 18:57:06 devstack cinder-volume[84538]: DEBUG cinder.volume.flows.manager.create_volume [None req-677156f1-a475-46e3-aa03-5a56560a7fa1 tempest-ServersNegativeTestJSON-32551584 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84538) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Apr 29 18:57:06 devstack cinder-volume[84538]: DEBUG cinder.volume.manager [None req-677156f1-a475-46e3-aa03-5a56560a7fa1 tempest-ServersNegativeTestJSON-32551584 None] Flow 'volume_create_manager' (3003461b-ee18-426f-9cf6-251df72db7e5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84538) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 18:57:06 devstack cinder-volume[84538]: DEBUG cinder.volume.manager [None req-677156f1-a475-46e3-aa03-5a56560a7fa1 tempest-ServersNegativeTestJSON-32551584 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7e6d6f95-dc0c-49f6-9558-6d21f927499a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 18:57:06 devstack cinder-volume[84538]: DEBUG cinder.coordination [None req-07018324-ea5c-4248-8f34-6c3b364d1980 tempest-DeleteServersTestJSON-1936124708 None] Lock "cinder-quobyte-a2f83cc4-e005-45d6-a4db-afb00dfef960" acquired by "delete_volume" :: waited 0.079s {{(pid=84538) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 18:57:06 devstack cinder-volume[84538]: DEBUG cinder.volume.manager [None req-677156f1-a475-46e3-aa03-5a56560a7fa1 tempest-ServersNegativeTestJSON-32551584 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7e6d6f95-dc0c-49f6-9558-6d21f927499a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-29T16:57:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServersNegativeTestJSON-volume-2041714645',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=da040c93-ee10-4271-a493-872210ce695d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='dc48db89cf674544965611a72e484e37',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T16:57:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T16:57:06Z,use_quota=True,user_id='87e14e0243aa43b6974f5788a2a5f267',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(62b05900-93e3-4190-a88f-1d87324303d1),volume_type_id=62b05900-93e3-4190-a88f-1d87324303d1)' {{(pid=84538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 18:57:06 devstack cinder-volume[84538]: DEBUG cinder.volume.manager [None req-677156f1-a475-46e3-aa03-5a56560a7fa1 tempest-ServersNegativeTestJSON-32551584 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c470b916-873f-4938-b5c2-51e450da46b9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 18:57:06 devstack cinder-volume[84538]: DEBUG cinder.volume.manager [None req-677156f1-a475-46e3-aa03-5a56560a7fa1 tempest-ServersNegativeTestJSON-32551584 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c470b916-873f-4938-b5c2-51e450da46b9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 18:57:06 devstack cinder-volume[84538]: DEBUG cinder.volume.manager [None req-677156f1-a475-46e3-aa03-5a56560a7fa1 tempest-ServersNegativeTestJSON-32551584 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7cd0cd1f-8746-4002-9a06-ec65a1587414) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 18:57:06 devstack cinder-volume[84538]: DEBUG cinder.volume.manager [None req-677156f1-a475-46e3-aa03-5a56560a7fa1 tempest-ServersNegativeTestJSON-32551584 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7cd0cd1f-8746-4002-9a06-ec65a1587414) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'da040c93-ee10-4271-a493-872210ce695d', 'volume_name': 'volume-da040c93-ee10-4271-a493-872210ce695d', 'volume_size': 1}' {{(pid=84538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 18:57:06 devstack cinder-volume[84538]: DEBUG cinder.volume.manager [None req-677156f1-a475-46e3-aa03-5a56560a7fa1 tempest-ServersNegativeTestJSON-32551584 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3a90afe9-4cf0-4295-bb34-9ce42162a8fe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 18:57:06 devstack cinder-volume[84538]: DEBUG cinder.volume.manager [None req-677156f1-a475-46e3-aa03-5a56560a7fa1 tempest-ServersNegativeTestJSON-32551584 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3a90afe9-4cf0-4295-bb34-9ce42162a8fe) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 18:57:06 devstack cinder-volume[84538]: DEBUG cinder.volume.manager [None req-677156f1-a475-46e3-aa03-5a56560a7fa1 tempest-ServersNegativeTestJSON-32551584 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (952ad0df-fd5f-4d28-92e0-9e8a0296b611) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 18:57:06 devstack cinder-volume[84538]: INFO cinder.volume.flows.manager.create_volume [None req-677156f1-a475-46e3-aa03-5a56560a7fa1 tempest-ServersNegativeTestJSON-32551584 None] Volume da040c93-ee10-4271-a493-872210ce695d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-da040c93-ee10-4271-a493-872210ce695d', 'volume_size': 1} Apr 29 18:57:06 devstack cinder-volume[84538]: DEBUG oslo_concurrency.lockutils [None req-677156f1-a475-46e3-aa03-5a56560a7fa1 tempest-ServersNegativeTestJSON-32551584 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 18:57:06 devstack cinder-volume[84538]: DEBUG oslo_concurrency.lockutils [None req-677156f1-a475-46e3-aa03-5a56560a7fa1 tempest-ServersNegativeTestJSON-32551584 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=84538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 18:57:06 devstack cinder-volume[84538]: DEBUG cinder.volume.drivers.quobyte [None req-677156f1-a475-46e3-aa03-5a56560a7fa1 tempest-ServersNegativeTestJSON-32551584 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-29T16:57:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServersNegativeTestJSON-volume-2041714645',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=da040c93-ee10-4271-a493-872210ce695d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='dc48db89cf674544965611a72e484e37',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T16:57:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T16:57:06Z,use_quota=True,user_id='87e14e0243aa43b6974f5788a2a5f267',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(62b05900-93e3-4190-a88f-1d87324303d1),volume_type_id=62b05900-93e3-4190-a88f-1d87324303d1)}" {{(pid=84538) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 29 18:57:06 devstack cinder-volume[84538]: DEBUG cinder.volume.drivers.remotefs [None req-677156f1-a475-46e3-aa03-5a56560a7fa1 tempest-ServersNegativeTestJSON-32551584 None] Creating volume da040c93-ee10-4271-a493-872210ce695d {{(pid=84538) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 29 18:57:06 devstack cinder-volume[84538]: DEBUG oslo_concurrency.lockutils [None req-677156f1-a475-46e3-aa03-5a56560a7fa1 tempest-ServersNegativeTestJSON-32551584 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 18:57:06 devstack cinder-volume[84538]: DEBUG oslo_concurrency.lockutils [None req-677156f1-a475-46e3-aa03-5a56560a7fa1 tempest-ServersNegativeTestJSON-32551584 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 18:57:06 devstack cinder-volume[84538]: DEBUG cinder.volume.drivers.quobyte [None req-677156f1-a475-46e3-aa03-5a56560a7fa1 tempest-ServersNegativeTestJSON-32551584 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-34312b00-dd6d-45bb-af98-75855cea8e48': None} {{(pid=84538) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 18:57:06 devstack cinder-volume[84538]: DEBUG cinder.volume.drivers.quobyte [None req-677156f1-a475-46e3-aa03-5a56560a7fa1 tempest-ServersNegativeTestJSON-32551584 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-34312b00-dd6d-45bb-af98-75855cea8e48'] {{(pid=84538) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 18:57:06 devstack cinder-volume[84538]: DEBUG oslo_concurrency.lockutils [None req-677156f1-a475-46e3-aa03-5a56560a7fa1 tempest-ServersNegativeTestJSON-32551584 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=84538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 18:57:06 devstack cinder-volume[84538]: DEBUG cinder.volume.drivers.quobyte [None req-677156f1-a475-46e3-aa03-5a56560a7fa1 tempest-ServersNegativeTestJSON-32551584 None] Selected osci02.corp.quobyte.com/cinder-vol-34312b00-dd6d-45bb-af98-75855cea8e48 as target Quobyte volume. {{(pid=84538) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 29 18:57:06 devstack cinder-volume[84538]: INFO cinder.volume.drivers.remotefs [None req-677156f1-a475-46e3-aa03-5a56560a7fa1 tempest-ServersNegativeTestJSON-32551584 None] casted to osci02.corp.quobyte.com/cinder-vol-34312b00-dd6d-45bb-af98-75855cea8e48 Apr 29 18:57:06 devstack cinder-volume[84538]: DEBUG oslo_concurrency.processutils [None req-677156f1-a475-46e3-aa03-5a56560a7fa1 tempest-ServersNegativeTestJSON-32551584 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-da040c93-ee10-4271-a493-872210ce695d 1073741824 {{(pid=84538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 18:57:06 devstack cinder-volume[84538]: DEBUG oslo.privsep.daemon [-] privsep: reply[88a1a529-0e53-4725-951e-3ac572da7571]: (4, 'qcow2') {{(pid=85803) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 18:57:06 devstack cinder-volume[84538]: DEBUG oslo_concurrency.processutils [None req-07018324-ea5c-4248-8f34-6c3b364d1980 tempest-DeleteServersTestJSON-1936124708 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-a2f83cc4-e005-45d6-a4db-afb00dfef960 {{(pid=84538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 18:57:06 devstack sudo[86772]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-da040c93-ee10-4271-a493-872210ce695d 1073741824 Apr 29 18:57:06 devstack sudo[86772]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 18:57:06 devstack sudo[86773]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-a2f83cc4-e005-45d6-a4db-afb00dfef960 Apr 29 18:57:06 devstack sudo[86773]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 18:57:07 devstack sudo[86773]: pam_unix(sudo:session): session closed for user root Apr 29 18:57:07 devstack cinder-volume[84538]: DEBUG oslo_concurrency.processutils [None req-07018324-ea5c-4248-8f34-6c3b364d1980 tempest-DeleteServersTestJSON-1936124708 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-a2f83cc4-e005-45d6-a4db-afb00dfef960" returned: 0 in 0.986s {{(pid=84538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 18:57:07 devstack cinder-volume[84538]: DEBUG oslo_concurrency.processutils [None req-07018324-ea5c-4248-8f34-6c3b364d1980 tempest-DeleteServersTestJSON-1936124708 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-a2f83cc4-e005-45d6-a4db-afb00dfef960 {{(pid=84538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 18:57:07 devstack sudo[86785]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-a2f83cc4-e005-45d6-a4db-afb00dfef960 Apr 29 18:57:07 devstack sudo[86785]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 18:57:07 devstack sudo[86772]: pam_unix(sudo:session): session closed for user root Apr 29 18:57:07 devstack cinder-volume[84538]: DEBUG oslo_concurrency.processutils [None req-677156f1-a475-46e3-aa03-5a56560a7fa1 tempest-ServersNegativeTestJSON-32551584 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-da040c93-ee10-4271-a493-872210ce695d 1073741824" returned: 0 in 1.195s {{(pid=84538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 18:57:07 devstack cinder-volume[84538]: DEBUG oslo_concurrency.processutils [None req-677156f1-a475-46e3-aa03-5a56560a7fa1 tempest-ServersNegativeTestJSON-32551584 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-da040c93-ee10-4271-a493-872210ce695d {{(pid=84538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 18:57:07 devstack sudo[86791]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-da040c93-ee10-4271-a493-872210ce695d Apr 29 18:57:07 devstack sudo[86791]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 18:57:08 devstack sudo[86785]: pam_unix(sudo:session): session closed for user root Apr 29 18:57:08 devstack cinder-volume[84538]: DEBUG oslo_concurrency.processutils [None req-07018324-ea5c-4248-8f34-6c3b364d1980 tempest-DeleteServersTestJSON-1936124708 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-a2f83cc4-e005-45d6-a4db-afb00dfef960" returned: 0 in 1.194s {{(pid=84538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 18:57:08 devstack cinder-volume[84538]: DEBUG cinder.coordination [None req-07018324-ea5c-4248-8f34-6c3b364d1980 tempest-DeleteServersTestJSON-1936124708 None] Lock "cinder-quobyte-a2f83cc4-e005-45d6-a4db-afb00dfef960" released by "delete_volume" :: held 2.296s {{(pid=84538) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 18:57:08 devstack cinder-volume[84538]: WARNING cinder.quota [None req-07018324-ea5c-4248-8f34-6c3b364d1980 tempest-DeleteServersTestJSON-1936124708 None] Deprecated: Default quota for resource: volumes_QuobyteHD is set by the default quota flag: quota_volumes_QuobyteHD, it is now deprecated. Please use the default quota class for default quota. Apr 29 18:57:08 devstack cinder-volume[84538]: WARNING cinder.quota [None req-07018324-ea5c-4248-8f34-6c3b364d1980 tempest-DeleteServersTestJSON-1936124708 None] Deprecated: Default quota for resource: gigabytes_QuobyteHD is set by the default quota flag: quota_gigabytes_QuobyteHD, it is now deprecated. Please use the default quota class for default quota. Apr 29 18:57:08 devstack cinder-volume[84538]: DEBUG cinder.quota [None req-07018324-ea5c-4248-8f34-6c3b364d1980 tempest-DeleteServersTestJSON-1936124708 None] Created reservations ['59459792-4fb9-4b64-91a4-57e024920a19', 'dddacee1-df2c-4337-a84e-68dbb0a166d3', '87f988cf-bea0-4e95-901a-76707f46ce15', '9eb636e3-3d87-4588-bb31-335c0ece1e75'] {{(pid=84538) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 29 18:57:08 devstack sudo[86791]: pam_unix(sudo:session): session closed for user root Apr 29 18:57:08 devstack cinder-volume[84538]: DEBUG oslo_concurrency.processutils [None req-677156f1-a475-46e3-aa03-5a56560a7fa1 tempest-ServersNegativeTestJSON-32551584 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-da040c93-ee10-4271-a493-872210ce695d" returned: 0 in 1.073s {{(pid=84538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 18:57:08 devstack cinder-volume[84538]: DEBUG cinder.volume.drivers.quobyte [None req-677156f1-a475-46e3-aa03-5a56560a7fa1 tempest-ServersNegativeTestJSON-32551584 None] <== create_volume: return (2354ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-34312b00-dd6d-45bb-af98-75855cea8e48'} {{(pid=84538) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 29 18:57:08 devstack cinder-volume[84538]: DEBUG oslo_concurrency.lockutils [None req-677156f1-a475-46e3-aa03-5a56560a7fa1 tempest-ServersNegativeTestJSON-32551584 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.357s {{(pid=84538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 18:57:08 devstack cinder-volume[84538]: DEBUG cinder.volume.manager [None req-677156f1-a475-46e3-aa03-5a56560a7fa1 tempest-ServersNegativeTestJSON-32551584 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (952ad0df-fd5f-4d28-92e0-9e8a0296b611) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-da040c93-ee10-4271-a493-872210ce695d', 'volume_size': 1}' {{(pid=84538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 18:57:08 devstack cinder-volume[84538]: DEBUG cinder.volume.manager [None req-677156f1-a475-46e3-aa03-5a56560a7fa1 tempest-ServersNegativeTestJSON-32551584 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (36ec8847-d271-436b-b269-a98dba846798) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 18:57:08 devstack cinder-volume[84538]: INFO cinder.volume.flows.manager.create_volume [None req-677156f1-a475-46e3-aa03-5a56560a7fa1 tempest-ServersNegativeTestJSON-32551584 None] Volume volume-da040c93-ee10-4271-a493-872210ce695d (da040c93-ee10-4271-a493-872210ce695d): created successfully Apr 29 18:57:08 devstack cinder-volume[84538]: DEBUG cinder.volume.manager [None req-677156f1-a475-46e3-aa03-5a56560a7fa1 tempest-ServersNegativeTestJSON-32551584 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (36ec8847-d271-436b-b269-a98dba846798) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 18:57:08 devstack cinder-volume[84538]: DEBUG cinder.volume.manager [None req-677156f1-a475-46e3-aa03-5a56560a7fa1 tempest-ServersNegativeTestJSON-32551584 None] Flow 'volume_create_manager' (3003461b-ee18-426f-9cf6-251df72db7e5) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84538) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 18:57:08 devstack cinder-volume[84538]: INFO cinder.volume.manager [None req-677156f1-a475-46e3-aa03-5a56560a7fa1 tempest-ServersNegativeTestJSON-32551584 None] Created volume successfully. Apr 29 18:57:08 devstack cinder-volume[84538]: DEBUG oslo_concurrency.lockutils [None req-07018324-ea5c-4248-8f34-6c3b364d1980 tempest-DeleteServersTestJSON-1936124708 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 18:57:08 devstack cinder-volume[84538]: DEBUG oslo_concurrency.lockutils [None req-07018324-ea5c-4248-8f34-6c3b364d1980 tempest-DeleteServersTestJSON-1936124708 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 18:57:08 devstack cinder-volume[84538]: DEBUG cinder.volume.drivers.quobyte [None req-07018324-ea5c-4248-8f34-6c3b364d1980 tempest-DeleteServersTestJSON-1936124708 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-34312b00-dd6d-45bb-af98-75855cea8e48': None} {{(pid=84538) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 18:57:08 devstack cinder-volume[84538]: DEBUG cinder.volume.drivers.quobyte [None req-07018324-ea5c-4248-8f34-6c3b364d1980 tempest-DeleteServersTestJSON-1936124708 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-34312b00-dd6d-45bb-af98-75855cea8e48'] {{(pid=84538) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 18:57:08 devstack cinder-volume[84538]: DEBUG oslo_concurrency.lockutils [None req-07018324-ea5c-4248-8f34-6c3b364d1980 tempest-DeleteServersTestJSON-1936124708 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=84538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 18:57:08 devstack cinder-volume[84538]: DEBUG oslo_concurrency.processutils [None req-07018324-ea5c-4248-8f34-6c3b364d1980 tempest-DeleteServersTestJSON-1936124708 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d {{(pid=84538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 18:57:09 devstack sudo[86795]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d Apr 29 18:57:09 devstack sudo[86795]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 18:57:09 devstack sudo[86795]: pam_unix(sudo:session): session closed for user root Apr 29 18:57:09 devstack cinder-volume[84538]: DEBUG oslo_concurrency.processutils [None req-07018324-ea5c-4248-8f34-6c3b364d1980 tempest-DeleteServersTestJSON-1936124708 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d" returned: 0 in 0.716s {{(pid=84538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 18:57:09 devstack cinder-volume[84538]: DEBUG cinder.manager [None req-07018324-ea5c-4248-8f34-6c3b364d1980 tempest-DeleteServersTestJSON-1936124708 None] Notifying Schedulers of capabilities ... {{(pid=84538) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 29 18:57:09 devstack cinder-volume[84538]: INFO cinder.volume.manager [None req-07018324-ea5c-4248-8f34-6c3b364d1980 tempest-DeleteServersTestJSON-1936124708 None] Deleted volume successfully. Apr 29 18:57:09 devstack cinder-volume[84538]: DEBUG cinder.coordination [None req-07018324-ea5c-4248-8f34-6c3b364d1980 tempest-DeleteServersTestJSON-1936124708 None] Lock "cinder-a2f83cc4-e005-45d6-a4db-afb00dfef960-delete_volume" released by "delete_volume" :: held 3.521s {{(pid=84538) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 18:57:11 devstack cinder-volume[84538]: DEBUG cinder.volume.flows.manager.create_volume [None req-c33e3225-ff29-4b37-ae19-38e0ed515035 tempest-ServersNegativeTestJSON-32551584 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84538) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Apr 29 18:57:11 devstack cinder-volume[84538]: DEBUG cinder.volume.manager [None req-c33e3225-ff29-4b37-ae19-38e0ed515035 tempest-ServersNegativeTestJSON-32551584 None] Flow 'volume_create_manager' (6018e5e1-a8fe-4ff3-b5d6-a115193fb010) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84538) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 18:57:11 devstack cinder-volume[84538]: DEBUG cinder.volume.manager [None req-c33e3225-ff29-4b37-ae19-38e0ed515035 tempest-ServersNegativeTestJSON-32551584 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a98e417b-2ab0-4c9b-a425-a6fcdd5ac270) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 18:57:11 devstack cinder-volume[84538]: DEBUG cinder.volume.manager [None req-c33e3225-ff29-4b37-ae19-38e0ed515035 tempest-ServersNegativeTestJSON-32551584 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a98e417b-2ab0-4c9b-a425-a6fcdd5ac270) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-29T16:57:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServersNegativeTestJSON-volume-81834407',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fe33eecf-266b-4c73-acb1-dfb57f7e696a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='dc48db89cf674544965611a72e484e37',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T16:57:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T16:57:11Z,use_quota=True,user_id='87e14e0243aa43b6974f5788a2a5f267',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(62b05900-93e3-4190-a88f-1d87324303d1),volume_type_id=62b05900-93e3-4190-a88f-1d87324303d1)' {{(pid=84538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 18:57:11 devstack cinder-volume[84538]: DEBUG cinder.volume.manager [None req-c33e3225-ff29-4b37-ae19-38e0ed515035 tempest-ServersNegativeTestJSON-32551584 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bd1ebbac-aebc-4780-93f6-4b657548bdcc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 18:57:11 devstack cinder-volume[84538]: DEBUG cinder.volume.manager [None req-c33e3225-ff29-4b37-ae19-38e0ed515035 tempest-ServersNegativeTestJSON-32551584 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bd1ebbac-aebc-4780-93f6-4b657548bdcc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 18:57:11 devstack cinder-volume[84538]: DEBUG cinder.volume.manager [None req-c33e3225-ff29-4b37-ae19-38e0ed515035 tempest-ServersNegativeTestJSON-32551584 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f420e21e-d1c2-4efc-9646-c9f586d23c89) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 18:57:11 devstack cinder-volume[84538]: DEBUG cinder.volume.manager [None req-c33e3225-ff29-4b37-ae19-38e0ed515035 tempest-ServersNegativeTestJSON-32551584 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f420e21e-d1c2-4efc-9646-c9f586d23c89) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'fe33eecf-266b-4c73-acb1-dfb57f7e696a', 'volume_name': 'volume-fe33eecf-266b-4c73-acb1-dfb57f7e696a', 'volume_size': 1}' {{(pid=84538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 18:57:11 devstack cinder-volume[84538]: DEBUG cinder.volume.manager [None req-c33e3225-ff29-4b37-ae19-38e0ed515035 tempest-ServersNegativeTestJSON-32551584 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3958dbad-34c3-44a3-aabd-bc7253da286e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 18:57:11 devstack cinder-volume[84538]: DEBUG cinder.volume.manager [None req-c33e3225-ff29-4b37-ae19-38e0ed515035 tempest-ServersNegativeTestJSON-32551584 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3958dbad-34c3-44a3-aabd-bc7253da286e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 18:57:11 devstack cinder-volume[84538]: DEBUG cinder.volume.manager [None req-c33e3225-ff29-4b37-ae19-38e0ed515035 tempest-ServersNegativeTestJSON-32551584 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2babe9ab-3f76-4899-bb6c-1b82b7f0141c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 18:57:11 devstack cinder-volume[84538]: INFO cinder.volume.flows.manager.create_volume [None req-c33e3225-ff29-4b37-ae19-38e0ed515035 tempest-ServersNegativeTestJSON-32551584 None] Volume fe33eecf-266b-4c73-acb1-dfb57f7e696a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-fe33eecf-266b-4c73-acb1-dfb57f7e696a', 'volume_size': 1} Apr 29 18:57:11 devstack cinder-volume[84538]: DEBUG oslo_concurrency.lockutils [None req-c33e3225-ff29-4b37-ae19-38e0ed515035 tempest-ServersNegativeTestJSON-32551584 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 18:57:11 devstack cinder-volume[84538]: DEBUG oslo_concurrency.lockutils [None req-c33e3225-ff29-4b37-ae19-38e0ed515035 tempest-ServersNegativeTestJSON-32551584 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=84538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 18:57:11 devstack cinder-volume[84538]: DEBUG cinder.volume.drivers.quobyte [None req-c33e3225-ff29-4b37-ae19-38e0ed515035 tempest-ServersNegativeTestJSON-32551584 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-29T16:57:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServersNegativeTestJSON-volume-81834407',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fe33eecf-266b-4c73-acb1-dfb57f7e696a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='dc48db89cf674544965611a72e484e37',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T16:57:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T16:57:11Z,use_quota=True,user_id='87e14e0243aa43b6974f5788a2a5f267',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(62b05900-93e3-4190-a88f-1d87324303d1),volume_type_id=62b05900-93e3-4190-a88f-1d87324303d1)}" {{(pid=84538) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 29 18:57:11 devstack cinder-volume[84538]: DEBUG cinder.volume.drivers.remotefs [None req-c33e3225-ff29-4b37-ae19-38e0ed515035 tempest-ServersNegativeTestJSON-32551584 None] Creating volume fe33eecf-266b-4c73-acb1-dfb57f7e696a {{(pid=84538) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 29 18:57:11 devstack cinder-volume[84538]: DEBUG oslo_concurrency.lockutils [None req-c33e3225-ff29-4b37-ae19-38e0ed515035 tempest-ServersNegativeTestJSON-32551584 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 18:57:11 devstack cinder-volume[84538]: DEBUG oslo_concurrency.lockutils [None req-c33e3225-ff29-4b37-ae19-38e0ed515035 tempest-ServersNegativeTestJSON-32551584 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 18:57:11 devstack cinder-volume[84538]: DEBUG cinder.volume.drivers.quobyte [None req-c33e3225-ff29-4b37-ae19-38e0ed515035 tempest-ServersNegativeTestJSON-32551584 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-34312b00-dd6d-45bb-af98-75855cea8e48': None} {{(pid=84538) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 18:57:11 devstack cinder-volume[84538]: DEBUG cinder.volume.drivers.quobyte [None req-c33e3225-ff29-4b37-ae19-38e0ed515035 tempest-ServersNegativeTestJSON-32551584 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-34312b00-dd6d-45bb-af98-75855cea8e48'] {{(pid=84538) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 18:57:11 devstack cinder-volume[84538]: DEBUG oslo_concurrency.lockutils [None req-c33e3225-ff29-4b37-ae19-38e0ed515035 tempest-ServersNegativeTestJSON-32551584 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=84538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 18:57:11 devstack cinder-volume[84538]: DEBUG cinder.volume.drivers.quobyte [None req-c33e3225-ff29-4b37-ae19-38e0ed515035 tempest-ServersNegativeTestJSON-32551584 None] Selected osci02.corp.quobyte.com/cinder-vol-34312b00-dd6d-45bb-af98-75855cea8e48 as target Quobyte volume. {{(pid=84538) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 29 18:57:11 devstack cinder-volume[84538]: INFO cinder.volume.drivers.remotefs [None req-c33e3225-ff29-4b37-ae19-38e0ed515035 tempest-ServersNegativeTestJSON-32551584 None] casted to osci02.corp.quobyte.com/cinder-vol-34312b00-dd6d-45bb-af98-75855cea8e48 Apr 29 18:57:11 devstack cinder-volume[84538]: DEBUG oslo_concurrency.processutils [None req-c33e3225-ff29-4b37-ae19-38e0ed515035 tempest-ServersNegativeTestJSON-32551584 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-fe33eecf-266b-4c73-acb1-dfb57f7e696a 1073741824 {{(pid=84538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 18:57:11 devstack sudo[86801]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-fe33eecf-266b-4c73-acb1-dfb57f7e696a 1073741824 Apr 29 18:57:11 devstack sudo[86801]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 18:57:12 devstack sudo[86801]: pam_unix(sudo:session): session closed for user root Apr 29 18:57:12 devstack cinder-volume[84538]: DEBUG oslo_concurrency.processutils [None req-c33e3225-ff29-4b37-ae19-38e0ed515035 tempest-ServersNegativeTestJSON-32551584 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-fe33eecf-266b-4c73-acb1-dfb57f7e696a 1073741824" returned: 0 in 1.121s {{(pid=84538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 18:57:12 devstack cinder-volume[84538]: DEBUG oslo_concurrency.processutils [None req-c33e3225-ff29-4b37-ae19-38e0ed515035 tempest-ServersNegativeTestJSON-32551584 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-fe33eecf-266b-4c73-acb1-dfb57f7e696a {{(pid=84538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 18:57:12 devstack sudo[86810]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-fe33eecf-266b-4c73-acb1-dfb57f7e696a Apr 29 18:57:12 devstack sudo[86810]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 18:57:13 devstack sudo[86810]: pam_unix(sudo:session): session closed for user root Apr 29 18:57:13 devstack cinder-volume[84538]: DEBUG oslo_concurrency.processutils [None req-c33e3225-ff29-4b37-ae19-38e0ed515035 tempest-ServersNegativeTestJSON-32551584 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-fe33eecf-266b-4c73-acb1-dfb57f7e696a" returned: 0 in 0.759s {{(pid=84538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 18:57:13 devstack cinder-volume[84538]: DEBUG cinder.volume.drivers.quobyte [None req-c33e3225-ff29-4b37-ae19-38e0ed515035 tempest-ServersNegativeTestJSON-32551584 None] <== create_volume: return (1926ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-34312b00-dd6d-45bb-af98-75855cea8e48'} {{(pid=84538) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 29 18:57:13 devstack cinder-volume[84538]: DEBUG oslo_concurrency.lockutils [None req-c33e3225-ff29-4b37-ae19-38e0ed515035 tempest-ServersNegativeTestJSON-32551584 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.929s {{(pid=84538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 18:57:13 devstack cinder-volume[84538]: DEBUG cinder.volume.manager [None req-c33e3225-ff29-4b37-ae19-38e0ed515035 tempest-ServersNegativeTestJSON-32551584 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2babe9ab-3f76-4899-bb6c-1b82b7f0141c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-fe33eecf-266b-4c73-acb1-dfb57f7e696a', 'volume_size': 1}' {{(pid=84538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 18:57:13 devstack cinder-volume[84538]: DEBUG cinder.volume.manager [None req-c33e3225-ff29-4b37-ae19-38e0ed515035 tempest-ServersNegativeTestJSON-32551584 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (57c8824b-986e-43d2-b347-9dedab637ff8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 18:57:13 devstack cinder-volume[84538]: INFO cinder.volume.flows.manager.create_volume [None req-c33e3225-ff29-4b37-ae19-38e0ed515035 tempest-ServersNegativeTestJSON-32551584 None] Volume volume-fe33eecf-266b-4c73-acb1-dfb57f7e696a (fe33eecf-266b-4c73-acb1-dfb57f7e696a): created successfully Apr 29 18:57:13 devstack cinder-volume[84538]: DEBUG cinder.volume.manager [None req-c33e3225-ff29-4b37-ae19-38e0ed515035 tempest-ServersNegativeTestJSON-32551584 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (57c8824b-986e-43d2-b347-9dedab637ff8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 18:57:13 devstack cinder-volume[84538]: DEBUG cinder.volume.manager [None req-c33e3225-ff29-4b37-ae19-38e0ed515035 tempest-ServersNegativeTestJSON-32551584 None] Flow 'volume_create_manager' (6018e5e1-a8fe-4ff3-b5d6-a115193fb010) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84538) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 18:57:13 devstack cinder-volume[84538]: INFO cinder.volume.manager [None req-c33e3225-ff29-4b37-ae19-38e0ed515035 tempest-ServersNegativeTestJSON-32551584 None] Created volume successfully. Apr 29 18:57:15 devstack cinder-volume[84538]: DEBUG cinder.coordination [None req-47e4d83a-3888-4d93-bb91-1ff855a289b4 tempest-ServersNegativeTestJSON-32551584 None] Acquiring lock "cinder-fe33eecf-266b-4c73-acb1-dfb57f7e696a-delete_volume" by "delete_volume" {{(pid=84538) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 18:57:15 devstack cinder-volume[84538]: DEBUG cinder.coordination [None req-47e4d83a-3888-4d93-bb91-1ff855a289b4 tempest-ServersNegativeTestJSON-32551584 None] Lock "cinder-fe33eecf-266b-4c73-acb1-dfb57f7e696a-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=84538) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 18:57:15 devstack cinder-volume[84538]: DEBUG cinder.coordination [None req-47e4d83a-3888-4d93-bb91-1ff855a289b4 tempest-ServersNegativeTestJSON-32551584 None] Acquiring lock "cinder-quobyte-fe33eecf-266b-4c73-acb1-dfb57f7e696a" by "delete_volume" {{(pid=84538) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 18:57:15 devstack cinder-volume[84538]: DEBUG cinder.coordination [None req-47e4d83a-3888-4d93-bb91-1ff855a289b4 tempest-ServersNegativeTestJSON-32551584 None] Lock "cinder-quobyte-fe33eecf-266b-4c73-acb1-dfb57f7e696a" acquired by "delete_volume" :: waited 0.020s {{(pid=84538) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 18:57:15 devstack cinder-volume[84538]: DEBUG oslo.privsep.daemon [-] privsep: reply[6e14983c-74f1-421f-a4d4-9b6ecc633ad4]: (4, 'qcow2') {{(pid=85803) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 18:57:15 devstack cinder-volume[84538]: DEBUG oslo_concurrency.processutils [None req-47e4d83a-3888-4d93-bb91-1ff855a289b4 tempest-ServersNegativeTestJSON-32551584 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-fe33eecf-266b-4c73-acb1-dfb57f7e696a {{(pid=84538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 18:57:15 devstack sudo[86815]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-fe33eecf-266b-4c73-acb1-dfb57f7e696a Apr 29 18:57:15 devstack sudo[86815]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 18:57:16 devstack sudo[86815]: pam_unix(sudo:session): session closed for user root Apr 29 18:57:16 devstack cinder-volume[84538]: DEBUG oslo_concurrency.processutils [None req-47e4d83a-3888-4d93-bb91-1ff855a289b4 tempest-ServersNegativeTestJSON-32551584 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-fe33eecf-266b-4c73-acb1-dfb57f7e696a" returned: 0 in 0.864s {{(pid=84538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 18:57:16 devstack cinder-volume[84538]: DEBUG oslo_concurrency.processutils [None req-47e4d83a-3888-4d93-bb91-1ff855a289b4 tempest-ServersNegativeTestJSON-32551584 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-fe33eecf-266b-4c73-acb1-dfb57f7e696a {{(pid=84538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 18:57:16 devstack sudo[86820]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-fe33eecf-266b-4c73-acb1-dfb57f7e696a Apr 29 18:57:16 devstack sudo[86820]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 18:57:17 devstack sudo[86820]: pam_unix(sudo:session): session closed for user root Apr 29 18:57:17 devstack cinder-volume[84538]: DEBUG oslo_concurrency.processutils [None req-47e4d83a-3888-4d93-bb91-1ff855a289b4 tempest-ServersNegativeTestJSON-32551584 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-fe33eecf-266b-4c73-acb1-dfb57f7e696a" returned: 0 in 0.854s {{(pid=84538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 18:57:17 devstack cinder-volume[84538]: DEBUG cinder.coordination [None req-47e4d83a-3888-4d93-bb91-1ff855a289b4 tempest-ServersNegativeTestJSON-32551584 None] Lock "cinder-quobyte-fe33eecf-266b-4c73-acb1-dfb57f7e696a" released by "delete_volume" :: held 1.775s {{(pid=84538) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 18:57:17 devstack cinder-volume[84538]: DEBUG cinder.quota [None req-47e4d83a-3888-4d93-bb91-1ff855a289b4 tempest-ServersNegativeTestJSON-32551584 None] Created reservations ['b9179a50-3325-497d-b091-0d9eb68dd6d8', 'f7c1191f-0cd8-43ec-962e-8b9f2bac3730', '7bf2f0bb-916d-4242-b785-95f737089312', '184aa937-cd47-4c3c-9db5-a4ad21e93845'] {{(pid=84538) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 29 18:57:17 devstack cinder-volume[84538]: DEBUG oslo_concurrency.lockutils [None req-47e4d83a-3888-4d93-bb91-1ff855a289b4 tempest-ServersNegativeTestJSON-32551584 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 18:57:17 devstack cinder-volume[84538]: DEBUG oslo_concurrency.lockutils [None req-47e4d83a-3888-4d93-bb91-1ff855a289b4 tempest-ServersNegativeTestJSON-32551584 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 18:57:17 devstack cinder-volume[84538]: DEBUG cinder.volume.drivers.quobyte [None req-47e4d83a-3888-4d93-bb91-1ff855a289b4 tempest-ServersNegativeTestJSON-32551584 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-34312b00-dd6d-45bb-af98-75855cea8e48': None} {{(pid=84538) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 18:57:17 devstack cinder-volume[84538]: DEBUG cinder.volume.drivers.quobyte [None req-47e4d83a-3888-4d93-bb91-1ff855a289b4 tempest-ServersNegativeTestJSON-32551584 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-34312b00-dd6d-45bb-af98-75855cea8e48'] {{(pid=84538) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 18:57:17 devstack cinder-volume[84538]: DEBUG oslo_concurrency.lockutils [None req-47e4d83a-3888-4d93-bb91-1ff855a289b4 tempest-ServersNegativeTestJSON-32551584 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.024s {{(pid=84538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 18:57:17 devstack cinder-volume[84538]: DEBUG oslo_concurrency.processutils [None req-47e4d83a-3888-4d93-bb91-1ff855a289b4 tempest-ServersNegativeTestJSON-32551584 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d {{(pid=84538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 18:57:17 devstack sudo[86858]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d Apr 29 18:57:17 devstack sudo[86858]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 18:57:17 devstack cinder-volume[84538]: DEBUG cinder.coordination [None req-42630952-ba49-434f-a2f6-1b6226212aef tempest-ServersNegativeTestJSON-32551584 None] Acquiring lock "cinder-da040c93-ee10-4271-a493-872210ce695d-delete_volume" by "delete_volume" {{(pid=84538) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 18:57:17 devstack cinder-volume[84538]: DEBUG cinder.coordination [None req-42630952-ba49-434f-a2f6-1b6226212aef tempest-ServersNegativeTestJSON-32551584 None] Lock "cinder-da040c93-ee10-4271-a493-872210ce695d-delete_volume" acquired by "delete_volume" :: waited 0.054s {{(pid=84538) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 18:57:17 devstack cinder-volume[84538]: DEBUG cinder.coordination [None req-42630952-ba49-434f-a2f6-1b6226212aef tempest-ServersNegativeTestJSON-32551584 None] Acquiring lock "cinder-quobyte-da040c93-ee10-4271-a493-872210ce695d" by "delete_volume" {{(pid=84538) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 18:57:17 devstack cinder-volume[84538]: DEBUG cinder.coordination [None req-42630952-ba49-434f-a2f6-1b6226212aef tempest-ServersNegativeTestJSON-32551584 None] Lock "cinder-quobyte-da040c93-ee10-4271-a493-872210ce695d" acquired by "delete_volume" :: waited 0.034s {{(pid=84538) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 18:57:18 devstack cinder-volume[84538]: DEBUG oslo.privsep.daemon [-] privsep: reply[0a59cbf3-e724-4ecc-98f0-cc3557489889]: (4, 'qcow2') {{(pid=85803) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 18:57:18 devstack cinder-volume[84538]: DEBUG oslo_concurrency.processutils [None req-42630952-ba49-434f-a2f6-1b6226212aef tempest-ServersNegativeTestJSON-32551584 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-da040c93-ee10-4271-a493-872210ce695d {{(pid=84538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 18:57:18 devstack sudo[86871]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-da040c93-ee10-4271-a493-872210ce695d Apr 29 18:57:18 devstack sudo[86871]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 18:57:18 devstack sudo[86858]: pam_unix(sudo:session): session closed for user root Apr 29 18:57:18 devstack cinder-volume[84538]: DEBUG oslo_concurrency.processutils [None req-47e4d83a-3888-4d93-bb91-1ff855a289b4 tempest-ServersNegativeTestJSON-32551584 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d" returned: 0 in 1.223s {{(pid=84538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 18:57:18 devstack cinder-volume[84538]: DEBUG cinder.manager [None req-47e4d83a-3888-4d93-bb91-1ff855a289b4 tempest-ServersNegativeTestJSON-32551584 None] Notifying Schedulers of capabilities ... {{(pid=84538) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 29 18:57:18 devstack cinder-volume[84538]: INFO cinder.volume.manager [None req-47e4d83a-3888-4d93-bb91-1ff855a289b4 tempest-ServersNegativeTestJSON-32551584 None] Deleted volume successfully. Apr 29 18:57:18 devstack cinder-volume[84538]: DEBUG cinder.coordination [None req-47e4d83a-3888-4d93-bb91-1ff855a289b4 tempest-ServersNegativeTestJSON-32551584 None] Lock "cinder-fe33eecf-266b-4c73-acb1-dfb57f7e696a-delete_volume" released by "delete_volume" :: held 3.495s {{(pid=84538) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 18:57:19 devstack sudo[86871]: pam_unix(sudo:session): session closed for user root Apr 29 18:57:19 devstack cinder-volume[84538]: DEBUG oslo_concurrency.processutils [None req-42630952-ba49-434f-a2f6-1b6226212aef tempest-ServersNegativeTestJSON-32551584 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-da040c93-ee10-4271-a493-872210ce695d" returned: 0 in 1.345s {{(pid=84538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 18:57:19 devstack cinder-volume[84538]: DEBUG oslo_concurrency.processutils [None req-42630952-ba49-434f-a2f6-1b6226212aef tempest-ServersNegativeTestJSON-32551584 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-da040c93-ee10-4271-a493-872210ce695d {{(pid=84538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 18:57:19 devstack sudo[86883]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-da040c93-ee10-4271-a493-872210ce695d Apr 29 18:57:19 devstack sudo[86883]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 18:57:20 devstack sudo[86883]: pam_unix(sudo:session): session closed for user root Apr 29 18:57:20 devstack cinder-volume[84538]: DEBUG oslo_concurrency.processutils [None req-42630952-ba49-434f-a2f6-1b6226212aef tempest-ServersNegativeTestJSON-32551584 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-da040c93-ee10-4271-a493-872210ce695d" returned: 0 in 0.956s {{(pid=84538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 18:57:20 devstack cinder-volume[84538]: DEBUG cinder.coordination [None req-42630952-ba49-434f-a2f6-1b6226212aef tempest-ServersNegativeTestJSON-32551584 None] Lock "cinder-quobyte-da040c93-ee10-4271-a493-872210ce695d" released by "delete_volume" :: held 2.398s {{(pid=84538) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 18:57:20 devstack cinder-volume[84538]: DEBUG cinder.quota [None req-42630952-ba49-434f-a2f6-1b6226212aef tempest-ServersNegativeTestJSON-32551584 None] Created reservations ['f08bbf30-64b5-4240-a26b-76a1698fe21b', '49240d10-71ee-4fb3-974d-bdbabc7c26db', 'f679a117-b369-4c19-bffb-23b69a8133bd', 'ba0597ac-f7cb-4039-bc92-85bd99b3f72f'] {{(pid=84538) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 29 18:57:20 devstack cinder-volume[84538]: DEBUG oslo_concurrency.lockutils [None req-42630952-ba49-434f-a2f6-1b6226212aef tempest-ServersNegativeTestJSON-32551584 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 18:57:20 devstack cinder-volume[84538]: DEBUG oslo_concurrency.lockutils [None req-42630952-ba49-434f-a2f6-1b6226212aef tempest-ServersNegativeTestJSON-32551584 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 18:57:20 devstack cinder-volume[84538]: DEBUG cinder.volume.drivers.quobyte [None req-42630952-ba49-434f-a2f6-1b6226212aef tempest-ServersNegativeTestJSON-32551584 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-34312b00-dd6d-45bb-af98-75855cea8e48': None} {{(pid=84538) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 18:57:20 devstack cinder-volume[84538]: DEBUG cinder.volume.drivers.quobyte [None req-42630952-ba49-434f-a2f6-1b6226212aef tempest-ServersNegativeTestJSON-32551584 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-34312b00-dd6d-45bb-af98-75855cea8e48'] {{(pid=84538) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 18:57:20 devstack cinder-volume[84538]: DEBUG oslo_concurrency.lockutils [None req-42630952-ba49-434f-a2f6-1b6226212aef tempest-ServersNegativeTestJSON-32551584 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=84538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 18:57:20 devstack cinder-volume[84538]: DEBUG oslo_concurrency.processutils [None req-42630952-ba49-434f-a2f6-1b6226212aef tempest-ServersNegativeTestJSON-32551584 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d {{(pid=84538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 18:57:20 devstack sudo[86899]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d Apr 29 18:57:20 devstack sudo[86899]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 18:57:21 devstack sudo[86899]: pam_unix(sudo:session): session closed for user root Apr 29 18:57:21 devstack cinder-volume[84538]: DEBUG oslo_concurrency.processutils [None req-42630952-ba49-434f-a2f6-1b6226212aef tempest-ServersNegativeTestJSON-32551584 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d" returned: 0 in 0.735s {{(pid=84538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 18:57:21 devstack cinder-volume[84538]: DEBUG cinder.manager [None req-42630952-ba49-434f-a2f6-1b6226212aef tempest-ServersNegativeTestJSON-32551584 None] Notifying Schedulers of capabilities ... {{(pid=84538) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 29 18:57:21 devstack cinder-volume[84538]: INFO cinder.volume.manager [None req-42630952-ba49-434f-a2f6-1b6226212aef tempest-ServersNegativeTestJSON-32551584 None] Deleted volume successfully. Apr 29 18:57:21 devstack cinder-volume[84538]: DEBUG cinder.coordination [None req-42630952-ba49-434f-a2f6-1b6226212aef tempest-ServersNegativeTestJSON-32551584 None] Lock "cinder-da040c93-ee10-4271-a493-872210ce695d-delete_volume" released by "delete_volume" :: held 3.506s {{(pid=84538) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 18:57:25 devstack cinder-volume[84538]: DEBUG oslo_service.periodic_task [None req-a93183a6-1080-461c-84de-2fcb210d4f60 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=84538) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}} Apr 29 18:57:25 devstack cinder-volume[84538]: DEBUG oslo_concurrency.lockutils [None req-a93183a6-1080-461c-84de-2fcb210d4f60 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 18:57:25 devstack cinder-volume[84538]: DEBUG oslo_concurrency.lockutils [None req-a93183a6-1080-461c-84de-2fcb210d4f60 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=84538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 18:57:25 devstack cinder-volume[84538]: DEBUG cinder.volume.drivers.quobyte [None req-a93183a6-1080-461c-84de-2fcb210d4f60 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-34312b00-dd6d-45bb-af98-75855cea8e48': None} {{(pid=84538) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 18:57:25 devstack cinder-volume[84538]: DEBUG cinder.volume.drivers.quobyte [None req-a93183a6-1080-461c-84de-2fcb210d4f60 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-34312b00-dd6d-45bb-af98-75855cea8e48'] {{(pid=84538) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 18:57:25 devstack cinder-volume[84538]: DEBUG oslo_concurrency.lockutils [None req-a93183a6-1080-461c-84de-2fcb210d4f60 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=84538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 18:57:25 devstack cinder-volume[84538]: DEBUG oslo_concurrency.processutils [None req-a93183a6-1080-461c-84de-2fcb210d4f60 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d {{(pid=84538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 18:57:25 devstack sudo[87012]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d Apr 29 18:57:25 devstack sudo[87012]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 18:57:26 devstack sudo[87012]: pam_unix(sudo:session): session closed for user root Apr 29 18:57:26 devstack cinder-volume[84538]: DEBUG oslo_concurrency.processutils [None req-a93183a6-1080-461c-84de-2fcb210d4f60 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d" returned: 0 in 1.202s {{(pid=84538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 18:57:26 devstack cinder-volume[84538]: DEBUG cinder.manager [None req-a93183a6-1080-461c-84de-2fcb210d4f60 None None] Notifying Schedulers of capabilities ... {{(pid=84538) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 29 18:57:27 devstack cinder-volume[84538]: DEBUG cinder.volume.manager [None req-5a7740f4-b216-4fd0-8983-2147a729f389 tempest-BackendsCapabilitiesAdminTestsJSON-1337196125 None] Obtained capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.1.14', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1775.5280113220215, 'free_capacity_gb': 1775.5280113220215, 'reserved_percentage': 0, 'QoS_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=84538) get_capabilities /opt/stack/cinder/cinder/volume/manager.py:4830}} Apr 29 18:57:28 devstack cinder-volume[84538]: DEBUG cinder.volume.manager [None req-881c1732-cbfc-4fed-b497-b4f1bdc6ca00 tempest-BackendsCapabilitiesAdminTestsJSON-1337196125 None] Obtained capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.1.14', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1775.5280113220215, 'free_capacity_gb': 1775.5280113220215, 'reserved_percentage': 0, 'QoS_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=84538) get_capabilities /opt/stack/cinder/cinder/volume/manager.py:4830}} Apr 29 18:57:30 devstack cinder-volume[84538]: DEBUG dbcounter [-] [84538] Writing DB stats cinder:SELECT=36,cinder:UPDATE=35,cinder:INSERT=6 {{(pid=84538) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Apr 29 18:57:31 devstack cinder-volume[84538]: DEBUG dbcounter [-] [84538] Writing DB stats cinder:SELECT=31,cinder:UPDATE=38,cinder:INSERT=9,cinder:DELETE=6 {{(pid=84538) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Apr 29 18:57:36 devstack cinder-volume[84538]: INFO cinder.volume.manager [None req-3c374c29-3554-43e4-b29c-7a00b2e41a0b tempest-GroupSnapshotsV319Test-312575611 None] Group tempest-GroupSnapshotsV319Test-Group-1115430250: creating Apr 29 18:57:36 devstack cinder-volume[84538]: INFO cinder.volume.manager [None req-3c374c29-3554-43e4-b29c-7a00b2e41a0b tempest-GroupSnapshotsV319Test-312575611 None] Group tempest-GroupSnapshotsV319Test-Group-1115430250: created successfully Apr 29 18:57:36 devstack cinder-volume[84538]: INFO cinder.volume.manager [None req-3c374c29-3554-43e4-b29c-7a00b2e41a0b tempest-GroupSnapshotsV319Test-312575611 None] Create group completed successfully. Apr 29 18:57:38 devstack cinder-volume[84538]: DEBUG cinder.volume.flows.manager.create_volume [None req-62a76713-02c9-47db-811b-d9c01a6cae9f tempest-GroupSnapshotsV319Test-312575611 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84538) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Apr 29 18:57:38 devstack cinder-volume[84538]: DEBUG cinder.volume.manager [None req-62a76713-02c9-47db-811b-d9c01a6cae9f tempest-GroupSnapshotsV319Test-312575611 None] Flow 'volume_create_manager' (3e74f68b-82b3-424d-9ad5-93f2ba5aafcf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84538) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 18:57:38 devstack cinder-volume[84538]: DEBUG cinder.volume.manager [None req-62a76713-02c9-47db-811b-d9c01a6cae9f tempest-GroupSnapshotsV319Test-312575611 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0fa4e9cd-328e-430b-9498-da12ec2590b4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 18:57:38 devstack cinder-volume[84538]: DEBUG cinder.volume.manager [None req-62a76713-02c9-47db-811b-d9c01a6cae9f tempest-GroupSnapshotsV319Test-312575611 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0fa4e9cd-328e-430b-9498-da12ec2590b4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-29T16:57:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-575535236',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=8e0fb631-07e3-4730-8671-af56297c99ae,host='devstack@QuobyteHD#QuobyteHD',id=54ce091a-02da-4176-9de7-384d89c0a8a8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d26415eb3f4e4fc380c7062cdb2209be',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T16:57:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T16:57:38Z,use_quota=True,user_id='96c25798222c4a288b938c8c61d8452b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e67ffc54-bf39-4afc-92c9-e9f7b45af5f1),volume_type_id=e67ffc54-bf39-4afc-92c9-e9f7b45af5f1)' {{(pid=84538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 18:57:38 devstack cinder-volume[84538]: DEBUG cinder.volume.manager [None req-62a76713-02c9-47db-811b-d9c01a6cae9f tempest-GroupSnapshotsV319Test-312575611 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (645d11c5-2826-4172-8193-bda09ab2603a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 18:57:38 devstack cinder-volume[84538]: DEBUG cinder.volume.manager [None req-62a76713-02c9-47db-811b-d9c01a6cae9f tempest-GroupSnapshotsV319Test-312575611 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (645d11c5-2826-4172-8193-bda09ab2603a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 18:57:38 devstack cinder-volume[84538]: DEBUG cinder.volume.manager [None req-62a76713-02c9-47db-811b-d9c01a6cae9f tempest-GroupSnapshotsV319Test-312575611 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0f9fcdde-92e3-492f-8ac7-29bdb6212795) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 18:57:38 devstack cinder-volume[84538]: DEBUG cinder.volume.manager [None req-62a76713-02c9-47db-811b-d9c01a6cae9f tempest-GroupSnapshotsV319Test-312575611 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0f9fcdde-92e3-492f-8ac7-29bdb6212795) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '54ce091a-02da-4176-9de7-384d89c0a8a8', 'volume_name': 'volume-54ce091a-02da-4176-9de7-384d89c0a8a8', 'volume_size': 1}' {{(pid=84538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 18:57:38 devstack cinder-volume[84538]: DEBUG cinder.volume.manager [None req-62a76713-02c9-47db-811b-d9c01a6cae9f tempest-GroupSnapshotsV319Test-312575611 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0dd41614-f8e5-4cba-b69e-6073d8d9d932) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 18:57:38 devstack cinder-volume[84538]: DEBUG cinder.volume.manager [None req-62a76713-02c9-47db-811b-d9c01a6cae9f tempest-GroupSnapshotsV319Test-312575611 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0dd41614-f8e5-4cba-b69e-6073d8d9d932) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 18:57:38 devstack cinder-volume[84538]: DEBUG cinder.volume.manager [None req-62a76713-02c9-47db-811b-d9c01a6cae9f tempest-GroupSnapshotsV319Test-312575611 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a3859484-5adf-46ee-bdad-8c6e7d407135) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 18:57:38 devstack cinder-volume[84538]: INFO cinder.volume.flows.manager.create_volume [None req-62a76713-02c9-47db-811b-d9c01a6cae9f tempest-GroupSnapshotsV319Test-312575611 None] Volume 54ce091a-02da-4176-9de7-384d89c0a8a8: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-54ce091a-02da-4176-9de7-384d89c0a8a8', 'volume_size': 1} Apr 29 18:57:38 devstack cinder-volume[84538]: DEBUG oslo_concurrency.lockutils [None req-62a76713-02c9-47db-811b-d9c01a6cae9f tempest-GroupSnapshotsV319Test-312575611 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 18:57:38 devstack cinder-volume[84538]: DEBUG oslo_concurrency.lockutils [None req-62a76713-02c9-47db-811b-d9c01a6cae9f tempest-GroupSnapshotsV319Test-312575611 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=84538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 18:57:38 devstack cinder-volume[84538]: DEBUG cinder.volume.drivers.quobyte [None req-62a76713-02c9-47db-811b-d9c01a6cae9f tempest-GroupSnapshotsV319Test-312575611 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=8e0fb631-07e3-4730-8671-af56297c99ae,created_at=2026-04-29T16:57:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-575535236',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=8e0fb631-07e3-4730-8671-af56297c99ae,host='devstack@QuobyteHD#QuobyteHD',id=54ce091a-02da-4176-9de7-384d89c0a8a8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d26415eb3f4e4fc380c7062cdb2209be',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T16:57:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T16:57:38Z,use_quota=True,user_id='96c25798222c4a288b938c8c61d8452b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e67ffc54-bf39-4afc-92c9-e9f7b45af5f1),volume_type_id=e67ffc54-bf39-4afc-92c9-e9f7b45af5f1)}" {{(pid=84538) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 29 18:57:38 devstack cinder-volume[84538]: DEBUG cinder.volume.drivers.remotefs [None req-62a76713-02c9-47db-811b-d9c01a6cae9f tempest-GroupSnapshotsV319Test-312575611 None] Creating volume 54ce091a-02da-4176-9de7-384d89c0a8a8 {{(pid=84538) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 29 18:57:38 devstack cinder-volume[84538]: DEBUG oslo_concurrency.lockutils [None req-62a76713-02c9-47db-811b-d9c01a6cae9f tempest-GroupSnapshotsV319Test-312575611 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 18:57:38 devstack cinder-volume[84538]: DEBUG oslo_concurrency.lockutils [None req-62a76713-02c9-47db-811b-d9c01a6cae9f tempest-GroupSnapshotsV319Test-312575611 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=84538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 18:57:38 devstack cinder-volume[84538]: DEBUG cinder.volume.drivers.quobyte [None req-62a76713-02c9-47db-811b-d9c01a6cae9f tempest-GroupSnapshotsV319Test-312575611 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-34312b00-dd6d-45bb-af98-75855cea8e48': None} {{(pid=84538) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 18:57:38 devstack cinder-volume[84538]: DEBUG cinder.volume.drivers.quobyte [None req-62a76713-02c9-47db-811b-d9c01a6cae9f tempest-GroupSnapshotsV319Test-312575611 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-34312b00-dd6d-45bb-af98-75855cea8e48'] {{(pid=84538) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 18:57:38 devstack cinder-volume[84538]: DEBUG oslo_concurrency.lockutils [None req-62a76713-02c9-47db-811b-d9c01a6cae9f tempest-GroupSnapshotsV319Test-312575611 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=84538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 18:57:38 devstack cinder-volume[84538]: DEBUG cinder.volume.drivers.quobyte [None req-62a76713-02c9-47db-811b-d9c01a6cae9f tempest-GroupSnapshotsV319Test-312575611 None] Selected osci02.corp.quobyte.com/cinder-vol-34312b00-dd6d-45bb-af98-75855cea8e48 as target Quobyte volume. {{(pid=84538) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 29 18:57:38 devstack cinder-volume[84538]: INFO cinder.volume.drivers.remotefs [None req-62a76713-02c9-47db-811b-d9c01a6cae9f tempest-GroupSnapshotsV319Test-312575611 None] casted to osci02.corp.quobyte.com/cinder-vol-34312b00-dd6d-45bb-af98-75855cea8e48 Apr 29 18:57:38 devstack cinder-volume[84538]: DEBUG oslo_concurrency.processutils [None req-62a76713-02c9-47db-811b-d9c01a6cae9f tempest-GroupSnapshotsV319Test-312575611 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-54ce091a-02da-4176-9de7-384d89c0a8a8 1073741824 {{(pid=84538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 18:57:38 devstack sudo[87171]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-54ce091a-02da-4176-9de7-384d89c0a8a8 1073741824 Apr 29 18:57:38 devstack sudo[87171]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 18:57:39 devstack sudo[87171]: pam_unix(sudo:session): session closed for user root Apr 29 18:57:39 devstack cinder-volume[84538]: DEBUG oslo_concurrency.processutils [None req-62a76713-02c9-47db-811b-d9c01a6cae9f tempest-GroupSnapshotsV319Test-312575611 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-54ce091a-02da-4176-9de7-384d89c0a8a8 1073741824" returned: 0 in 1.076s {{(pid=84538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 18:57:39 devstack cinder-volume[84538]: DEBUG oslo_concurrency.processutils [None req-62a76713-02c9-47db-811b-d9c01a6cae9f tempest-GroupSnapshotsV319Test-312575611 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-54ce091a-02da-4176-9de7-384d89c0a8a8 {{(pid=84538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 18:57:39 devstack sudo[87206]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-54ce091a-02da-4176-9de7-384d89c0a8a8 Apr 29 18:57:39 devstack sudo[87206]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 18:57:40 devstack sudo[87206]: pam_unix(sudo:session): session closed for user root Apr 29 18:57:40 devstack cinder-volume[84538]: DEBUG oslo_concurrency.processutils [None req-62a76713-02c9-47db-811b-d9c01a6cae9f tempest-GroupSnapshotsV319Test-312575611 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-54ce091a-02da-4176-9de7-384d89c0a8a8" returned: 0 in 0.705s {{(pid=84538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 18:57:40 devstack cinder-volume[84538]: DEBUG cinder.volume.drivers.quobyte [None req-62a76713-02c9-47db-811b-d9c01a6cae9f tempest-GroupSnapshotsV319Test-312575611 None] <== create_volume: return (1836ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-34312b00-dd6d-45bb-af98-75855cea8e48'} {{(pid=84538) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 29 18:57:40 devstack cinder-volume[84538]: DEBUG oslo_concurrency.lockutils [None req-62a76713-02c9-47db-811b-d9c01a6cae9f tempest-GroupSnapshotsV319Test-312575611 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.839s {{(pid=84538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 18:57:40 devstack cinder-volume[84538]: DEBUG cinder.volume.manager [None req-62a76713-02c9-47db-811b-d9c01a6cae9f tempest-GroupSnapshotsV319Test-312575611 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a3859484-5adf-46ee-bdad-8c6e7d407135) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-54ce091a-02da-4176-9de7-384d89c0a8a8', 'volume_size': 1}' {{(pid=84538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 18:57:40 devstack cinder-volume[84538]: DEBUG cinder.volume.manager [None req-62a76713-02c9-47db-811b-d9c01a6cae9f tempest-GroupSnapshotsV319Test-312575611 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3e9bcec0-e6f1-4c5f-84ad-14786557102f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 18:57:40 devstack cinder-volume[84538]: INFO cinder.volume.flows.manager.create_volume [None req-62a76713-02c9-47db-811b-d9c01a6cae9f tempest-GroupSnapshotsV319Test-312575611 None] Volume volume-54ce091a-02da-4176-9de7-384d89c0a8a8 (54ce091a-02da-4176-9de7-384d89c0a8a8): created successfully Apr 29 18:57:40 devstack cinder-volume[84538]: DEBUG cinder.volume.manager [None req-62a76713-02c9-47db-811b-d9c01a6cae9f tempest-GroupSnapshotsV319Test-312575611 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3e9bcec0-e6f1-4c5f-84ad-14786557102f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 18:57:40 devstack cinder-volume[84538]: DEBUG cinder.volume.manager [None req-62a76713-02c9-47db-811b-d9c01a6cae9f tempest-GroupSnapshotsV319Test-312575611 None] Flow 'volume_create_manager' (3e74f68b-82b3-424d-9ad5-93f2ba5aafcf) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84538) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 18:57:40 devstack cinder-volume[84538]: INFO cinder.volume.manager [None req-62a76713-02c9-47db-811b-d9c01a6cae9f tempest-GroupSnapshotsV319Test-312575611 None] Created volume successfully. Apr 29 18:57:41 devstack cinder-volume[84538]: INFO cinder.volume.manager [None req-3c971334-ef2e-4367-89a7-eaf9c151a0d8 tempest-GroupSnapshotsV319Test-312575611 None] GroupSnapshot 5796b5dc-a79d-423c-b257-d167a480dea9: creating. Apr 29 18:57:41 devstack cinder-volume[84538]: DEBUG cinder.volume.manager [None req-3c971334-ef2e-4367-89a7-eaf9c151a0d8 tempest-GroupSnapshotsV319Test-312575611 None] Group snapshot 5796b5dc-a79d-423c-b257-d167a480dea9: creating. {{(pid=84538) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4175}} Apr 29 18:57:41 devstack cinder-volume[84538]: DEBUG oslo_concurrency.lockutils [None req-3c971334-ef2e-4367-89a7-eaf9c151a0d8 tempest-GroupSnapshotsV319Test-312575611 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=84538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 18:57:41 devstack cinder-volume[84538]: DEBUG oslo_concurrency.lockutils [None req-3c971334-ef2e-4367-89a7-eaf9c151a0d8 tempest-GroupSnapshotsV319Test-312575611 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=84538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 18:57:41 devstack cinder-volume[84538]: DEBUG cinder.volume.drivers.remotefs [None req-3c971334-ef2e-4367-89a7-eaf9c151a0d8 tempest-GroupSnapshotsV319Test-312575611 None] Creating offline snapshot 4beb7121-c05a-4367-a877-75503dcd91a8 of volume 54ce091a-02da-4176-9de7-384d89c0a8a8 {{(pid=84538) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}} Apr 29 18:57:41 devstack cinder-volume[84538]: DEBUG oslo.privsep.daemon [-] privsep: reply[241ed991-c256-4732-bedb-09355f630384]: (4, 'qcow2') {{(pid=85803) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 18:57:41 devstack cinder-volume[84538]: DEBUG oslo_concurrency.processutils [None req-3c971334-ef2e-4367-89a7-eaf9c151a0d8 tempest-GroupSnapshotsV319Test-312575611 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-54ce091a-02da-4176-9de7-384d89c0a8a8 {{(pid=84538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 18:57:41 devstack sudo[87217]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-54ce091a-02da-4176-9de7-384d89c0a8a8 Apr 29 18:57:41 devstack sudo[87217]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 18:57:42 devstack sudo[87217]: pam_unix(sudo:session): session closed for user root Apr 29 18:57:42 devstack cinder-volume[84538]: DEBUG oslo_concurrency.processutils [None req-3c971334-ef2e-4367-89a7-eaf9c151a0d8 tempest-GroupSnapshotsV319Test-312575611 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-54ce091a-02da-4176-9de7-384d89c0a8a8" returned: 0 in 1.265s {{(pid=84538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 18:57:42 devstack cinder-volume[84538]: DEBUG oslo_concurrency.processutils [None req-3c971334-ef2e-4367-89a7-eaf9c151a0d8 tempest-GroupSnapshotsV319Test-312575611 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-54ce091a-02da-4176-9de7-384d89c0a8a8,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-54ce091a-02da-4176-9de7-384d89c0a8a8.4beb7121-c05a-4367-a877-75503dcd91a8 1G {{(pid=84538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 18:57:42 devstack sudo[87282]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-54ce091a-02da-4176-9de7-384d89c0a8a8,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-54ce091a-02da-4176-9de7-384d89c0a8a8.4beb7121-c05a-4367-a877-75503dcd91a8 1G Apr 29 18:57:42 devstack sudo[87282]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 18:57:43 devstack sudo[87282]: pam_unix(sudo:session): session closed for user root Apr 29 18:57:43 devstack cinder-volume[84538]: DEBUG oslo_concurrency.processutils [None req-3c971334-ef2e-4367-89a7-eaf9c151a0d8 tempest-GroupSnapshotsV319Test-312575611 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-54ce091a-02da-4176-9de7-384d89c0a8a8,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-54ce091a-02da-4176-9de7-384d89c0a8a8.4beb7121-c05a-4367-a877-75503dcd91a8 1G" returned: 0 in 1.098s {{(pid=84538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 18:57:43 devstack cinder-volume[84538]: DEBUG oslo_concurrency.processutils [None req-3c971334-ef2e-4367-89a7-eaf9c151a0d8 tempest-GroupSnapshotsV319Test-312575611 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-54ce091a-02da-4176-9de7-384d89c0a8a8 -F qcow2 /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-54ce091a-02da-4176-9de7-384d89c0a8a8.4beb7121-c05a-4367-a877-75503dcd91a8 {{(pid=84538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 18:57:43 devstack sudo[87293]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-54ce091a-02da-4176-9de7-384d89c0a8a8 -F qcow2 /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-54ce091a-02da-4176-9de7-384d89c0a8a8.4beb7121-c05a-4367-a877-75503dcd91a8 Apr 29 18:57:43 devstack sudo[87293]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 18:57:44 devstack sudo[87293]: pam_unix(sudo:session): session closed for user root Apr 29 18:57:44 devstack cinder-volume[84538]: DEBUG oslo_concurrency.processutils [None req-3c971334-ef2e-4367-89a7-eaf9c151a0d8 tempest-GroupSnapshotsV319Test-312575611 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-54ce091a-02da-4176-9de7-384d89c0a8a8 -F qcow2 /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-54ce091a-02da-4176-9de7-384d89c0a8a8.4beb7121-c05a-4367-a877-75503dcd91a8" returned: 0 in 0.925s {{(pid=84538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 18:57:44 devstack cinder-volume[84538]: WARNING cinder.volume.drivers.remotefs [None req-3c971334-ef2e-4367-89a7-eaf9c151a0d8 tempest-GroupSnapshotsV319Test-312575611 None] /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-54ce091a-02da-4176-9de7-384d89c0a8a8.4beb7121-c05a-4367-a877-75503dcd91a8 is being set with open permissions: ugo+rw: NotImplementedError Apr 29 18:57:44 devstack cinder-volume[84538]: DEBUG oslo_concurrency.processutils [None req-3c971334-ef2e-4367-89a7-eaf9c151a0d8 tempest-GroupSnapshotsV319Test-312575611 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-54ce091a-02da-4176-9de7-384d89c0a8a8.4beb7121-c05a-4367-a877-75503dcd91a8 {{(pid=84538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 18:57:44 devstack sudo[87299]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-54ce091a-02da-4176-9de7-384d89c0a8a8.4beb7121-c05a-4367-a877-75503dcd91a8 Apr 29 18:57:44 devstack sudo[87299]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 18:57:45 devstack sudo[87299]: pam_unix(sudo:session): session closed for user root Apr 29 18:57:45 devstack cinder-volume[84538]: DEBUG oslo_concurrency.processutils [None req-3c971334-ef2e-4367-89a7-eaf9c151a0d8 tempest-GroupSnapshotsV319Test-312575611 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-54ce091a-02da-4176-9de7-384d89c0a8a8.4beb7121-c05a-4367-a877-75503dcd91a8" returned: 0 in 1.392s {{(pid=84538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 18:57:46 devstack cinder-volume[84538]: DEBUG oslo_concurrency.processutils [None req-3c971334-ef2e-4367-89a7-eaf9c151a0d8 tempest-GroupSnapshotsV319Test-312575611 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-54ce091a-02da-4176-9de7-384d89c0a8a8.info {{(pid=84538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 18:57:46 devstack sudo[87304]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-54ce091a-02da-4176-9de7-384d89c0a8a8.info Apr 29 18:57:46 devstack sudo[87304]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 18:57:46 devstack cinder-volume[84538]: DEBUG cinder.volume.flows.manager.create_volume [None req-5a002b17-3e5a-44bc-ac03-e62509569916 tempest-VolumesAdminNegativeTest-1441649975 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84538) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Apr 29 18:57:46 devstack cinder-volume[84538]: DEBUG cinder.volume.manager [None req-5a002b17-3e5a-44bc-ac03-e62509569916 tempest-VolumesAdminNegativeTest-1441649975 None] Flow 'volume_create_manager' (c66447c2-8d93-4c2b-9c1b-b0493f066e10) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84538) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 18:57:46 devstack cinder-volume[84538]: DEBUG cinder.volume.manager [None req-5a002b17-3e5a-44bc-ac03-e62509569916 tempest-VolumesAdminNegativeTest-1441649975 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ee5094f7-04c0-46f6-86e5-28f75016b861) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 18:57:46 devstack cinder-volume[84538]: DEBUG cinder.volume.manager [None req-5a002b17-3e5a-44bc-ac03-e62509569916 tempest-VolumesAdminNegativeTest-1441649975 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ee5094f7-04c0-46f6-86e5-28f75016b861) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-29T16:57:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesAdminNegativeTest-volume-518518683',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8e60bb01-6554-45ba-b4b7-3156648cce54,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9bf433a9d39143608216261cc26ca784',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T16:57:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T16:57:47Z,use_quota=True,user_id='531b6ca92b374255b7ee346fbfc8aa5e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(62b05900-93e3-4190-a88f-1d87324303d1),volume_type_id=62b05900-93e3-4190-a88f-1d87324303d1)' {{(pid=84538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 18:57:46 devstack cinder-volume[84538]: DEBUG cinder.volume.manager [None req-5a002b17-3e5a-44bc-ac03-e62509569916 tempest-VolumesAdminNegativeTest-1441649975 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7d0958de-5992-4459-897a-1854cf9f71a1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 18:57:46 devstack cinder-volume[84538]: DEBUG cinder.volume.manager [None req-5a002b17-3e5a-44bc-ac03-e62509569916 tempest-VolumesAdminNegativeTest-1441649975 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7d0958de-5992-4459-897a-1854cf9f71a1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 18:57:46 devstack cinder-volume[84538]: DEBUG cinder.volume.manager [None req-5a002b17-3e5a-44bc-ac03-e62509569916 tempest-VolumesAdminNegativeTest-1441649975 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (034b63d2-7cc2-4f09-909e-eb37fce36242) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 18:57:46 devstack cinder-volume[84538]: DEBUG cinder.volume.manager [None req-5a002b17-3e5a-44bc-ac03-e62509569916 tempest-VolumesAdminNegativeTest-1441649975 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (034b63d2-7cc2-4f09-909e-eb37fce36242) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8e60bb01-6554-45ba-b4b7-3156648cce54', 'volume_name': 'volume-8e60bb01-6554-45ba-b4b7-3156648cce54', 'volume_size': 1}' {{(pid=84538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 18:57:47 devstack cinder-volume[84538]: DEBUG cinder.volume.manager [None req-5a002b17-3e5a-44bc-ac03-e62509569916 tempest-VolumesAdminNegativeTest-1441649975 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b72e1784-0bf5-4936-a1c8-4836e72f66d9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 18:57:47 devstack cinder-volume[84538]: DEBUG cinder.volume.manager [None req-5a002b17-3e5a-44bc-ac03-e62509569916 tempest-VolumesAdminNegativeTest-1441649975 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b72e1784-0bf5-4936-a1c8-4836e72f66d9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 18:57:47 devstack cinder-volume[84538]: DEBUG cinder.volume.manager [None req-5a002b17-3e5a-44bc-ac03-e62509569916 tempest-VolumesAdminNegativeTest-1441649975 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f4e075ff-3381-4fe9-bea7-d1719bdb7982) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 18:57:47 devstack cinder-volume[84538]: INFO cinder.volume.flows.manager.create_volume [None req-5a002b17-3e5a-44bc-ac03-e62509569916 tempest-VolumesAdminNegativeTest-1441649975 None] Volume 8e60bb01-6554-45ba-b4b7-3156648cce54: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8e60bb01-6554-45ba-b4b7-3156648cce54', 'volume_size': 1} Apr 29 18:57:47 devstack cinder-volume[84538]: DEBUG oslo_concurrency.lockutils [None req-5a002b17-3e5a-44bc-ac03-e62509569916 tempest-VolumesAdminNegativeTest-1441649975 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 18:57:47 devstack sudo[87304]: pam_unix(sudo:session): session closed for user root Apr 29 18:57:47 devstack cinder-volume[84538]: DEBUG oslo_concurrency.processutils [None req-3c971334-ef2e-4367-89a7-eaf9c151a0d8 tempest-GroupSnapshotsV319Test-312575611 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-54ce091a-02da-4176-9de7-384d89c0a8a8.info" returned: 0 in 1.460s {{(pid=84538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 18:57:47 devstack cinder-volume[84538]: WARNING cinder.volume.drivers.remotefs [None req-3c971334-ef2e-4367-89a7-eaf9c151a0d8 tempest-GroupSnapshotsV319Test-312575611 None] /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-54ce091a-02da-4176-9de7-384d89c0a8a8.info is being set with open permissions: ugo+rw: NotImplementedError Apr 29 18:57:47 devstack cinder-volume[84538]: DEBUG oslo_concurrency.processutils [None req-3c971334-ef2e-4367-89a7-eaf9c151a0d8 tempest-GroupSnapshotsV319Test-312575611 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-54ce091a-02da-4176-9de7-384d89c0a8a8.info {{(pid=84538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 18:57:47 devstack sudo[87325]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-54ce091a-02da-4176-9de7-384d89c0a8a8.info Apr 29 18:57:47 devstack sudo[87325]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 18:57:48 devstack sudo[87325]: pam_unix(sudo:session): session closed for user root Apr 29 18:57:48 devstack cinder-volume[84538]: DEBUG oslo_concurrency.processutils [None req-3c971334-ef2e-4367-89a7-eaf9c151a0d8 tempest-GroupSnapshotsV319Test-312575611 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-54ce091a-02da-4176-9de7-384d89c0a8a8.info" returned: 0 in 0.664s {{(pid=84538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 18:57:48 devstack cinder-volume[84538]: DEBUG oslo_concurrency.lockutils [None req-3c971334-ef2e-4367-89a7-eaf9c151a0d8 tempest-GroupSnapshotsV319Test-312575611 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 6.987s {{(pid=84538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 18:57:48 devstack cinder-volume[84538]: DEBUG oslo_concurrency.lockutils [None req-5a002b17-3e5a-44bc-ac03-e62509569916 tempest-VolumesAdminNegativeTest-1441649975 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.210s {{(pid=84538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 18:57:48 devstack cinder-volume[84538]: DEBUG cinder.volume.drivers.quobyte [None req-5a002b17-3e5a-44bc-ac03-e62509569916 tempest-VolumesAdminNegativeTest-1441649975 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-29T16:57:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesAdminNegativeTest-volume-518518683',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8e60bb01-6554-45ba-b4b7-3156648cce54,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9bf433a9d39143608216261cc26ca784',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T16:57:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T16:57:47Z,use_quota=True,user_id='531b6ca92b374255b7ee346fbfc8aa5e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(62b05900-93e3-4190-a88f-1d87324303d1),volume_type_id=62b05900-93e3-4190-a88f-1d87324303d1)}" {{(pid=84538) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 29 18:57:48 devstack cinder-volume[84538]: DEBUG cinder.volume.drivers.remotefs [None req-5a002b17-3e5a-44bc-ac03-e62509569916 tempest-VolumesAdminNegativeTest-1441649975 None] Creating volume 8e60bb01-6554-45ba-b4b7-3156648cce54 {{(pid=84538) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 29 18:57:48 devstack cinder-volume[84538]: DEBUG oslo_concurrency.lockutils [None req-5a002b17-3e5a-44bc-ac03-e62509569916 tempest-VolumesAdminNegativeTest-1441649975 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 18:57:48 devstack cinder-volume[84538]: DEBUG oslo_concurrency.lockutils [None req-5a002b17-3e5a-44bc-ac03-e62509569916 tempest-VolumesAdminNegativeTest-1441649975 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=84538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 18:57:48 devstack cinder-volume[84538]: DEBUG cinder.volume.drivers.quobyte [None req-5a002b17-3e5a-44bc-ac03-e62509569916 tempest-VolumesAdminNegativeTest-1441649975 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-34312b00-dd6d-45bb-af98-75855cea8e48': None} {{(pid=84538) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 18:57:48 devstack cinder-volume[84538]: DEBUG cinder.volume.drivers.quobyte [None req-5a002b17-3e5a-44bc-ac03-e62509569916 tempest-VolumesAdminNegativeTest-1441649975 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-34312b00-dd6d-45bb-af98-75855cea8e48'] {{(pid=84538) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 18:57:48 devstack cinder-volume[84538]: DEBUG oslo_concurrency.lockutils [None req-5a002b17-3e5a-44bc-ac03-e62509569916 tempest-VolumesAdminNegativeTest-1441649975 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=84538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 18:57:48 devstack cinder-volume[84538]: DEBUG cinder.volume.drivers.quobyte [None req-5a002b17-3e5a-44bc-ac03-e62509569916 tempest-VolumesAdminNegativeTest-1441649975 None] Selected osci02.corp.quobyte.com/cinder-vol-34312b00-dd6d-45bb-af98-75855cea8e48 as target Quobyte volume. {{(pid=84538) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 29 18:57:48 devstack cinder-volume[84538]: INFO cinder.volume.drivers.remotefs [None req-5a002b17-3e5a-44bc-ac03-e62509569916 tempest-VolumesAdminNegativeTest-1441649975 None] casted to osci02.corp.quobyte.com/cinder-vol-34312b00-dd6d-45bb-af98-75855cea8e48 Apr 29 18:57:48 devstack cinder-volume[84538]: DEBUG oslo_concurrency.processutils [None req-5a002b17-3e5a-44bc-ac03-e62509569916 tempest-VolumesAdminNegativeTest-1441649975 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-8e60bb01-6554-45ba-b4b7-3156648cce54 1073741824 {{(pid=84538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 18:57:48 devstack sudo[87330]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-8e60bb01-6554-45ba-b4b7-3156648cce54 1073741824 Apr 29 18:57:48 devstack sudo[87330]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 18:57:48 devstack cinder-volume[84538]: INFO cinder.volume.manager [None req-3c971334-ef2e-4367-89a7-eaf9c151a0d8 tempest-GroupSnapshotsV319Test-312575611 None] group_snapshot 5796b5dc-a79d-423c-b257-d167a480dea9: created successfully Apr 29 18:57:49 devstack sudo[87330]: pam_unix(sudo:session): session closed for user root Apr 29 18:57:49 devstack cinder-volume[84538]: DEBUG oslo_concurrency.processutils [None req-5a002b17-3e5a-44bc-ac03-e62509569916 tempest-VolumesAdminNegativeTest-1441649975 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-8e60bb01-6554-45ba-b4b7-3156648cce54 1073741824" returned: 0 in 1.104s {{(pid=84538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 18:57:49 devstack cinder-volume[84538]: DEBUG oslo_concurrency.processutils [None req-5a002b17-3e5a-44bc-ac03-e62509569916 tempest-VolumesAdminNegativeTest-1441649975 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-8e60bb01-6554-45ba-b4b7-3156648cce54 {{(pid=84538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 18:57:49 devstack sudo[87335]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-8e60bb01-6554-45ba-b4b7-3156648cce54 Apr 29 18:57:49 devstack sudo[87335]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 18:57:49 devstack cinder-volume[84538]: INFO cinder.volume.manager [None req-9309745b-4033-4df5-98c7-6cb68fe427ef tempest-GroupSnapshotsV319Test-312575611 None] group_snapshot 5796b5dc-a79d-423c-b257-d167a480dea9: deleting Apr 29 18:57:49 devstack cinder-volume[84538]: DEBUG cinder.volume.manager [None req-9309745b-4033-4df5-98c7-6cb68fe427ef tempest-GroupSnapshotsV319Test-312575611 None] group_snapshot 5796b5dc-a79d-423c-b257-d167a480dea9: deleting {{(pid=84538) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4350}} Apr 29 18:57:49 devstack cinder-volume[84538]: DEBUG cinder.coordination [None req-9309745b-4033-4df5-98c7-6cb68fe427ef tempest-GroupSnapshotsV319Test-312575611 None] Acquiring lock "cinder-quobyte-54ce091a-02da-4176-9de7-384d89c0a8a8" by "delete_snapshot" {{(pid=84538) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 18:57:49 devstack cinder-volume[84538]: DEBUG cinder.coordination [None req-9309745b-4033-4df5-98c7-6cb68fe427ef tempest-GroupSnapshotsV319Test-312575611 None] Lock "cinder-quobyte-54ce091a-02da-4176-9de7-384d89c0a8a8" acquired by "delete_snapshot" :: waited 0.033s {{(pid=84538) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 18:57:49 devstack cinder-volume[84538]: DEBUG cinder.coordination [None req-9309745b-4033-4df5-98c7-6cb68fe427ef tempest-GroupSnapshotsV319Test-312575611 None] Acquiring lock "cinder-quobyte-4beb7121-c05a-4367-a877-75503dcd91a8" by "_delete_snapshot" {{(pid=84538) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 18:57:49 devstack cinder-volume[84538]: DEBUG cinder.coordination [None req-9309745b-4033-4df5-98c7-6cb68fe427ef tempest-GroupSnapshotsV319Test-312575611 None] Lock "cinder-quobyte-4beb7121-c05a-4367-a877-75503dcd91a8" acquired by "_delete_snapshot" :: waited 0.026s {{(pid=84538) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 18:57:49 devstack cinder-volume[84538]: DEBUG cinder.volume.drivers.remotefs [None req-9309745b-4033-4df5-98c7-6cb68fe427ef tempest-GroupSnapshotsV319Test-312575611 None] Deleting offline snapshot 4beb7121-c05a-4367-a877-75503dcd91a8 of volume 54ce091a-02da-4176-9de7-384d89c0a8a8 {{(pid=84538) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 29 18:57:49 devstack cinder-volume[84538]: DEBUG cinder.volume.drivers.remotefs [None req-9309745b-4033-4df5-98c7-6cb68fe427ef tempest-GroupSnapshotsV319Test-312575611 None] snapshot_file for this snap is: volume-54ce091a-02da-4176-9de7-384d89c0a8a8.4beb7121-c05a-4367-a877-75503dcd91a8 {{(pid=84538) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 29 18:57:49 devstack cinder-volume[84538]: DEBUG oslo.privsep.daemon [-] privsep: reply[60e8b43e-ca7c-44b1-80bf-441ce2db75e9]: (4, 'qcow2') {{(pid=85803) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 18:57:49 devstack cinder-volume[84538]: DEBUG oslo_concurrency.processutils [None req-9309745b-4033-4df5-98c7-6cb68fe427ef tempest-GroupSnapshotsV319Test-312575611 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-54ce091a-02da-4176-9de7-384d89c0a8a8.4beb7121-c05a-4367-a877-75503dcd91a8 {{(pid=84538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 18:57:49 devstack sudo[87337]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-54ce091a-02da-4176-9de7-384d89c0a8a8.4beb7121-c05a-4367-a877-75503dcd91a8 Apr 29 18:57:49 devstack sudo[87337]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 18:57:50 devstack sudo[87335]: pam_unix(sudo:session): session closed for user root Apr 29 18:57:50 devstack cinder-volume[84538]: DEBUG oslo_concurrency.processutils [None req-5a002b17-3e5a-44bc-ac03-e62509569916 tempest-VolumesAdminNegativeTest-1441649975 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-8e60bb01-6554-45ba-b4b7-3156648cce54" returned: 0 in 1.166s {{(pid=84538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 18:57:50 devstack cinder-volume[84538]: DEBUG cinder.volume.drivers.quobyte [None req-5a002b17-3e5a-44bc-ac03-e62509569916 tempest-VolumesAdminNegativeTest-1441649975 None] <== create_volume: return (2328ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-34312b00-dd6d-45bb-af98-75855cea8e48'} {{(pid=84538) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 29 18:57:50 devstack cinder-volume[84538]: DEBUG oslo_concurrency.lockutils [None req-5a002b17-3e5a-44bc-ac03-e62509569916 tempest-VolumesAdminNegativeTest-1441649975 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.331s {{(pid=84538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 18:57:50 devstack cinder-volume[84538]: DEBUG cinder.volume.manager [None req-5a002b17-3e5a-44bc-ac03-e62509569916 tempest-VolumesAdminNegativeTest-1441649975 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f4e075ff-3381-4fe9-bea7-d1719bdb7982) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8e60bb01-6554-45ba-b4b7-3156648cce54', 'volume_size': 1}' {{(pid=84538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 18:57:50 devstack cinder-volume[84538]: DEBUG cinder.volume.manager [None req-5a002b17-3e5a-44bc-ac03-e62509569916 tempest-VolumesAdminNegativeTest-1441649975 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8d0b15a2-b4c3-45a9-84c3-fb3e6d9476f9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 18:57:50 devstack cinder-volume[84538]: INFO cinder.volume.flows.manager.create_volume [None req-5a002b17-3e5a-44bc-ac03-e62509569916 tempest-VolumesAdminNegativeTest-1441649975 None] Volume volume-8e60bb01-6554-45ba-b4b7-3156648cce54 (8e60bb01-6554-45ba-b4b7-3156648cce54): created successfully Apr 29 18:57:50 devstack cinder-volume[84538]: DEBUG cinder.volume.manager [None req-5a002b17-3e5a-44bc-ac03-e62509569916 tempest-VolumesAdminNegativeTest-1441649975 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8d0b15a2-b4c3-45a9-84c3-fb3e6d9476f9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 18:57:50 devstack cinder-volume[84538]: DEBUG cinder.volume.manager [None req-5a002b17-3e5a-44bc-ac03-e62509569916 tempest-VolumesAdminNegativeTest-1441649975 None] Flow 'volume_create_manager' (c66447c2-8d93-4c2b-9c1b-b0493f066e10) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84538) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 18:57:50 devstack cinder-volume[84538]: INFO cinder.volume.manager [None req-5a002b17-3e5a-44bc-ac03-e62509569916 tempest-VolumesAdminNegativeTest-1441649975 None] Created volume successfully. Apr 29 18:57:50 devstack sudo[87337]: pam_unix(sudo:session): session closed for user root Apr 29 18:57:50 devstack cinder-volume[84538]: DEBUG oslo_concurrency.processutils [None req-9309745b-4033-4df5-98c7-6cb68fe427ef tempest-GroupSnapshotsV319Test-312575611 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-54ce091a-02da-4176-9de7-384d89c0a8a8.4beb7121-c05a-4367-a877-75503dcd91a8" returned: 0 in 1.220s {{(pid=84538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 18:57:50 devstack cinder-volume[84538]: DEBUG cinder.volume.drivers.remotefs [None req-9309745b-4033-4df5-98c7-6cb68fe427ef tempest-GroupSnapshotsV319Test-312575611 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-54ce091a-02da-4176-9de7-384d89c0a8a8(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=84538) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 29 18:57:50 devstack cinder-volume[84538]: DEBUG oslo.privsep.daemon [-] privsep: reply[d5b8d6b1-cf16-4ae4-bdca-8f2614465b8a]: (4, 'qcow2') {{(pid=85803) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 18:57:50 devstack cinder-volume[84538]: DEBUG oslo_concurrency.processutils [None req-9309745b-4033-4df5-98c7-6cb68fe427ef tempest-GroupSnapshotsV319Test-312575611 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-54ce091a-02da-4176-9de7-384d89c0a8a8 {{(pid=84538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 18:57:51 devstack sudo[87343]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-54ce091a-02da-4176-9de7-384d89c0a8a8 Apr 29 18:57:51 devstack sudo[87343]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 18:57:52 devstack sudo[87343]: pam_unix(sudo:session): session closed for user root Apr 29 18:57:52 devstack cinder-volume[84538]: DEBUG oslo_concurrency.processutils [None req-9309745b-4033-4df5-98c7-6cb68fe427ef tempest-GroupSnapshotsV319Test-312575611 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-54ce091a-02da-4176-9de7-384d89c0a8a8" returned: 0 in 1.108s {{(pid=84538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 18:57:52 devstack cinder-volume[84538]: DEBUG oslo_concurrency.processutils [None req-9309745b-4033-4df5-98c7-6cb68fe427ef tempest-GroupSnapshotsV319Test-312575611 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-54ce091a-02da-4176-9de7-384d89c0a8a8.4beb7121-c05a-4367-a877-75503dcd91a8 {{(pid=84538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 18:57:52 devstack cinder-volume[84538]: DEBUG cinder.coordination [None req-69777c54-5169-40d6-97ab-6160c9a67a62 tempest-VolumesAdminNegativeTest-1441649975 None] Acquiring lock "cinder-8e60bb01-6554-45ba-b4b7-3156648cce54-delete_volume" by "delete_volume" {{(pid=84538) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 18:57:52 devstack sudo[87352]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-54ce091a-02da-4176-9de7-384d89c0a8a8.4beb7121-c05a-4367-a877-75503dcd91a8 Apr 29 18:57:52 devstack sudo[87352]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 18:57:52 devstack cinder-volume[84538]: DEBUG cinder.coordination [None req-69777c54-5169-40d6-97ab-6160c9a67a62 tempest-VolumesAdminNegativeTest-1441649975 None] Lock "cinder-8e60bb01-6554-45ba-b4b7-3156648cce54-delete_volume" acquired by "delete_volume" :: waited 0.050s {{(pid=84538) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 18:57:52 devstack cinder-volume[84538]: DEBUG cinder.coordination [None req-69777c54-5169-40d6-97ab-6160c9a67a62 tempest-VolumesAdminNegativeTest-1441649975 None] Acquiring lock "cinder-quobyte-8e60bb01-6554-45ba-b4b7-3156648cce54" by "delete_volume" {{(pid=84538) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 18:57:52 devstack cinder-volume[84538]: DEBUG cinder.coordination [None req-69777c54-5169-40d6-97ab-6160c9a67a62 tempest-VolumesAdminNegativeTest-1441649975 None] Lock "cinder-quobyte-8e60bb01-6554-45ba-b4b7-3156648cce54" acquired by "delete_volume" :: waited 0.025s {{(pid=84538) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 18:57:52 devstack cinder-volume[84538]: DEBUG oslo.privsep.daemon [-] privsep: reply[eae6e328-f4a5-4ebf-8be0-a6f930421c50]: (4, 'qcow2') {{(pid=85803) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 18:57:52 devstack cinder-volume[84538]: DEBUG oslo_concurrency.processutils [None req-69777c54-5169-40d6-97ab-6160c9a67a62 tempest-VolumesAdminNegativeTest-1441649975 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-8e60bb01-6554-45ba-b4b7-3156648cce54 {{(pid=84538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 18:57:52 devstack sudo[87354]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-8e60bb01-6554-45ba-b4b7-3156648cce54 Apr 29 18:57:52 devstack sudo[87354]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 18:57:53 devstack sudo[87352]: pam_unix(sudo:session): session closed for user root Apr 29 18:57:53 devstack cinder-volume[84538]: DEBUG oslo_concurrency.processutils [None req-9309745b-4033-4df5-98c7-6cb68fe427ef tempest-GroupSnapshotsV319Test-312575611 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-54ce091a-02da-4176-9de7-384d89c0a8a8.4beb7121-c05a-4367-a877-75503dcd91a8" returned: 0 in 1.089s {{(pid=84538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 18:57:53 devstack cinder-volume[84538]: DEBUG oslo_concurrency.processutils [None req-9309745b-4033-4df5-98c7-6cb68fe427ef tempest-GroupSnapshotsV319Test-312575611 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-54ce091a-02da-4176-9de7-384d89c0a8a8.4beb7121-c05a-4367-a877-75503dcd91a8 {{(pid=84538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 18:57:53 devstack sudo[87376]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-54ce091a-02da-4176-9de7-384d89c0a8a8.4beb7121-c05a-4367-a877-75503dcd91a8 Apr 29 18:57:53 devstack sudo[87376]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 18:57:53 devstack sudo[87354]: pam_unix(sudo:session): session closed for user root Apr 29 18:57:53 devstack cinder-volume[84538]: DEBUG oslo_concurrency.processutils [None req-69777c54-5169-40d6-97ab-6160c9a67a62 tempest-VolumesAdminNegativeTest-1441649975 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-8e60bb01-6554-45ba-b4b7-3156648cce54" returned: 0 in 1.225s {{(pid=84538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 18:57:53 devstack cinder-volume[84538]: DEBUG oslo_concurrency.processutils [None req-69777c54-5169-40d6-97ab-6160c9a67a62 tempest-VolumesAdminNegativeTest-1441649975 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-8e60bb01-6554-45ba-b4b7-3156648cce54 {{(pid=84538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 18:57:53 devstack sudo[87401]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-8e60bb01-6554-45ba-b4b7-3156648cce54 Apr 29 18:57:53 devstack sudo[87401]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 18:57:54 devstack sudo[87376]: pam_unix(sudo:session): session closed for user root Apr 29 18:57:54 devstack cinder-volume[84538]: DEBUG oslo_concurrency.processutils [None req-9309745b-4033-4df5-98c7-6cb68fe427ef tempest-GroupSnapshotsV319Test-312575611 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-54ce091a-02da-4176-9de7-384d89c0a8a8.4beb7121-c05a-4367-a877-75503dcd91a8" returned: 0 in 1.368s {{(pid=84538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 18:57:54 devstack cinder-volume[84538]: DEBUG cinder.coordination [None req-9309745b-4033-4df5-98c7-6cb68fe427ef tempest-GroupSnapshotsV319Test-312575611 None] Lock "cinder-quobyte-4beb7121-c05a-4367-a877-75503dcd91a8" released by "_delete_snapshot" :: held 4.945s {{(pid=84538) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 18:57:54 devstack cinder-volume[84538]: DEBUG cinder.coordination [None req-9309745b-4033-4df5-98c7-6cb68fe427ef tempest-GroupSnapshotsV319Test-312575611 None] Lock "cinder-quobyte-54ce091a-02da-4176-9de7-384d89c0a8a8" released by "delete_snapshot" :: held 4.991s {{(pid=84538) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 18:57:54 devstack cinder-volume[84538]: WARNING cinder.quota [None req-9309745b-4033-4df5-98c7-6cb68fe427ef tempest-GroupSnapshotsV319Test-312575611 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsV319Test-volume-type-1134189149 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsV319Test-volume-type-1134189149, it is now deprecated. Please use the default quota class for default quota. Apr 29 18:57:54 devstack cinder-volume[84538]: WARNING cinder.quota [None req-9309745b-4033-4df5-98c7-6cb68fe427ef tempest-GroupSnapshotsV319Test-312575611 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsV319Test-volume-type-1134189149 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsV319Test-volume-type-1134189149, it is now deprecated. Please use the default quota class for default quota. Apr 29 18:57:54 devstack cinder-volume[84538]: DEBUG cinder.quota [None req-9309745b-4033-4df5-98c7-6cb68fe427ef tempest-GroupSnapshotsV319Test-312575611 None] Created reservations ['2d777f3e-a72e-4d5f-96b5-c945ec0d6a48', 'c5ba0757-378f-4285-9d2f-120447ac92ba', '96421cee-f671-4a4b-81c7-b3280fccca85', 'b2cf863e-ec60-4746-9990-bd8c7ae6afe1'] {{(pid=84538) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 29 18:57:54 devstack cinder-volume[84538]: INFO cinder.volume.manager [None req-9309745b-4033-4df5-98c7-6cb68fe427ef tempest-GroupSnapshotsV319Test-312575611 None] group_snapshot 5796b5dc-a79d-423c-b257-d167a480dea9: deleted successfully Apr 29 18:57:55 devstack sudo[87401]: pam_unix(sudo:session): session closed for user root Apr 29 18:57:55 devstack cinder-volume[84538]: DEBUG oslo_concurrency.processutils [None req-69777c54-5169-40d6-97ab-6160c9a67a62 tempest-VolumesAdminNegativeTest-1441649975 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-8e60bb01-6554-45ba-b4b7-3156648cce54" returned: 0 in 1.634s {{(pid=84538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 18:57:55 devstack cinder-volume[84538]: DEBUG cinder.coordination [None req-69777c54-5169-40d6-97ab-6160c9a67a62 tempest-VolumesAdminNegativeTest-1441649975 None] Lock "cinder-quobyte-8e60bb01-6554-45ba-b4b7-3156648cce54" released by "delete_volume" :: held 2.932s {{(pid=84538) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 18:57:55 devstack cinder-volume[84538]: DEBUG cinder.quota [None req-69777c54-5169-40d6-97ab-6160c9a67a62 tempest-VolumesAdminNegativeTest-1441649975 None] Created reservations ['4699ee2a-3607-40b1-8369-aec0f494cbb7', '8bc59162-298a-4c7b-96af-5364daaa4c92', '54890522-bdda-4f6b-aa52-7fda176a43b8', 'a28992bf-3371-4fee-ab67-a295e87d1c47'] {{(pid=84538) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 29 18:57:55 devstack cinder-volume[84538]: DEBUG oslo_concurrency.lockutils [None req-69777c54-5169-40d6-97ab-6160c9a67a62 tempest-VolumesAdminNegativeTest-1441649975 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 18:57:55 devstack cinder-volume[84538]: DEBUG oslo_concurrency.lockutils [None req-69777c54-5169-40d6-97ab-6160c9a67a62 tempest-VolumesAdminNegativeTest-1441649975 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=84538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 18:57:55 devstack cinder-volume[84538]: DEBUG cinder.volume.drivers.quobyte [None req-69777c54-5169-40d6-97ab-6160c9a67a62 tempest-VolumesAdminNegativeTest-1441649975 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-34312b00-dd6d-45bb-af98-75855cea8e48': None} {{(pid=84538) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 18:57:55 devstack cinder-volume[84538]: DEBUG cinder.volume.drivers.quobyte [None req-69777c54-5169-40d6-97ab-6160c9a67a62 tempest-VolumesAdminNegativeTest-1441649975 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-34312b00-dd6d-45bb-af98-75855cea8e48'] {{(pid=84538) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 18:57:55 devstack cinder-volume[84538]: DEBUG oslo_concurrency.lockutils [None req-69777c54-5169-40d6-97ab-6160c9a67a62 tempest-VolumesAdminNegativeTest-1441649975 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=84538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 18:57:55 devstack cinder-volume[84538]: DEBUG oslo_concurrency.processutils [None req-69777c54-5169-40d6-97ab-6160c9a67a62 tempest-VolumesAdminNegativeTest-1441649975 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d {{(pid=84538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 18:57:55 devstack sudo[87416]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d Apr 29 18:57:55 devstack sudo[87416]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 18:57:56 devstack cinder-volume[84538]: DEBUG cinder.coordination [None req-1b7fe424-a82b-4330-95b7-17e7c5a860fa tempest-GroupSnapshotsV319Test-312575611 None] Acquiring lock "cinder-quobyte-54ce091a-02da-4176-9de7-384d89c0a8a8" by "delete_volume" {{(pid=84538) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 18:57:56 devstack cinder-volume[84538]: DEBUG cinder.coordination [None req-1b7fe424-a82b-4330-95b7-17e7c5a860fa tempest-GroupSnapshotsV319Test-312575611 None] Lock "cinder-quobyte-54ce091a-02da-4176-9de7-384d89c0a8a8" acquired by "delete_volume" :: waited 0.051s {{(pid=84538) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 18:57:56 devstack cinder-volume[84538]: DEBUG oslo.privsep.daemon [-] privsep: reply[f7aefed2-32e7-4e75-b084-7897239d23d6]: (4, 'qcow2') {{(pid=85803) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 18:57:56 devstack cinder-volume[84538]: DEBUG oslo_concurrency.processutils [None req-1b7fe424-a82b-4330-95b7-17e7c5a860fa tempest-GroupSnapshotsV319Test-312575611 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-54ce091a-02da-4176-9de7-384d89c0a8a8 {{(pid=84538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 18:57:56 devstack sudo[87451]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-54ce091a-02da-4176-9de7-384d89c0a8a8 Apr 29 18:57:56 devstack sudo[87451]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 18:57:56 devstack sudo[87416]: pam_unix(sudo:session): session closed for user root Apr 29 18:57:56 devstack cinder-volume[84538]: DEBUG oslo_concurrency.processutils [None req-69777c54-5169-40d6-97ab-6160c9a67a62 tempest-VolumesAdminNegativeTest-1441649975 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d" returned: 0 in 1.560s {{(pid=84538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 18:57:56 devstack cinder-volume[84538]: DEBUG cinder.manager [None req-69777c54-5169-40d6-97ab-6160c9a67a62 tempest-VolumesAdminNegativeTest-1441649975 None] Notifying Schedulers of capabilities ... {{(pid=84538) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 29 18:57:56 devstack cinder-volume[84538]: INFO cinder.volume.manager [None req-69777c54-5169-40d6-97ab-6160c9a67a62 tempest-VolumesAdminNegativeTest-1441649975 None] Deleted volume successfully. Apr 29 18:57:56 devstack cinder-volume[84538]: DEBUG cinder.coordination [None req-69777c54-5169-40d6-97ab-6160c9a67a62 tempest-VolumesAdminNegativeTest-1441649975 None] Lock "cinder-8e60bb01-6554-45ba-b4b7-3156648cce54-delete_volume" released by "delete_volume" :: held 4.810s {{(pid=84538) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 18:57:58 devstack sudo[87451]: pam_unix(sudo:session): session closed for user root Apr 29 18:57:58 devstack cinder-volume[84538]: DEBUG oslo_concurrency.processutils [None req-1b7fe424-a82b-4330-95b7-17e7c5a860fa tempest-GroupSnapshotsV319Test-312575611 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-54ce091a-02da-4176-9de7-384d89c0a8a8" returned: 0 in 1.787s {{(pid=84538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 18:57:58 devstack cinder-volume[84538]: DEBUG oslo_concurrency.processutils [None req-1b7fe424-a82b-4330-95b7-17e7c5a860fa tempest-GroupSnapshotsV319Test-312575611 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-54ce091a-02da-4176-9de7-384d89c0a8a8 {{(pid=84538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 18:57:58 devstack sudo[87496]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-54ce091a-02da-4176-9de7-384d89c0a8a8 Apr 29 18:57:58 devstack sudo[87496]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 18:57:59 devstack sudo[87496]: pam_unix(sudo:session): session closed for user root Apr 29 18:57:59 devstack cinder-volume[84538]: DEBUG oslo_concurrency.processutils [None req-1b7fe424-a82b-4330-95b7-17e7c5a860fa tempest-GroupSnapshotsV319Test-312575611 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-54ce091a-02da-4176-9de7-384d89c0a8a8" returned: 0 in 1.268s {{(pid=84538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 18:57:59 devstack cinder-volume[84538]: DEBUG cinder.coordination [None req-1b7fe424-a82b-4330-95b7-17e7c5a860fa tempest-GroupSnapshotsV319Test-312575611 None] Lock "cinder-quobyte-54ce091a-02da-4176-9de7-384d89c0a8a8" released by "delete_volume" :: held 3.212s {{(pid=84538) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 18:57:59 devstack cinder-volume[84538]: DEBUG cinder.quota [None req-1b7fe424-a82b-4330-95b7-17e7c5a860fa tempest-GroupSnapshotsV319Test-312575611 None] Created reservations ['0e1263aa-7879-4cfc-a490-59c4a9f82867'] {{(pid=84538) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 29 18:57:59 devstack cinder-volume[84538]: WARNING cinder.quota [None req-1b7fe424-a82b-4330-95b7-17e7c5a860fa tempest-GroupSnapshotsV319Test-312575611 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsV319Test-volume-type-1134189149 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsV319Test-volume-type-1134189149, it is now deprecated. Please use the default quota class for default quota. Apr 29 18:57:59 devstack cinder-volume[84538]: DEBUG cinder.quota [None req-1b7fe424-a82b-4330-95b7-17e7c5a860fa tempest-GroupSnapshotsV319Test-312575611 None] Created reservations ['2b704a8c-94d7-4638-bc9b-b06750f6711b', 'b13a8050-c99c-4719-85cb-827d92cf41c1', 'f422b7ec-8783-4fc9-bb31-cb59a3008e98', '62803cdd-4a60-4e65-a6dc-54068b164370'] {{(pid=84538) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 29 18:57:59 devstack cinder-volume[84538]: DEBUG oslo_concurrency.lockutils [None req-1b7fe424-a82b-4330-95b7-17e7c5a860fa tempest-GroupSnapshotsV319Test-312575611 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 18:57:59 devstack cinder-volume[84538]: DEBUG oslo_concurrency.lockutils [None req-1b7fe424-a82b-4330-95b7-17e7c5a860fa tempest-GroupSnapshotsV319Test-312575611 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 18:57:59 devstack cinder-volume[84538]: DEBUG cinder.volume.drivers.quobyte [None req-1b7fe424-a82b-4330-95b7-17e7c5a860fa tempest-GroupSnapshotsV319Test-312575611 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-34312b00-dd6d-45bb-af98-75855cea8e48': None} {{(pid=84538) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 18:57:59 devstack cinder-volume[84538]: DEBUG cinder.volume.drivers.quobyte [None req-1b7fe424-a82b-4330-95b7-17e7c5a860fa tempest-GroupSnapshotsV319Test-312575611 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-34312b00-dd6d-45bb-af98-75855cea8e48'] {{(pid=84538) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 18:57:59 devstack cinder-volume[84538]: DEBUG oslo_concurrency.lockutils [None req-1b7fe424-a82b-4330-95b7-17e7c5a860fa tempest-GroupSnapshotsV319Test-312575611 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=84538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 18:57:59 devstack cinder-volume[84538]: DEBUG oslo_concurrency.processutils [None req-1b7fe424-a82b-4330-95b7-17e7c5a860fa tempest-GroupSnapshotsV319Test-312575611 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d {{(pid=84538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 18:57:59 devstack sudo[87503]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d Apr 29 18:57:59 devstack sudo[87503]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 18:58:00 devstack sudo[87503]: pam_unix(sudo:session): session closed for user root Apr 29 18:58:00 devstack cinder-volume[84538]: DEBUG oslo_concurrency.processutils [None req-1b7fe424-a82b-4330-95b7-17e7c5a860fa tempest-GroupSnapshotsV319Test-312575611 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d" returned: 0 in 0.760s {{(pid=84538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 18:58:00 devstack cinder-volume[84538]: DEBUG cinder.manager [None req-1b7fe424-a82b-4330-95b7-17e7c5a860fa tempest-GroupSnapshotsV319Test-312575611 None] Notifying Schedulers of capabilities ... {{(pid=84538) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 29 18:58:00 devstack cinder-volume[84538]: INFO cinder.volume.manager [None req-1b7fe424-a82b-4330-95b7-17e7c5a860fa tempest-GroupSnapshotsV319Test-312575611 None] Delete group completed successfully. Apr 29 18:58:01 devstack cinder-volume[84538]: DEBUG cinder.volume.flows.manager.create_volume [None req-040fef91-e954-4218-81a9-6306514f3f4a tempest-SnapshotsActionsTest-711673579 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84538) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Apr 29 18:58:01 devstack cinder-volume[84538]: DEBUG cinder.volume.manager [None req-040fef91-e954-4218-81a9-6306514f3f4a tempest-SnapshotsActionsTest-711673579 None] Flow 'volume_create_manager' (b3b93e58-d8e0-4fe0-a305-7957053c1f96) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84538) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 18:58:01 devstack cinder-volume[84538]: DEBUG cinder.volume.manager [None req-040fef91-e954-4218-81a9-6306514f3f4a tempest-SnapshotsActionsTest-711673579 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f7afdee2-3a77-4ef9-b433-1315e595fd24) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 18:58:01 devstack cinder-volume[84538]: DEBUG cinder.volume.manager [None req-040fef91-e954-4218-81a9-6306514f3f4a tempest-SnapshotsActionsTest-711673579 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f7afdee2-3a77-4ef9-b433-1315e595fd24) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-29T16:58:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotsActionsTest-Volume-1372145064',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=556880c3-9a02-4e53-8a6c-203a2e269036,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f941b19ce6b24144bb2489827008932f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T16:58:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T16:58:01Z,use_quota=True,user_id='086b1a99bb14447b82fe5b5ed64f4d1f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(62b05900-93e3-4190-a88f-1d87324303d1),volume_type_id=62b05900-93e3-4190-a88f-1d87324303d1)' {{(pid=84538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 18:58:01 devstack cinder-volume[84538]: DEBUG cinder.volume.manager [None req-040fef91-e954-4218-81a9-6306514f3f4a tempest-SnapshotsActionsTest-711673579 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b073f1f3-1257-4540-b49a-033e14a9bfa8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 18:58:01 devstack cinder-volume[84538]: DEBUG cinder.volume.manager [None req-040fef91-e954-4218-81a9-6306514f3f4a tempest-SnapshotsActionsTest-711673579 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b073f1f3-1257-4540-b49a-033e14a9bfa8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 18:58:01 devstack cinder-volume[84538]: DEBUG cinder.volume.manager [None req-040fef91-e954-4218-81a9-6306514f3f4a tempest-SnapshotsActionsTest-711673579 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2950e2e2-09ed-4043-928f-b529015119a2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 18:58:01 devstack cinder-volume[84538]: DEBUG cinder.volume.manager [None req-040fef91-e954-4218-81a9-6306514f3f4a tempest-SnapshotsActionsTest-711673579 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2950e2e2-09ed-4043-928f-b529015119a2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '556880c3-9a02-4e53-8a6c-203a2e269036', 'volume_name': 'volume-556880c3-9a02-4e53-8a6c-203a2e269036', 'volume_size': 1}' {{(pid=84538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 18:58:01 devstack cinder-volume[84538]: DEBUG cinder.volume.manager [None req-040fef91-e954-4218-81a9-6306514f3f4a tempest-SnapshotsActionsTest-711673579 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d74ead94-c326-488a-9272-0050350a10e7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 18:58:01 devstack cinder-volume[84538]: DEBUG cinder.volume.manager [None req-040fef91-e954-4218-81a9-6306514f3f4a tempest-SnapshotsActionsTest-711673579 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d74ead94-c326-488a-9272-0050350a10e7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 18:58:01 devstack cinder-volume[84538]: DEBUG cinder.volume.manager [None req-040fef91-e954-4218-81a9-6306514f3f4a tempest-SnapshotsActionsTest-711673579 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (990f07d2-f595-4ae5-bdfb-5a73d5651f0c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 18:58:01 devstack cinder-volume[84538]: INFO cinder.volume.flows.manager.create_volume [None req-040fef91-e954-4218-81a9-6306514f3f4a tempest-SnapshotsActionsTest-711673579 None] Volume 556880c3-9a02-4e53-8a6c-203a2e269036: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-556880c3-9a02-4e53-8a6c-203a2e269036', 'volume_size': 1} Apr 29 18:58:01 devstack cinder-volume[84538]: DEBUG oslo_concurrency.lockutils [None req-040fef91-e954-4218-81a9-6306514f3f4a tempest-SnapshotsActionsTest-711673579 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 18:58:01 devstack cinder-volume[84538]: DEBUG oslo_concurrency.lockutils [None req-040fef91-e954-4218-81a9-6306514f3f4a tempest-SnapshotsActionsTest-711673579 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=84538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 18:58:01 devstack cinder-volume[84538]: DEBUG cinder.volume.drivers.quobyte [None req-040fef91-e954-4218-81a9-6306514f3f4a tempest-SnapshotsActionsTest-711673579 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-29T16:58:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotsActionsTest-Volume-1372145064',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=556880c3-9a02-4e53-8a6c-203a2e269036,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f941b19ce6b24144bb2489827008932f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T16:58:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T16:58:01Z,use_quota=True,user_id='086b1a99bb14447b82fe5b5ed64f4d1f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(62b05900-93e3-4190-a88f-1d87324303d1),volume_type_id=62b05900-93e3-4190-a88f-1d87324303d1)}" {{(pid=84538) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 29 18:58:01 devstack cinder-volume[84538]: DEBUG cinder.volume.drivers.remotefs [None req-040fef91-e954-4218-81a9-6306514f3f4a tempest-SnapshotsActionsTest-711673579 None] Creating volume 556880c3-9a02-4e53-8a6c-203a2e269036 {{(pid=84538) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 29 18:58:01 devstack cinder-volume[84538]: DEBUG oslo_concurrency.lockutils [None req-040fef91-e954-4218-81a9-6306514f3f4a tempest-SnapshotsActionsTest-711673579 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 18:58:01 devstack cinder-volume[84538]: DEBUG oslo_concurrency.lockutils [None req-040fef91-e954-4218-81a9-6306514f3f4a tempest-SnapshotsActionsTest-711673579 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=84538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 18:58:01 devstack cinder-volume[84538]: DEBUG cinder.volume.drivers.quobyte [None req-040fef91-e954-4218-81a9-6306514f3f4a tempest-SnapshotsActionsTest-711673579 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-34312b00-dd6d-45bb-af98-75855cea8e48': None} {{(pid=84538) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 18:58:01 devstack cinder-volume[84538]: DEBUG cinder.volume.drivers.quobyte [None req-040fef91-e954-4218-81a9-6306514f3f4a tempest-SnapshotsActionsTest-711673579 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-34312b00-dd6d-45bb-af98-75855cea8e48'] {{(pid=84538) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 18:58:01 devstack cinder-volume[84538]: DEBUG oslo_concurrency.lockutils [None req-040fef91-e954-4218-81a9-6306514f3f4a tempest-SnapshotsActionsTest-711673579 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=84538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 18:58:01 devstack cinder-volume[84538]: DEBUG cinder.volume.drivers.quobyte [None req-040fef91-e954-4218-81a9-6306514f3f4a tempest-SnapshotsActionsTest-711673579 None] Selected osci02.corp.quobyte.com/cinder-vol-34312b00-dd6d-45bb-af98-75855cea8e48 as target Quobyte volume. {{(pid=84538) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 29 18:58:01 devstack cinder-volume[84538]: INFO cinder.volume.drivers.remotefs [None req-040fef91-e954-4218-81a9-6306514f3f4a tempest-SnapshotsActionsTest-711673579 None] casted to osci02.corp.quobyte.com/cinder-vol-34312b00-dd6d-45bb-af98-75855cea8e48 Apr 29 18:58:01 devstack cinder-volume[84538]: DEBUG oslo_concurrency.processutils [None req-040fef91-e954-4218-81a9-6306514f3f4a tempest-SnapshotsActionsTest-711673579 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-556880c3-9a02-4e53-8a6c-203a2e269036 1073741824 {{(pid=84538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 18:58:01 devstack sudo[87507]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-556880c3-9a02-4e53-8a6c-203a2e269036 1073741824 Apr 29 18:58:01 devstack sudo[87507]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 18:58:02 devstack sudo[87507]: pam_unix(sudo:session): session closed for user root Apr 29 18:58:02 devstack cinder-volume[84538]: DEBUG oslo_concurrency.processutils [None req-040fef91-e954-4218-81a9-6306514f3f4a tempest-SnapshotsActionsTest-711673579 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-556880c3-9a02-4e53-8a6c-203a2e269036 1073741824" returned: 0 in 0.907s {{(pid=84538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 18:58:02 devstack cinder-volume[84538]: DEBUG oslo_concurrency.processutils [None req-040fef91-e954-4218-81a9-6306514f3f4a tempest-SnapshotsActionsTest-711673579 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-556880c3-9a02-4e53-8a6c-203a2e269036 {{(pid=84538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 18:58:02 devstack sudo[87514]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-556880c3-9a02-4e53-8a6c-203a2e269036 Apr 29 18:58:02 devstack sudo[87514]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 18:58:03 devstack sudo[87514]: pam_unix(sudo:session): session closed for user root Apr 29 18:58:03 devstack cinder-volume[84538]: DEBUG oslo_concurrency.processutils [None req-040fef91-e954-4218-81a9-6306514f3f4a tempest-SnapshotsActionsTest-711673579 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-556880c3-9a02-4e53-8a6c-203a2e269036" returned: 0 in 1.053s {{(pid=84538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 18:58:03 devstack cinder-volume[84538]: DEBUG cinder.volume.drivers.quobyte [None req-040fef91-e954-4218-81a9-6306514f3f4a tempest-SnapshotsActionsTest-711673579 None] <== create_volume: return (2019ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-34312b00-dd6d-45bb-af98-75855cea8e48'} {{(pid=84538) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 29 18:58:03 devstack cinder-volume[84538]: DEBUG oslo_concurrency.lockutils [None req-040fef91-e954-4218-81a9-6306514f3f4a tempest-SnapshotsActionsTest-711673579 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.023s {{(pid=84538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 18:58:03 devstack cinder-volume[84538]: DEBUG cinder.volume.manager [None req-040fef91-e954-4218-81a9-6306514f3f4a tempest-SnapshotsActionsTest-711673579 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (990f07d2-f595-4ae5-bdfb-5a73d5651f0c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-556880c3-9a02-4e53-8a6c-203a2e269036', 'volume_size': 1}' {{(pid=84538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 18:58:03 devstack cinder-volume[84538]: DEBUG cinder.volume.manager [None req-040fef91-e954-4218-81a9-6306514f3f4a tempest-SnapshotsActionsTest-711673579 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a9d4307a-4871-4f3c-b41f-6d088527afce) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 18:58:03 devstack cinder-volume[84538]: INFO cinder.volume.flows.manager.create_volume [None req-040fef91-e954-4218-81a9-6306514f3f4a tempest-SnapshotsActionsTest-711673579 None] Volume volume-556880c3-9a02-4e53-8a6c-203a2e269036 (556880c3-9a02-4e53-8a6c-203a2e269036): created successfully Apr 29 18:58:03 devstack cinder-volume[84538]: DEBUG cinder.volume.manager [None req-040fef91-e954-4218-81a9-6306514f3f4a tempest-SnapshotsActionsTest-711673579 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a9d4307a-4871-4f3c-b41f-6d088527afce) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 18:58:03 devstack cinder-volume[84538]: DEBUG cinder.volume.manager [None req-040fef91-e954-4218-81a9-6306514f3f4a tempest-SnapshotsActionsTest-711673579 None] Flow 'volume_create_manager' (b3b93e58-d8e0-4fe0-a305-7957053c1f96) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84538) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 18:58:03 devstack cinder-volume[84538]: INFO cinder.volume.manager [None req-040fef91-e954-4218-81a9-6306514f3f4a tempest-SnapshotsActionsTest-711673579 None] Created volume successfully. Apr 29 18:58:05 devstack cinder-volume[84538]: DEBUG oslo_concurrency.lockutils [None req-9876fb8d-38d6-40c4-830a-9ea1f3793a30 tempest-SnapshotsActionsTest-711673579 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=84538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 18:58:05 devstack cinder-volume[84538]: DEBUG oslo_concurrency.lockutils [None req-9876fb8d-38d6-40c4-830a-9ea1f3793a30 tempest-SnapshotsActionsTest-711673579 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=84538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 18:58:05 devstack cinder-volume[84538]: DEBUG cinder.volume.drivers.remotefs [None req-9876fb8d-38d6-40c4-830a-9ea1f3793a30 tempest-SnapshotsActionsTest-711673579 None] Creating offline snapshot 2dbee080-eb30-4349-9d21-fa64930394ca of volume 556880c3-9a02-4e53-8a6c-203a2e269036 {{(pid=84538) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}} Apr 29 18:58:05 devstack cinder-volume[84538]: DEBUG oslo.privsep.daemon [-] privsep: reply[4e748071-cbbb-4c52-9f62-0ac588c9fd3f]: (4, 'qcow2') {{(pid=85803) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 18:58:05 devstack cinder-volume[84538]: DEBUG oslo_concurrency.processutils [None req-9876fb8d-38d6-40c4-830a-9ea1f3793a30 tempest-SnapshotsActionsTest-711673579 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-556880c3-9a02-4e53-8a6c-203a2e269036 {{(pid=84538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 18:58:05 devstack sudo[87544]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-556880c3-9a02-4e53-8a6c-203a2e269036 Apr 29 18:58:05 devstack sudo[87544]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 18:58:06 devstack sudo[87544]: pam_unix(sudo:session): session closed for user root Apr 29 18:58:06 devstack cinder-volume[84538]: DEBUG oslo_concurrency.processutils [None req-9876fb8d-38d6-40c4-830a-9ea1f3793a30 tempest-SnapshotsActionsTest-711673579 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-556880c3-9a02-4e53-8a6c-203a2e269036" returned: 0 in 1.299s {{(pid=84538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 18:58:06 devstack cinder-volume[84538]: DEBUG oslo_concurrency.processutils [None req-9876fb8d-38d6-40c4-830a-9ea1f3793a30 tempest-SnapshotsActionsTest-711673579 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-556880c3-9a02-4e53-8a6c-203a2e269036,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-556880c3-9a02-4e53-8a6c-203a2e269036.2dbee080-eb30-4349-9d21-fa64930394ca 1G {{(pid=84538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 18:58:06 devstack sudo[87550]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-556880c3-9a02-4e53-8a6c-203a2e269036,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-556880c3-9a02-4e53-8a6c-203a2e269036.2dbee080-eb30-4349-9d21-fa64930394ca 1G Apr 29 18:58:06 devstack sudo[87550]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 18:58:07 devstack sudo[87550]: pam_unix(sudo:session): session closed for user root Apr 29 18:58:07 devstack cinder-volume[84538]: DEBUG oslo_concurrency.processutils [None req-9876fb8d-38d6-40c4-830a-9ea1f3793a30 tempest-SnapshotsActionsTest-711673579 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-556880c3-9a02-4e53-8a6c-203a2e269036,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-556880c3-9a02-4e53-8a6c-203a2e269036.2dbee080-eb30-4349-9d21-fa64930394ca 1G" returned: 0 in 1.254s {{(pid=84538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 18:58:07 devstack cinder-volume[84538]: DEBUG oslo_concurrency.processutils [None req-9876fb8d-38d6-40c4-830a-9ea1f3793a30 tempest-SnapshotsActionsTest-711673579 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-556880c3-9a02-4e53-8a6c-203a2e269036 -F qcow2 /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-556880c3-9a02-4e53-8a6c-203a2e269036.2dbee080-eb30-4349-9d21-fa64930394ca {{(pid=84538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 18:58:07 devstack sudo[87555]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-556880c3-9a02-4e53-8a6c-203a2e269036 -F qcow2 /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-556880c3-9a02-4e53-8a6c-203a2e269036.2dbee080-eb30-4349-9d21-fa64930394ca Apr 29 18:58:07 devstack sudo[87555]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 18:58:08 devstack sudo[87555]: pam_unix(sudo:session): session closed for user root Apr 29 18:58:08 devstack cinder-volume[84538]: DEBUG oslo_concurrency.processutils [None req-9876fb8d-38d6-40c4-830a-9ea1f3793a30 tempest-SnapshotsActionsTest-711673579 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-556880c3-9a02-4e53-8a6c-203a2e269036 -F qcow2 /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-556880c3-9a02-4e53-8a6c-203a2e269036.2dbee080-eb30-4349-9d21-fa64930394ca" returned: 0 in 1.241s {{(pid=84538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 18:58:08 devstack cinder-volume[84538]: WARNING cinder.volume.drivers.remotefs [None req-9876fb8d-38d6-40c4-830a-9ea1f3793a30 tempest-SnapshotsActionsTest-711673579 None] /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-556880c3-9a02-4e53-8a6c-203a2e269036.2dbee080-eb30-4349-9d21-fa64930394ca is being set with open permissions: ugo+rw Apr 29 18:58:08 devstack cinder-volume[84538]: DEBUG oslo_concurrency.processutils [None req-9876fb8d-38d6-40c4-830a-9ea1f3793a30 tempest-SnapshotsActionsTest-711673579 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-556880c3-9a02-4e53-8a6c-203a2e269036.2dbee080-eb30-4349-9d21-fa64930394ca {{(pid=84538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 18:58:08 devstack sudo[87579]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-556880c3-9a02-4e53-8a6c-203a2e269036.2dbee080-eb30-4349-9d21-fa64930394ca Apr 29 18:58:08 devstack sudo[87579]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 18:58:09 devstack sudo[87579]: pam_unix(sudo:session): session closed for user root Apr 29 18:58:09 devstack cinder-volume[84538]: DEBUG oslo_concurrency.processutils [None req-9876fb8d-38d6-40c4-830a-9ea1f3793a30 tempest-SnapshotsActionsTest-711673579 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-556880c3-9a02-4e53-8a6c-203a2e269036.2dbee080-eb30-4349-9d21-fa64930394ca" returned: 0 in 0.749s {{(pid=84538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 18:58:09 devstack cinder-volume[84538]: DEBUG oslo_concurrency.processutils [None req-9876fb8d-38d6-40c4-830a-9ea1f3793a30 tempest-SnapshotsActionsTest-711673579 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-556880c3-9a02-4e53-8a6c-203a2e269036.info {{(pid=84538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 18:58:09 devstack sudo[87583]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-556880c3-9a02-4e53-8a6c-203a2e269036.info Apr 29 18:58:09 devstack sudo[87583]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 18:58:10 devstack sudo[87583]: pam_unix(sudo:session): session closed for user root Apr 29 18:58:10 devstack cinder-volume[84538]: DEBUG oslo_concurrency.processutils [None req-9876fb8d-38d6-40c4-830a-9ea1f3793a30 tempest-SnapshotsActionsTest-711673579 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-556880c3-9a02-4e53-8a6c-203a2e269036.info" returned: 0 in 0.882s {{(pid=84538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 18:58:10 devstack cinder-volume[84538]: WARNING cinder.volume.drivers.remotefs [None req-9876fb8d-38d6-40c4-830a-9ea1f3793a30 tempest-SnapshotsActionsTest-711673579 None] /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-556880c3-9a02-4e53-8a6c-203a2e269036.info is being set with open permissions: ugo+rw Apr 29 18:58:10 devstack cinder-volume[84538]: DEBUG oslo_concurrency.processutils [None req-9876fb8d-38d6-40c4-830a-9ea1f3793a30 tempest-SnapshotsActionsTest-711673579 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-556880c3-9a02-4e53-8a6c-203a2e269036.info {{(pid=84538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 18:58:10 devstack sudo[87586]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-556880c3-9a02-4e53-8a6c-203a2e269036.info Apr 29 18:58:10 devstack sudo[87586]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 18:58:11 devstack sudo[87586]: pam_unix(sudo:session): session closed for user root Apr 29 18:58:11 devstack cinder-volume[84538]: DEBUG oslo_concurrency.processutils [None req-9876fb8d-38d6-40c4-830a-9ea1f3793a30 tempest-SnapshotsActionsTest-711673579 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-556880c3-9a02-4e53-8a6c-203a2e269036.info" returned: 0 in 0.906s {{(pid=84538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 18:58:11 devstack cinder-volume[84538]: DEBUG oslo_concurrency.lockutils [None req-9876fb8d-38d6-40c4-830a-9ea1f3793a30 tempest-SnapshotsActionsTest-711673579 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 6.507s {{(pid=84538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 18:58:11 devstack cinder-volume[84538]: INFO cinder.volume.manager [None req-9876fb8d-38d6-40c4-830a-9ea1f3793a30 tempest-SnapshotsActionsTest-711673579 None] Create snapshot completed successfully Apr 29 18:58:13 devstack cinder-volume[84538]: DEBUG oslo_concurrency.lockutils [None req-032a4f8a-0f9f-43a1-ae05-2917c37d0c6a tempest-SnapshotsActionsTest-711673579 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=84538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 18:58:13 devstack cinder-volume[84538]: DEBUG oslo_concurrency.lockutils [None req-032a4f8a-0f9f-43a1-ae05-2917c37d0c6a tempest-SnapshotsActionsTest-711673579 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=84538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 18:58:13 devstack cinder-volume[84538]: DEBUG cinder.volume.drivers.remotefs [None req-032a4f8a-0f9f-43a1-ae05-2917c37d0c6a tempest-SnapshotsActionsTest-711673579 None] Creating offline snapshot fa0e8ce3-caab-4bd9-a0a9-792644696a8d of volume 556880c3-9a02-4e53-8a6c-203a2e269036 {{(pid=84538) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}} Apr 29 18:58:13 devstack cinder-volume[84538]: DEBUG oslo.privsep.daemon [-] privsep: reply[9922e674-da9c-49e6-8ab2-c37cca7a4520]: (4, 'qcow2') {{(pid=85803) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 18:58:13 devstack cinder-volume[84538]: DEBUG oslo_concurrency.processutils [None req-032a4f8a-0f9f-43a1-ae05-2917c37d0c6a tempest-SnapshotsActionsTest-711673579 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-556880c3-9a02-4e53-8a6c-203a2e269036.2dbee080-eb30-4349-9d21-fa64930394ca {{(pid=84538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 18:58:13 devstack sudo[87596]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-556880c3-9a02-4e53-8a6c-203a2e269036.2dbee080-eb30-4349-9d21-fa64930394ca Apr 29 18:58:13 devstack sudo[87596]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 18:58:14 devstack sudo[87596]: pam_unix(sudo:session): session closed for user root Apr 29 18:58:14 devstack cinder-volume[84538]: DEBUG oslo_concurrency.processutils [None req-032a4f8a-0f9f-43a1-ae05-2917c37d0c6a tempest-SnapshotsActionsTest-711673579 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-556880c3-9a02-4e53-8a6c-203a2e269036.2dbee080-eb30-4349-9d21-fa64930394ca" returned: 0 in 1.016s {{(pid=84538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 18:58:14 devstack cinder-volume[84538]: DEBUG cinder.volume.drivers.remotefs [None req-032a4f8a-0f9f-43a1-ae05-2917c37d0c6a tempest-SnapshotsActionsTest-711673579 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-556880c3-9a02-4e53-8a6c-203a2e269036(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=84538) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 29 18:58:14 devstack cinder-volume[84538]: DEBUG oslo_concurrency.processutils [None req-032a4f8a-0f9f-43a1-ae05-2917c37d0c6a tempest-SnapshotsActionsTest-711673579 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-556880c3-9a02-4e53-8a6c-203a2e269036.2dbee080-eb30-4349-9d21-fa64930394ca,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-556880c3-9a02-4e53-8a6c-203a2e269036.fa0e8ce3-caab-4bd9-a0a9-792644696a8d 1G {{(pid=84538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 18:58:14 devstack sudo[87603]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-556880c3-9a02-4e53-8a6c-203a2e269036.2dbee080-eb30-4349-9d21-fa64930394ca,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-556880c3-9a02-4e53-8a6c-203a2e269036.fa0e8ce3-caab-4bd9-a0a9-792644696a8d 1G Apr 29 18:58:14 devstack sudo[87603]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 18:58:15 devstack sudo[87603]: pam_unix(sudo:session): session closed for user root Apr 29 18:58:15 devstack cinder-volume[84538]: DEBUG oslo_concurrency.processutils [None req-032a4f8a-0f9f-43a1-ae05-2917c37d0c6a tempest-SnapshotsActionsTest-711673579 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-556880c3-9a02-4e53-8a6c-203a2e269036.2dbee080-eb30-4349-9d21-fa64930394ca,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-556880c3-9a02-4e53-8a6c-203a2e269036.fa0e8ce3-caab-4bd9-a0a9-792644696a8d 1G" returned: 0 in 1.096s {{(pid=84538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 18:58:15 devstack cinder-volume[84538]: DEBUG oslo_concurrency.processutils [None req-032a4f8a-0f9f-43a1-ae05-2917c37d0c6a tempest-SnapshotsActionsTest-711673579 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-556880c3-9a02-4e53-8a6c-203a2e269036.2dbee080-eb30-4349-9d21-fa64930394ca -F qcow2 /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-556880c3-9a02-4e53-8a6c-203a2e269036.fa0e8ce3-caab-4bd9-a0a9-792644696a8d {{(pid=84538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 18:58:15 devstack sudo[87609]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-556880c3-9a02-4e53-8a6c-203a2e269036.2dbee080-eb30-4349-9d21-fa64930394ca -F qcow2 /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-556880c3-9a02-4e53-8a6c-203a2e269036.fa0e8ce3-caab-4bd9-a0a9-792644696a8d Apr 29 18:58:15 devstack sudo[87609]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 18:58:16 devstack cinder-volume[84538]: INFO cinder.volume.manager [None req-cdb3c1f1-32db-417d-8295-f99459a72d9e tempest-GroupsTest-154144425 None] Group tempest-Group1-247815244: creating Apr 29 18:58:16 devstack cinder-volume[84538]: INFO cinder.volume.manager [None req-cdb3c1f1-32db-417d-8295-f99459a72d9e tempest-GroupsTest-154144425 None] Group tempest-Group1-247815244: created successfully Apr 29 18:58:16 devstack cinder-volume[84538]: INFO cinder.volume.manager [None req-cdb3c1f1-32db-417d-8295-f99459a72d9e tempest-GroupsTest-154144425 None] Create group completed successfully. Apr 29 18:58:16 devstack sudo[87609]: pam_unix(sudo:session): session closed for user root Apr 29 18:58:16 devstack cinder-volume[84538]: DEBUG oslo_concurrency.processutils [None req-032a4f8a-0f9f-43a1-ae05-2917c37d0c6a tempest-SnapshotsActionsTest-711673579 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-556880c3-9a02-4e53-8a6c-203a2e269036.2dbee080-eb30-4349-9d21-fa64930394ca -F qcow2 /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-556880c3-9a02-4e53-8a6c-203a2e269036.fa0e8ce3-caab-4bd9-a0a9-792644696a8d" returned: 0 in 1.184s {{(pid=84538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 18:58:16 devstack cinder-volume[84538]: WARNING cinder.volume.drivers.remotefs [None req-032a4f8a-0f9f-43a1-ae05-2917c37d0c6a tempest-SnapshotsActionsTest-711673579 None] /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-556880c3-9a02-4e53-8a6c-203a2e269036.fa0e8ce3-caab-4bd9-a0a9-792644696a8d is being set with open permissions: ugo+rw Apr 29 18:58:16 devstack cinder-volume[84538]: DEBUG oslo_concurrency.processutils [None req-032a4f8a-0f9f-43a1-ae05-2917c37d0c6a tempest-SnapshotsActionsTest-711673579 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-556880c3-9a02-4e53-8a6c-203a2e269036.fa0e8ce3-caab-4bd9-a0a9-792644696a8d {{(pid=84538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 18:58:16 devstack sudo[87615]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-556880c3-9a02-4e53-8a6c-203a2e269036.fa0e8ce3-caab-4bd9-a0a9-792644696a8d Apr 29 18:58:16 devstack sudo[87615]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 18:58:17 devstack sudo[87615]: pam_unix(sudo:session): session closed for user root Apr 29 18:58:17 devstack cinder-volume[84538]: DEBUG oslo_concurrency.processutils [None req-032a4f8a-0f9f-43a1-ae05-2917c37d0c6a tempest-SnapshotsActionsTest-711673579 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-556880c3-9a02-4e53-8a6c-203a2e269036.fa0e8ce3-caab-4bd9-a0a9-792644696a8d" returned: 0 in 0.938s {{(pid=84538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 18:58:17 devstack cinder-volume[84538]: DEBUG oslo_concurrency.lockutils [None req-032a4f8a-0f9f-43a1-ae05-2917c37d0c6a tempest-SnapshotsActionsTest-711673579 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.424s {{(pid=84538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 18:58:17 devstack cinder-volume[84538]: INFO cinder.volume.manager [None req-096e657d-a305-42af-845e-d1bf2c5ebeeb tempest-GroupsTest-154144425 None] Group tempest-Group2-1483485681: creating Apr 29 18:58:17 devstack cinder-volume[84538]: INFO cinder.volume.manager [None req-032a4f8a-0f9f-43a1-ae05-2917c37d0c6a tempest-SnapshotsActionsTest-711673579 None] Create snapshot completed successfully Apr 29 18:58:17 devstack cinder-volume[84538]: INFO cinder.volume.manager [None req-096e657d-a305-42af-845e-d1bf2c5ebeeb tempest-GroupsTest-154144425 None] Group tempest-Group2-1483485681: created successfully Apr 29 18:58:17 devstack cinder-volume[84538]: INFO cinder.volume.manager [None req-096e657d-a305-42af-845e-d1bf2c5ebeeb tempest-GroupsTest-154144425 None] Create group completed successfully. Apr 29 18:58:18 devstack cinder-volume[84538]: DEBUG cinder.volume.flows.manager.create_volume [req-bf16baee-6c76-4e52-8515-05ddc420e29e req-2a116e42-652d-482c-8f4e-ec45f386d179 tempest-ServerBootFromVolumeStableRescueTest-1114355649 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84538) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Apr 29 18:58:18 devstack cinder-volume[84538]: DEBUG cinder.volume.manager [req-bf16baee-6c76-4e52-8515-05ddc420e29e req-2a116e42-652d-482c-8f4e-ec45f386d179 tempest-ServerBootFromVolumeStableRescueTest-1114355649 None] Flow 'volume_create_manager' (2e70ea35-3a57-4984-aa3b-ec2cdf288b41) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84538) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 18:58:18 devstack cinder-volume[84538]: DEBUG cinder.volume.manager [req-bf16baee-6c76-4e52-8515-05ddc420e29e req-2a116e42-652d-482c-8f4e-ec45f386d179 tempest-ServerBootFromVolumeStableRescueTest-1114355649 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (28dc8177-fd85-4c6d-a4da-e79ddf38fe1b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 18:58:18 devstack cinder-volume[84538]: DEBUG cinder.volume.manager [req-bf16baee-6c76-4e52-8515-05ddc420e29e req-2a116e42-652d-482c-8f4e-ec45f386d179 tempest-ServerBootFromVolumeStableRescueTest-1114355649 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (28dc8177-fd85-4c6d-a4da-e79ddf38fe1b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-29T16:58:18Z,deleted=False,deleted_at=None,display_description='',display_name='',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1adeda9a-0a54-42f8-b9f8-14806f72b985,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='952a9a1064164a17a985a1b405951979',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T16:58:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T16:58:18Z,use_quota=True,user_id='98e810d72fd94fb0b0d586d7a18415b8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(62b05900-93e3-4190-a88f-1d87324303d1),volume_type_id=62b05900-93e3-4190-a88f-1d87324303d1)' {{(pid=84538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 18:58:18 devstack cinder-volume[84538]: DEBUG cinder.volume.manager [req-bf16baee-6c76-4e52-8515-05ddc420e29e req-2a116e42-652d-482c-8f4e-ec45f386d179 tempest-ServerBootFromVolumeStableRescueTest-1114355649 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (34e3d655-2489-408a-abe2-66a1a89bcb61) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 18:58:18 devstack cinder-volume[84538]: DEBUG cinder.volume.manager [req-bf16baee-6c76-4e52-8515-05ddc420e29e req-2a116e42-652d-482c-8f4e-ec45f386d179 tempest-ServerBootFromVolumeStableRescueTest-1114355649 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (34e3d655-2489-408a-abe2-66a1a89bcb61) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 18:58:18 devstack cinder-volume[84538]: DEBUG cinder.volume.manager [req-bf16baee-6c76-4e52-8515-05ddc420e29e req-2a116e42-652d-482c-8f4e-ec45f386d179 tempest-ServerBootFromVolumeStableRescueTest-1114355649 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bf3637ef-93fc-4fbd-b550-623a9bfc59ad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 18:58:18 devstack cinder-volume[84538]: DEBUG cinder.image.glance [req-bf16baee-6c76-4e52-8515-05ddc420e29e req-2a116e42-652d-482c-8f4e-ec45f386d179 tempest-ServerBootFromVolumeStableRescueTest-1114355649 None] Creating Keystone auth plugin from conf {{(pid=84538) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Apr 29 18:58:19 devstack cinder-volume[84538]: DEBUG cinder.coordination [None req-b0b5a8e9-7e65-4704-b6e8-b6b85d193e74 tempest-SnapshotsActionsTest-2130050802 None] Acquiring lock "cinder-fa0e8ce3-caab-4bd9-a0a9-792644696a8d-delete_snapshot" by "delete_snapshot" {{(pid=84538) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 18:58:19 devstack cinder-volume[84538]: DEBUG cinder.coordination [None req-b0b5a8e9-7e65-4704-b6e8-b6b85d193e74 tempest-SnapshotsActionsTest-2130050802 None] Lock "cinder-fa0e8ce3-caab-4bd9-a0a9-792644696a8d-delete_snapshot" acquired by "delete_snapshot" :: waited 0.030s {{(pid=84538) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 18:58:19 devstack cinder-volume[84538]: DEBUG cinder.coordination [None req-b0b5a8e9-7e65-4704-b6e8-b6b85d193e74 tempest-SnapshotsActionsTest-2130050802 None] Acquiring lock "cinder-quobyte-556880c3-9a02-4e53-8a6c-203a2e269036" by "delete_snapshot" {{(pid=84538) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 18:58:19 devstack cinder-volume[84538]: DEBUG cinder.volume.manager [req-bf16baee-6c76-4e52-8515-05ddc420e29e req-2a116e42-652d-482c-8f4e-ec45f386d179 tempest-ServerBootFromVolumeStableRescueTest-1114355649 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bf3637ef-93fc-4fbd-b550-623a9bfc59ad) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '1adeda9a-0a54-42f8-b9f8-14806f72b985', 'volume_name': 'volume-1adeda9a-0a54-42f8-b9f8-14806f72b985', 'volume_size': 1, 'image_id': '11605644-0a6a-4a0a-b123-c09ab01cd4db', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/11605644-0a6a-4a0a-b123-c09ab01cd4db', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '853afc5ea27148009f8c02d351cf4d80', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '11605644-0a6a-4a0a-b123-c09ab01cd4db', 'created_at': datetime.datetime(2026, 4, 29, 16, 52, 8, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 4, 29, 16, 52, 10, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/11605644-0a6a-4a0a-b123-c09ab01cd4db/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=84538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 18:58:19 devstack cinder-volume[84538]: DEBUG cinder.volume.manager [req-bf16baee-6c76-4e52-8515-05ddc420e29e req-2a116e42-652d-482c-8f4e-ec45f386d179 tempest-ServerBootFromVolumeStableRescueTest-1114355649 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (860562a6-7c30-4225-903f-a6a289768cfb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 18:58:19 devstack cinder-volume[84538]: DEBUG cinder.volume.manager [req-bf16baee-6c76-4e52-8515-05ddc420e29e req-2a116e42-652d-482c-8f4e-ec45f386d179 tempest-ServerBootFromVolumeStableRescueTest-1114355649 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (860562a6-7c30-4225-903f-a6a289768cfb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 18:58:19 devstack cinder-volume[84538]: DEBUG cinder.volume.manager [req-bf16baee-6c76-4e52-8515-05ddc420e29e req-2a116e42-652d-482c-8f4e-ec45f386d179 tempest-ServerBootFromVolumeStableRescueTest-1114355649 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1db37944-a081-4319-935e-aac3abf0e5ef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 18:58:19 devstack cinder-volume[84538]: INFO cinder.volume.flows.manager.create_volume [req-bf16baee-6c76-4e52-8515-05ddc420e29e req-2a116e42-652d-482c-8f4e-ec45f386d179 tempest-ServerBootFromVolumeStableRescueTest-1114355649 None] Volume 1adeda9a-0a54-42f8-b9f8-14806f72b985: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-1adeda9a-0a54-42f8-b9f8-14806f72b985', 'volume_size': 1, 'image_id': '11605644-0a6a-4a0a-b123-c09ab01cd4db', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/11605644-0a6a-4a0a-b123-c09ab01cd4db', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '853afc5ea27148009f8c02d351cf4d80', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '11605644-0a6a-4a0a-b123-c09ab01cd4db', 'created_at': datetime.datetime(2026, 4, 29, 16, 52, 8, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 4, 29, 16, 52, 10, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/11605644-0a6a-4a0a-b123-c09ab01cd4db/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': } Apr 29 18:58:19 devstack cinder-volume[84538]: DEBUG cinder.volume.flows.manager.create_volume [req-bf16baee-6c76-4e52-8515-05ddc420e29e req-2a116e42-652d-482c-8f4e-ec45f386d179 tempest-ServerBootFromVolumeStableRescueTest-1114355649 None] Trying to clone 1adeda9a-0a54-42f8-b9f8-14806f72b985 from image 11605644-0a6a-4a0a-b123-c09ab01cd4db at location (None, [{'url': 'file:///opt/stack/data/glance/images/11605644-0a6a-4a0a-b123-c09ab01cd4db', 'metadata': {}}]). {{(pid=84538) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1082}} Apr 29 18:58:19 devstack cinder-volume[84538]: DEBUG cinder.coordination [None req-b0b5a8e9-7e65-4704-b6e8-b6b85d193e74 tempest-SnapshotsActionsTest-2130050802 None] Lock "cinder-quobyte-556880c3-9a02-4e53-8a6c-203a2e269036" acquired by "delete_snapshot" :: waited 0.074s {{(pid=84538) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 18:58:19 devstack cinder-volume[84538]: DEBUG cinder.coordination [None req-b0b5a8e9-7e65-4704-b6e8-b6b85d193e74 tempest-SnapshotsActionsTest-2130050802 None] Acquiring lock "cinder-quobyte-fa0e8ce3-caab-4bd9-a0a9-792644696a8d" by "_delete_snapshot" {{(pid=84538) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 18:58:19 devstack cinder-volume[84538]: DEBUG cinder.coordination [None req-b0b5a8e9-7e65-4704-b6e8-b6b85d193e74 tempest-SnapshotsActionsTest-2130050802 None] Lock "cinder-quobyte-fa0e8ce3-caab-4bd9-a0a9-792644696a8d" acquired by "_delete_snapshot" :: waited 0.021s {{(pid=84538) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 18:58:19 devstack cinder-volume[84538]: DEBUG cinder.volume.drivers.remotefs [None req-b0b5a8e9-7e65-4704-b6e8-b6b85d193e74 tempest-SnapshotsActionsTest-2130050802 None] Deleting offline snapshot fa0e8ce3-caab-4bd9-a0a9-792644696a8d of volume 556880c3-9a02-4e53-8a6c-203a2e269036 {{(pid=84538) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 29 18:58:19 devstack cinder-volume[84538]: DEBUG cinder.volume.drivers.remotefs [None req-b0b5a8e9-7e65-4704-b6e8-b6b85d193e74 tempest-SnapshotsActionsTest-2130050802 None] snapshot_file for this snap is: volume-556880c3-9a02-4e53-8a6c-203a2e269036.fa0e8ce3-caab-4bd9-a0a9-792644696a8d {{(pid=84538) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 29 18:58:19 devstack cinder-volume[84538]: DEBUG oslo.privsep.daemon [-] privsep: reply[473fa925-d7f1-4892-936a-40ad2b0ca885]: (4, 'qcow2') {{(pid=85803) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 18:58:19 devstack cinder-volume[84538]: DEBUG oslo_concurrency.processutils [None req-b0b5a8e9-7e65-4704-b6e8-b6b85d193e74 tempest-SnapshotsActionsTest-2130050802 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-556880c3-9a02-4e53-8a6c-203a2e269036.fa0e8ce3-caab-4bd9-a0a9-792644696a8d {{(pid=84538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 18:58:19 devstack sudo[87621]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-556880c3-9a02-4e53-8a6c-203a2e269036.fa0e8ce3-caab-4bd9-a0a9-792644696a8d Apr 29 18:58:19 devstack sudo[87621]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 18:58:19 devstack cinder-volume[84538]: DEBUG cinder.image.image_utils [req-bf16baee-6c76-4e52-8515-05ddc420e29e req-2a116e42-652d-482c-8f4e-ec45f386d179 tempest-ServerBootFromVolumeStableRescueTest-1114355649 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_11605644-0a6a-4a0a-b123-c09ab01cd4db_bmt2krhsdevstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=84538) fetch /opt/stack/cinder/cinder/image/image_utils.py:732}} Apr 29 18:58:19 devstack cinder-volume[84538]: INFO cinder.image.image_utils [req-bf16baee-6c76-4e52-8515-05ddc420e29e req-2a116e42-652d-482c-8f4e-ec45f386d179 tempest-ServerBootFromVolumeStableRescueTest-1114355649 None] Image download 20.69 MB at 20.69 MB/s Apr 29 18:58:19 devstack cinder-volume[84538]: DEBUG cinder.volume.flows.manager.create_volume [None req-1dafbc3c-3cbb-40c1-9b33-a762ed21a2bf tempest-GroupsTest-154144425 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84538) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Apr 29 18:58:19 devstack cinder-volume[84538]: DEBUG cinder.volume.manager [None req-1dafbc3c-3cbb-40c1-9b33-a762ed21a2bf tempest-GroupsTest-154144425 None] Flow 'volume_create_manager' (b850fa61-7c3a-4eea-998c-ad77644ccbd9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84538) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 18:58:19 devstack cinder-volume[84538]: DEBUG cinder.volume.manager [None req-1dafbc3c-3cbb-40c1-9b33-a762ed21a2bf tempest-GroupsTest-154144425 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7e28d459-e773-46c0-ba35-2be9aa630da7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 18:58:19 devstack cinder-volume[84538]: DEBUG oslo.privsep.daemon [-] privsep: reply[0730e8f5-1641-4f43-a0fd-d5ab9859f152]: (4, 'qcow2') {{(pid=85803) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 18:58:19 devstack cinder-volume[84538]: DEBUG oslo_concurrency.processutils [req-bf16baee-6c76-4e52-8515-05ddc420e29e req-2a116e42-652d-482c-8f4e-ec45f386d179 tempest-ServerBootFromVolumeStableRescueTest-1114355649 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_11605644-0a6a-4a0a-b123-c09ab01cd4db_bmt2krhsdevstack@QuobyteHD {{(pid=84538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 18:58:19 devstack cinder-volume[84538]: DEBUG cinder.volume.manager [None req-1dafbc3c-3cbb-40c1-9b33-a762ed21a2bf tempest-GroupsTest-154144425 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7e28d459-e773-46c0-ba35-2be9aa630da7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-29T16:58:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-2081102150',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=868c3857-d943-4998-b9e0-4a65b7bd4329,host='devstack@QuobyteHD#QuobyteHD',id=f4f5d6d1-f9b3-428f-94a0-840c2eb2fe41,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9ab3398093534a62b84e4a6c08d37c07',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T16:58:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T16:58:20Z,use_quota=True,user_id='95304710377440ffbc634fb5237aa25b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(af577299-6ead-485c-a4fa-c454cb38b4c0),volume_type_id=af577299-6ead-485c-a4fa-c454cb38b4c0)' {{(pid=84538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 18:58:19 devstack cinder-volume[84538]: DEBUG cinder.volume.manager [None req-1dafbc3c-3cbb-40c1-9b33-a762ed21a2bf tempest-GroupsTest-154144425 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (05a1a9e1-5701-4456-8b54-6ac63c8ad39b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 18:58:19 devstack cinder-volume[84538]: DEBUG cinder.volume.manager [None req-1dafbc3c-3cbb-40c1-9b33-a762ed21a2bf tempest-GroupsTest-154144425 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (05a1a9e1-5701-4456-8b54-6ac63c8ad39b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 18:58:19 devstack cinder-volume[84538]: DEBUG cinder.volume.manager [None req-1dafbc3c-3cbb-40c1-9b33-a762ed21a2bf tempest-GroupsTest-154144425 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bf2d943f-9860-402f-b413-856090c551e3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 18:58:19 devstack cinder-volume[84538]: DEBUG cinder.volume.manager [None req-1dafbc3c-3cbb-40c1-9b33-a762ed21a2bf tempest-GroupsTest-154144425 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bf2d943f-9860-402f-b413-856090c551e3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f4f5d6d1-f9b3-428f-94a0-840c2eb2fe41', 'volume_name': 'volume-f4f5d6d1-f9b3-428f-94a0-840c2eb2fe41', 'volume_size': 1}' {{(pid=84538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 18:58:19 devstack cinder-volume[84538]: DEBUG cinder.volume.manager [None req-1dafbc3c-3cbb-40c1-9b33-a762ed21a2bf tempest-GroupsTest-154144425 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c8d7e211-2970-446b-ada3-7419fbcb3107) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 18:58:19 devstack cinder-volume[84538]: DEBUG cinder.volume.manager [None req-1dafbc3c-3cbb-40c1-9b33-a762ed21a2bf tempest-GroupsTest-154144425 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c8d7e211-2970-446b-ada3-7419fbcb3107) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 18:58:19 devstack cinder-volume[84538]: DEBUG cinder.volume.manager [None req-1dafbc3c-3cbb-40c1-9b33-a762ed21a2bf tempest-GroupsTest-154144425 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (97e1633c-76ea-48d7-8e3d-d8b600ef625e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 18:58:19 devstack cinder-volume[84538]: INFO cinder.volume.flows.manager.create_volume [None req-1dafbc3c-3cbb-40c1-9b33-a762ed21a2bf tempest-GroupsTest-154144425 None] Volume f4f5d6d1-f9b3-428f-94a0-840c2eb2fe41: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f4f5d6d1-f9b3-428f-94a0-840c2eb2fe41', 'volume_size': 1} Apr 29 18:58:19 devstack cinder-volume[84538]: DEBUG oslo_concurrency.lockutils [None req-1dafbc3c-3cbb-40c1-9b33-a762ed21a2bf tempest-GroupsTest-154144425 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 18:58:19 devstack cinder-volume[84538]: DEBUG oslo_concurrency.lockutils [None req-1dafbc3c-3cbb-40c1-9b33-a762ed21a2bf tempest-GroupsTest-154144425 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=84538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 18:58:19 devstack cinder-volume[84538]: DEBUG cinder.volume.drivers.quobyte [None req-1dafbc3c-3cbb-40c1-9b33-a762ed21a2bf tempest-GroupsTest-154144425 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=868c3857-d943-4998-b9e0-4a65b7bd4329,created_at=2026-04-29T16:58:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-2081102150',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=868c3857-d943-4998-b9e0-4a65b7bd4329,host='devstack@QuobyteHD#QuobyteHD',id=f4f5d6d1-f9b3-428f-94a0-840c2eb2fe41,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9ab3398093534a62b84e4a6c08d37c07',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T16:58:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T16:58:20Z,use_quota=True,user_id='95304710377440ffbc634fb5237aa25b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(af577299-6ead-485c-a4fa-c454cb38b4c0),volume_type_id=af577299-6ead-485c-a4fa-c454cb38b4c0)}" {{(pid=84538) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 29 18:58:19 devstack cinder-volume[84538]: DEBUG cinder.volume.drivers.remotefs [None req-1dafbc3c-3cbb-40c1-9b33-a762ed21a2bf tempest-GroupsTest-154144425 None] Creating volume f4f5d6d1-f9b3-428f-94a0-840c2eb2fe41 {{(pid=84538) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 29 18:58:19 devstack cinder-volume[84538]: DEBUG oslo_concurrency.lockutils [None req-1dafbc3c-3cbb-40c1-9b33-a762ed21a2bf tempest-GroupsTest-154144425 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 18:58:19 devstack cinder-volume[84538]: DEBUG oslo_concurrency.lockutils [None req-1dafbc3c-3cbb-40c1-9b33-a762ed21a2bf tempest-GroupsTest-154144425 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 18:58:19 devstack cinder-volume[84538]: DEBUG cinder.volume.drivers.quobyte [None req-1dafbc3c-3cbb-40c1-9b33-a762ed21a2bf tempest-GroupsTest-154144425 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-34312b00-dd6d-45bb-af98-75855cea8e48': None} {{(pid=84538) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 18:58:19 devstack cinder-volume[84538]: DEBUG cinder.volume.drivers.quobyte [None req-1dafbc3c-3cbb-40c1-9b33-a762ed21a2bf tempest-GroupsTest-154144425 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-34312b00-dd6d-45bb-af98-75855cea8e48'] {{(pid=84538) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 18:58:19 devstack cinder-volume[84538]: DEBUG oslo_concurrency.lockutils [None req-1dafbc3c-3cbb-40c1-9b33-a762ed21a2bf tempest-GroupsTest-154144425 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=84538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 18:58:19 devstack cinder-volume[84538]: DEBUG cinder.volume.drivers.quobyte [None req-1dafbc3c-3cbb-40c1-9b33-a762ed21a2bf tempest-GroupsTest-154144425 None] Selected osci02.corp.quobyte.com/cinder-vol-34312b00-dd6d-45bb-af98-75855cea8e48 as target Quobyte volume. {{(pid=84538) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 29 18:58:19 devstack cinder-volume[84538]: INFO cinder.volume.drivers.remotefs [None req-1dafbc3c-3cbb-40c1-9b33-a762ed21a2bf tempest-GroupsTest-154144425 None] casted to osci02.corp.quobyte.com/cinder-vol-34312b00-dd6d-45bb-af98-75855cea8e48 Apr 29 18:58:19 devstack cinder-volume[84538]: DEBUG oslo_concurrency.processutils [None req-1dafbc3c-3cbb-40c1-9b33-a762ed21a2bf tempest-GroupsTest-154144425 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-f4f5d6d1-f9b3-428f-94a0-840c2eb2fe41 1073741824 {{(pid=84538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 18:58:19 devstack sudo[87645]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_11605644-0a6a-4a0a-b123-c09ab01cd4db_bmt2krhsdevstack@QuobyteHD Apr 29 18:58:19 devstack sudo[87645]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 18:58:19 devstack sudo[87646]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-f4f5d6d1-f9b3-428f-94a0-840c2eb2fe41 1073741824 Apr 29 18:58:19 devstack sudo[87646]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 18:58:20 devstack sudo[87621]: pam_unix(sudo:session): session closed for user root Apr 29 18:58:20 devstack cinder-volume[84538]: DEBUG oslo_concurrency.processutils [None req-b0b5a8e9-7e65-4704-b6e8-b6b85d193e74 tempest-SnapshotsActionsTest-2130050802 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-556880c3-9a02-4e53-8a6c-203a2e269036.fa0e8ce3-caab-4bd9-a0a9-792644696a8d" returned: 0 in 1.267s {{(pid=84538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 18:58:20 devstack cinder-volume[84538]: DEBUG cinder.volume.drivers.remotefs [None req-b0b5a8e9-7e65-4704-b6e8-b6b85d193e74 tempest-SnapshotsActionsTest-2130050802 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-556880c3-9a02-4e53-8a6c-203a2e269036(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=84538) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 29 18:58:20 devstack cinder-volume[84538]: DEBUG oslo.privsep.daemon [-] privsep: reply[124b6223-5346-4f7c-8def-83787cdb4609]: (4, 'qcow2') {{(pid=85803) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 18:58:20 devstack cinder-volume[84538]: DEBUG oslo_concurrency.processutils [None req-b0b5a8e9-7e65-4704-b6e8-b6b85d193e74 tempest-SnapshotsActionsTest-2130050802 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-556880c3-9a02-4e53-8a6c-203a2e269036.2dbee080-eb30-4349-9d21-fa64930394ca {{(pid=84538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 18:58:20 devstack sudo[87652]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-556880c3-9a02-4e53-8a6c-203a2e269036.2dbee080-eb30-4349-9d21-fa64930394ca Apr 29 18:58:20 devstack sudo[87652]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 18:58:20 devstack sudo[87645]: pam_unix(sudo:session): session closed for user root Apr 29 18:58:20 devstack cinder-volume[84538]: DEBUG oslo_concurrency.processutils [req-bf16baee-6c76-4e52-8515-05ddc420e29e req-2a116e42-652d-482c-8f4e-ec45f386d179 tempest-ServerBootFromVolumeStableRescueTest-1114355649 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_11605644-0a6a-4a0a-b123-c09ab01cd4db_bmt2krhsdevstack@QuobyteHD" returned: 0 in 0.875s {{(pid=84538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 18:58:20 devstack cinder-volume[84538]: DEBUG cinder.image.image_utils [req-bf16baee-6c76-4e52-8515-05ddc420e29e req-2a116e42-652d-482c-8f4e-ec45f386d179 tempest-ServerBootFromVolumeStableRescueTest-1114355649 None] Temporary image 11605644-0a6a-4a0a-b123-c09ab01cd4db is fetched for user 98e810d72fd94fb0b0d586d7a18415b8. {{(pid=84538) fetch /opt/stack/cinder/cinder/image/image_utils.py:1431}} Apr 29 18:58:20 devstack cinder-volume[84538]: DEBUG oslo.privsep.daemon [-] privsep: reply[1d987946-7e1b-4c85-a05e-58d8ad178c15]: (4, 'qcow2') {{(pid=85803) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 18:58:20 devstack cinder-volume[84538]: DEBUG oslo_concurrency.processutils [req-bf16baee-6c76-4e52-8515-05ddc420e29e req-2a116e42-652d-482c-8f4e-ec45f386d179 tempest-ServerBootFromVolumeStableRescueTest-1114355649 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_11605644-0a6a-4a0a-b123-c09ab01cd4db_bmt2krhsdevstack@QuobyteHD {{(pid=84538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 18:58:21 devstack sudo[87661]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_11605644-0a6a-4a0a-b123-c09ab01cd4db_bmt2krhsdevstack@QuobyteHD Apr 29 18:58:21 devstack sudo[87661]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 18:58:21 devstack sudo[87646]: pam_unix(sudo:session): session closed for user root Apr 29 18:58:21 devstack cinder-volume[84538]: DEBUG oslo_concurrency.processutils [None req-1dafbc3c-3cbb-40c1-9b33-a762ed21a2bf tempest-GroupsTest-154144425 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-f4f5d6d1-f9b3-428f-94a0-840c2eb2fe41 1073741824" returned: 0 in 1.127s {{(pid=84538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 18:58:21 devstack cinder-volume[84538]: DEBUG oslo_concurrency.processutils [None req-1dafbc3c-3cbb-40c1-9b33-a762ed21a2bf tempest-GroupsTest-154144425 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-f4f5d6d1-f9b3-428f-94a0-840c2eb2fe41 {{(pid=84538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 18:58:21 devstack sudo[87663]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-f4f5d6d1-f9b3-428f-94a0-840c2eb2fe41 Apr 29 18:58:21 devstack sudo[87663]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 18:58:21 devstack sudo[87652]: pam_unix(sudo:session): session closed for user root Apr 29 18:58:21 devstack cinder-volume[84538]: DEBUG oslo_concurrency.processutils [None req-b0b5a8e9-7e65-4704-b6e8-b6b85d193e74 tempest-SnapshotsActionsTest-2130050802 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-556880c3-9a02-4e53-8a6c-203a2e269036.2dbee080-eb30-4349-9d21-fa64930394ca" returned: 0 in 1.105s {{(pid=84538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 18:58:21 devstack cinder-volume[84538]: DEBUG cinder.volume.drivers.remotefs [None req-b0b5a8e9-7e65-4704-b6e8-b6b85d193e74 tempest-SnapshotsActionsTest-2130050802 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-556880c3-9a02-4e53-8a6c-203a2e269036(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=84538) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 29 18:58:21 devstack cinder-volume[84538]: DEBUG oslo_concurrency.processutils [None req-b0b5a8e9-7e65-4704-b6e8-b6b85d193e74 tempest-SnapshotsActionsTest-2130050802 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-556880c3-9a02-4e53-8a6c-203a2e269036.fa0e8ce3-caab-4bd9-a0a9-792644696a8d {{(pid=84538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 18:58:21 devstack sudo[87669]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-556880c3-9a02-4e53-8a6c-203a2e269036.fa0e8ce3-caab-4bd9-a0a9-792644696a8d Apr 29 18:58:21 devstack sudo[87669]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 18:58:21 devstack sudo[87661]: pam_unix(sudo:session): session closed for user root Apr 29 18:58:21 devstack cinder-volume[84538]: DEBUG oslo_concurrency.processutils [req-bf16baee-6c76-4e52-8515-05ddc420e29e req-2a116e42-652d-482c-8f4e-ec45f386d179 tempest-ServerBootFromVolumeStableRescueTest-1114355649 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_11605644-0a6a-4a0a-b123-c09ab01cd4db_bmt2krhsdevstack@QuobyteHD" returned: 0 in 0.951s {{(pid=84538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 18:58:21 devstack cinder-volume[84538]: DEBUG oslo_concurrency.lockutils [req-bf16baee-6c76-4e52-8515-05ddc420e29e req-2a116e42-652d-482c-8f4e-ec45f386d179 tempest-ServerBootFromVolumeStableRescueTest-1114355649 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 18:58:22 devstack sudo[87663]: pam_unix(sudo:session): session closed for user root Apr 29 18:58:22 devstack cinder-volume[84538]: DEBUG oslo_concurrency.processutils [None req-1dafbc3c-3cbb-40c1-9b33-a762ed21a2bf tempest-GroupsTest-154144425 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-f4f5d6d1-f9b3-428f-94a0-840c2eb2fe41" returned: 0 in 0.976s {{(pid=84538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 18:58:22 devstack cinder-volume[84538]: DEBUG cinder.volume.drivers.quobyte [None req-1dafbc3c-3cbb-40c1-9b33-a762ed21a2bf tempest-GroupsTest-154144425 None] <== create_volume: return (2160ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-34312b00-dd6d-45bb-af98-75855cea8e48'} {{(pid=84538) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 29 18:58:22 devstack cinder-volume[84538]: DEBUG oslo_concurrency.lockutils [None req-1dafbc3c-3cbb-40c1-9b33-a762ed21a2bf tempest-GroupsTest-154144425 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.164s {{(pid=84538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 18:58:22 devstack cinder-volume[84538]: DEBUG oslo_concurrency.lockutils [req-bf16baee-6c76-4e52-8515-05ddc420e29e req-2a116e42-652d-482c-8f4e-ec45f386d179 tempest-ServerBootFromVolumeStableRescueTest-1114355649 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.305s {{(pid=84538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 18:58:22 devstack cinder-volume[84538]: DEBUG cinder.volume.drivers.quobyte [req-bf16baee-6c76-4e52-8515-05ddc420e29e req-2a116e42-652d-482c-8f4e-ec45f386d179 tempest-ServerBootFromVolumeStableRescueTest-1114355649 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-29T16:58:18Z,deleted=False,deleted_at=None,display_description='',display_name='',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1adeda9a-0a54-42f8-b9f8-14806f72b985,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='952a9a1064164a17a985a1b405951979',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T16:58:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T16:58:18Z,use_quota=True,user_id='98e810d72fd94fb0b0d586d7a18415b8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(62b05900-93e3-4190-a88f-1d87324303d1),volume_type_id=62b05900-93e3-4190-a88f-1d87324303d1)}" {{(pid=84538) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 29 18:58:22 devstack cinder-volume[84538]: DEBUG cinder.volume.drivers.remotefs [req-bf16baee-6c76-4e52-8515-05ddc420e29e req-2a116e42-652d-482c-8f4e-ec45f386d179 tempest-ServerBootFromVolumeStableRescueTest-1114355649 None] Creating volume 1adeda9a-0a54-42f8-b9f8-14806f72b985 {{(pid=84538) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 29 18:58:22 devstack cinder-volume[84538]: DEBUG oslo_concurrency.lockutils [req-bf16baee-6c76-4e52-8515-05ddc420e29e req-2a116e42-652d-482c-8f4e-ec45f386d179 tempest-ServerBootFromVolumeStableRescueTest-1114355649 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 18:58:22 devstack cinder-volume[84538]: DEBUG oslo_concurrency.lockutils [req-bf16baee-6c76-4e52-8515-05ddc420e29e req-2a116e42-652d-482c-8f4e-ec45f386d179 tempest-ServerBootFromVolumeStableRescueTest-1114355649 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 18:58:22 devstack cinder-volume[84538]: DEBUG cinder.volume.drivers.quobyte [req-bf16baee-6c76-4e52-8515-05ddc420e29e req-2a116e42-652d-482c-8f4e-ec45f386d179 tempest-ServerBootFromVolumeStableRescueTest-1114355649 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-34312b00-dd6d-45bb-af98-75855cea8e48': None} {{(pid=84538) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 18:58:22 devstack cinder-volume[84538]: DEBUG cinder.volume.drivers.quobyte [req-bf16baee-6c76-4e52-8515-05ddc420e29e req-2a116e42-652d-482c-8f4e-ec45f386d179 tempest-ServerBootFromVolumeStableRescueTest-1114355649 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-34312b00-dd6d-45bb-af98-75855cea8e48'] {{(pid=84538) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 18:58:22 devstack cinder-volume[84538]: DEBUG oslo_concurrency.lockutils [req-bf16baee-6c76-4e52-8515-05ddc420e29e req-2a116e42-652d-482c-8f4e-ec45f386d179 tempest-ServerBootFromVolumeStableRescueTest-1114355649 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=84538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 18:58:22 devstack cinder-volume[84538]: DEBUG cinder.volume.drivers.quobyte [req-bf16baee-6c76-4e52-8515-05ddc420e29e req-2a116e42-652d-482c-8f4e-ec45f386d179 tempest-ServerBootFromVolumeStableRescueTest-1114355649 None] Selected osci02.corp.quobyte.com/cinder-vol-34312b00-dd6d-45bb-af98-75855cea8e48 as target Quobyte volume. {{(pid=84538) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 29 18:58:22 devstack cinder-volume[84538]: INFO cinder.volume.drivers.remotefs [req-bf16baee-6c76-4e52-8515-05ddc420e29e req-2a116e42-652d-482c-8f4e-ec45f386d179 tempest-ServerBootFromVolumeStableRescueTest-1114355649 None] casted to osci02.corp.quobyte.com/cinder-vol-34312b00-dd6d-45bb-af98-75855cea8e48 Apr 29 18:58:22 devstack cinder-volume[84538]: DEBUG oslo_concurrency.processutils [req-bf16baee-6c76-4e52-8515-05ddc420e29e req-2a116e42-652d-482c-8f4e-ec45f386d179 tempest-ServerBootFromVolumeStableRescueTest-1114355649 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-1adeda9a-0a54-42f8-b9f8-14806f72b985 1073741824 {{(pid=84538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 18:58:22 devstack cinder-volume[84538]: DEBUG cinder.volume.manager [None req-1dafbc3c-3cbb-40c1-9b33-a762ed21a2bf tempest-GroupsTest-154144425 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (97e1633c-76ea-48d7-8e3d-d8b600ef625e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f4f5d6d1-f9b3-428f-94a0-840c2eb2fe41', 'volume_size': 1}' {{(pid=84538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 18:58:22 devstack sudo[87674]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-1adeda9a-0a54-42f8-b9f8-14806f72b985 1073741824 Apr 29 18:58:22 devstack sudo[87674]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 18:58:22 devstack cinder-volume[84538]: DEBUG cinder.volume.manager [None req-1dafbc3c-3cbb-40c1-9b33-a762ed21a2bf tempest-GroupsTest-154144425 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cbafda8d-a28a-4787-bb06-3db7f4b61fce) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 18:58:22 devstack cinder-volume[84538]: INFO cinder.volume.flows.manager.create_volume [None req-1dafbc3c-3cbb-40c1-9b33-a762ed21a2bf tempest-GroupsTest-154144425 None] Volume volume-f4f5d6d1-f9b3-428f-94a0-840c2eb2fe41 (f4f5d6d1-f9b3-428f-94a0-840c2eb2fe41): created successfully Apr 29 18:58:22 devstack cinder-volume[84538]: DEBUG cinder.volume.manager [None req-1dafbc3c-3cbb-40c1-9b33-a762ed21a2bf tempest-GroupsTest-154144425 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cbafda8d-a28a-4787-bb06-3db7f4b61fce) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 18:58:22 devstack cinder-volume[84538]: DEBUG cinder.volume.manager [None req-1dafbc3c-3cbb-40c1-9b33-a762ed21a2bf tempest-GroupsTest-154144425 None] Flow 'volume_create_manager' (b850fa61-7c3a-4eea-998c-ad77644ccbd9) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84538) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 18:58:22 devstack cinder-volume[84538]: INFO cinder.volume.manager [None req-1dafbc3c-3cbb-40c1-9b33-a762ed21a2bf tempest-GroupsTest-154144425 None] Created volume successfully. Apr 29 18:58:22 devstack sudo[87669]: pam_unix(sudo:session): session closed for user root Apr 29 18:58:22 devstack cinder-volume[84538]: DEBUG oslo_concurrency.processutils [None req-b0b5a8e9-7e65-4704-b6e8-b6b85d193e74 tempest-SnapshotsActionsTest-2130050802 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-556880c3-9a02-4e53-8a6c-203a2e269036.fa0e8ce3-caab-4bd9-a0a9-792644696a8d" returned: 0 in 0.907s {{(pid=84538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 18:58:22 devstack cinder-volume[84538]: DEBUG oslo_concurrency.processutils [None req-b0b5a8e9-7e65-4704-b6e8-b6b85d193e74 tempest-SnapshotsActionsTest-2130050802 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-556880c3-9a02-4e53-8a6c-203a2e269036.fa0e8ce3-caab-4bd9-a0a9-792644696a8d {{(pid=84538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 18:58:22 devstack sudo[87680]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-556880c3-9a02-4e53-8a6c-203a2e269036.fa0e8ce3-caab-4bd9-a0a9-792644696a8d Apr 29 18:58:22 devstack sudo[87680]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 18:58:23 devstack cinder-volume[84538]: DEBUG oslo_concurrency.processutils [req-bf16baee-6c76-4e52-8515-05ddc420e29e req-2a116e42-652d-482c-8f4e-ec45f386d179 tempest-ServerBootFromVolumeStableRescueTest-1114355649 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-1adeda9a-0a54-42f8-b9f8-14806f72b985 1073741824" returned: 0 in 0.911s {{(pid=84538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 18:58:23 devstack sudo[87674]: pam_unix(sudo:session): session closed for user root Apr 29 18:58:23 devstack cinder-volume[84538]: DEBUG oslo_concurrency.processutils [req-bf16baee-6c76-4e52-8515-05ddc420e29e req-2a116e42-652d-482c-8f4e-ec45f386d179 tempest-ServerBootFromVolumeStableRescueTest-1114355649 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-1adeda9a-0a54-42f8-b9f8-14806f72b985 {{(pid=84538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 18:58:23 devstack sudo[87686]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-1adeda9a-0a54-42f8-b9f8-14806f72b985 Apr 29 18:58:23 devstack sudo[87686]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 18:58:23 devstack sudo[87680]: pam_unix(sudo:session): session closed for user root Apr 29 18:58:23 devstack cinder-volume[84538]: DEBUG oslo_concurrency.processutils [None req-b0b5a8e9-7e65-4704-b6e8-b6b85d193e74 tempest-SnapshotsActionsTest-2130050802 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-556880c3-9a02-4e53-8a6c-203a2e269036.fa0e8ce3-caab-4bd9-a0a9-792644696a8d" returned: 0 in 0.758s {{(pid=84538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 18:58:23 devstack cinder-volume[84538]: DEBUG cinder.coordination [None req-b0b5a8e9-7e65-4704-b6e8-b6b85d193e74 tempest-SnapshotsActionsTest-2130050802 None] Lock "cinder-quobyte-fa0e8ce3-caab-4bd9-a0a9-792644696a8d" released by "_delete_snapshot" :: held 4.187s {{(pid=84538) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 18:58:23 devstack cinder-volume[84538]: DEBUG cinder.coordination [None req-b0b5a8e9-7e65-4704-b6e8-b6b85d193e74 tempest-SnapshotsActionsTest-2130050802 None] Lock "cinder-quobyte-556880c3-9a02-4e53-8a6c-203a2e269036" released by "delete_snapshot" :: held 4.225s {{(pid=84538) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 18:58:23 devstack cinder-volume[84538]: WARNING cinder.quota [None req-b0b5a8e9-7e65-4704-b6e8-b6b85d193e74 tempest-SnapshotsActionsTest-2130050802 None] Deprecated: Default quota for resource: snapshots_QuobyteHD is set by the default quota flag: quota_snapshots_QuobyteHD, it is now deprecated. Please use the default quota class for default quota. Apr 29 18:58:23 devstack cinder-volume[84538]: DEBUG cinder.quota [None req-b0b5a8e9-7e65-4704-b6e8-b6b85d193e74 tempest-SnapshotsActionsTest-2130050802 None] Created reservations ['832428ac-890e-4ef3-9365-ef260a325a5b', 'b133218c-e65e-40ad-8c6a-8a12f1a1dfa1', 'f1c7863c-c016-4286-a356-7a7e0bccfb20', '49421d9e-b106-4f53-8b8f-367db04d9fba'] {{(pid=84538) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 29 18:58:23 devstack cinder-volume[84538]: INFO cinder.volume.manager [None req-b0b5a8e9-7e65-4704-b6e8-b6b85d193e74 tempest-SnapshotsActionsTest-2130050802 None] Delete snapshot completed successfully. Apr 29 18:58:23 devstack cinder-volume[84538]: DEBUG cinder.coordination [None req-b0b5a8e9-7e65-4704-b6e8-b6b85d193e74 tempest-SnapshotsActionsTest-2130050802 None] Lock "cinder-fa0e8ce3-caab-4bd9-a0a9-792644696a8d-delete_snapshot" released by "delete_snapshot" :: held 4.480s {{(pid=84538) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 18:58:23 devstack cinder-volume[84538]: DEBUG cinder.coordination [None req-bd29ec61-c175-43df-bff0-dcad5443f5ef tempest-GroupsTest-154144425 None] Acquiring lock "cinder-quobyte-f4f5d6d1-f9b3-428f-94a0-840c2eb2fe41" by "delete_volume" {{(pid=84538) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 18:58:23 devstack cinder-volume[84538]: DEBUG cinder.coordination [None req-bd29ec61-c175-43df-bff0-dcad5443f5ef tempest-GroupsTest-154144425 None] Lock "cinder-quobyte-f4f5d6d1-f9b3-428f-94a0-840c2eb2fe41" acquired by "delete_volume" :: waited 0.015s {{(pid=84538) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 18:58:23 devstack cinder-volume[84538]: DEBUG oslo.privsep.daemon [-] privsep: reply[2a8b49e3-d4e3-49d6-8b0c-8c74f6a21926]: (4, 'qcow2') {{(pid=85803) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 18:58:23 devstack cinder-volume[84538]: DEBUG oslo_concurrency.processutils [None req-bd29ec61-c175-43df-bff0-dcad5443f5ef tempest-GroupsTest-154144425 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-f4f5d6d1-f9b3-428f-94a0-840c2eb2fe41 {{(pid=84538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 18:58:23 devstack sudo[87686]: pam_unix(sudo:session): session closed for user root Apr 29 18:58:23 devstack cinder-volume[84538]: DEBUG oslo_concurrency.processutils [req-bf16baee-6c76-4e52-8515-05ddc420e29e req-2a116e42-652d-482c-8f4e-ec45f386d179 tempest-ServerBootFromVolumeStableRescueTest-1114355649 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-1adeda9a-0a54-42f8-b9f8-14806f72b985" returned: 0 in 0.775s {{(pid=84538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 18:58:23 devstack cinder-volume[84538]: DEBUG cinder.volume.drivers.quobyte [req-bf16baee-6c76-4e52-8515-05ddc420e29e req-2a116e42-652d-482c-8f4e-ec45f386d179 tempest-ServerBootFromVolumeStableRescueTest-1114355649 None] <== create_volume: return (1746ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-34312b00-dd6d-45bb-af98-75855cea8e48'} {{(pid=84538) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 29 18:58:23 devstack cinder-volume[84538]: DEBUG oslo_concurrency.lockutils [req-bf16baee-6c76-4e52-8515-05ddc420e29e req-2a116e42-652d-482c-8f4e-ec45f386d179 tempest-ServerBootFromVolumeStableRescueTest-1114355649 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.749s {{(pid=84538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 18:58:23 devstack cinder-volume[84538]: DEBUG cinder.volume.volume_utils [req-bf16baee-6c76-4e52-8515-05ddc420e29e req-2a116e42-652d-482c-8f4e-ec45f386d179 tempest-ServerBootFromVolumeStableRescueTest-1114355649 None] Attempting download of 11605644-0a6a-4a0a-b123-c09ab01cd4db ((None, [{'url': 'file:///opt/stack/data/glance/images/11605644-0a6a-4a0a-b123-c09ab01cd4db', 'metadata': {}}])) to volume 1adeda9a-0a54-42f8-b9f8-14806f72b985. {{(pid=84538) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1189}} Apr 29 18:58:23 devstack cinder-volume[84538]: DEBUG oslo.privsep.daemon [-] privsep: reply[15f8e303-83b7-40ab-b7ab-49deb2e3da4e]: (4, 'raw') {{(pid=85803) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 18:58:23 devstack cinder-volume[84538]: DEBUG oslo_concurrency.processutils [req-bf16baee-6c76-4e52-8515-05ddc420e29e req-2a116e42-652d-482c-8f4e-ec45f386d179 tempest-ServerBootFromVolumeStableRescueTest-1114355649 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_11605644-0a6a-4a0a-b123-c09ab01cd4db_su3gkul1 {{(pid=84538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 18:58:23 devstack sudo[87690]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-f4f5d6d1-f9b3-428f-94a0-840c2eb2fe41 Apr 29 18:58:23 devstack sudo[87690]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 18:58:24 devstack sudo[87691]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_11605644-0a6a-4a0a-b123-c09ab01cd4db_su3gkul1 Apr 29 18:58:24 devstack sudo[87691]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 18:58:24 devstack sudo[87690]: pam_unix(sudo:session): session closed for user root Apr 29 18:58:24 devstack cinder-volume[84538]: DEBUG oslo_concurrency.processutils [None req-bd29ec61-c175-43df-bff0-dcad5443f5ef tempest-GroupsTest-154144425 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-f4f5d6d1-f9b3-428f-94a0-840c2eb2fe41" returned: 0 in 0.797s {{(pid=84538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 18:58:24 devstack cinder-volume[84538]: DEBUG oslo_concurrency.processutils [None req-bd29ec61-c175-43df-bff0-dcad5443f5ef tempest-GroupsTest-154144425 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-f4f5d6d1-f9b3-428f-94a0-840c2eb2fe41 {{(pid=84538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 18:58:24 devstack sudo[87698]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-f4f5d6d1-f9b3-428f-94a0-840c2eb2fe41 Apr 29 18:58:24 devstack sudo[87698]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 18:58:24 devstack cinder-volume[84538]: DEBUG oslo_concurrency.lockutils [None req-7bd1987f-d666-4e1e-b22f-e68427c62582 tempest-SnapshotsActionsTest-711673579 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=84538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 18:58:24 devstack cinder-volume[84538]: DEBUG oslo_concurrency.lockutils [None req-7bd1987f-d666-4e1e-b22f-e68427c62582 tempest-SnapshotsActionsTest-711673579 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.002s {{(pid=84538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 18:58:24 devstack sudo[87691]: pam_unix(sudo:session): session closed for user root Apr 29 18:58:24 devstack cinder-volume[84538]: DEBUG oslo_concurrency.processutils [req-bf16baee-6c76-4e52-8515-05ddc420e29e req-2a116e42-652d-482c-8f4e-ec45f386d179 tempest-ServerBootFromVolumeStableRescueTest-1114355649 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_11605644-0a6a-4a0a-b123-c09ab01cd4db_su3gkul1" returned: 0 in 0.830s {{(pid=84538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 18:58:24 devstack cinder-volume[84538]: DEBUG oslo_concurrency.processutils [req-bf16baee-6c76-4e52-8515-05ddc420e29e req-2a116e42-652d-482c-8f4e-ec45f386d179 tempest-ServerBootFromVolumeStableRescueTest-1114355649 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_11605644-0a6a-4a0a-b123-c09ab01cd4db_su3gkul1 {{(pid=84538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 18:58:24 devstack cinder-volume[84538]: DEBUG cinder.volume.drivers.remotefs [None req-7bd1987f-d666-4e1e-b22f-e68427c62582 tempest-SnapshotsActionsTest-711673579 None] Creating offline snapshot f0d1074c-6c31-4850-a6f5-bd604b31f83b of volume 556880c3-9a02-4e53-8a6c-203a2e269036 {{(pid=84538) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}} Apr 29 18:58:24 devstack cinder-volume[84538]: DEBUG oslo.privsep.daemon [-] privsep: reply[2467ad84-90b5-4a69-b6d0-eba1d5b20749]: (4, 'qcow2') {{(pid=85803) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 18:58:24 devstack cinder-volume[84538]: DEBUG oslo_concurrency.processutils [None req-7bd1987f-d666-4e1e-b22f-e68427c62582 tempest-SnapshotsActionsTest-711673579 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-556880c3-9a02-4e53-8a6c-203a2e269036.2dbee080-eb30-4349-9d21-fa64930394ca {{(pid=84538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 18:58:24 devstack sudo[87701]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_11605644-0a6a-4a0a-b123-c09ab01cd4db_su3gkul1 Apr 29 18:58:24 devstack sudo[87701]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 18:58:24 devstack sudo[87702]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-556880c3-9a02-4e53-8a6c-203a2e269036.2dbee080-eb30-4349-9d21-fa64930394ca Apr 29 18:58:24 devstack sudo[87702]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 18:58:25 devstack cinder-volume[84538]: DEBUG oslo_service.periodic_task [None req-a93183a6-1080-461c-84de-2fcb210d4f60 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=84538) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}} Apr 29 18:58:25 devstack cinder-volume[84538]: DEBUG oslo_concurrency.lockutils [None req-a93183a6-1080-461c-84de-2fcb210d4f60 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 18:58:25 devstack cinder-volume[84538]: DEBUG oslo_concurrency.lockutils [None req-a93183a6-1080-461c-84de-2fcb210d4f60 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 18:58:25 devstack cinder-volume[84538]: DEBUG cinder.volume.drivers.quobyte [None req-a93183a6-1080-461c-84de-2fcb210d4f60 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-34312b00-dd6d-45bb-af98-75855cea8e48': None} {{(pid=84538) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 18:58:25 devstack cinder-volume[84538]: DEBUG cinder.volume.drivers.quobyte [None req-a93183a6-1080-461c-84de-2fcb210d4f60 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-34312b00-dd6d-45bb-af98-75855cea8e48'] {{(pid=84538) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 18:58:25 devstack cinder-volume[84538]: DEBUG oslo_concurrency.lockutils [None req-a93183a6-1080-461c-84de-2fcb210d4f60 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=84538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 18:58:25 devstack cinder-volume[84538]: DEBUG oslo_concurrency.processutils [None req-a93183a6-1080-461c-84de-2fcb210d4f60 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d {{(pid=84538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 18:58:25 devstack sudo[87705]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d Apr 29 18:58:25 devstack sudo[87705]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 18:58:25 devstack sudo[87698]: pam_unix(sudo:session): session closed for user root Apr 29 18:58:25 devstack cinder-volume[84538]: DEBUG oslo_concurrency.processutils [None req-bd29ec61-c175-43df-bff0-dcad5443f5ef tempest-GroupsTest-154144425 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-f4f5d6d1-f9b3-428f-94a0-840c2eb2fe41" returned: 0 in 0.874s {{(pid=84538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 18:58:25 devstack cinder-volume[84538]: DEBUG cinder.coordination [None req-bd29ec61-c175-43df-bff0-dcad5443f5ef tempest-GroupsTest-154144425 None] Lock "cinder-quobyte-f4f5d6d1-f9b3-428f-94a0-840c2eb2fe41" released by "delete_volume" :: held 1.738s {{(pid=84538) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 18:58:25 devstack cinder-volume[84538]: DEBUG cinder.quota [None req-bd29ec61-c175-43df-bff0-dcad5443f5ef tempest-GroupsTest-154144425 None] Created reservations ['9c2f5ad1-4ce1-4b23-b7dd-2fcde692e6ee'] {{(pid=84538) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 29 18:58:25 devstack cinder-volume[84538]: WARNING cinder.quota [None req-bd29ec61-c175-43df-bff0-dcad5443f5ef tempest-GroupsTest-154144425 None] Deprecated: Default quota for resource: volumes_tempest-GroupsTest-volume-type-16171181 is set by the default quota flag: quota_volumes_tempest-GroupsTest-volume-type-16171181, it is now deprecated. Please use the default quota class for default quota. Apr 29 18:58:25 devstack cinder-volume[84538]: WARNING cinder.quota [None req-bd29ec61-c175-43df-bff0-dcad5443f5ef tempest-GroupsTest-154144425 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupsTest-volume-type-16171181 is set by the default quota flag: quota_gigabytes_tempest-GroupsTest-volume-type-16171181, it is now deprecated. Please use the default quota class for default quota. Apr 29 18:58:25 devstack cinder-volume[84538]: DEBUG cinder.quota [None req-bd29ec61-c175-43df-bff0-dcad5443f5ef tempest-GroupsTest-154144425 None] Created reservations ['2f65dfb6-4a23-4c0a-8f94-eb795c149bb1', '35933b1f-8821-4086-842a-0f28efcb621b', '4a427cd8-97b4-4221-b027-b68d6f91a2a7', '2fcc45b2-a007-46d7-9d6a-86d313bc4cf6'] {{(pid=84538) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 29 18:58:25 devstack sudo[87701]: pam_unix(sudo:session): session closed for user root Apr 29 18:58:25 devstack cinder-volume[84538]: DEBUG oslo_concurrency.processutils [req-bf16baee-6c76-4e52-8515-05ddc420e29e req-2a116e42-652d-482c-8f4e-ec45f386d179 tempest-ServerBootFromVolumeStableRescueTest-1114355649 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_11605644-0a6a-4a0a-b123-c09ab01cd4db_su3gkul1" returned: 1 in 1.075s {{(pid=84538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 18:58:25 devstack cinder-volume[84538]: DEBUG oslo_concurrency.processutils [req-bf16baee-6c76-4e52-8515-05ddc420e29e req-2a116e42-652d-482c-8f4e-ec45f386d179 tempest-ServerBootFromVolumeStableRescueTest-1114355649 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_11605644-0a6a-4a0a-b123-c09ab01cd4db_su3gkul1' failed. Not Retrying. {{(pid=84538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Apr 29 18:58:25 devstack cinder-volume[84538]: DEBUG oslo.privsep.daemon [-] privsep: reply[e2433018-2404-4055-b4a8-612f246c219b]: (4, 'qcow2') {{(pid=85803) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 18:58:25 devstack cinder-volume[84538]: DEBUG oslo_concurrency.processutils [req-bf16baee-6c76-4e52-8515-05ddc420e29e req-2a116e42-652d-482c-8f4e-ec45f386d179 tempest-ServerBootFromVolumeStableRescueTest-1114355649 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_11605644-0a6a-4a0a-b123-c09ab01cd4db_bmt2krhsdevstack@QuobyteHD {{(pid=84538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 18:58:25 devstack cinder-volume[84538]: DEBUG oslo_concurrency.lockutils [None req-bd29ec61-c175-43df-bff0-dcad5443f5ef tempest-GroupsTest-154144425 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 18:58:25 devstack cinder-volume[84538]: DEBUG oslo_concurrency.lockutils [None req-bd29ec61-c175-43df-bff0-dcad5443f5ef tempest-GroupsTest-154144425 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 18:58:25 devstack cinder-volume[84538]: DEBUG cinder.volume.drivers.quobyte [None req-bd29ec61-c175-43df-bff0-dcad5443f5ef tempest-GroupsTest-154144425 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-34312b00-dd6d-45bb-af98-75855cea8e48': None} {{(pid=84538) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 18:58:25 devstack cinder-volume[84538]: DEBUG cinder.volume.drivers.quobyte [None req-bd29ec61-c175-43df-bff0-dcad5443f5ef tempest-GroupsTest-154144425 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-34312b00-dd6d-45bb-af98-75855cea8e48'] {{(pid=84538) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 18:58:25 devstack cinder-volume[84538]: DEBUG oslo_concurrency.lockutils [None req-bd29ec61-c175-43df-bff0-dcad5443f5ef tempest-GroupsTest-154144425 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=84538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 18:58:25 devstack cinder-volume[84538]: DEBUG oslo_concurrency.processutils [None req-bd29ec61-c175-43df-bff0-dcad5443f5ef tempest-GroupsTest-154144425 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d {{(pid=84538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 18:58:26 devstack sudo[87715]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d Apr 29 18:58:26 devstack sudo[87715]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 18:58:26 devstack sudo[87705]: pam_unix(sudo:session): session closed for user root Apr 29 18:58:26 devstack cinder-volume[84538]: DEBUG oslo_concurrency.processutils [None req-a93183a6-1080-461c-84de-2fcb210d4f60 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d" returned: 0 in 0.956s {{(pid=84538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 18:58:26 devstack cinder-volume[84538]: DEBUG cinder.manager [None req-a93183a6-1080-461c-84de-2fcb210d4f60 None None] Notifying Schedulers of capabilities ... {{(pid=84538) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 29 18:58:26 devstack sudo[87710]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_11605644-0a6a-4a0a-b123-c09ab01cd4db_bmt2krhsdevstack@QuobyteHD Apr 29 18:58:26 devstack sudo[87710]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 18:58:26 devstack sudo[87702]: pam_unix(sudo:session): session closed for user root Apr 29 18:58:26 devstack cinder-volume[84538]: DEBUG oslo_concurrency.processutils [None req-7bd1987f-d666-4e1e-b22f-e68427c62582 tempest-SnapshotsActionsTest-711673579 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-556880c3-9a02-4e53-8a6c-203a2e269036.2dbee080-eb30-4349-9d21-fa64930394ca" returned: 0 in 1.419s {{(pid=84538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 18:58:26 devstack cinder-volume[84538]: DEBUG cinder.volume.drivers.remotefs [None req-7bd1987f-d666-4e1e-b22f-e68427c62582 tempest-SnapshotsActionsTest-711673579 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-556880c3-9a02-4e53-8a6c-203a2e269036(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=84538) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 29 18:58:26 devstack cinder-volume[84538]: DEBUG oslo_concurrency.processutils [None req-7bd1987f-d666-4e1e-b22f-e68427c62582 tempest-SnapshotsActionsTest-711673579 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-556880c3-9a02-4e53-8a6c-203a2e269036.2dbee080-eb30-4349-9d21-fa64930394ca,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-556880c3-9a02-4e53-8a6c-203a2e269036.f0d1074c-6c31-4850-a6f5-bd604b31f83b 1G {{(pid=84538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 18:58:26 devstack sudo[87718]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-556880c3-9a02-4e53-8a6c-203a2e269036.2dbee080-eb30-4349-9d21-fa64930394ca,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-556880c3-9a02-4e53-8a6c-203a2e269036.f0d1074c-6c31-4850-a6f5-bd604b31f83b 1G Apr 29 18:58:26 devstack sudo[87718]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 18:58:26 devstack cinder-volume[84538]: DEBUG cinder.quota [None req-ad09a646-e610-4aa6-a3a7-e20f938e4748 tempest-GroupsTest-154144425 None] Created reservations ['0bd86609-2263-478d-a9e3-691ca65fd090'] {{(pid=84538) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 29 18:58:26 devstack cinder-volume[84538]: DEBUG oslo_concurrency.lockutils [None req-ad09a646-e610-4aa6-a3a7-e20f938e4748 tempest-GroupsTest-154144425 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 18:58:26 devstack cinder-volume[84538]: DEBUG oslo_concurrency.lockutils [None req-ad09a646-e610-4aa6-a3a7-e20f938e4748 tempest-GroupsTest-154144425 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 18:58:26 devstack cinder-volume[84538]: DEBUG cinder.volume.drivers.quobyte [None req-ad09a646-e610-4aa6-a3a7-e20f938e4748 tempest-GroupsTest-154144425 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-34312b00-dd6d-45bb-af98-75855cea8e48': None} {{(pid=84538) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 18:58:26 devstack cinder-volume[84538]: DEBUG cinder.volume.drivers.quobyte [None req-ad09a646-e610-4aa6-a3a7-e20f938e4748 tempest-GroupsTest-154144425 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-34312b00-dd6d-45bb-af98-75855cea8e48'] {{(pid=84538) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 18:58:26 devstack cinder-volume[84538]: DEBUG oslo_concurrency.lockutils [None req-ad09a646-e610-4aa6-a3a7-e20f938e4748 tempest-GroupsTest-154144425 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.020s {{(pid=84538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 18:58:26 devstack cinder-volume[84538]: DEBUG oslo_concurrency.processutils [None req-ad09a646-e610-4aa6-a3a7-e20f938e4748 tempest-GroupsTest-154144425 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d {{(pid=84538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 18:58:26 devstack sudo[87720]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d Apr 29 18:58:26 devstack sudo[87720]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 18:58:26 devstack sudo[87715]: pam_unix(sudo:session): session closed for user root Apr 29 18:58:26 devstack cinder-volume[84538]: DEBUG oslo_concurrency.processutils [None req-bd29ec61-c175-43df-bff0-dcad5443f5ef tempest-GroupsTest-154144425 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d" returned: 0 in 0.938s {{(pid=84538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 18:58:26 devstack cinder-volume[84538]: DEBUG cinder.manager [None req-bd29ec61-c175-43df-bff0-dcad5443f5ef tempest-GroupsTest-154144425 None] Notifying Schedulers of capabilities ... {{(pid=84538) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 29 18:58:26 devstack cinder-volume[84538]: INFO cinder.volume.manager [None req-bd29ec61-c175-43df-bff0-dcad5443f5ef tempest-GroupsTest-154144425 None] Delete group completed successfully. Apr 29 18:58:27 devstack sudo[87710]: pam_unix(sudo:session): session closed for user root Apr 29 18:58:27 devstack cinder-volume[84538]: DEBUG oslo_concurrency.processutils [req-bf16baee-6c76-4e52-8515-05ddc420e29e req-2a116e42-652d-482c-8f4e-ec45f386d179 tempest-ServerBootFromVolumeStableRescueTest-1114355649 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_11605644-0a6a-4a0a-b123-c09ab01cd4db_bmt2krhsdevstack@QuobyteHD" returned: 0 in 1.348s {{(pid=84538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 18:58:27 devstack cinder-volume[84538]: DEBUG cinder.image.image_utils [req-bf16baee-6c76-4e52-8515-05ddc420e29e req-2a116e42-652d-482c-8f4e-ec45f386d179 tempest-ServerBootFromVolumeStableRescueTest-1114355649 None] 11605644-0a6a-4a0a-b123-c09ab01cd4db was qcow2, converting to raw {{(pid=84538) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1120}} Apr 29 18:58:27 devstack cinder-volume[84538]: DEBUG oslo_concurrency.processutils [req-bf16baee-6c76-4e52-8515-05ddc420e29e req-2a116e42-652d-482c-8f4e-ec45f386d179 tempest-ServerBootFromVolumeStableRescueTest-1114355649 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_11605644-0a6a-4a0a-b123-c09ab01cd4db_bmt2krhsdevstack@QuobyteHD /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-1adeda9a-0a54-42f8-b9f8-14806f72b985 {{(pid=84538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 18:58:27 devstack sudo[87732]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_11605644-0a6a-4a0a-b123-c09ab01cd4db_bmt2krhsdevstack@QuobyteHD /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-1adeda9a-0a54-42f8-b9f8-14806f72b985 Apr 29 18:58:27 devstack sudo[87732]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 18:58:27 devstack sudo[87720]: pam_unix(sudo:session): session closed for user root Apr 29 18:58:27 devstack cinder-volume[84538]: DEBUG oslo_concurrency.processutils [None req-ad09a646-e610-4aa6-a3a7-e20f938e4748 tempest-GroupsTest-154144425 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d" returned: 0 in 0.852s {{(pid=84538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 18:58:27 devstack cinder-volume[84538]: DEBUG cinder.manager [None req-ad09a646-e610-4aa6-a3a7-e20f938e4748 tempest-GroupsTest-154144425 None] Notifying Schedulers of capabilities ... {{(pid=84538) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 29 18:58:27 devstack cinder-volume[84538]: INFO cinder.volume.manager [None req-ad09a646-e610-4aa6-a3a7-e20f938e4748 tempest-GroupsTest-154144425 None] Delete group completed successfully. Apr 29 18:58:27 devstack sudo[87718]: pam_unix(sudo:session): session closed for user root Apr 29 18:58:27 devstack cinder-volume[84538]: DEBUG oslo_concurrency.processutils [None req-7bd1987f-d666-4e1e-b22f-e68427c62582 tempest-SnapshotsActionsTest-711673579 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-556880c3-9a02-4e53-8a6c-203a2e269036.2dbee080-eb30-4349-9d21-fa64930394ca,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-556880c3-9a02-4e53-8a6c-203a2e269036.f0d1074c-6c31-4850-a6f5-bd604b31f83b 1G" returned: 0 in 1.219s {{(pid=84538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 18:58:27 devstack cinder-volume[84538]: DEBUG oslo_concurrency.processutils [None req-7bd1987f-d666-4e1e-b22f-e68427c62582 tempest-SnapshotsActionsTest-711673579 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-556880c3-9a02-4e53-8a6c-203a2e269036.2dbee080-eb30-4349-9d21-fa64930394ca -F qcow2 /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-556880c3-9a02-4e53-8a6c-203a2e269036.f0d1074c-6c31-4850-a6f5-bd604b31f83b {{(pid=84538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 18:58:27 devstack sudo[87735]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-556880c3-9a02-4e53-8a6c-203a2e269036.2dbee080-eb30-4349-9d21-fa64930394ca -F qcow2 /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-556880c3-9a02-4e53-8a6c-203a2e269036.f0d1074c-6c31-4850-a6f5-bd604b31f83b Apr 29 18:58:27 devstack sudo[87735]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 18:58:28 devstack cinder-volume[84538]: INFO cinder.volume.manager [None req-5f15937b-c45f-4f74-93d2-12c28925ecaa tempest-GroupsTest-154144425 None] Group tempest-GroupsTest-Group-437706586: creating Apr 29 18:58:28 devstack cinder-volume[84538]: INFO cinder.volume.manager [None req-5f15937b-c45f-4f74-93d2-12c28925ecaa tempest-GroupsTest-154144425 None] Group tempest-GroupsTest-Group-437706586: created successfully Apr 29 18:58:28 devstack cinder-volume[84538]: INFO cinder.volume.manager [None req-5f15937b-c45f-4f74-93d2-12c28925ecaa tempest-GroupsTest-154144425 None] Create group completed successfully. Apr 29 18:58:28 devstack sudo[87735]: pam_unix(sudo:session): session closed for user root Apr 29 18:58:28 devstack cinder-volume[84538]: DEBUG oslo_concurrency.processutils [None req-7bd1987f-d666-4e1e-b22f-e68427c62582 tempest-SnapshotsActionsTest-711673579 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-556880c3-9a02-4e53-8a6c-203a2e269036.2dbee080-eb30-4349-9d21-fa64930394ca -F qcow2 /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-556880c3-9a02-4e53-8a6c-203a2e269036.f0d1074c-6c31-4850-a6f5-bd604b31f83b" returned: 0 in 1.058s {{(pid=84538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 18:58:28 devstack cinder-volume[84538]: WARNING cinder.volume.drivers.remotefs [None req-7bd1987f-d666-4e1e-b22f-e68427c62582 tempest-SnapshotsActionsTest-711673579 None] /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-556880c3-9a02-4e53-8a6c-203a2e269036.f0d1074c-6c31-4850-a6f5-bd604b31f83b is being set with open permissions: ugo+rw Apr 29 18:58:28 devstack cinder-volume[84538]: DEBUG oslo_concurrency.processutils [None req-7bd1987f-d666-4e1e-b22f-e68427c62582 tempest-SnapshotsActionsTest-711673579 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-556880c3-9a02-4e53-8a6c-203a2e269036.f0d1074c-6c31-4850-a6f5-bd604b31f83b {{(pid=84538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 18:58:28 devstack sudo[87765]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-556880c3-9a02-4e53-8a6c-203a2e269036.f0d1074c-6c31-4850-a6f5-bd604b31f83b Apr 29 18:58:28 devstack sudo[87765]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 18:58:29 devstack sudo[87765]: pam_unix(sudo:session): session closed for user root Apr 29 18:58:29 devstack cinder-volume[84538]: DEBUG oslo_concurrency.processutils [None req-7bd1987f-d666-4e1e-b22f-e68427c62582 tempest-SnapshotsActionsTest-711673579 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-556880c3-9a02-4e53-8a6c-203a2e269036.f0d1074c-6c31-4850-a6f5-bd604b31f83b" returned: 0 in 0.784s {{(pid=84538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 18:58:29 devstack cinder-volume[84538]: DEBUG oslo_concurrency.lockutils [None req-7bd1987f-d666-4e1e-b22f-e68427c62582 tempest-SnapshotsActionsTest-711673579 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.625s {{(pid=84538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 18:58:29 devstack cinder-volume[84538]: INFO cinder.volume.manager [None req-7bd1987f-d666-4e1e-b22f-e68427c62582 tempest-SnapshotsActionsTest-711673579 None] Create snapshot completed successfully Apr 29 18:58:29 devstack sudo[87732]: pam_unix(sudo:session): session closed for user root Apr 29 18:58:29 devstack cinder-volume[84538]: DEBUG oslo_concurrency.processutils [req-bf16baee-6c76-4e52-8515-05ddc420e29e req-2a116e42-652d-482c-8f4e-ec45f386d179 tempest-ServerBootFromVolumeStableRescueTest-1114355649 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_11605644-0a6a-4a0a-b123-c09ab01cd4db_bmt2krhsdevstack@QuobyteHD /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-1adeda9a-0a54-42f8-b9f8-14806f72b985" returned: 0 in 2.623s {{(pid=84538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 18:58:29 devstack cinder-volume[84538]: DEBUG cinder.image.image_utils [req-bf16baee-6c76-4e52-8515-05ddc420e29e req-2a116e42-652d-482c-8f4e-ec45f386d179 tempest-ServerBootFromVolumeStableRescueTest-1114355649 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_11605644-0a6a-4a0a-b123-c09ab01cd4db_bmt2krhsdevstack@QuobyteHD, size 112.00 MB, duration 2.62 sec, destination /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-1adeda9a-0a54-42f8-b9f8-14806f72b985 {{(pid=84538) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}} Apr 29 18:58:29 devstack cinder-volume[84538]: INFO cinder.image.image_utils [req-bf16baee-6c76-4e52-8515-05ddc420e29e req-2a116e42-652d-482c-8f4e-ec45f386d179 tempest-ServerBootFromVolumeStableRescueTest-1114355649 None] Converted 112.00 MB image at 42.68 MB/s Apr 29 18:58:29 devstack cinder-volume[84538]: DEBUG oslo_concurrency.processutils [req-bf16baee-6c76-4e52-8515-05ddc420e29e req-2a116e42-652d-482c-8f4e-ec45f386d179 tempest-ServerBootFromVolumeStableRescueTest-1114355649 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-1adeda9a-0a54-42f8-b9f8-14806f72b985 1G {{(pid=84538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 18:58:29 devstack sudo[87769]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-1adeda9a-0a54-42f8-b9f8-14806f72b985 1G Apr 29 18:58:29 devstack sudo[87769]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 18:58:30 devstack cinder-volume[84538]: DEBUG cinder.volume.flows.manager.create_volume [None req-48656dda-4875-46bc-9a5b-3f86a7d762f7 tempest-GroupsTest-154144425 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84538) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Apr 29 18:58:30 devstack cinder-volume[84538]: DEBUG cinder.volume.manager [None req-48656dda-4875-46bc-9a5b-3f86a7d762f7 tempest-GroupsTest-154144425 None] Flow 'volume_create_manager' (6003ef5f-294e-4008-9fd6-9d5093c1040a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84538) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 18:58:30 devstack cinder-volume[84538]: DEBUG cinder.volume.manager [None req-48656dda-4875-46bc-9a5b-3f86a7d762f7 tempest-GroupsTest-154144425 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (688bed4c-4b47-4012-bb5f-67e4bd92f9d8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 18:58:30 devstack cinder-volume[84538]: DEBUG cinder.volume.manager [None req-48656dda-4875-46bc-9a5b-3f86a7d762f7 tempest-GroupsTest-154144425 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (688bed4c-4b47-4012-bb5f-67e4bd92f9d8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-29T16:58:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-295540321',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=4908f73e-1ccc-4817-884a-cd7ff6542cb1,host='devstack@QuobyteHD#QuobyteHD',id=4bd48426-52eb-4b1a-be0f-3571cc0c9c92,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9ab3398093534a62b84e4a6c08d37c07',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T16:58:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T16:58:30Z,use_quota=True,user_id='95304710377440ffbc634fb5237aa25b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(feedd468-7042-4c3d-b5a2-4d5f4fc2db34),volume_type_id=feedd468-7042-4c3d-b5a2-4d5f4fc2db34)' {{(pid=84538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 18:58:30 devstack cinder-volume[84538]: DEBUG cinder.volume.manager [None req-48656dda-4875-46bc-9a5b-3f86a7d762f7 tempest-GroupsTest-154144425 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b41de019-0267-413f-a22d-68b76414e03f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 18:58:30 devstack cinder-volume[84538]: DEBUG cinder.volume.manager [None req-48656dda-4875-46bc-9a5b-3f86a7d762f7 tempest-GroupsTest-154144425 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b41de019-0267-413f-a22d-68b76414e03f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 18:58:30 devstack cinder-volume[84538]: DEBUG cinder.volume.manager [None req-48656dda-4875-46bc-9a5b-3f86a7d762f7 tempest-GroupsTest-154144425 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c2589195-4f68-4477-9f88-59c4668756d9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 18:58:30 devstack cinder-volume[84538]: DEBUG cinder.volume.manager [None req-48656dda-4875-46bc-9a5b-3f86a7d762f7 tempest-GroupsTest-154144425 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c2589195-4f68-4477-9f88-59c4668756d9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4bd48426-52eb-4b1a-be0f-3571cc0c9c92', 'volume_name': 'volume-4bd48426-52eb-4b1a-be0f-3571cc0c9c92', 'volume_size': 1}' {{(pid=84538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 18:58:30 devstack cinder-volume[84538]: DEBUG cinder.volume.manager [None req-48656dda-4875-46bc-9a5b-3f86a7d762f7 tempest-GroupsTest-154144425 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f8b725e0-cb47-49b8-8410-68ac3888b6a1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 18:58:30 devstack cinder-volume[84538]: DEBUG cinder.volume.manager [None req-48656dda-4875-46bc-9a5b-3f86a7d762f7 tempest-GroupsTest-154144425 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f8b725e0-cb47-49b8-8410-68ac3888b6a1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 18:58:30 devstack cinder-volume[84538]: DEBUG cinder.volume.manager [None req-48656dda-4875-46bc-9a5b-3f86a7d762f7 tempest-GroupsTest-154144425 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6f8c082d-2de5-40c5-a17f-4f196e12ad67) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 18:58:30 devstack cinder-volume[84538]: INFO cinder.volume.flows.manager.create_volume [None req-48656dda-4875-46bc-9a5b-3f86a7d762f7 tempest-GroupsTest-154144425 None] Volume 4bd48426-52eb-4b1a-be0f-3571cc0c9c92: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4bd48426-52eb-4b1a-be0f-3571cc0c9c92', 'volume_size': 1} Apr 29 18:58:30 devstack cinder-volume[84538]: DEBUG oslo_concurrency.lockutils [None req-48656dda-4875-46bc-9a5b-3f86a7d762f7 tempest-GroupsTest-154144425 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 18:58:30 devstack cinder-volume[84538]: DEBUG oslo_concurrency.lockutils [None req-48656dda-4875-46bc-9a5b-3f86a7d762f7 tempest-GroupsTest-154144425 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=84538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 18:58:30 devstack cinder-volume[84538]: DEBUG cinder.volume.drivers.quobyte [None req-48656dda-4875-46bc-9a5b-3f86a7d762f7 tempest-GroupsTest-154144425 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=4908f73e-1ccc-4817-884a-cd7ff6542cb1,created_at=2026-04-29T16:58:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-295540321',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=4908f73e-1ccc-4817-884a-cd7ff6542cb1,host='devstack@QuobyteHD#QuobyteHD',id=4bd48426-52eb-4b1a-be0f-3571cc0c9c92,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9ab3398093534a62b84e4a6c08d37c07',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T16:58:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T16:58:30Z,use_quota=True,user_id='95304710377440ffbc634fb5237aa25b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(feedd468-7042-4c3d-b5a2-4d5f4fc2db34),volume_type_id=feedd468-7042-4c3d-b5a2-4d5f4fc2db34)}" {{(pid=84538) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 29 18:58:30 devstack cinder-volume[84538]: DEBUG cinder.volume.drivers.remotefs [None req-48656dda-4875-46bc-9a5b-3f86a7d762f7 tempest-GroupsTest-154144425 None] Creating volume 4bd48426-52eb-4b1a-be0f-3571cc0c9c92 {{(pid=84538) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 29 18:58:30 devstack cinder-volume[84538]: DEBUG oslo_concurrency.lockutils [None req-48656dda-4875-46bc-9a5b-3f86a7d762f7 tempest-GroupsTest-154144425 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 18:58:30 devstack cinder-volume[84538]: DEBUG oslo_concurrency.lockutils [None req-48656dda-4875-46bc-9a5b-3f86a7d762f7 tempest-GroupsTest-154144425 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=84538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 18:58:30 devstack cinder-volume[84538]: DEBUG cinder.volume.drivers.quobyte [None req-48656dda-4875-46bc-9a5b-3f86a7d762f7 tempest-GroupsTest-154144425 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-34312b00-dd6d-45bb-af98-75855cea8e48': None} {{(pid=84538) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 18:58:30 devstack cinder-volume[84538]: DEBUG cinder.volume.drivers.quobyte [None req-48656dda-4875-46bc-9a5b-3f86a7d762f7 tempest-GroupsTest-154144425 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-34312b00-dd6d-45bb-af98-75855cea8e48'] {{(pid=84538) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 18:58:30 devstack cinder-volume[84538]: DEBUG oslo_concurrency.lockutils [None req-48656dda-4875-46bc-9a5b-3f86a7d762f7 tempest-GroupsTest-154144425 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=84538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 18:58:30 devstack cinder-volume[84538]: DEBUG cinder.volume.drivers.quobyte [None req-48656dda-4875-46bc-9a5b-3f86a7d762f7 tempest-GroupsTest-154144425 None] Selected osci02.corp.quobyte.com/cinder-vol-34312b00-dd6d-45bb-af98-75855cea8e48 as target Quobyte volume. {{(pid=84538) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 29 18:58:30 devstack cinder-volume[84538]: INFO cinder.volume.drivers.remotefs [None req-48656dda-4875-46bc-9a5b-3f86a7d762f7 tempest-GroupsTest-154144425 None] casted to osci02.corp.quobyte.com/cinder-vol-34312b00-dd6d-45bb-af98-75855cea8e48 Apr 29 18:58:30 devstack cinder-volume[84538]: DEBUG oslo_concurrency.processutils [None req-48656dda-4875-46bc-9a5b-3f86a7d762f7 tempest-GroupsTest-154144425 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-4bd48426-52eb-4b1a-be0f-3571cc0c9c92 1073741824 {{(pid=84538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 18:58:30 devstack sudo[87771]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-4bd48426-52eb-4b1a-be0f-3571cc0c9c92 1073741824 Apr 29 18:58:30 devstack sudo[87771]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 18:58:30 devstack cinder-volume[84538]: DEBUG cinder.coordination [None req-ceac2dee-1302-40fa-a8d6-30c499c47bcb tempest-SnapshotsActionsTest-2130050802 None] Acquiring lock "cinder-f0d1074c-6c31-4850-a6f5-bd604b31f83b-delete_snapshot" by "delete_snapshot" {{(pid=84538) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 18:58:30 devstack cinder-volume[84538]: DEBUG cinder.coordination [None req-ceac2dee-1302-40fa-a8d6-30c499c47bcb tempest-SnapshotsActionsTest-2130050802 None] Lock "cinder-f0d1074c-6c31-4850-a6f5-bd604b31f83b-delete_snapshot" acquired by "delete_snapshot" :: waited 0.033s {{(pid=84538) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 18:58:30 devstack cinder-volume[84538]: DEBUG cinder.coordination [None req-ceac2dee-1302-40fa-a8d6-30c499c47bcb tempest-SnapshotsActionsTest-2130050802 None] Acquiring lock "cinder-quobyte-556880c3-9a02-4e53-8a6c-203a2e269036" by "delete_snapshot" {{(pid=84538) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 18:58:30 devstack cinder-volume[84538]: DEBUG cinder.coordination [None req-ceac2dee-1302-40fa-a8d6-30c499c47bcb tempest-SnapshotsActionsTest-2130050802 None] Lock "cinder-quobyte-556880c3-9a02-4e53-8a6c-203a2e269036" acquired by "delete_snapshot" :: waited 0.023s {{(pid=84538) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 18:58:30 devstack cinder-volume[84538]: DEBUG cinder.coordination [None req-ceac2dee-1302-40fa-a8d6-30c499c47bcb tempest-SnapshotsActionsTest-2130050802 None] Acquiring lock "cinder-quobyte-f0d1074c-6c31-4850-a6f5-bd604b31f83b" by "_delete_snapshot" {{(pid=84538) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 18:58:30 devstack cinder-volume[84538]: DEBUG cinder.coordination [None req-ceac2dee-1302-40fa-a8d6-30c499c47bcb tempest-SnapshotsActionsTest-2130050802 None] Lock "cinder-quobyte-f0d1074c-6c31-4850-a6f5-bd604b31f83b" acquired by "_delete_snapshot" :: waited 0.042s {{(pid=84538) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 18:58:30 devstack cinder-volume[84538]: DEBUG cinder.volume.drivers.remotefs [None req-ceac2dee-1302-40fa-a8d6-30c499c47bcb tempest-SnapshotsActionsTest-2130050802 None] Deleting offline snapshot f0d1074c-6c31-4850-a6f5-bd604b31f83b of volume 556880c3-9a02-4e53-8a6c-203a2e269036 {{(pid=84538) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 29 18:58:30 devstack cinder-volume[84538]: DEBUG cinder.volume.drivers.remotefs [None req-ceac2dee-1302-40fa-a8d6-30c499c47bcb tempest-SnapshotsActionsTest-2130050802 None] snapshot_file for this snap is: volume-556880c3-9a02-4e53-8a6c-203a2e269036.f0d1074c-6c31-4850-a6f5-bd604b31f83b {{(pid=84538) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 29 18:58:30 devstack cinder-volume[84538]: DEBUG oslo.privsep.daemon [-] privsep: reply[f7695dab-e848-49fb-904a-a5dc99247546]: (4, 'qcow2') {{(pid=85803) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 18:58:30 devstack cinder-volume[84538]: DEBUG oslo_concurrency.processutils [None req-ceac2dee-1302-40fa-a8d6-30c499c47bcb tempest-SnapshotsActionsTest-2130050802 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-556880c3-9a02-4e53-8a6c-203a2e269036.f0d1074c-6c31-4850-a6f5-bd604b31f83b {{(pid=84538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 18:58:30 devstack sudo[87773]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-556880c3-9a02-4e53-8a6c-203a2e269036.f0d1074c-6c31-4850-a6f5-bd604b31f83b Apr 29 18:58:30 devstack sudo[87773]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 18:58:30 devstack sudo[87769]: pam_unix(sudo:session): session closed for user root Apr 29 18:58:30 devstack cinder-volume[84538]: DEBUG oslo_concurrency.processutils [req-bf16baee-6c76-4e52-8515-05ddc420e29e req-2a116e42-652d-482c-8f4e-ec45f386d179 tempest-ServerBootFromVolumeStableRescueTest-1114355649 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-1adeda9a-0a54-42f8-b9f8-14806f72b985 1G" returned: 0 in 0.881s {{(pid=84538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 18:58:30 devstack cinder-volume[84538]: DEBUG oslo.privsep.daemon [-] privsep: reply[ff25ba20-d66c-4ff9-92d0-f6d1f0e9d955]: (4, 'raw') {{(pid=85803) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 18:58:30 devstack cinder-volume[84538]: DEBUG oslo_concurrency.processutils [req-bf16baee-6c76-4e52-8515-05ddc420e29e req-2a116e42-652d-482c-8f4e-ec45f386d179 tempest-ServerBootFromVolumeStableRescueTest-1114355649 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-1adeda9a-0a54-42f8-b9f8-14806f72b985 {{(pid=84538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 18:58:30 devstack sudo[87780]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-1adeda9a-0a54-42f8-b9f8-14806f72b985 Apr 29 18:58:30 devstack sudo[87780]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 18:58:31 devstack sudo[87771]: pam_unix(sudo:session): session closed for user root Apr 29 18:58:31 devstack cinder-volume[84538]: DEBUG oslo_concurrency.processutils [None req-48656dda-4875-46bc-9a5b-3f86a7d762f7 tempest-GroupsTest-154144425 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-4bd48426-52eb-4b1a-be0f-3571cc0c9c92 1073741824" returned: 0 in 1.075s {{(pid=84538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 18:58:31 devstack cinder-volume[84538]: DEBUG dbcounter [-] [84538] Writing DB stats cinder:SELECT=80,cinder:UPDATE=70,cinder:DELETE=4,cinder:INSERT=17 {{(pid=84538) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Apr 29 18:58:31 devstack cinder-volume[84538]: DEBUG oslo_concurrency.processutils [None req-48656dda-4875-46bc-9a5b-3f86a7d762f7 tempest-GroupsTest-154144425 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-4bd48426-52eb-4b1a-be0f-3571cc0c9c92 {{(pid=84538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 18:58:31 devstack sudo[87786]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-4bd48426-52eb-4b1a-be0f-3571cc0c9c92 Apr 29 18:58:31 devstack sudo[87786]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 18:58:31 devstack sudo[87773]: pam_unix(sudo:session): session closed for user root Apr 29 18:58:31 devstack cinder-volume[84538]: DEBUG oslo_concurrency.processutils [None req-ceac2dee-1302-40fa-a8d6-30c499c47bcb tempest-SnapshotsActionsTest-2130050802 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-556880c3-9a02-4e53-8a6c-203a2e269036.f0d1074c-6c31-4850-a6f5-bd604b31f83b" returned: 0 in 1.037s {{(pid=84538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 18:58:31 devstack cinder-volume[84538]: DEBUG cinder.volume.drivers.remotefs [None req-ceac2dee-1302-40fa-a8d6-30c499c47bcb tempest-SnapshotsActionsTest-2130050802 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-556880c3-9a02-4e53-8a6c-203a2e269036(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=84538) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 29 18:58:31 devstack cinder-volume[84538]: DEBUG oslo.privsep.daemon [-] privsep: reply[a395a1c1-da7a-42a0-a827-f773e5d90297]: (4, 'qcow2') {{(pid=85803) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 18:58:31 devstack cinder-volume[84538]: DEBUG oslo_concurrency.processutils [None req-ceac2dee-1302-40fa-a8d6-30c499c47bcb tempest-SnapshotsActionsTest-2130050802 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-556880c3-9a02-4e53-8a6c-203a2e269036.2dbee080-eb30-4349-9d21-fa64930394ca {{(pid=84538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 18:58:31 devstack sudo[87788]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-556880c3-9a02-4e53-8a6c-203a2e269036.2dbee080-eb30-4349-9d21-fa64930394ca Apr 29 18:58:31 devstack sudo[87788]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 18:58:31 devstack sudo[87780]: pam_unix(sudo:session): session closed for user root Apr 29 18:58:31 devstack cinder-volume[84538]: DEBUG oslo_concurrency.processutils [req-bf16baee-6c76-4e52-8515-05ddc420e29e req-2a116e42-652d-482c-8f4e-ec45f386d179 tempest-ServerBootFromVolumeStableRescueTest-1114355649 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-1adeda9a-0a54-42f8-b9f8-14806f72b985" returned: 0 in 1.152s {{(pid=84538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 18:58:31 devstack cinder-volume[84538]: DEBUG oslo_concurrency.processutils [req-bf16baee-6c76-4e52-8515-05ddc420e29e req-2a116e42-652d-482c-8f4e-ec45f386d179 tempest-ServerBootFromVolumeStableRescueTest-1114355649 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-1adeda9a-0a54-42f8-b9f8-14806f72b985 {{(pid=84538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 18:58:32 devstack sudo[87792]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-1adeda9a-0a54-42f8-b9f8-14806f72b985 Apr 29 18:58:32 devstack sudo[87792]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 18:58:32 devstack sudo[87786]: pam_unix(sudo:session): session closed for user root Apr 29 18:58:32 devstack cinder-volume[84538]: DEBUG oslo_concurrency.processutils [None req-48656dda-4875-46bc-9a5b-3f86a7d762f7 tempest-GroupsTest-154144425 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-4bd48426-52eb-4b1a-be0f-3571cc0c9c92" returned: 0 in 0.883s {{(pid=84538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 18:58:32 devstack cinder-volume[84538]: DEBUG cinder.volume.drivers.quobyte [None req-48656dda-4875-46bc-9a5b-3f86a7d762f7 tempest-GroupsTest-154144425 None] <== create_volume: return (2059ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-34312b00-dd6d-45bb-af98-75855cea8e48'} {{(pid=84538) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 29 18:58:32 devstack cinder-volume[84538]: DEBUG oslo_concurrency.lockutils [None req-48656dda-4875-46bc-9a5b-3f86a7d762f7 tempest-GroupsTest-154144425 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.062s {{(pid=84538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 18:58:32 devstack cinder-volume[84538]: DEBUG cinder.volume.manager [None req-48656dda-4875-46bc-9a5b-3f86a7d762f7 tempest-GroupsTest-154144425 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6f8c082d-2de5-40c5-a17f-4f196e12ad67) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4bd48426-52eb-4b1a-be0f-3571cc0c9c92', 'volume_size': 1}' {{(pid=84538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 18:58:32 devstack cinder-volume[84538]: DEBUG cinder.volume.manager [None req-48656dda-4875-46bc-9a5b-3f86a7d762f7 tempest-GroupsTest-154144425 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (928657b4-f989-4a93-8a41-c5bfe9486e4c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 18:58:32 devstack cinder-volume[84538]: DEBUG dbcounter [-] [84538] Writing DB stats cinder:SELECT=67,cinder:UPDATE=69,cinder:INSERT=15,cinder:DELETE=4 {{(pid=84538) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Apr 29 18:58:32 devstack cinder-volume[84538]: INFO cinder.volume.flows.manager.create_volume [None req-48656dda-4875-46bc-9a5b-3f86a7d762f7 tempest-GroupsTest-154144425 None] Volume volume-4bd48426-52eb-4b1a-be0f-3571cc0c9c92 (4bd48426-52eb-4b1a-be0f-3571cc0c9c92): created successfully Apr 29 18:58:32 devstack cinder-volume[84538]: DEBUG cinder.volume.manager [None req-48656dda-4875-46bc-9a5b-3f86a7d762f7 tempest-GroupsTest-154144425 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (928657b4-f989-4a93-8a41-c5bfe9486e4c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 18:58:32 devstack cinder-volume[84538]: DEBUG cinder.volume.manager [None req-48656dda-4875-46bc-9a5b-3f86a7d762f7 tempest-GroupsTest-154144425 None] Flow 'volume_create_manager' (6003ef5f-294e-4008-9fd6-9d5093c1040a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84538) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 18:58:32 devstack cinder-volume[84538]: INFO cinder.volume.manager [None req-48656dda-4875-46bc-9a5b-3f86a7d762f7 tempest-GroupsTest-154144425 None] Created volume successfully. Apr 29 18:58:32 devstack sudo[87788]: pam_unix(sudo:session): session closed for user root Apr 29 18:58:32 devstack cinder-volume[84538]: DEBUG oslo_concurrency.processutils [None req-ceac2dee-1302-40fa-a8d6-30c499c47bcb tempest-SnapshotsActionsTest-2130050802 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-556880c3-9a02-4e53-8a6c-203a2e269036.2dbee080-eb30-4349-9d21-fa64930394ca" returned: 0 in 0.967s {{(pid=84538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 18:58:32 devstack cinder-volume[84538]: DEBUG cinder.volume.drivers.remotefs [None req-ceac2dee-1302-40fa-a8d6-30c499c47bcb tempest-SnapshotsActionsTest-2130050802 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-556880c3-9a02-4e53-8a6c-203a2e269036(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=84538) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 29 18:58:32 devstack cinder-volume[84538]: DEBUG oslo_concurrency.processutils [None req-ceac2dee-1302-40fa-a8d6-30c499c47bcb tempest-SnapshotsActionsTest-2130050802 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-556880c3-9a02-4e53-8a6c-203a2e269036.f0d1074c-6c31-4850-a6f5-bd604b31f83b {{(pid=84538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 18:58:32 devstack sudo[87798]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-556880c3-9a02-4e53-8a6c-203a2e269036.f0d1074c-6c31-4850-a6f5-bd604b31f83b Apr 29 18:58:32 devstack sudo[87798]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 18:58:32 devstack sudo[87792]: pam_unix(sudo:session): session closed for user root Apr 29 18:58:32 devstack cinder-volume[84538]: DEBUG oslo_concurrency.processutils [req-bf16baee-6c76-4e52-8515-05ddc420e29e req-2a116e42-652d-482c-8f4e-ec45f386d179 tempest-ServerBootFromVolumeStableRescueTest-1114355649 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-1adeda9a-0a54-42f8-b9f8-14806f72b985" returned: 1 in 0.893s {{(pid=84538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 18:58:32 devstack cinder-volume[84538]: DEBUG oslo_concurrency.processutils [req-bf16baee-6c76-4e52-8515-05ddc420e29e req-2a116e42-652d-482c-8f4e-ec45f386d179 tempest-ServerBootFromVolumeStableRescueTest-1114355649 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-1adeda9a-0a54-42f8-b9f8-14806f72b985' failed. Not Retrying. {{(pid=84538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Apr 29 18:58:32 devstack cinder-volume[84538]: DEBUG cinder.volume.volume_utils [req-bf16baee-6c76-4e52-8515-05ddc420e29e req-2a116e42-652d-482c-8f4e-ec45f386d179 tempest-ServerBootFromVolumeStableRescueTest-1114355649 None] Downloaded image 11605644-0a6a-4a0a-b123-c09ab01cd4db ((None, [{'url': 'file:///opt/stack/data/glance/images/11605644-0a6a-4a0a-b123-c09ab01cd4db', 'metadata': {}}])) to volume 1adeda9a-0a54-42f8-b9f8-14806f72b985 successfully. {{(pid=84538) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1234}} Apr 29 18:58:32 devstack cinder-volume[84538]: DEBUG cinder.image.image_utils [req-bf16baee-6c76-4e52-8515-05ddc420e29e req-2a116e42-652d-482c-8f4e-ec45f386d179 tempest-ServerBootFromVolumeStableRescueTest-1114355649 None] Temporary image 11605644-0a6a-4a0a-b123-c09ab01cd4db for user 98e810d72fd94fb0b0d586d7a18415b8 is deleted. {{(pid=84538) fetch /opt/stack/cinder/cinder/image/image_utils.py:1435}} Apr 29 18:58:32 devstack cinder-volume[84538]: DEBUG cinder.volume.volume_utils [req-bf16baee-6c76-4e52-8515-05ddc420e29e req-2a116e42-652d-482c-8f4e-ec45f386d179 tempest-ServerBootFromVolumeStableRescueTest-1114355649 None] Marking volume 1adeda9a-0a54-42f8-b9f8-14806f72b985 as bootable. {{(pid=84538) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1138}} Apr 29 18:58:32 devstack cinder-volume[84538]: DEBUG cinder.volume.flows.manager.create_volume [req-bf16baee-6c76-4e52-8515-05ddc420e29e req-2a116e42-652d-482c-8f4e-ec45f386d179 tempest-ServerBootFromVolumeStableRescueTest-1114355649 None] Copying metadata from image 11605644-0a6a-4a0a-b123-c09ab01cd4db to 1adeda9a-0a54-42f8-b9f8-14806f72b985. {{(pid=84538) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Apr 29 18:58:32 devstack cinder-volume[84538]: DEBUG cinder.volume.flows.manager.create_volume [req-bf16baee-6c76-4e52-8515-05ddc420e29e req-2a116e42-652d-482c-8f4e-ec45f386d179 tempest-ServerBootFromVolumeStableRescueTest-1114355649 None] Creating volume glance metadata for volume 1adeda9a-0a54-42f8-b9f8-14806f72b985 backed by image 11605644-0a6a-4a0a-b123-c09ab01cd4db with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': '11605644-0a6a-4a0a-b123-c09ab01cd4db', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=84538) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Apr 29 18:58:32 devstack cinder-volume[84538]: DEBUG cinder.volume.manager [req-bf16baee-6c76-4e52-8515-05ddc420e29e req-2a116e42-652d-482c-8f4e-ec45f386d179 tempest-ServerBootFromVolumeStableRescueTest-1114355649 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1db37944-a081-4319-935e-aac3abf0e5ef) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1adeda9a-0a54-42f8-b9f8-14806f72b985', 'volume_size': 1, 'image_id': '11605644-0a6a-4a0a-b123-c09ab01cd4db', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/11605644-0a6a-4a0a-b123-c09ab01cd4db', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '853afc5ea27148009f8c02d351cf4d80', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '11605644-0a6a-4a0a-b123-c09ab01cd4db', 'created_at': datetime.datetime(2026, 4, 29, 16, 52, 8, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 4, 29, 16, 52, 10, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/11605644-0a6a-4a0a-b123-c09ab01cd4db/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=84538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 18:58:32 devstack cinder-volume[84538]: DEBUG cinder.volume.manager [req-bf16baee-6c76-4e52-8515-05ddc420e29e req-2a116e42-652d-482c-8f4e-ec45f386d179 tempest-ServerBootFromVolumeStableRescueTest-1114355649 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (515c31ee-57ac-45ee-8a63-d5c1d1c64c6c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 18:58:32 devstack cinder-volume[84538]: INFO cinder.volume.flows.manager.create_volume [req-bf16baee-6c76-4e52-8515-05ddc420e29e req-2a116e42-652d-482c-8f4e-ec45f386d179 tempest-ServerBootFromVolumeStableRescueTest-1114355649 None] Volume volume-1adeda9a-0a54-42f8-b9f8-14806f72b985 (1adeda9a-0a54-42f8-b9f8-14806f72b985): created successfully Apr 29 18:58:33 devstack cinder-volume[84538]: DEBUG cinder.volume.manager [req-bf16baee-6c76-4e52-8515-05ddc420e29e req-2a116e42-652d-482c-8f4e-ec45f386d179 tempest-ServerBootFromVolumeStableRescueTest-1114355649 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (515c31ee-57ac-45ee-8a63-d5c1d1c64c6c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 18:58:33 devstack cinder-volume[84538]: DEBUG cinder.volume.manager [req-bf16baee-6c76-4e52-8515-05ddc420e29e req-2a116e42-652d-482c-8f4e-ec45f386d179 tempest-ServerBootFromVolumeStableRescueTest-1114355649 None] Flow 'volume_create_manager' (2e70ea35-3a57-4984-aa3b-ec2cdf288b41) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84538) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 18:58:33 devstack cinder-volume[84538]: INFO cinder.volume.manager [req-bf16baee-6c76-4e52-8515-05ddc420e29e req-2a116e42-652d-482c-8f4e-ec45f386d179 tempest-ServerBootFromVolumeStableRescueTest-1114355649 None] Created volume successfully. Apr 29 18:58:33 devstack sudo[87798]: pam_unix(sudo:session): session closed for user root Apr 29 18:58:33 devstack cinder-volume[84538]: DEBUG oslo_concurrency.processutils [None req-ceac2dee-1302-40fa-a8d6-30c499c47bcb tempest-SnapshotsActionsTest-2130050802 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-556880c3-9a02-4e53-8a6c-203a2e269036.f0d1074c-6c31-4850-a6f5-bd604b31f83b" returned: 0 in 0.869s {{(pid=84538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 18:58:33 devstack cinder-volume[84538]: DEBUG oslo_concurrency.processutils [None req-ceac2dee-1302-40fa-a8d6-30c499c47bcb tempest-SnapshotsActionsTest-2130050802 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-556880c3-9a02-4e53-8a6c-203a2e269036.f0d1074c-6c31-4850-a6f5-bd604b31f83b {{(pid=84538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 18:58:33 devstack sudo[87807]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-556880c3-9a02-4e53-8a6c-203a2e269036.f0d1074c-6c31-4850-a6f5-bd604b31f83b Apr 29 18:58:33 devstack sudo[87807]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 18:58:34 devstack cinder-volume[84538]: DEBUG cinder.volume.flows.manager.create_volume [None req-547b7cd1-a691-4e23-ad77-403c4970c3d5 tempest-GroupsTest-154144425 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84538) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Apr 29 18:58:34 devstack cinder-volume[84538]: DEBUG cinder.volume.manager [None req-547b7cd1-a691-4e23-ad77-403c4970c3d5 tempest-GroupsTest-154144425 None] Flow 'volume_create_manager' (da74db1a-e9ef-4542-a7dc-b9b8bbe685f8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84538) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 18:58:34 devstack cinder-volume[84538]: DEBUG cinder.volume.manager [None req-547b7cd1-a691-4e23-ad77-403c4970c3d5 tempest-GroupsTest-154144425 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c21a159a-2a88-4c20-b611-3fdd7971a00f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 18:58:34 devstack cinder-volume[84538]: DEBUG cinder.volume.manager [None req-547b7cd1-a691-4e23-ad77-403c4970c3d5 tempest-GroupsTest-154144425 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c21a159a-2a88-4c20-b611-3fdd7971a00f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-29T16:58:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1871084949',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=4908f73e-1ccc-4817-884a-cd7ff6542cb1,host='devstack@QuobyteHD#QuobyteHD',id=625194d7-3e94-4a9b-a899-1774a2d061d8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9ab3398093534a62b84e4a6c08d37c07',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T16:58:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T16:58:34Z,use_quota=True,user_id='95304710377440ffbc634fb5237aa25b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(feedd468-7042-4c3d-b5a2-4d5f4fc2db34),volume_type_id=feedd468-7042-4c3d-b5a2-4d5f4fc2db34)' {{(pid=84538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 18:58:34 devstack cinder-volume[84538]: DEBUG cinder.volume.manager [None req-547b7cd1-a691-4e23-ad77-403c4970c3d5 tempest-GroupsTest-154144425 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c962038a-a1f2-4b65-a317-d4952c772aa6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 18:58:34 devstack cinder-volume[84538]: DEBUG cinder.volume.manager [None req-547b7cd1-a691-4e23-ad77-403c4970c3d5 tempest-GroupsTest-154144425 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c962038a-a1f2-4b65-a317-d4952c772aa6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 18:58:34 devstack cinder-volume[84538]: DEBUG cinder.volume.manager [None req-547b7cd1-a691-4e23-ad77-403c4970c3d5 tempest-GroupsTest-154144425 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2944c619-9db4-485f-806b-499f26635284) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 18:58:34 devstack sudo[87807]: pam_unix(sudo:session): session closed for user root Apr 29 18:58:34 devstack cinder-volume[84538]: DEBUG cinder.volume.manager [None req-547b7cd1-a691-4e23-ad77-403c4970c3d5 tempest-GroupsTest-154144425 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2944c619-9db4-485f-806b-499f26635284) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '625194d7-3e94-4a9b-a899-1774a2d061d8', 'volume_name': 'volume-625194d7-3e94-4a9b-a899-1774a2d061d8', 'volume_size': 1}' {{(pid=84538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 18:58:34 devstack cinder-volume[84538]: DEBUG cinder.volume.manager [None req-547b7cd1-a691-4e23-ad77-403c4970c3d5 tempest-GroupsTest-154144425 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3a03e100-b3b3-4e14-a4f8-abbe499ea45b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 18:58:34 devstack cinder-volume[84538]: DEBUG cinder.volume.manager [None req-547b7cd1-a691-4e23-ad77-403c4970c3d5 tempest-GroupsTest-154144425 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3a03e100-b3b3-4e14-a4f8-abbe499ea45b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 18:58:34 devstack cinder-volume[84538]: DEBUG cinder.volume.manager [None req-547b7cd1-a691-4e23-ad77-403c4970c3d5 tempest-GroupsTest-154144425 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2bd4cadf-f1ff-4039-8e5f-8b344d4c03be) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 18:58:34 devstack cinder-volume[84538]: INFO cinder.volume.flows.manager.create_volume [None req-547b7cd1-a691-4e23-ad77-403c4970c3d5 tempest-GroupsTest-154144425 None] Volume 625194d7-3e94-4a9b-a899-1774a2d061d8: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-625194d7-3e94-4a9b-a899-1774a2d061d8', 'volume_size': 1} Apr 29 18:58:34 devstack cinder-volume[84538]: DEBUG oslo_concurrency.lockutils [None req-547b7cd1-a691-4e23-ad77-403c4970c3d5 tempest-GroupsTest-154144425 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 18:58:34 devstack cinder-volume[84538]: DEBUG oslo_concurrency.lockutils [None req-547b7cd1-a691-4e23-ad77-403c4970c3d5 tempest-GroupsTest-154144425 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.003s {{(pid=84538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 18:58:34 devstack cinder-volume[84538]: DEBUG cinder.volume.drivers.quobyte [None req-547b7cd1-a691-4e23-ad77-403c4970c3d5 tempest-GroupsTest-154144425 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=4908f73e-1ccc-4817-884a-cd7ff6542cb1,created_at=2026-04-29T16:58:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1871084949',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=4908f73e-1ccc-4817-884a-cd7ff6542cb1,host='devstack@QuobyteHD#QuobyteHD',id=625194d7-3e94-4a9b-a899-1774a2d061d8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9ab3398093534a62b84e4a6c08d37c07',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T16:58:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T16:58:34Z,use_quota=True,user_id='95304710377440ffbc634fb5237aa25b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(feedd468-7042-4c3d-b5a2-4d5f4fc2db34),volume_type_id=feedd468-7042-4c3d-b5a2-4d5f4fc2db34)}" {{(pid=84538) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 29 18:58:34 devstack cinder-volume[84538]: DEBUG cinder.volume.drivers.remotefs [None req-547b7cd1-a691-4e23-ad77-403c4970c3d5 tempest-GroupsTest-154144425 None] Creating volume 625194d7-3e94-4a9b-a899-1774a2d061d8 {{(pid=84538) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 29 18:58:34 devstack cinder-volume[84538]: DEBUG oslo_concurrency.lockutils [None req-547b7cd1-a691-4e23-ad77-403c4970c3d5 tempest-GroupsTest-154144425 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 18:58:34 devstack cinder-volume[84538]: DEBUG oslo_concurrency.lockutils [None req-547b7cd1-a691-4e23-ad77-403c4970c3d5 tempest-GroupsTest-154144425 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 18:58:34 devstack cinder-volume[84538]: DEBUG cinder.volume.drivers.quobyte [None req-547b7cd1-a691-4e23-ad77-403c4970c3d5 tempest-GroupsTest-154144425 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-34312b00-dd6d-45bb-af98-75855cea8e48': None} {{(pid=84538) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 18:58:34 devstack cinder-volume[84538]: DEBUG cinder.volume.drivers.quobyte [None req-547b7cd1-a691-4e23-ad77-403c4970c3d5 tempest-GroupsTest-154144425 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-34312b00-dd6d-45bb-af98-75855cea8e48'] {{(pid=84538) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 18:58:34 devstack cinder-volume[84538]: DEBUG oslo_concurrency.lockutils [None req-547b7cd1-a691-4e23-ad77-403c4970c3d5 tempest-GroupsTest-154144425 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=84538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 18:58:34 devstack cinder-volume[84538]: DEBUG cinder.volume.drivers.quobyte [None req-547b7cd1-a691-4e23-ad77-403c4970c3d5 tempest-GroupsTest-154144425 None] Selected osci02.corp.quobyte.com/cinder-vol-34312b00-dd6d-45bb-af98-75855cea8e48 as target Quobyte volume. {{(pid=84538) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 29 18:58:34 devstack cinder-volume[84538]: INFO cinder.volume.drivers.remotefs [None req-547b7cd1-a691-4e23-ad77-403c4970c3d5 tempest-GroupsTest-154144425 None] casted to osci02.corp.quobyte.com/cinder-vol-34312b00-dd6d-45bb-af98-75855cea8e48 Apr 29 18:58:34 devstack cinder-volume[84538]: DEBUG oslo_concurrency.processutils [None req-547b7cd1-a691-4e23-ad77-403c4970c3d5 tempest-GroupsTest-154144425 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-625194d7-3e94-4a9b-a899-1774a2d061d8 1073741824 {{(pid=84538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 18:58:34 devstack cinder-volume[84538]: DEBUG oslo_concurrency.processutils [None req-ceac2dee-1302-40fa-a8d6-30c499c47bcb tempest-SnapshotsActionsTest-2130050802 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-556880c3-9a02-4e53-8a6c-203a2e269036.f0d1074c-6c31-4850-a6f5-bd604b31f83b" returned: 0 in 0.916s {{(pid=84538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 18:58:34 devstack sudo[87814]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-625194d7-3e94-4a9b-a899-1774a2d061d8 1073741824 Apr 29 18:58:34 devstack sudo[87814]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 18:58:34 devstack cinder-volume[84538]: DEBUG cinder.coordination [None req-ceac2dee-1302-40fa-a8d6-30c499c47bcb tempest-SnapshotsActionsTest-2130050802 None] Lock "cinder-quobyte-f0d1074c-6c31-4850-a6f5-bd604b31f83b" released by "_delete_snapshot" :: held 3.957s {{(pid=84538) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 18:58:34 devstack cinder-volume[84538]: DEBUG cinder.coordination [None req-ceac2dee-1302-40fa-a8d6-30c499c47bcb tempest-SnapshotsActionsTest-2130050802 None] Lock "cinder-quobyte-556880c3-9a02-4e53-8a6c-203a2e269036" released by "delete_snapshot" :: held 4.019s {{(pid=84538) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 18:58:34 devstack cinder-volume[84538]: DEBUG cinder.quota [None req-ceac2dee-1302-40fa-a8d6-30c499c47bcb tempest-SnapshotsActionsTest-2130050802 None] Created reservations ['8708b650-e6e2-4c33-8156-a4655e151fde', 'e6f233dd-84a6-4cb7-979a-29046a5d9268', '5a711453-9137-4a82-9cca-2d7b6f56d8ff', '4564f93b-3ec8-44bc-8198-d0016fc67a18'] {{(pid=84538) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 29 18:58:34 devstack cinder-volume[84538]: DEBUG oslo_concurrency.lockutils [req-bf16baee-6c76-4e52-8515-05ddc420e29e req-1bc79175-b63a-4fef-8262-01c4dcbd67a1 tempest-ServerBootFromVolumeStableRescueTest-1114355649 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=84538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 18:58:34 devstack cinder-volume[84538]: INFO cinder.volume.manager [None req-ceac2dee-1302-40fa-a8d6-30c499c47bcb tempest-SnapshotsActionsTest-2130050802 None] Delete snapshot completed successfully. Apr 29 18:58:34 devstack cinder-volume[84538]: DEBUG cinder.coordination [None req-ceac2dee-1302-40fa-a8d6-30c499c47bcb tempest-SnapshotsActionsTest-2130050802 None] Lock "cinder-f0d1074c-6c31-4850-a6f5-bd604b31f83b-delete_snapshot" released by "delete_snapshot" :: held 4.322s {{(pid=84538) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 18:58:35 devstack sudo[87814]: pam_unix(sudo:session): session closed for user root Apr 29 18:58:35 devstack cinder-volume[84538]: DEBUG oslo_concurrency.processutils [None req-547b7cd1-a691-4e23-ad77-403c4970c3d5 tempest-GroupsTest-154144425 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-625194d7-3e94-4a9b-a899-1774a2d061d8 1073741824" returned: 0 in 1.071s {{(pid=84538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 18:58:35 devstack cinder-volume[84538]: DEBUG oslo_concurrency.processutils [None req-547b7cd1-a691-4e23-ad77-403c4970c3d5 tempest-GroupsTest-154144425 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-625194d7-3e94-4a9b-a899-1774a2d061d8 {{(pid=84538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 18:58:35 devstack sudo[87824]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-625194d7-3e94-4a9b-a899-1774a2d061d8 Apr 29 18:58:35 devstack sudo[87824]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 18:58:35 devstack cinder-volume[84538]: DEBUG oslo_concurrency.lockutils [None req-8594e1cf-e6ff-45a9-85b9-5ad6358f5a4e tempest-SnapshotsActionsTest-711673579 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=84538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 18:58:36 devstack sudo[87824]: pam_unix(sudo:session): session closed for user root Apr 29 18:58:36 devstack cinder-volume[84538]: DEBUG oslo_concurrency.processutils [None req-547b7cd1-a691-4e23-ad77-403c4970c3d5 tempest-GroupsTest-154144425 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-625194d7-3e94-4a9b-a899-1774a2d061d8" returned: 0 in 0.718s {{(pid=84538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 18:58:36 devstack cinder-volume[84538]: DEBUG cinder.volume.drivers.quobyte [None req-547b7cd1-a691-4e23-ad77-403c4970c3d5 tempest-GroupsTest-154144425 None] <== create_volume: return (1832ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-34312b00-dd6d-45bb-af98-75855cea8e48'} {{(pid=84538) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 29 18:58:36 devstack cinder-volume[84538]: DEBUG oslo_concurrency.lockutils [None req-547b7cd1-a691-4e23-ad77-403c4970c3d5 tempest-GroupsTest-154144425 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.836s {{(pid=84538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 18:58:36 devstack cinder-volume[84538]: DEBUG oslo_concurrency.lockutils [req-bf16baee-6c76-4e52-8515-05ddc420e29e req-1bc79175-b63a-4fef-8262-01c4dcbd67a1 tempest-ServerBootFromVolumeStableRescueTest-1114355649 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 1.474s {{(pid=84538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 18:58:36 devstack cinder-volume[84538]: DEBUG cinder.volume.manager [None req-547b7cd1-a691-4e23-ad77-403c4970c3d5 tempest-GroupsTest-154144425 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2bd4cadf-f1ff-4039-8e5f-8b344d4c03be) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-625194d7-3e94-4a9b-a899-1774a2d061d8', 'volume_size': 1}' {{(pid=84538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 18:58:36 devstack cinder-volume[84538]: DEBUG cinder.volume.manager [None req-547b7cd1-a691-4e23-ad77-403c4970c3d5 tempest-GroupsTest-154144425 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2a537d53-16c5-4c7a-973b-db22a4333d66) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 18:58:36 devstack cinder-volume[84538]: DEBUG oslo.privsep.daemon [-] privsep: reply[416edc55-501e-48c2-a8a1-b9cf2b35a295]: (4, 'raw') {{(pid=85803) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 18:58:36 devstack cinder-volume[84538]: DEBUG oslo_concurrency.processutils [req-bf16baee-6c76-4e52-8515-05ddc420e29e req-1bc79175-b63a-4fef-8262-01c4dcbd67a1 tempest-ServerBootFromVolumeStableRescueTest-1114355649 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-1adeda9a-0a54-42f8-b9f8-14806f72b985 {{(pid=84538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 18:58:36 devstack cinder-volume[84538]: INFO cinder.volume.flows.manager.create_volume [None req-547b7cd1-a691-4e23-ad77-403c4970c3d5 tempest-GroupsTest-154144425 None] Volume volume-625194d7-3e94-4a9b-a899-1774a2d061d8 (625194d7-3e94-4a9b-a899-1774a2d061d8): created successfully Apr 29 18:58:36 devstack cinder-volume[84538]: DEBUG cinder.volume.manager [None req-547b7cd1-a691-4e23-ad77-403c4970c3d5 tempest-GroupsTest-154144425 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2a537d53-16c5-4c7a-973b-db22a4333d66) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 18:58:36 devstack cinder-volume[84538]: DEBUG cinder.volume.manager [None req-547b7cd1-a691-4e23-ad77-403c4970c3d5 tempest-GroupsTest-154144425 None] Flow 'volume_create_manager' (da74db1a-e9ef-4542-a7dc-b9b8bbe685f8) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84538) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 18:58:36 devstack cinder-volume[84538]: INFO cinder.volume.manager [None req-547b7cd1-a691-4e23-ad77-403c4970c3d5 tempest-GroupsTest-154144425 None] Created volume successfully. Apr 29 18:58:36 devstack sudo[87827]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-1adeda9a-0a54-42f8-b9f8-14806f72b985 Apr 29 18:58:36 devstack sudo[87827]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 18:58:36 devstack cinder-volume[84538]: INFO cinder.volume.manager [None req-35e2771e-aa16-403d-943b-7001841eed0d tempest-GroupsTest-154144425 None] Update group completed successfully. Apr 29 18:58:36 devstack sudo[87827]: pam_unix(sudo:session): session closed for user root Apr 29 18:58:36 devstack cinder-volume[84538]: DEBUG oslo_concurrency.processutils [req-bf16baee-6c76-4e52-8515-05ddc420e29e req-1bc79175-b63a-4fef-8262-01c4dcbd67a1 tempest-ServerBootFromVolumeStableRescueTest-1114355649 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-1adeda9a-0a54-42f8-b9f8-14806f72b985" returned: 0 in 0.882s {{(pid=84538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 18:58:36 devstack cinder-volume[84538]: DEBUG oslo_concurrency.processutils [req-bf16baee-6c76-4e52-8515-05ddc420e29e req-1bc79175-b63a-4fef-8262-01c4dcbd67a1 tempest-ServerBootFromVolumeStableRescueTest-1114355649 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-1adeda9a-0a54-42f8-b9f8-14806f72b985 {{(pid=84538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 18:58:37 devstack sudo[87831]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-1adeda9a-0a54-42f8-b9f8-14806f72b985 Apr 29 18:58:37 devstack sudo[87831]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 18:58:37 devstack sudo[87831]: pam_unix(sudo:session): session closed for user root Apr 29 18:58:37 devstack cinder-volume[84538]: DEBUG oslo_concurrency.processutils [req-bf16baee-6c76-4e52-8515-05ddc420e29e req-1bc79175-b63a-4fef-8262-01c4dcbd67a1 tempest-ServerBootFromVolumeStableRescueTest-1114355649 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-1adeda9a-0a54-42f8-b9f8-14806f72b985" returned: 1 in 0.736s {{(pid=84538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 18:58:37 devstack cinder-volume[84538]: DEBUG oslo_concurrency.processutils [req-bf16baee-6c76-4e52-8515-05ddc420e29e req-1bc79175-b63a-4fef-8262-01c4dcbd67a1 tempest-ServerBootFromVolumeStableRescueTest-1114355649 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-1adeda9a-0a54-42f8-b9f8-14806f72b985' failed. Not Retrying. {{(pid=84538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Apr 29 18:58:37 devstack cinder-volume[84538]: DEBUG oslo_concurrency.lockutils [req-bf16baee-6c76-4e52-8515-05ddc420e29e req-1bc79175-b63a-4fef-8262-01c4dcbd67a1 tempest-ServerBootFromVolumeStableRescueTest-1114355649 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 1.681s {{(pid=84538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 18:58:37 devstack cinder-volume[84538]: DEBUG oslo_concurrency.lockutils [None req-8594e1cf-e6ff-45a9-85b9-5ad6358f5a4e tempest-SnapshotsActionsTest-711673579 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 1.736s {{(pid=84538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 18:58:37 devstack cinder-volume[84538]: DEBUG cinder.volume.drivers.remotefs [None req-8594e1cf-e6ff-45a9-85b9-5ad6358f5a4e tempest-SnapshotsActionsTest-711673579 None] Creating offline snapshot 07942535-a943-4b14-950c-0b79b19eb8d4 of volume 556880c3-9a02-4e53-8a6c-203a2e269036 {{(pid=84538) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}} Apr 29 18:58:37 devstack cinder-volume[84538]: DEBUG oslo.privsep.daemon [-] privsep: reply[4a5d93bd-4822-4016-94e3-d54c71c3c3af]: (4, 'qcow2') {{(pid=85803) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 18:58:37 devstack cinder-volume[84538]: DEBUG oslo_concurrency.processutils [None req-8594e1cf-e6ff-45a9-85b9-5ad6358f5a4e tempest-SnapshotsActionsTest-711673579 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-556880c3-9a02-4e53-8a6c-203a2e269036.2dbee080-eb30-4349-9d21-fa64930394ca {{(pid=84538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 18:58:37 devstack cinder-volume[84538]: DEBUG cinder.volume.manager [req-bf16baee-6c76-4e52-8515-05ddc420e29e req-1bc79175-b63a-4fef-8262-01c4dcbd67a1 tempest-ServerBootFromVolumeStableRescueTest-1114355649 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-34312b00-dd6d-45bb-af98-75855cea8e48', 'name': 'volume-1adeda9a-0a54-42f8-b9f8-14806f72b985', 'options': None, 'format': 'raw', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '32dc924e-691f-4664-b5e5-21ef48e3de71', 'enforce_multipath': True} {{(pid=84538) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Apr 29 18:58:37 devstack cinder-volume[84538]: INFO cinder.volume.manager [req-bf16baee-6c76-4e52-8515-05ddc420e29e req-1bc79175-b63a-4fef-8262-01c4dcbd67a1 tempest-ServerBootFromVolumeStableRescueTest-1114355649 None] attachment_update completed successfully. Apr 29 18:58:37 devstack sudo[87838]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-556880c3-9a02-4e53-8a6c-203a2e269036.2dbee080-eb30-4349-9d21-fa64930394ca Apr 29 18:58:37 devstack sudo[87838]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 18:58:37 devstack cinder-volume[84538]: INFO cinder.volume.manager [None req-0de2cb15-8113-444a-9254-0d9ef834ef6f tempest-GroupsTest-154144425 None] Update group completed successfully. Apr 29 18:58:38 devstack sudo[87838]: pam_unix(sudo:session): session closed for user root Apr 29 18:58:38 devstack cinder-volume[84538]: DEBUG oslo_concurrency.processutils [None req-8594e1cf-e6ff-45a9-85b9-5ad6358f5a4e tempest-SnapshotsActionsTest-711673579 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-556880c3-9a02-4e53-8a6c-203a2e269036.2dbee080-eb30-4349-9d21-fa64930394ca" returned: 0 in 0.786s {{(pid=84538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 18:58:38 devstack cinder-volume[84538]: DEBUG cinder.volume.drivers.remotefs [None req-8594e1cf-e6ff-45a9-85b9-5ad6358f5a4e tempest-SnapshotsActionsTest-711673579 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-556880c3-9a02-4e53-8a6c-203a2e269036(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=84538) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 29 18:58:38 devstack cinder-volume[84538]: DEBUG oslo_concurrency.processutils [None req-8594e1cf-e6ff-45a9-85b9-5ad6358f5a4e tempest-SnapshotsActionsTest-711673579 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-556880c3-9a02-4e53-8a6c-203a2e269036.2dbee080-eb30-4349-9d21-fa64930394ca,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-556880c3-9a02-4e53-8a6c-203a2e269036.07942535-a943-4b14-950c-0b79b19eb8d4 1G {{(pid=84538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 18:58:38 devstack sudo[87844]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-556880c3-9a02-4e53-8a6c-203a2e269036.2dbee080-eb30-4349-9d21-fa64930394ca,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-556880c3-9a02-4e53-8a6c-203a2e269036.07942535-a943-4b14-950c-0b79b19eb8d4 1G Apr 29 18:58:38 devstack sudo[87844]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 18:58:39 devstack cinder-volume[84538]: DEBUG cinder.coordination [None req-13a0b23e-56ec-4640-930e-48f1e466b542 tempest-GroupsTest-154144425 None] Acquiring lock "cinder-quobyte-4bd48426-52eb-4b1a-be0f-3571cc0c9c92" by "delete_volume" {{(pid=84538) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 18:58:39 devstack cinder-volume[84538]: DEBUG cinder.coordination [None req-13a0b23e-56ec-4640-930e-48f1e466b542 tempest-GroupsTest-154144425 None] Lock "cinder-quobyte-4bd48426-52eb-4b1a-be0f-3571cc0c9c92" acquired by "delete_volume" :: waited 0.052s {{(pid=84538) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 18:58:39 devstack cinder-volume[84538]: DEBUG oslo.privsep.daemon [-] privsep: reply[a23065ee-f96e-4108-901c-209c6faad2a4]: (4, 'qcow2') {{(pid=85803) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 18:58:39 devstack cinder-volume[84538]: DEBUG oslo_concurrency.processutils [None req-13a0b23e-56ec-4640-930e-48f1e466b542 tempest-GroupsTest-154144425 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-4bd48426-52eb-4b1a-be0f-3571cc0c9c92 {{(pid=84538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 18:58:40 devstack sudo[87889]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-4bd48426-52eb-4b1a-be0f-3571cc0c9c92 Apr 29 18:58:40 devstack sudo[87889]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 18:58:40 devstack sudo[87844]: pam_unix(sudo:session): session closed for user root Apr 29 18:58:40 devstack cinder-volume[84538]: DEBUG oslo_concurrency.processutils [None req-8594e1cf-e6ff-45a9-85b9-5ad6358f5a4e tempest-SnapshotsActionsTest-711673579 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-556880c3-9a02-4e53-8a6c-203a2e269036.2dbee080-eb30-4349-9d21-fa64930394ca,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-556880c3-9a02-4e53-8a6c-203a2e269036.07942535-a943-4b14-950c-0b79b19eb8d4 1G" returned: 0 in 1.640s {{(pid=84538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 18:58:40 devstack cinder-volume[84538]: DEBUG oslo_concurrency.processutils [None req-8594e1cf-e6ff-45a9-85b9-5ad6358f5a4e tempest-SnapshotsActionsTest-711673579 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-556880c3-9a02-4e53-8a6c-203a2e269036.2dbee080-eb30-4349-9d21-fa64930394ca -F qcow2 /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-556880c3-9a02-4e53-8a6c-203a2e269036.07942535-a943-4b14-950c-0b79b19eb8d4 {{(pid=84538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 18:58:40 devstack sudo[87899]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-556880c3-9a02-4e53-8a6c-203a2e269036.2dbee080-eb30-4349-9d21-fa64930394ca -F qcow2 /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-556880c3-9a02-4e53-8a6c-203a2e269036.07942535-a943-4b14-950c-0b79b19eb8d4 Apr 29 18:58:40 devstack sudo[87899]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 18:58:40 devstack sudo[87889]: pam_unix(sudo:session): session closed for user root Apr 29 18:58:40 devstack cinder-volume[84538]: DEBUG oslo_concurrency.processutils [None req-13a0b23e-56ec-4640-930e-48f1e466b542 tempest-GroupsTest-154144425 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-4bd48426-52eb-4b1a-be0f-3571cc0c9c92" returned: 0 in 1.113s {{(pid=84538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 18:58:40 devstack cinder-volume[84538]: DEBUG oslo_concurrency.processutils [None req-13a0b23e-56ec-4640-930e-48f1e466b542 tempest-GroupsTest-154144425 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-4bd48426-52eb-4b1a-be0f-3571cc0c9c92 {{(pid=84538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 18:58:40 devstack sudo[87909]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-4bd48426-52eb-4b1a-be0f-3571cc0c9c92 Apr 29 18:58:40 devstack sudo[87909]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 18:58:41 devstack sudo[87899]: pam_unix(sudo:session): session closed for user root Apr 29 18:58:41 devstack cinder-volume[84538]: DEBUG oslo_concurrency.processutils [None req-8594e1cf-e6ff-45a9-85b9-5ad6358f5a4e tempest-SnapshotsActionsTest-711673579 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-556880c3-9a02-4e53-8a6c-203a2e269036.2dbee080-eb30-4349-9d21-fa64930394ca -F qcow2 /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-556880c3-9a02-4e53-8a6c-203a2e269036.07942535-a943-4b14-950c-0b79b19eb8d4" returned: 0 in 0.873s {{(pid=84538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 18:58:41 devstack cinder-volume[84538]: WARNING cinder.volume.drivers.remotefs [None req-8594e1cf-e6ff-45a9-85b9-5ad6358f5a4e tempest-SnapshotsActionsTest-711673579 None] /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-556880c3-9a02-4e53-8a6c-203a2e269036.07942535-a943-4b14-950c-0b79b19eb8d4 is being set with open permissions: ugo+rw Apr 29 18:58:41 devstack cinder-volume[84538]: DEBUG oslo_concurrency.processutils [None req-8594e1cf-e6ff-45a9-85b9-5ad6358f5a4e tempest-SnapshotsActionsTest-711673579 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-556880c3-9a02-4e53-8a6c-203a2e269036.07942535-a943-4b14-950c-0b79b19eb8d4 {{(pid=84538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 18:58:41 devstack sudo[87915]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-556880c3-9a02-4e53-8a6c-203a2e269036.07942535-a943-4b14-950c-0b79b19eb8d4 Apr 29 18:58:41 devstack sudo[87915]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 18:58:41 devstack sudo[87909]: pam_unix(sudo:session): session closed for user root Apr 29 18:58:41 devstack cinder-volume[84538]: DEBUG oslo_concurrency.processutils [None req-13a0b23e-56ec-4640-930e-48f1e466b542 tempest-GroupsTest-154144425 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-4bd48426-52eb-4b1a-be0f-3571cc0c9c92" returned: 0 in 0.711s {{(pid=84538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 18:58:41 devstack cinder-volume[84538]: DEBUG cinder.coordination [None req-13a0b23e-56ec-4640-930e-48f1e466b542 tempest-GroupsTest-154144425 None] Lock "cinder-quobyte-4bd48426-52eb-4b1a-be0f-3571cc0c9c92" released by "delete_volume" :: held 1.927s {{(pid=84538) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 18:58:41 devstack cinder-volume[84538]: DEBUG cinder.coordination [None req-13a0b23e-56ec-4640-930e-48f1e466b542 tempest-GroupsTest-154144425 None] Acquiring lock "cinder-quobyte-625194d7-3e94-4a9b-a899-1774a2d061d8" by "delete_volume" {{(pid=84538) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 18:58:41 devstack cinder-volume[84538]: DEBUG cinder.coordination [None req-13a0b23e-56ec-4640-930e-48f1e466b542 tempest-GroupsTest-154144425 None] Lock "cinder-quobyte-625194d7-3e94-4a9b-a899-1774a2d061d8" acquired by "delete_volume" :: waited 0.016s {{(pid=84538) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 18:58:41 devstack cinder-volume[84538]: DEBUG oslo.privsep.daemon [-] privsep: reply[ef783fc5-c4ac-46e7-83ae-84ba5f79ed1b]: (4, 'qcow2') {{(pid=85803) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 18:58:41 devstack cinder-volume[84538]: DEBUG oslo_concurrency.processutils [None req-13a0b23e-56ec-4640-930e-48f1e466b542 tempest-GroupsTest-154144425 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-625194d7-3e94-4a9b-a899-1774a2d061d8 {{(pid=84538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 18:58:41 devstack sudo[87919]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-625194d7-3e94-4a9b-a899-1774a2d061d8 Apr 29 18:58:41 devstack sudo[87915]: pam_unix(sudo:session): session closed for user root Apr 29 18:58:41 devstack sudo[87919]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 18:58:41 devstack cinder-volume[84538]: DEBUG oslo_concurrency.processutils [None req-8594e1cf-e6ff-45a9-85b9-5ad6358f5a4e tempest-SnapshotsActionsTest-711673579 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-556880c3-9a02-4e53-8a6c-203a2e269036.07942535-a943-4b14-950c-0b79b19eb8d4" returned: 0 in 0.669s {{(pid=84538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 18:58:41 devstack cinder-volume[84538]: DEBUG oslo_concurrency.lockutils [None req-8594e1cf-e6ff-45a9-85b9-5ad6358f5a4e tempest-SnapshotsActionsTest-711673579 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.086s {{(pid=84538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 18:58:41 devstack cinder-volume[84538]: INFO cinder.volume.manager [None req-8594e1cf-e6ff-45a9-85b9-5ad6358f5a4e tempest-SnapshotsActionsTest-711673579 None] Create snapshot completed successfully Apr 29 18:58:42 devstack cinder-volume[84538]: DEBUG cinder.coordination [None req-cc10076a-b592-4180-b1d9-ee5367c328fe tempest-SnapshotsActionsTest-2130050802 None] Acquiring lock "cinder-07942535-a943-4b14-950c-0b79b19eb8d4-delete_snapshot" by "delete_snapshot" {{(pid=84538) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 18:58:42 devstack cinder-volume[84538]: DEBUG cinder.coordination [None req-cc10076a-b592-4180-b1d9-ee5367c328fe tempest-SnapshotsActionsTest-2130050802 None] Lock "cinder-07942535-a943-4b14-950c-0b79b19eb8d4-delete_snapshot" acquired by "delete_snapshot" :: waited 0.035s {{(pid=84538) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 18:58:42 devstack cinder-volume[84538]: DEBUG cinder.coordination [None req-cc10076a-b592-4180-b1d9-ee5367c328fe tempest-SnapshotsActionsTest-2130050802 None] Acquiring lock "cinder-quobyte-556880c3-9a02-4e53-8a6c-203a2e269036" by "delete_snapshot" {{(pid=84538) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 18:58:42 devstack sudo[87919]: pam_unix(sudo:session): session closed for user root Apr 29 18:58:42 devstack cinder-volume[84538]: DEBUG oslo_concurrency.processutils [None req-13a0b23e-56ec-4640-930e-48f1e466b542 tempest-GroupsTest-154144425 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-625194d7-3e94-4a9b-a899-1774a2d061d8" returned: 0 in 0.794s {{(pid=84538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 18:58:42 devstack cinder-volume[84538]: DEBUG oslo_concurrency.processutils [None req-13a0b23e-56ec-4640-930e-48f1e466b542 tempest-GroupsTest-154144425 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-625194d7-3e94-4a9b-a899-1774a2d061d8 {{(pid=84538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 18:58:42 devstack cinder-volume[84538]: DEBUG cinder.coordination [None req-cc10076a-b592-4180-b1d9-ee5367c328fe tempest-SnapshotsActionsTest-2130050802 None] Lock "cinder-quobyte-556880c3-9a02-4e53-8a6c-203a2e269036" acquired by "delete_snapshot" :: waited 0.030s {{(pid=84538) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 18:58:42 devstack cinder-volume[84538]: DEBUG cinder.coordination [None req-cc10076a-b592-4180-b1d9-ee5367c328fe tempest-SnapshotsActionsTest-2130050802 None] Acquiring lock "cinder-quobyte-07942535-a943-4b14-950c-0b79b19eb8d4" by "_delete_snapshot" {{(pid=84538) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 18:58:42 devstack sudo[87925]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-625194d7-3e94-4a9b-a899-1774a2d061d8 Apr 29 18:58:42 devstack sudo[87925]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 18:58:42 devstack cinder-volume[84538]: DEBUG cinder.coordination [None req-cc10076a-b592-4180-b1d9-ee5367c328fe tempest-SnapshotsActionsTest-2130050802 None] Lock "cinder-quobyte-07942535-a943-4b14-950c-0b79b19eb8d4" acquired by "_delete_snapshot" :: waited 0.018s {{(pid=84538) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 18:58:42 devstack cinder-volume[84538]: DEBUG cinder.volume.drivers.remotefs [None req-cc10076a-b592-4180-b1d9-ee5367c328fe tempest-SnapshotsActionsTest-2130050802 None] Deleting offline snapshot 07942535-a943-4b14-950c-0b79b19eb8d4 of volume 556880c3-9a02-4e53-8a6c-203a2e269036 {{(pid=84538) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 29 18:58:42 devstack cinder-volume[84538]: DEBUG cinder.volume.drivers.remotefs [None req-cc10076a-b592-4180-b1d9-ee5367c328fe tempest-SnapshotsActionsTest-2130050802 None] snapshot_file for this snap is: volume-556880c3-9a02-4e53-8a6c-203a2e269036.07942535-a943-4b14-950c-0b79b19eb8d4 {{(pid=84538) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 29 18:58:42 devstack cinder-volume[84538]: DEBUG oslo.privsep.daemon [-] privsep: reply[e7cfd538-5c3b-418a-a386-4478249b9f52]: (4, 'qcow2') {{(pid=85803) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 18:58:42 devstack cinder-volume[84538]: DEBUG oslo_concurrency.processutils [None req-cc10076a-b592-4180-b1d9-ee5367c328fe tempest-SnapshotsActionsTest-2130050802 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-556880c3-9a02-4e53-8a6c-203a2e269036.07942535-a943-4b14-950c-0b79b19eb8d4 {{(pid=84538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 18:58:42 devstack sudo[87929]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-556880c3-9a02-4e53-8a6c-203a2e269036.07942535-a943-4b14-950c-0b79b19eb8d4 Apr 29 18:58:42 devstack sudo[87929]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 18:58:43 devstack sudo[87925]: pam_unix(sudo:session): session closed for user root Apr 29 18:58:43 devstack cinder-volume[84538]: DEBUG oslo_concurrency.processutils [None req-13a0b23e-56ec-4640-930e-48f1e466b542 tempest-GroupsTest-154144425 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-625194d7-3e94-4a9b-a899-1774a2d061d8" returned: 0 in 1.098s {{(pid=84538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 18:58:43 devstack cinder-volume[84538]: DEBUG cinder.coordination [None req-13a0b23e-56ec-4640-930e-48f1e466b542 tempest-GroupsTest-154144425 None] Lock "cinder-quobyte-625194d7-3e94-4a9b-a899-1774a2d061d8" released by "delete_volume" :: held 1.946s {{(pid=84538) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 18:58:43 devstack cinder-volume[84538]: DEBUG cinder.quota [None req-13a0b23e-56ec-4640-930e-48f1e466b542 tempest-GroupsTest-154144425 None] Created reservations ['749efd1c-67b3-4086-b5e8-ac7fd202fbb4'] {{(pid=84538) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 29 18:58:43 devstack sudo[87929]: pam_unix(sudo:session): session closed for user root Apr 29 18:58:43 devstack cinder-volume[84538]: DEBUG oslo_concurrency.processutils [None req-cc10076a-b592-4180-b1d9-ee5367c328fe tempest-SnapshotsActionsTest-2130050802 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-556880c3-9a02-4e53-8a6c-203a2e269036.07942535-a943-4b14-950c-0b79b19eb8d4" returned: 0 in 1.174s {{(pid=84538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 18:58:43 devstack cinder-volume[84538]: DEBUG cinder.volume.drivers.remotefs [None req-cc10076a-b592-4180-b1d9-ee5367c328fe tempest-SnapshotsActionsTest-2130050802 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-556880c3-9a02-4e53-8a6c-203a2e269036(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=84538) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 29 18:58:43 devstack cinder-volume[84538]: DEBUG oslo.privsep.daemon [-] privsep: reply[4e56a99f-d1c3-4735-9aff-c52be2ef8956]: (4, 'qcow2') {{(pid=85803) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 18:58:43 devstack cinder-volume[84538]: DEBUG oslo_concurrency.processutils [None req-cc10076a-b592-4180-b1d9-ee5367c328fe tempest-SnapshotsActionsTest-2130050802 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-556880c3-9a02-4e53-8a6c-203a2e269036.2dbee080-eb30-4349-9d21-fa64930394ca {{(pid=84538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 18:58:43 devstack cinder-volume[84538]: WARNING cinder.quota [None req-13a0b23e-56ec-4640-930e-48f1e466b542 tempest-GroupsTest-154144425 None] Deprecated: Default quota for resource: volumes_tempest-GroupsTest-volume-type-626992565 is set by the default quota flag: quota_volumes_tempest-GroupsTest-volume-type-626992565, it is now deprecated. Please use the default quota class for default quota. Apr 29 18:58:43 devstack cinder-volume[84538]: WARNING cinder.quota [None req-13a0b23e-56ec-4640-930e-48f1e466b542 tempest-GroupsTest-154144425 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupsTest-volume-type-626992565 is set by the default quota flag: quota_gigabytes_tempest-GroupsTest-volume-type-626992565, it is now deprecated. Please use the default quota class for default quota. Apr 29 18:58:43 devstack cinder-volume[84538]: DEBUG cinder.quota [None req-13a0b23e-56ec-4640-930e-48f1e466b542 tempest-GroupsTest-154144425 None] Created reservations ['316470e5-b799-42ec-84cb-971ea52819fe', '4ccf516d-db10-4b94-88e7-7048725bfdf7', '388461ea-c47d-4dba-a9ce-cc4d0b8e515d', '32fe503d-3bd3-4e5a-b79f-b34d5dce221f'] {{(pid=84538) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 29 18:58:43 devstack sudo[87968]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-556880c3-9a02-4e53-8a6c-203a2e269036.2dbee080-eb30-4349-9d21-fa64930394ca Apr 29 18:58:43 devstack sudo[87968]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 18:58:43 devstack cinder-volume[84538]: DEBUG cinder.quota [None req-13a0b23e-56ec-4640-930e-48f1e466b542 tempest-GroupsTest-154144425 None] Created reservations ['e7d80158-c601-4d03-b68b-c0d71b797b37', 'ef565fd8-7c8d-4d29-93aa-05a66122a5bb', '3c277132-7a58-4721-8150-b0a7ade8927b', '535edcce-439e-4427-bc0c-5a7ba07ef13f'] {{(pid=84538) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 29 18:58:44 devstack cinder-volume[84538]: DEBUG oslo_concurrency.lockutils [None req-13a0b23e-56ec-4640-930e-48f1e466b542 tempest-GroupsTest-154144425 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 18:58:44 devstack cinder-volume[84538]: DEBUG oslo_concurrency.lockutils [None req-13a0b23e-56ec-4640-930e-48f1e466b542 tempest-GroupsTest-154144425 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 18:58:44 devstack cinder-volume[84538]: DEBUG cinder.volume.drivers.quobyte [None req-13a0b23e-56ec-4640-930e-48f1e466b542 tempest-GroupsTest-154144425 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-34312b00-dd6d-45bb-af98-75855cea8e48': None} {{(pid=84538) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 18:58:44 devstack cinder-volume[84538]: DEBUG cinder.volume.drivers.quobyte [None req-13a0b23e-56ec-4640-930e-48f1e466b542 tempest-GroupsTest-154144425 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-34312b00-dd6d-45bb-af98-75855cea8e48'] {{(pid=84538) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 18:58:44 devstack cinder-volume[84538]: DEBUG oslo_concurrency.lockutils [None req-13a0b23e-56ec-4640-930e-48f1e466b542 tempest-GroupsTest-154144425 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=84538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 18:58:44 devstack cinder-volume[84538]: DEBUG oslo_concurrency.processutils [None req-13a0b23e-56ec-4640-930e-48f1e466b542 tempest-GroupsTest-154144425 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d {{(pid=84538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 18:58:44 devstack sudo[87971]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d Apr 29 18:58:44 devstack sudo[87971]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 18:58:45 devstack sudo[87968]: pam_unix(sudo:session): session closed for user root Apr 29 18:58:45 devstack cinder-volume[84538]: DEBUG oslo_concurrency.processutils [None req-cc10076a-b592-4180-b1d9-ee5367c328fe tempest-SnapshotsActionsTest-2130050802 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-556880c3-9a02-4e53-8a6c-203a2e269036.2dbee080-eb30-4349-9d21-fa64930394ca" returned: 0 in 1.628s {{(pid=84538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 18:58:45 devstack cinder-volume[84538]: DEBUG cinder.volume.drivers.remotefs [None req-cc10076a-b592-4180-b1d9-ee5367c328fe tempest-SnapshotsActionsTest-2130050802 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-556880c3-9a02-4e53-8a6c-203a2e269036(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=84538) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 29 18:58:45 devstack cinder-volume[84538]: DEBUG oslo_concurrency.processutils [None req-cc10076a-b592-4180-b1d9-ee5367c328fe tempest-SnapshotsActionsTest-2130050802 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-556880c3-9a02-4e53-8a6c-203a2e269036.07942535-a943-4b14-950c-0b79b19eb8d4 {{(pid=84538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 18:58:45 devstack sudo[87979]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-556880c3-9a02-4e53-8a6c-203a2e269036.07942535-a943-4b14-950c-0b79b19eb8d4 Apr 29 18:58:45 devstack sudo[87979]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 18:58:45 devstack sudo[87971]: pam_unix(sudo:session): session closed for user root Apr 29 18:58:45 devstack cinder-volume[84538]: DEBUG oslo_concurrency.processutils [None req-13a0b23e-56ec-4640-930e-48f1e466b542 tempest-GroupsTest-154144425 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d" returned: 0 in 1.503s {{(pid=84538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 18:58:45 devstack cinder-volume[84538]: DEBUG cinder.manager [None req-13a0b23e-56ec-4640-930e-48f1e466b542 tempest-GroupsTest-154144425 None] Notifying Schedulers of capabilities ... {{(pid=84538) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 29 18:58:45 devstack cinder-volume[84538]: INFO cinder.volume.manager [None req-13a0b23e-56ec-4640-930e-48f1e466b542 tempest-GroupsTest-154144425 None] Delete group completed successfully. Apr 29 18:58:47 devstack sudo[87979]: pam_unix(sudo:session): session closed for user root Apr 29 18:58:47 devstack cinder-volume[84538]: DEBUG oslo_concurrency.processutils [None req-cc10076a-b592-4180-b1d9-ee5367c328fe tempest-SnapshotsActionsTest-2130050802 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-556880c3-9a02-4e53-8a6c-203a2e269036.07942535-a943-4b14-950c-0b79b19eb8d4" returned: 0 in 1.842s {{(pid=84538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 18:58:47 devstack cinder-volume[84538]: DEBUG oslo_concurrency.processutils [None req-cc10076a-b592-4180-b1d9-ee5367c328fe tempest-SnapshotsActionsTest-2130050802 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-556880c3-9a02-4e53-8a6c-203a2e269036.07942535-a943-4b14-950c-0b79b19eb8d4 {{(pid=84538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 18:58:47 devstack sudo[88004]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-556880c3-9a02-4e53-8a6c-203a2e269036.07942535-a943-4b14-950c-0b79b19eb8d4 Apr 29 18:58:47 devstack sudo[88004]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 18:58:48 devstack sudo[88004]: pam_unix(sudo:session): session closed for user root Apr 29 18:58:48 devstack cinder-volume[84538]: DEBUG oslo_concurrency.processutils [None req-cc10076a-b592-4180-b1d9-ee5367c328fe tempest-SnapshotsActionsTest-2130050802 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-556880c3-9a02-4e53-8a6c-203a2e269036.07942535-a943-4b14-950c-0b79b19eb8d4" returned: 0 in 1.347s {{(pid=84538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 18:58:48 devstack cinder-volume[84538]: DEBUG cinder.coordination [None req-cc10076a-b592-4180-b1d9-ee5367c328fe tempest-SnapshotsActionsTest-2130050802 None] Lock "cinder-quobyte-07942535-a943-4b14-950c-0b79b19eb8d4" released by "_delete_snapshot" :: held 6.138s {{(pid=84538) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 18:58:48 devstack cinder-volume[84538]: DEBUG cinder.coordination [None req-cc10076a-b592-4180-b1d9-ee5367c328fe tempest-SnapshotsActionsTest-2130050802 None] Lock "cinder-quobyte-556880c3-9a02-4e53-8a6c-203a2e269036" released by "delete_snapshot" :: held 6.174s {{(pid=84538) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 18:58:48 devstack cinder-volume[84538]: DEBUG cinder.quota [None req-cc10076a-b592-4180-b1d9-ee5367c328fe tempest-SnapshotsActionsTest-2130050802 None] Created reservations ['13b1e0f8-e8db-4d29-952c-009cf0307d27', '94428917-ea6b-4e7c-97b2-6a2d04ecf956', '81c7b84b-77bc-4097-81f6-e043d76bb850', '366e485c-c7fb-4156-86e4-82711869346f'] {{(pid=84538) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 29 18:58:48 devstack cinder-volume[84538]: INFO cinder.volume.manager [None req-cc10076a-b592-4180-b1d9-ee5367c328fe tempest-SnapshotsActionsTest-2130050802 None] Delete snapshot completed successfully. Apr 29 18:58:48 devstack cinder-volume[84538]: DEBUG cinder.coordination [None req-cc10076a-b592-4180-b1d9-ee5367c328fe tempest-SnapshotsActionsTest-2130050802 None] Lock "cinder-07942535-a943-4b14-950c-0b79b19eb8d4-delete_snapshot" released by "delete_snapshot" :: held 6.473s {{(pid=84538) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 18:58:49 devstack cinder-volume[84538]: DEBUG oslo_concurrency.lockutils [None req-077cab6d-5374-4344-bc6b-d380075b99a3 tempest-SnapshotsActionsTest-711673579 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=84538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 18:58:49 devstack cinder-volume[84538]: DEBUG oslo_concurrency.lockutils [None req-077cab6d-5374-4344-bc6b-d380075b99a3 tempest-SnapshotsActionsTest-711673579 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=84538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 18:58:49 devstack cinder-volume[84538]: DEBUG cinder.volume.drivers.remotefs [None req-077cab6d-5374-4344-bc6b-d380075b99a3 tempest-SnapshotsActionsTest-711673579 None] Creating offline snapshot 3e4bf32c-ed58-4eb1-b0ed-a3a4e26dde75 of volume 556880c3-9a02-4e53-8a6c-203a2e269036 {{(pid=84538) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}} Apr 29 18:58:49 devstack cinder-volume[84538]: DEBUG oslo.privsep.daemon [-] privsep: reply[21979beb-d4a2-4a0a-9d79-c9d02bff6bc9]: (4, 'qcow2') {{(pid=85803) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 18:58:49 devstack cinder-volume[84538]: DEBUG oslo_concurrency.processutils [None req-077cab6d-5374-4344-bc6b-d380075b99a3 tempest-SnapshotsActionsTest-711673579 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-556880c3-9a02-4e53-8a6c-203a2e269036.2dbee080-eb30-4349-9d21-fa64930394ca {{(pid=84538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 18:58:50 devstack sudo[88026]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-556880c3-9a02-4e53-8a6c-203a2e269036.2dbee080-eb30-4349-9d21-fa64930394ca Apr 29 18:58:50 devstack sudo[88026]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 18:58:51 devstack sudo[88026]: pam_unix(sudo:session): session closed for user root Apr 29 18:58:51 devstack cinder-volume[84538]: DEBUG oslo_concurrency.processutils [None req-077cab6d-5374-4344-bc6b-d380075b99a3 tempest-SnapshotsActionsTest-711673579 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-556880c3-9a02-4e53-8a6c-203a2e269036.2dbee080-eb30-4349-9d21-fa64930394ca" returned: 0 in 1.310s {{(pid=84538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 18:58:51 devstack cinder-volume[84538]: DEBUG cinder.volume.drivers.remotefs [None req-077cab6d-5374-4344-bc6b-d380075b99a3 tempest-SnapshotsActionsTest-711673579 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-556880c3-9a02-4e53-8a6c-203a2e269036(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=84538) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 29 18:58:51 devstack cinder-volume[84538]: DEBUG oslo_concurrency.processutils [None req-077cab6d-5374-4344-bc6b-d380075b99a3 tempest-SnapshotsActionsTest-711673579 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-556880c3-9a02-4e53-8a6c-203a2e269036.2dbee080-eb30-4349-9d21-fa64930394ca,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-556880c3-9a02-4e53-8a6c-203a2e269036.3e4bf32c-ed58-4eb1-b0ed-a3a4e26dde75 1G {{(pid=84538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 18:58:51 devstack sudo[88036]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-556880c3-9a02-4e53-8a6c-203a2e269036.2dbee080-eb30-4349-9d21-fa64930394ca,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-556880c3-9a02-4e53-8a6c-203a2e269036.3e4bf32c-ed58-4eb1-b0ed-a3a4e26dde75 1G Apr 29 18:58:51 devstack sudo[88036]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 18:58:52 devstack sudo[88036]: pam_unix(sudo:session): session closed for user root Apr 29 18:58:52 devstack cinder-volume[84538]: DEBUG oslo_concurrency.processutils [None req-077cab6d-5374-4344-bc6b-d380075b99a3 tempest-SnapshotsActionsTest-711673579 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-556880c3-9a02-4e53-8a6c-203a2e269036.2dbee080-eb30-4349-9d21-fa64930394ca,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-556880c3-9a02-4e53-8a6c-203a2e269036.3e4bf32c-ed58-4eb1-b0ed-a3a4e26dde75 1G" returned: 0 in 1.254s {{(pid=84538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 18:58:52 devstack cinder-volume[84538]: DEBUG oslo_concurrency.processutils [None req-077cab6d-5374-4344-bc6b-d380075b99a3 tempest-SnapshotsActionsTest-711673579 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-556880c3-9a02-4e53-8a6c-203a2e269036.2dbee080-eb30-4349-9d21-fa64930394ca -F qcow2 /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-556880c3-9a02-4e53-8a6c-203a2e269036.3e4bf32c-ed58-4eb1-b0ed-a3a4e26dde75 {{(pid=84538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 18:58:52 devstack sudo[88043]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-556880c3-9a02-4e53-8a6c-203a2e269036.2dbee080-eb30-4349-9d21-fa64930394ca -F qcow2 /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-556880c3-9a02-4e53-8a6c-203a2e269036.3e4bf32c-ed58-4eb1-b0ed-a3a4e26dde75 Apr 29 18:58:52 devstack sudo[88043]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 18:58:53 devstack sudo[88043]: pam_unix(sudo:session): session closed for user root Apr 29 18:58:53 devstack cinder-volume[84538]: DEBUG oslo_concurrency.processutils [None req-077cab6d-5374-4344-bc6b-d380075b99a3 tempest-SnapshotsActionsTest-711673579 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-556880c3-9a02-4e53-8a6c-203a2e269036.2dbee080-eb30-4349-9d21-fa64930394ca -F qcow2 /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-556880c3-9a02-4e53-8a6c-203a2e269036.3e4bf32c-ed58-4eb1-b0ed-a3a4e26dde75" returned: 0 in 0.921s {{(pid=84538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 18:58:53 devstack cinder-volume[84538]: WARNING cinder.volume.drivers.remotefs [None req-077cab6d-5374-4344-bc6b-d380075b99a3 tempest-SnapshotsActionsTest-711673579 None] /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-556880c3-9a02-4e53-8a6c-203a2e269036.3e4bf32c-ed58-4eb1-b0ed-a3a4e26dde75 is being set with open permissions: ugo+rw Apr 29 18:58:53 devstack cinder-volume[84538]: DEBUG oslo_concurrency.processutils [None req-077cab6d-5374-4344-bc6b-d380075b99a3 tempest-SnapshotsActionsTest-711673579 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-556880c3-9a02-4e53-8a6c-203a2e269036.3e4bf32c-ed58-4eb1-b0ed-a3a4e26dde75 {{(pid=84538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 18:58:53 devstack sudo[88050]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-556880c3-9a02-4e53-8a6c-203a2e269036.3e4bf32c-ed58-4eb1-b0ed-a3a4e26dde75 Apr 29 18:58:53 devstack sudo[88050]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 18:58:54 devstack sudo[88050]: pam_unix(sudo:session): session closed for user root Apr 29 18:58:54 devstack cinder-volume[84538]: DEBUG oslo_concurrency.processutils [None req-077cab6d-5374-4344-bc6b-d380075b99a3 tempest-SnapshotsActionsTest-711673579 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-556880c3-9a02-4e53-8a6c-203a2e269036.3e4bf32c-ed58-4eb1-b0ed-a3a4e26dde75" returned: 0 in 0.980s {{(pid=84538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 18:58:54 devstack cinder-volume[84538]: DEBUG oslo_concurrency.lockutils [None req-077cab6d-5374-4344-bc6b-d380075b99a3 tempest-SnapshotsActionsTest-711673579 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.679s {{(pid=84538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 18:58:54 devstack cinder-volume[84538]: INFO cinder.volume.manager [None req-077cab6d-5374-4344-bc6b-d380075b99a3 tempest-SnapshotsActionsTest-711673579 None] Create snapshot completed successfully Apr 29 18:58:55 devstack cinder-volume[84538]: DEBUG cinder.coordination [None req-04ae250c-296a-4c20-a94d-0451b6035bf5 tempest-SnapshotsActionsTest-2130050802 None] Acquiring lock "cinder-3e4bf32c-ed58-4eb1-b0ed-a3a4e26dde75-delete_snapshot" by "delete_snapshot" {{(pid=84538) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 18:58:55 devstack cinder-volume[84538]: DEBUG cinder.coordination [None req-04ae250c-296a-4c20-a94d-0451b6035bf5 tempest-SnapshotsActionsTest-2130050802 None] Lock "cinder-3e4bf32c-ed58-4eb1-b0ed-a3a4e26dde75-delete_snapshot" acquired by "delete_snapshot" :: waited 0.025s {{(pid=84538) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 18:58:55 devstack cinder-volume[84538]: DEBUG cinder.coordination [None req-04ae250c-296a-4c20-a94d-0451b6035bf5 tempest-SnapshotsActionsTest-2130050802 None] Acquiring lock "cinder-quobyte-556880c3-9a02-4e53-8a6c-203a2e269036" by "delete_snapshot" {{(pid=84538) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 18:58:55 devstack cinder-volume[84538]: DEBUG cinder.coordination [None req-04ae250c-296a-4c20-a94d-0451b6035bf5 tempest-SnapshotsActionsTest-2130050802 None] Lock "cinder-quobyte-556880c3-9a02-4e53-8a6c-203a2e269036" acquired by "delete_snapshot" :: waited 0.015s {{(pid=84538) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 18:58:55 devstack cinder-volume[84538]: DEBUG cinder.coordination [None req-04ae250c-296a-4c20-a94d-0451b6035bf5 tempest-SnapshotsActionsTest-2130050802 None] Acquiring lock "cinder-quobyte-3e4bf32c-ed58-4eb1-b0ed-a3a4e26dde75" by "_delete_snapshot" {{(pid=84538) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 18:58:55 devstack cinder-volume[84538]: DEBUG cinder.coordination [None req-04ae250c-296a-4c20-a94d-0451b6035bf5 tempest-SnapshotsActionsTest-2130050802 None] Lock "cinder-quobyte-3e4bf32c-ed58-4eb1-b0ed-a3a4e26dde75" acquired by "_delete_snapshot" :: waited 0.013s {{(pid=84538) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 18:58:55 devstack cinder-volume[84538]: DEBUG cinder.volume.drivers.remotefs [None req-04ae250c-296a-4c20-a94d-0451b6035bf5 tempest-SnapshotsActionsTest-2130050802 None] Deleting offline snapshot 3e4bf32c-ed58-4eb1-b0ed-a3a4e26dde75 of volume 556880c3-9a02-4e53-8a6c-203a2e269036 {{(pid=84538) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 29 18:58:55 devstack cinder-volume[84538]: DEBUG cinder.volume.drivers.remotefs [None req-04ae250c-296a-4c20-a94d-0451b6035bf5 tempest-SnapshotsActionsTest-2130050802 None] snapshot_file for this snap is: volume-556880c3-9a02-4e53-8a6c-203a2e269036.3e4bf32c-ed58-4eb1-b0ed-a3a4e26dde75 {{(pid=84538) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 29 18:58:55 devstack cinder-volume[84538]: DEBUG oslo.privsep.daemon [-] privsep: reply[d7d7eec6-efc4-4bb6-9317-95e54a9bde88]: (4, 'qcow2') {{(pid=85803) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 18:58:55 devstack cinder-volume[84538]: DEBUG oslo_concurrency.processutils [None req-04ae250c-296a-4c20-a94d-0451b6035bf5 tempest-SnapshotsActionsTest-2130050802 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-556880c3-9a02-4e53-8a6c-203a2e269036.3e4bf32c-ed58-4eb1-b0ed-a3a4e26dde75 {{(pid=84538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 18:58:55 devstack sudo[88119]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-556880c3-9a02-4e53-8a6c-203a2e269036.3e4bf32c-ed58-4eb1-b0ed-a3a4e26dde75 Apr 29 18:58:55 devstack sudo[88119]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 18:58:56 devstack sudo[88119]: pam_unix(sudo:session): session closed for user root Apr 29 18:58:56 devstack cinder-volume[84538]: DEBUG oslo_concurrency.processutils [None req-04ae250c-296a-4c20-a94d-0451b6035bf5 tempest-SnapshotsActionsTest-2130050802 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-556880c3-9a02-4e53-8a6c-203a2e269036.3e4bf32c-ed58-4eb1-b0ed-a3a4e26dde75" returned: 0 in 1.350s {{(pid=84538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 18:58:56 devstack cinder-volume[84538]: DEBUG cinder.volume.drivers.remotefs [None req-04ae250c-296a-4c20-a94d-0451b6035bf5 tempest-SnapshotsActionsTest-2130050802 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-556880c3-9a02-4e53-8a6c-203a2e269036(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=84538) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 29 18:58:56 devstack cinder-volume[84538]: DEBUG oslo.privsep.daemon [-] privsep: reply[f45bc19d-13db-4344-a4d9-881c92e30e91]: (4, 'qcow2') {{(pid=85803) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 18:58:56 devstack cinder-volume[84538]: DEBUG oslo_concurrency.processutils [None req-04ae250c-296a-4c20-a94d-0451b6035bf5 tempest-SnapshotsActionsTest-2130050802 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-556880c3-9a02-4e53-8a6c-203a2e269036.2dbee080-eb30-4349-9d21-fa64930394ca {{(pid=84538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 18:58:56 devstack sudo[88234]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-556880c3-9a02-4e53-8a6c-203a2e269036.2dbee080-eb30-4349-9d21-fa64930394ca Apr 29 18:58:56 devstack sudo[88234]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 18:58:58 devstack sudo[88234]: pam_unix(sudo:session): session closed for user root Apr 29 18:58:58 devstack cinder-volume[84538]: DEBUG oslo_concurrency.processutils [None req-04ae250c-296a-4c20-a94d-0451b6035bf5 tempest-SnapshotsActionsTest-2130050802 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-556880c3-9a02-4e53-8a6c-203a2e269036.2dbee080-eb30-4349-9d21-fa64930394ca" returned: 0 in 1.675s {{(pid=84538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 18:58:58 devstack cinder-volume[84538]: DEBUG cinder.volume.drivers.remotefs [None req-04ae250c-296a-4c20-a94d-0451b6035bf5 tempest-SnapshotsActionsTest-2130050802 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-556880c3-9a02-4e53-8a6c-203a2e269036(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=84538) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 29 18:58:58 devstack cinder-volume[84538]: DEBUG oslo_concurrency.processutils [None req-04ae250c-296a-4c20-a94d-0451b6035bf5 tempest-SnapshotsActionsTest-2130050802 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-556880c3-9a02-4e53-8a6c-203a2e269036.3e4bf32c-ed58-4eb1-b0ed-a3a4e26dde75 {{(pid=84538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 18:58:58 devstack sudo[88291]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-556880c3-9a02-4e53-8a6c-203a2e269036.3e4bf32c-ed58-4eb1-b0ed-a3a4e26dde75 Apr 29 18:58:58 devstack sudo[88291]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 18:58:59 devstack sudo[88291]: pam_unix(sudo:session): session closed for user root Apr 29 18:58:59 devstack cinder-volume[84538]: DEBUG oslo_concurrency.processutils [None req-04ae250c-296a-4c20-a94d-0451b6035bf5 tempest-SnapshotsActionsTest-2130050802 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-556880c3-9a02-4e53-8a6c-203a2e269036.3e4bf32c-ed58-4eb1-b0ed-a3a4e26dde75" returned: 0 in 1.449s {{(pid=84538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 18:58:59 devstack cinder-volume[84538]: DEBUG oslo_concurrency.processutils [None req-04ae250c-296a-4c20-a94d-0451b6035bf5 tempest-SnapshotsActionsTest-2130050802 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-556880c3-9a02-4e53-8a6c-203a2e269036.3e4bf32c-ed58-4eb1-b0ed-a3a4e26dde75 {{(pid=84538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 18:58:59 devstack sudo[88310]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-556880c3-9a02-4e53-8a6c-203a2e269036.3e4bf32c-ed58-4eb1-b0ed-a3a4e26dde75 Apr 29 18:58:59 devstack sudo[88310]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 18:59:01 devstack sudo[88310]: pam_unix(sudo:session): session closed for user root Apr 29 18:59:01 devstack cinder-volume[84538]: DEBUG oslo_concurrency.processutils [None req-04ae250c-296a-4c20-a94d-0451b6035bf5 tempest-SnapshotsActionsTest-2130050802 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-556880c3-9a02-4e53-8a6c-203a2e269036.3e4bf32c-ed58-4eb1-b0ed-a3a4e26dde75" returned: 0 in 1.262s {{(pid=84538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 18:59:01 devstack cinder-volume[84538]: DEBUG cinder.coordination [None req-04ae250c-296a-4c20-a94d-0451b6035bf5 tempest-SnapshotsActionsTest-2130050802 None] Lock "cinder-quobyte-3e4bf32c-ed58-4eb1-b0ed-a3a4e26dde75" released by "_delete_snapshot" :: held 5.898s {{(pid=84538) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 18:59:01 devstack cinder-volume[84538]: DEBUG cinder.coordination [None req-04ae250c-296a-4c20-a94d-0451b6035bf5 tempest-SnapshotsActionsTest-2130050802 None] Lock "cinder-quobyte-556880c3-9a02-4e53-8a6c-203a2e269036" released by "delete_snapshot" :: held 5.922s {{(pid=84538) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 18:59:01 devstack cinder-volume[84538]: DEBUG cinder.quota [None req-04ae250c-296a-4c20-a94d-0451b6035bf5 tempest-SnapshotsActionsTest-2130050802 None] Created reservations ['0d7a7a31-c87e-46f2-b79a-5f51feafb7d4', '0d81a1ca-fd6e-4111-b8aa-9e1be0e4ffcd', 'ff9eb654-0002-4269-9296-a7deb3f774bd', '5ebb6a36-7ea9-489c-a86c-b62ac5d592b0'] {{(pid=84538) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 29 18:59:01 devstack cinder-volume[84538]: INFO cinder.volume.manager [None req-04ae250c-296a-4c20-a94d-0451b6035bf5 tempest-SnapshotsActionsTest-2130050802 None] Delete snapshot completed successfully. Apr 29 18:59:01 devstack cinder-volume[84538]: DEBUG cinder.coordination [None req-04ae250c-296a-4c20-a94d-0451b6035bf5 tempest-SnapshotsActionsTest-2130050802 None] Lock "cinder-3e4bf32c-ed58-4eb1-b0ed-a3a4e26dde75-delete_snapshot" released by "delete_snapshot" :: held 6.153s {{(pid=84538) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 18:59:02 devstack cinder-volume[84538]: DEBUG cinder.coordination [None req-0cfbe7c7-4b08-4154-82b9-5a34f82515d8 tempest-SnapshotsActionsTest-711673579 None] Acquiring lock "cinder-2dbee080-eb30-4349-9d21-fa64930394ca-delete_snapshot" by "delete_snapshot" {{(pid=84538) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 18:59:02 devstack cinder-volume[84538]: DEBUG cinder.coordination [None req-0cfbe7c7-4b08-4154-82b9-5a34f82515d8 tempest-SnapshotsActionsTest-711673579 None] Lock "cinder-2dbee080-eb30-4349-9d21-fa64930394ca-delete_snapshot" acquired by "delete_snapshot" :: waited 0.041s {{(pid=84538) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 18:59:02 devstack cinder-volume[84538]: DEBUG cinder.coordination [None req-0cfbe7c7-4b08-4154-82b9-5a34f82515d8 tempest-SnapshotsActionsTest-711673579 None] Acquiring lock "cinder-quobyte-556880c3-9a02-4e53-8a6c-203a2e269036" by "delete_snapshot" {{(pid=84538) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 18:59:02 devstack cinder-volume[84538]: DEBUG cinder.coordination [None req-0cfbe7c7-4b08-4154-82b9-5a34f82515d8 tempest-SnapshotsActionsTest-711673579 None] Lock "cinder-quobyte-556880c3-9a02-4e53-8a6c-203a2e269036" acquired by "delete_snapshot" :: waited 0.033s {{(pid=84538) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 18:59:02 devstack cinder-volume[84538]: DEBUG cinder.coordination [None req-0cfbe7c7-4b08-4154-82b9-5a34f82515d8 tempest-SnapshotsActionsTest-711673579 None] Acquiring lock "cinder-quobyte-2dbee080-eb30-4349-9d21-fa64930394ca" by "_delete_snapshot" {{(pid=84538) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 18:59:02 devstack cinder-volume[84538]: DEBUG cinder.coordination [None req-0cfbe7c7-4b08-4154-82b9-5a34f82515d8 tempest-SnapshotsActionsTest-711673579 None] Lock "cinder-quobyte-2dbee080-eb30-4349-9d21-fa64930394ca" acquired by "_delete_snapshot" :: waited 0.039s {{(pid=84538) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 18:59:02 devstack cinder-volume[84538]: DEBUG cinder.volume.drivers.remotefs [None req-0cfbe7c7-4b08-4154-82b9-5a34f82515d8 tempest-SnapshotsActionsTest-711673579 None] Deleting offline snapshot 2dbee080-eb30-4349-9d21-fa64930394ca of volume 556880c3-9a02-4e53-8a6c-203a2e269036 {{(pid=84538) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 29 18:59:02 devstack cinder-volume[84538]: DEBUG cinder.volume.drivers.remotefs [None req-0cfbe7c7-4b08-4154-82b9-5a34f82515d8 tempest-SnapshotsActionsTest-711673579 None] snapshot_file for this snap is: volume-556880c3-9a02-4e53-8a6c-203a2e269036.2dbee080-eb30-4349-9d21-fa64930394ca {{(pid=84538) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 29 18:59:02 devstack cinder-volume[84538]: DEBUG oslo.privsep.daemon [-] privsep: reply[252dc994-1e0a-4064-8dec-8120aed00b65]: (4, 'qcow2') {{(pid=85803) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 18:59:02 devstack cinder-volume[84538]: DEBUG oslo_concurrency.processutils [None req-0cfbe7c7-4b08-4154-82b9-5a34f82515d8 tempest-SnapshotsActionsTest-711673579 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-556880c3-9a02-4e53-8a6c-203a2e269036.2dbee080-eb30-4349-9d21-fa64930394ca {{(pid=84538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 18:59:03 devstack sudo[88315]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-556880c3-9a02-4e53-8a6c-203a2e269036.2dbee080-eb30-4349-9d21-fa64930394ca Apr 29 18:59:03 devstack sudo[88315]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 18:59:04 devstack sudo[88315]: pam_unix(sudo:session): session closed for user root Apr 29 18:59:04 devstack cinder-volume[84538]: DEBUG oslo_concurrency.processutils [None req-0cfbe7c7-4b08-4154-82b9-5a34f82515d8 tempest-SnapshotsActionsTest-711673579 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-556880c3-9a02-4e53-8a6c-203a2e269036.2dbee080-eb30-4349-9d21-fa64930394ca" returned: 0 in 1.969s {{(pid=84538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 18:59:04 devstack cinder-volume[84538]: DEBUG cinder.volume.drivers.remotefs [None req-0cfbe7c7-4b08-4154-82b9-5a34f82515d8 tempest-SnapshotsActionsTest-711673579 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-556880c3-9a02-4e53-8a6c-203a2e269036(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=84538) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 29 18:59:04 devstack cinder-volume[84538]: DEBUG oslo.privsep.daemon [-] privsep: reply[b659a931-7b4d-44cf-8638-35ea3259e5ab]: (4, 'qcow2') {{(pid=85803) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 18:59:04 devstack cinder-volume[84538]: DEBUG oslo_concurrency.processutils [None req-0cfbe7c7-4b08-4154-82b9-5a34f82515d8 tempest-SnapshotsActionsTest-711673579 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-556880c3-9a02-4e53-8a6c-203a2e269036 {{(pid=84538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 18:59:05 devstack sudo[88359]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-556880c3-9a02-4e53-8a6c-203a2e269036 Apr 29 18:59:05 devstack sudo[88359]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 18:59:06 devstack sudo[88359]: pam_unix(sudo:session): session closed for user root Apr 29 18:59:06 devstack cinder-volume[84538]: DEBUG oslo_concurrency.processutils [None req-0cfbe7c7-4b08-4154-82b9-5a34f82515d8 tempest-SnapshotsActionsTest-711673579 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-556880c3-9a02-4e53-8a6c-203a2e269036" returned: 0 in 1.369s {{(pid=84538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 18:59:06 devstack cinder-volume[84538]: DEBUG oslo_concurrency.processutils [None req-0cfbe7c7-4b08-4154-82b9-5a34f82515d8 tempest-SnapshotsActionsTest-711673579 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-556880c3-9a02-4e53-8a6c-203a2e269036.2dbee080-eb30-4349-9d21-fa64930394ca {{(pid=84538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 18:59:06 devstack sudo[88366]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-556880c3-9a02-4e53-8a6c-203a2e269036.2dbee080-eb30-4349-9d21-fa64930394ca Apr 29 18:59:06 devstack sudo[88366]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 18:59:07 devstack sudo[88366]: pam_unix(sudo:session): session closed for user root Apr 29 18:59:07 devstack cinder-volume[84538]: DEBUG oslo_concurrency.processutils [None req-0cfbe7c7-4b08-4154-82b9-5a34f82515d8 tempest-SnapshotsActionsTest-711673579 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-556880c3-9a02-4e53-8a6c-203a2e269036.2dbee080-eb30-4349-9d21-fa64930394ca" returned: 0 in 1.165s {{(pid=84538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 18:59:07 devstack cinder-volume[84538]: DEBUG oslo_concurrency.processutils [None req-0cfbe7c7-4b08-4154-82b9-5a34f82515d8 tempest-SnapshotsActionsTest-711673579 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-556880c3-9a02-4e53-8a6c-203a2e269036.2dbee080-eb30-4349-9d21-fa64930394ca {{(pid=84538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 18:59:07 devstack sudo[88372]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-556880c3-9a02-4e53-8a6c-203a2e269036.2dbee080-eb30-4349-9d21-fa64930394ca Apr 29 18:59:07 devstack sudo[88372]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 18:59:09 devstack sudo[88372]: pam_unix(sudo:session): session closed for user root Apr 29 18:59:09 devstack cinder-volume[84538]: DEBUG oslo_concurrency.processutils [None req-0cfbe7c7-4b08-4154-82b9-5a34f82515d8 tempest-SnapshotsActionsTest-711673579 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-556880c3-9a02-4e53-8a6c-203a2e269036.2dbee080-eb30-4349-9d21-fa64930394ca" returned: 0 in 1.707s {{(pid=84538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 18:59:09 devstack cinder-volume[84538]: DEBUG cinder.coordination [None req-0cfbe7c7-4b08-4154-82b9-5a34f82515d8 tempest-SnapshotsActionsTest-711673579 None] Lock "cinder-quobyte-2dbee080-eb30-4349-9d21-fa64930394ca" released by "_delete_snapshot" :: held 6.528s {{(pid=84538) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 18:59:09 devstack cinder-volume[84538]: DEBUG cinder.coordination [None req-0cfbe7c7-4b08-4154-82b9-5a34f82515d8 tempest-SnapshotsActionsTest-711673579 None] Lock "cinder-quobyte-556880c3-9a02-4e53-8a6c-203a2e269036" released by "delete_snapshot" :: held 6.588s {{(pid=84538) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 18:59:09 devstack cinder-volume[84538]: DEBUG cinder.quota [None req-0cfbe7c7-4b08-4154-82b9-5a34f82515d8 tempest-SnapshotsActionsTest-711673579 None] Created reservations ['04d015f1-0945-41c3-90ba-b430fc08f719', '9684999c-23ac-4e10-ab7b-25573eeab6c3', '16b3e7a4-0be4-41cf-862d-6d03f9663ac7', 'ce6b0e4a-05b4-4c58-bfa7-99a4b9b20813'] {{(pid=84538) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 29 18:59:09 devstack cinder-volume[84538]: INFO cinder.volume.manager [None req-0cfbe7c7-4b08-4154-82b9-5a34f82515d8 tempest-SnapshotsActionsTest-711673579 None] Delete snapshot completed successfully. Apr 29 18:59:09 devstack cinder-volume[84538]: DEBUG cinder.coordination [None req-0cfbe7c7-4b08-4154-82b9-5a34f82515d8 tempest-SnapshotsActionsTest-711673579 None] Lock "cinder-2dbee080-eb30-4349-9d21-fa64930394ca-delete_snapshot" released by "delete_snapshot" :: held 6.833s {{(pid=84538) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 18:59:09 devstack cinder-volume[84538]: DEBUG cinder.volume.flows.manager.create_volume [None req-22e81c05-befe-47f8-8b27-9af56fc676ab tempest-VolumeSnapshotQuotasNegativeTestJSON-1151111991 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84538) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Apr 29 18:59:09 devstack cinder-volume[84538]: DEBUG cinder.volume.manager [None req-22e81c05-befe-47f8-8b27-9af56fc676ab tempest-VolumeSnapshotQuotasNegativeTestJSON-1151111991 None] Flow 'volume_create_manager' (14a0ea50-644d-4795-8f54-84b9bdf84992) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84538) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 18:59:09 devstack cinder-volume[84538]: DEBUG cinder.volume.manager [None req-22e81c05-befe-47f8-8b27-9af56fc676ab tempest-VolumeSnapshotQuotasNegativeTestJSON-1151111991 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4a0898f0-8ba5-4bbf-b591-3b52ba9e59ec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 18:59:09 devstack cinder-volume[84538]: DEBUG cinder.volume.manager [None req-22e81c05-befe-47f8-8b27-9af56fc676ab tempest-VolumeSnapshotQuotasNegativeTestJSON-1151111991 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4a0898f0-8ba5-4bbf-b591-3b52ba9e59ec) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-29T16:59:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeSnapshotQuotasNegativeTestJSON-Volume-1738764410',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9b017876-282f-40d2-a656-b6e82922c70e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='440f074fff5b48d9999f2fc90263489a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T16:59:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T16:59:09Z,use_quota=True,user_id='7d9626879cea40c8ac33b6cf4e86cec0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(62b05900-93e3-4190-a88f-1d87324303d1),volume_type_id=62b05900-93e3-4190-a88f-1d87324303d1)' {{(pid=84538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 18:59:09 devstack cinder-volume[84538]: DEBUG cinder.volume.manager [None req-22e81c05-befe-47f8-8b27-9af56fc676ab tempest-VolumeSnapshotQuotasNegativeTestJSON-1151111991 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b84b4c13-0e1f-401e-ae5f-aedd49d053e9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 18:59:09 devstack cinder-volume[84538]: DEBUG cinder.volume.manager [None req-22e81c05-befe-47f8-8b27-9af56fc676ab tempest-VolumeSnapshotQuotasNegativeTestJSON-1151111991 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b84b4c13-0e1f-401e-ae5f-aedd49d053e9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 18:59:09 devstack cinder-volume[84538]: DEBUG cinder.volume.manager [None req-22e81c05-befe-47f8-8b27-9af56fc676ab tempest-VolumeSnapshotQuotasNegativeTestJSON-1151111991 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (72719771-290e-41aa-8a41-5a98f78ee8ed) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 18:59:09 devstack cinder-volume[84538]: DEBUG cinder.volume.manager [None req-22e81c05-befe-47f8-8b27-9af56fc676ab tempest-VolumeSnapshotQuotasNegativeTestJSON-1151111991 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (72719771-290e-41aa-8a41-5a98f78ee8ed) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9b017876-282f-40d2-a656-b6e82922c70e', 'volume_name': 'volume-9b017876-282f-40d2-a656-b6e82922c70e', 'volume_size': 1}' {{(pid=84538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 18:59:09 devstack cinder-volume[84538]: DEBUG cinder.volume.manager [None req-22e81c05-befe-47f8-8b27-9af56fc676ab tempest-VolumeSnapshotQuotasNegativeTestJSON-1151111991 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c4f29d27-9a22-4683-bc4d-0bd4d712a731) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 18:59:09 devstack cinder-volume[84538]: DEBUG cinder.volume.manager [None req-22e81c05-befe-47f8-8b27-9af56fc676ab tempest-VolumeSnapshotQuotasNegativeTestJSON-1151111991 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c4f29d27-9a22-4683-bc4d-0bd4d712a731) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 18:59:09 devstack cinder-volume[84538]: DEBUG cinder.volume.manager [None req-22e81c05-befe-47f8-8b27-9af56fc676ab tempest-VolumeSnapshotQuotasNegativeTestJSON-1151111991 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (57f86129-075a-4273-8efe-3abc3da55389) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 18:59:09 devstack cinder-volume[84538]: INFO cinder.volume.flows.manager.create_volume [None req-22e81c05-befe-47f8-8b27-9af56fc676ab tempest-VolumeSnapshotQuotasNegativeTestJSON-1151111991 None] Volume 9b017876-282f-40d2-a656-b6e82922c70e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9b017876-282f-40d2-a656-b6e82922c70e', 'volume_size': 1} Apr 29 18:59:09 devstack cinder-volume[84538]: DEBUG oslo_concurrency.lockutils [None req-22e81c05-befe-47f8-8b27-9af56fc676ab tempest-VolumeSnapshotQuotasNegativeTestJSON-1151111991 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 18:59:09 devstack cinder-volume[84538]: DEBUG oslo_concurrency.lockutils [None req-22e81c05-befe-47f8-8b27-9af56fc676ab tempest-VolumeSnapshotQuotasNegativeTestJSON-1151111991 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.005s {{(pid=84538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 18:59:09 devstack cinder-volume[84538]: DEBUG cinder.volume.drivers.quobyte [None req-22e81c05-befe-47f8-8b27-9af56fc676ab tempest-VolumeSnapshotQuotasNegativeTestJSON-1151111991 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-29T16:59:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeSnapshotQuotasNegativeTestJSON-Volume-1738764410',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9b017876-282f-40d2-a656-b6e82922c70e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='440f074fff5b48d9999f2fc90263489a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T16:59:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T16:59:09Z,use_quota=True,user_id='7d9626879cea40c8ac33b6cf4e86cec0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(62b05900-93e3-4190-a88f-1d87324303d1),volume_type_id=62b05900-93e3-4190-a88f-1d87324303d1)}" {{(pid=84538) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 29 18:59:09 devstack cinder-volume[84538]: DEBUG cinder.volume.drivers.remotefs [None req-22e81c05-befe-47f8-8b27-9af56fc676ab tempest-VolumeSnapshotQuotasNegativeTestJSON-1151111991 None] Creating volume 9b017876-282f-40d2-a656-b6e82922c70e {{(pid=84538) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 29 18:59:09 devstack cinder-volume[84538]: DEBUG oslo_concurrency.lockutils [None req-22e81c05-befe-47f8-8b27-9af56fc676ab tempest-VolumeSnapshotQuotasNegativeTestJSON-1151111991 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 18:59:09 devstack cinder-volume[84538]: DEBUG oslo_concurrency.lockutils [None req-22e81c05-befe-47f8-8b27-9af56fc676ab tempest-VolumeSnapshotQuotasNegativeTestJSON-1151111991 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 18:59:09 devstack cinder-volume[84538]: DEBUG cinder.volume.drivers.quobyte [None req-22e81c05-befe-47f8-8b27-9af56fc676ab tempest-VolumeSnapshotQuotasNegativeTestJSON-1151111991 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-34312b00-dd6d-45bb-af98-75855cea8e48': None} {{(pid=84538) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 18:59:09 devstack cinder-volume[84538]: DEBUG cinder.volume.drivers.quobyte [None req-22e81c05-befe-47f8-8b27-9af56fc676ab tempest-VolumeSnapshotQuotasNegativeTestJSON-1151111991 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-34312b00-dd6d-45bb-af98-75855cea8e48'] {{(pid=84538) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 18:59:09 devstack cinder-volume[84538]: DEBUG oslo_concurrency.lockutils [None req-22e81c05-befe-47f8-8b27-9af56fc676ab tempest-VolumeSnapshotQuotasNegativeTestJSON-1151111991 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.027s {{(pid=84538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 18:59:09 devstack cinder-volume[84538]: DEBUG cinder.volume.drivers.quobyte [None req-22e81c05-befe-47f8-8b27-9af56fc676ab tempest-VolumeSnapshotQuotasNegativeTestJSON-1151111991 None] Selected osci02.corp.quobyte.com/cinder-vol-34312b00-dd6d-45bb-af98-75855cea8e48 as target Quobyte volume. {{(pid=84538) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 29 18:59:09 devstack cinder-volume[84538]: INFO cinder.volume.drivers.remotefs [None req-22e81c05-befe-47f8-8b27-9af56fc676ab tempest-VolumeSnapshotQuotasNegativeTestJSON-1151111991 None] casted to osci02.corp.quobyte.com/cinder-vol-34312b00-dd6d-45bb-af98-75855cea8e48 Apr 29 18:59:09 devstack cinder-volume[84538]: DEBUG oslo_concurrency.processutils [None req-22e81c05-befe-47f8-8b27-9af56fc676ab tempest-VolumeSnapshotQuotasNegativeTestJSON-1151111991 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-9b017876-282f-40d2-a656-b6e82922c70e 1073741824 {{(pid=84538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 18:59:09 devstack sudo[88420]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-9b017876-282f-40d2-a656-b6e82922c70e 1073741824 Apr 29 18:59:09 devstack sudo[88420]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 18:59:10 devstack cinder-volume[84538]: DEBUG cinder.coordination [None req-4b19ad3a-5865-4469-a58a-1e6201a42fb2 tempest-SnapshotsActionsTest-711673579 None] Acquiring lock "cinder-556880c3-9a02-4e53-8a6c-203a2e269036-delete_volume" by "delete_volume" {{(pid=84538) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 18:59:10 devstack cinder-volume[84538]: DEBUG cinder.coordination [None req-4b19ad3a-5865-4469-a58a-1e6201a42fb2 tempest-SnapshotsActionsTest-711673579 None] Lock "cinder-556880c3-9a02-4e53-8a6c-203a2e269036-delete_volume" acquired by "delete_volume" :: waited 0.055s {{(pid=84538) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 18:59:10 devstack cinder-volume[84538]: DEBUG cinder.coordination [None req-4b19ad3a-5865-4469-a58a-1e6201a42fb2 tempest-SnapshotsActionsTest-711673579 None] Acquiring lock "cinder-quobyte-556880c3-9a02-4e53-8a6c-203a2e269036" by "delete_volume" {{(pid=84538) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 18:59:10 devstack cinder-volume[84538]: DEBUG cinder.coordination [None req-4b19ad3a-5865-4469-a58a-1e6201a42fb2 tempest-SnapshotsActionsTest-711673579 None] Lock "cinder-quobyte-556880c3-9a02-4e53-8a6c-203a2e269036" acquired by "delete_volume" :: waited 0.033s {{(pid=84538) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 18:59:10 devstack cinder-volume[84538]: DEBUG oslo.privsep.daemon [-] privsep: reply[0c98aebc-59f6-495f-9263-fce6f3da8c5c]: (4, 'qcow2') {{(pid=85803) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 18:59:10 devstack cinder-volume[84538]: DEBUG oslo_concurrency.processutils [None req-4b19ad3a-5865-4469-a58a-1e6201a42fb2 tempest-SnapshotsActionsTest-711673579 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-556880c3-9a02-4e53-8a6c-203a2e269036 {{(pid=84538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 18:59:11 devstack sudo[88426]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-556880c3-9a02-4e53-8a6c-203a2e269036 Apr 29 18:59:11 devstack sudo[88426]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 18:59:11 devstack sudo[88420]: pam_unix(sudo:session): session closed for user root Apr 29 18:59:11 devstack cinder-volume[84538]: DEBUG oslo_concurrency.processutils [None req-22e81c05-befe-47f8-8b27-9af56fc676ab tempest-VolumeSnapshotQuotasNegativeTestJSON-1151111991 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-9b017876-282f-40d2-a656-b6e82922c70e 1073741824" returned: 0 in 1.480s {{(pid=84538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 18:59:11 devstack cinder-volume[84538]: DEBUG oslo_concurrency.processutils [None req-22e81c05-befe-47f8-8b27-9af56fc676ab tempest-VolumeSnapshotQuotasNegativeTestJSON-1151111991 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-9b017876-282f-40d2-a656-b6e82922c70e {{(pid=84538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 18:59:11 devstack sudo[88441]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-9b017876-282f-40d2-a656-b6e82922c70e Apr 29 18:59:11 devstack sudo[88441]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 18:59:12 devstack sudo[88426]: pam_unix(sudo:session): session closed for user root Apr 29 18:59:12 devstack cinder-volume[84538]: DEBUG oslo_concurrency.processutils [None req-4b19ad3a-5865-4469-a58a-1e6201a42fb2 tempest-SnapshotsActionsTest-711673579 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-556880c3-9a02-4e53-8a6c-203a2e269036" returned: 0 in 1.305s {{(pid=84538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 18:59:12 devstack cinder-volume[84538]: DEBUG oslo_concurrency.processutils [None req-4b19ad3a-5865-4469-a58a-1e6201a42fb2 tempest-SnapshotsActionsTest-711673579 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-556880c3-9a02-4e53-8a6c-203a2e269036 {{(pid=84538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 18:59:12 devstack sudo[88481]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-556880c3-9a02-4e53-8a6c-203a2e269036 Apr 29 18:59:12 devstack sudo[88481]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 18:59:13 devstack sudo[88441]: pam_unix(sudo:session): session closed for user root Apr 29 18:59:13 devstack cinder-volume[84538]: DEBUG oslo_concurrency.processutils [None req-22e81c05-befe-47f8-8b27-9af56fc676ab tempest-VolumeSnapshotQuotasNegativeTestJSON-1151111991 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-9b017876-282f-40d2-a656-b6e82922c70e" returned: 0 in 1.691s {{(pid=84538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 18:59:13 devstack cinder-volume[84538]: DEBUG cinder.volume.drivers.quobyte [None req-22e81c05-befe-47f8-8b27-9af56fc676ab tempest-VolumeSnapshotQuotasNegativeTestJSON-1151111991 None] <== create_volume: return (3320ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-34312b00-dd6d-45bb-af98-75855cea8e48'} {{(pid=84538) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 29 18:59:13 devstack cinder-volume[84538]: DEBUG oslo_concurrency.lockutils [None req-22e81c05-befe-47f8-8b27-9af56fc676ab tempest-VolumeSnapshotQuotasNegativeTestJSON-1151111991 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 3.330s {{(pid=84538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 18:59:13 devstack cinder-volume[84538]: DEBUG cinder.volume.manager [None req-22e81c05-befe-47f8-8b27-9af56fc676ab tempest-VolumeSnapshotQuotasNegativeTestJSON-1151111991 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (57f86129-075a-4273-8efe-3abc3da55389) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9b017876-282f-40d2-a656-b6e82922c70e', 'volume_size': 1}' {{(pid=84538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 18:59:13 devstack cinder-volume[84538]: DEBUG cinder.volume.manager [None req-22e81c05-befe-47f8-8b27-9af56fc676ab tempest-VolumeSnapshotQuotasNegativeTestJSON-1151111991 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6ea647b2-c44a-413e-848f-c6f1f2ed9e9c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 18:59:13 devstack cinder-volume[84538]: INFO cinder.volume.flows.manager.create_volume [None req-22e81c05-befe-47f8-8b27-9af56fc676ab tempest-VolumeSnapshotQuotasNegativeTestJSON-1151111991 None] Volume volume-9b017876-282f-40d2-a656-b6e82922c70e (9b017876-282f-40d2-a656-b6e82922c70e): created successfully Apr 29 18:59:13 devstack cinder-volume[84538]: DEBUG cinder.volume.manager [None req-22e81c05-befe-47f8-8b27-9af56fc676ab tempest-VolumeSnapshotQuotasNegativeTestJSON-1151111991 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6ea647b2-c44a-413e-848f-c6f1f2ed9e9c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 18:59:13 devstack cinder-volume[84538]: DEBUG cinder.volume.manager [None req-22e81c05-befe-47f8-8b27-9af56fc676ab tempest-VolumeSnapshotQuotasNegativeTestJSON-1151111991 None] Flow 'volume_create_manager' (14a0ea50-644d-4795-8f54-84b9bdf84992) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84538) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 18:59:13 devstack cinder-volume[84538]: INFO cinder.volume.manager [None req-22e81c05-befe-47f8-8b27-9af56fc676ab tempest-VolumeSnapshotQuotasNegativeTestJSON-1151111991 None] Created volume successfully. Apr 29 18:59:13 devstack sudo[88481]: pam_unix(sudo:session): session closed for user root Apr 29 18:59:13 devstack cinder-volume[84538]: DEBUG oslo_concurrency.processutils [None req-4b19ad3a-5865-4469-a58a-1e6201a42fb2 tempest-SnapshotsActionsTest-711673579 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-556880c3-9a02-4e53-8a6c-203a2e269036" returned: 0 in 1.328s {{(pid=84538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 18:59:13 devstack cinder-volume[84538]: DEBUG cinder.coordination [None req-4b19ad3a-5865-4469-a58a-1e6201a42fb2 tempest-SnapshotsActionsTest-711673579 None] Lock "cinder-quobyte-556880c3-9a02-4e53-8a6c-203a2e269036" released by "delete_volume" :: held 2.763s {{(pid=84538) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 18:59:13 devstack cinder-volume[84538]: DEBUG cinder.quota [None req-4b19ad3a-5865-4469-a58a-1e6201a42fb2 tempest-SnapshotsActionsTest-711673579 None] Created reservations ['1f483b3e-f56e-4afc-bfcd-15dd7f8aecce', '5d1550ba-5e9f-444e-ae34-96e0fbf085ec', 'e5c7d938-1432-40ae-803c-1fb949eb3c46', '2e984fd8-cc60-4ae8-8e05-623b3ee627a8'] {{(pid=84538) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 29 18:59:13 devstack cinder-volume[84538]: DEBUG oslo_concurrency.lockutils [None req-4b19ad3a-5865-4469-a58a-1e6201a42fb2 tempest-SnapshotsActionsTest-711673579 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 18:59:13 devstack cinder-volume[84538]: DEBUG oslo_concurrency.lockutils [None req-4b19ad3a-5865-4469-a58a-1e6201a42fb2 tempest-SnapshotsActionsTest-711673579 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 18:59:13 devstack cinder-volume[84538]: DEBUG cinder.volume.drivers.quobyte [None req-4b19ad3a-5865-4469-a58a-1e6201a42fb2 tempest-SnapshotsActionsTest-711673579 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-34312b00-dd6d-45bb-af98-75855cea8e48': None} {{(pid=84538) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 18:59:13 devstack cinder-volume[84538]: DEBUG cinder.volume.drivers.quobyte [None req-4b19ad3a-5865-4469-a58a-1e6201a42fb2 tempest-SnapshotsActionsTest-711673579 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-34312b00-dd6d-45bb-af98-75855cea8e48'] {{(pid=84538) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 18:59:13 devstack cinder-volume[84538]: DEBUG oslo_concurrency.lockutils [None req-4b19ad3a-5865-4469-a58a-1e6201a42fb2 tempest-SnapshotsActionsTest-711673579 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=84538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 18:59:13 devstack cinder-volume[84538]: DEBUG oslo_concurrency.processutils [None req-4b19ad3a-5865-4469-a58a-1e6201a42fb2 tempest-SnapshotsActionsTest-711673579 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d {{(pid=84538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 18:59:13 devstack sudo[88542]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d Apr 29 18:59:13 devstack sudo[88542]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 18:59:14 devstack cinder-volume[84538]: DEBUG oslo_concurrency.lockutils [None req-081bf172-43b1-49a4-bca1-4ed957ae92f2 tempest-VolumeSnapshotQuotasNegativeTestJSON-1151111991 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=84538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 18:59:14 devstack cinder-volume[84538]: DEBUG oslo_concurrency.lockutils [None req-081bf172-43b1-49a4-bca1-4ed957ae92f2 tempest-VolumeSnapshotQuotasNegativeTestJSON-1151111991 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=84538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 18:59:14 devstack cinder-volume[84538]: DEBUG cinder.volume.drivers.remotefs [None req-081bf172-43b1-49a4-bca1-4ed957ae92f2 tempest-VolumeSnapshotQuotasNegativeTestJSON-1151111991 None] Creating offline snapshot 26591671-ffa0-4d07-972c-8fd023827f2d of volume 9b017876-282f-40d2-a656-b6e82922c70e {{(pid=84538) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}} Apr 29 18:59:14 devstack cinder-volume[84538]: DEBUG oslo.privsep.daemon [-] privsep: reply[b4a73010-9254-450b-9925-bb8e8d1c9fc0]: (4, 'qcow2') {{(pid=85803) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 18:59:14 devstack cinder-volume[84538]: DEBUG oslo_concurrency.processutils [None req-081bf172-43b1-49a4-bca1-4ed957ae92f2 tempest-VolumeSnapshotQuotasNegativeTestJSON-1151111991 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-9b017876-282f-40d2-a656-b6e82922c70e {{(pid=84538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 18:59:15 devstack sudo[88570]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-9b017876-282f-40d2-a656-b6e82922c70e Apr 29 18:59:15 devstack sudo[88570]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 18:59:16 devstack sudo[88542]: pam_unix(sudo:session): session closed for user root Apr 29 18:59:16 devstack cinder-volume[84538]: DEBUG oslo_concurrency.processutils [None req-4b19ad3a-5865-4469-a58a-1e6201a42fb2 tempest-SnapshotsActionsTest-711673579 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d" returned: 0 in 2.426s {{(pid=84538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 18:59:16 devstack cinder-volume[84538]: DEBUG cinder.manager [None req-4b19ad3a-5865-4469-a58a-1e6201a42fb2 tempest-SnapshotsActionsTest-711673579 None] Notifying Schedulers of capabilities ... {{(pid=84538) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 29 18:59:16 devstack cinder-volume[84538]: INFO cinder.volume.manager [None req-4b19ad3a-5865-4469-a58a-1e6201a42fb2 tempest-SnapshotsActionsTest-711673579 None] Deleted volume successfully. Apr 29 18:59:16 devstack cinder-volume[84538]: DEBUG cinder.coordination [None req-4b19ad3a-5865-4469-a58a-1e6201a42fb2 tempest-SnapshotsActionsTest-711673579 None] Lock "cinder-556880c3-9a02-4e53-8a6c-203a2e269036-delete_volume" released by "delete_volume" :: held 5.727s {{(pid=84538) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 18:59:16 devstack sudo[88570]: pam_unix(sudo:session): session closed for user root Apr 29 18:59:16 devstack cinder-volume[84538]: DEBUG oslo_concurrency.processutils [None req-081bf172-43b1-49a4-bca1-4ed957ae92f2 tempest-VolumeSnapshotQuotasNegativeTestJSON-1151111991 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-9b017876-282f-40d2-a656-b6e82922c70e" returned: 0 in 2.360s {{(pid=84538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 18:59:16 devstack cinder-volume[84538]: DEBUG oslo_concurrency.processutils [None req-081bf172-43b1-49a4-bca1-4ed957ae92f2 tempest-VolumeSnapshotQuotasNegativeTestJSON-1151111991 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-9b017876-282f-40d2-a656-b6e82922c70e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-9b017876-282f-40d2-a656-b6e82922c70e.26591671-ffa0-4d07-972c-8fd023827f2d 1G {{(pid=84538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 18:59:17 devstack sudo[88581]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-9b017876-282f-40d2-a656-b6e82922c70e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-9b017876-282f-40d2-a656-b6e82922c70e.26591671-ffa0-4d07-972c-8fd023827f2d 1G Apr 29 18:59:17 devstack sudo[88581]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 18:59:19 devstack sudo[88581]: pam_unix(sudo:session): session closed for user root Apr 29 18:59:19 devstack cinder-volume[84538]: DEBUG oslo_concurrency.processutils [None req-081bf172-43b1-49a4-bca1-4ed957ae92f2 tempest-VolumeSnapshotQuotasNegativeTestJSON-1151111991 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-9b017876-282f-40d2-a656-b6e82922c70e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-9b017876-282f-40d2-a656-b6e82922c70e.26591671-ffa0-4d07-972c-8fd023827f2d 1G" returned: 0 in 2.372s {{(pid=84538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 18:59:19 devstack cinder-volume[84538]: DEBUG oslo_concurrency.processutils [None req-081bf172-43b1-49a4-bca1-4ed957ae92f2 tempest-VolumeSnapshotQuotasNegativeTestJSON-1151111991 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9b017876-282f-40d2-a656-b6e82922c70e -F qcow2 /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-9b017876-282f-40d2-a656-b6e82922c70e.26591671-ffa0-4d07-972c-8fd023827f2d {{(pid=84538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 18:59:19 devstack sudo[88665]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9b017876-282f-40d2-a656-b6e82922c70e -F qcow2 /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-9b017876-282f-40d2-a656-b6e82922c70e.26591671-ffa0-4d07-972c-8fd023827f2d Apr 29 18:59:19 devstack sudo[88665]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 18:59:20 devstack cinder-volume[84538]: DEBUG cinder.volume.flows.manager.create_volume [None req-dc2a35e8-92de-4e5a-9032-369d57f3a3d9 tempest-ServerRescueNegativeTestJSON-1814105964 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84538) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Apr 29 18:59:20 devstack cinder-volume[84538]: DEBUG cinder.volume.manager [None req-dc2a35e8-92de-4e5a-9032-369d57f3a3d9 tempest-ServerRescueNegativeTestJSON-1814105964 None] Flow 'volume_create_manager' (2adc52b8-6a24-4b1c-9d18-827cf901e87f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84538) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 18:59:20 devstack cinder-volume[84538]: DEBUG cinder.volume.manager [None req-dc2a35e8-92de-4e5a-9032-369d57f3a3d9 tempest-ServerRescueNegativeTestJSON-1814105964 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d33afebe-5883-47f0-90be-3671460b7369) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 18:59:20 devstack cinder-volume[84538]: DEBUG cinder.volume.manager [None req-dc2a35e8-92de-4e5a-9032-369d57f3a3d9 tempest-ServerRescueNegativeTestJSON-1814105964 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d33afebe-5883-47f0-90be-3671460b7369) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-29T16:59:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServerRescueNegativeTestJSON-volume-12317049',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=92f3dc2e-8d80-4cbf-8884-3718e6ca1a50,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0475aeb7fd3642419cb4c734cd52e133',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T16:59:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T16:59:20Z,use_quota=True,user_id='e5a2a97e2e6349a99b6068aba3140a6a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(62b05900-93e3-4190-a88f-1d87324303d1),volume_type_id=62b05900-93e3-4190-a88f-1d87324303d1)' {{(pid=84538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 18:59:20 devstack cinder-volume[84538]: DEBUG cinder.volume.manager [None req-dc2a35e8-92de-4e5a-9032-369d57f3a3d9 tempest-ServerRescueNegativeTestJSON-1814105964 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d63ca8e5-6a2f-4b7d-a838-b1f45ed7de6e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 18:59:20 devstack cinder-volume[84538]: DEBUG cinder.volume.manager [None req-dc2a35e8-92de-4e5a-9032-369d57f3a3d9 tempest-ServerRescueNegativeTestJSON-1814105964 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d63ca8e5-6a2f-4b7d-a838-b1f45ed7de6e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 18:59:20 devstack cinder-volume[84538]: DEBUG cinder.volume.manager [None req-dc2a35e8-92de-4e5a-9032-369d57f3a3d9 tempest-ServerRescueNegativeTestJSON-1814105964 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (51fe2106-934a-4cd7-ae99-3772339a01ba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 18:59:20 devstack cinder-volume[84538]: DEBUG cinder.volume.manager [None req-dc2a35e8-92de-4e5a-9032-369d57f3a3d9 tempest-ServerRescueNegativeTestJSON-1814105964 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (51fe2106-934a-4cd7-ae99-3772339a01ba) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '92f3dc2e-8d80-4cbf-8884-3718e6ca1a50', 'volume_name': 'volume-92f3dc2e-8d80-4cbf-8884-3718e6ca1a50', 'volume_size': 1}' {{(pid=84538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 18:59:20 devstack cinder-volume[84538]: DEBUG cinder.volume.manager [None req-dc2a35e8-92de-4e5a-9032-369d57f3a3d9 tempest-ServerRescueNegativeTestJSON-1814105964 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9bf45606-4ddd-492c-90ed-b522d2c8dff5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 18:59:20 devstack cinder-volume[84538]: DEBUG cinder.volume.manager [None req-dc2a35e8-92de-4e5a-9032-369d57f3a3d9 tempest-ServerRescueNegativeTestJSON-1814105964 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9bf45606-4ddd-492c-90ed-b522d2c8dff5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 18:59:20 devstack cinder-volume[84538]: DEBUG cinder.volume.manager [None req-dc2a35e8-92de-4e5a-9032-369d57f3a3d9 tempest-ServerRescueNegativeTestJSON-1814105964 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (50eaa61e-d605-4219-9743-c21c4d75587c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 18:59:20 devstack cinder-volume[84538]: INFO cinder.volume.flows.manager.create_volume [None req-dc2a35e8-92de-4e5a-9032-369d57f3a3d9 tempest-ServerRescueNegativeTestJSON-1814105964 None] Volume 92f3dc2e-8d80-4cbf-8884-3718e6ca1a50: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-92f3dc2e-8d80-4cbf-8884-3718e6ca1a50', 'volume_size': 1} Apr 29 18:59:20 devstack cinder-volume[84538]: DEBUG oslo_concurrency.lockutils [None req-dc2a35e8-92de-4e5a-9032-369d57f3a3d9 tempest-ServerRescueNegativeTestJSON-1814105964 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 18:59:20 devstack sudo[88665]: pam_unix(sudo:session): session closed for user root Apr 29 18:59:20 devstack cinder-volume[84538]: DEBUG oslo_concurrency.processutils [None req-081bf172-43b1-49a4-bca1-4ed957ae92f2 tempest-VolumeSnapshotQuotasNegativeTestJSON-1151111991 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9b017876-282f-40d2-a656-b6e82922c70e -F qcow2 /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-9b017876-282f-40d2-a656-b6e82922c70e.26591671-ffa0-4d07-972c-8fd023827f2d" returned: 0 in 1.281s {{(pid=84538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 18:59:20 devstack cinder-volume[84538]: WARNING cinder.volume.drivers.remotefs [None req-081bf172-43b1-49a4-bca1-4ed957ae92f2 tempest-VolumeSnapshotQuotasNegativeTestJSON-1151111991 None] /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-9b017876-282f-40d2-a656-b6e82922c70e.26591671-ffa0-4d07-972c-8fd023827f2d is being set with open permissions: ugo+rw Apr 29 18:59:20 devstack cinder-volume[84538]: DEBUG oslo_concurrency.processutils [None req-081bf172-43b1-49a4-bca1-4ed957ae92f2 tempest-VolumeSnapshotQuotasNegativeTestJSON-1151111991 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-9b017876-282f-40d2-a656-b6e82922c70e.26591671-ffa0-4d07-972c-8fd023827f2d {{(pid=84538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 18:59:20 devstack sudo[88680]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-9b017876-282f-40d2-a656-b6e82922c70e.26591671-ffa0-4d07-972c-8fd023827f2d Apr 29 18:59:20 devstack sudo[88680]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 18:59:21 devstack sudo[88680]: pam_unix(sudo:session): session closed for user root Apr 29 18:59:21 devstack cinder-volume[84538]: DEBUG oslo_concurrency.processutils [None req-081bf172-43b1-49a4-bca1-4ed957ae92f2 tempest-VolumeSnapshotQuotasNegativeTestJSON-1151111991 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-9b017876-282f-40d2-a656-b6e82922c70e.26591671-ffa0-4d07-972c-8fd023827f2d" returned: 0 in 0.830s {{(pid=84538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 18:59:21 devstack cinder-volume[84538]: DEBUG oslo_concurrency.processutils [None req-081bf172-43b1-49a4-bca1-4ed957ae92f2 tempest-VolumeSnapshotQuotasNegativeTestJSON-1151111991 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-9b017876-282f-40d2-a656-b6e82922c70e.info {{(pid=84538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 18:59:21 devstack sudo[88685]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-9b017876-282f-40d2-a656-b6e82922c70e.info Apr 29 18:59:21 devstack sudo[88685]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 18:59:22 devstack sudo[88685]: pam_unix(sudo:session): session closed for user root Apr 29 18:59:22 devstack cinder-volume[84538]: DEBUG oslo_concurrency.processutils [None req-081bf172-43b1-49a4-bca1-4ed957ae92f2 tempest-VolumeSnapshotQuotasNegativeTestJSON-1151111991 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-9b017876-282f-40d2-a656-b6e82922c70e.info" returned: 0 in 0.723s {{(pid=84538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 18:59:22 devstack cinder-volume[84538]: WARNING cinder.volume.drivers.remotefs [None req-081bf172-43b1-49a4-bca1-4ed957ae92f2 tempest-VolumeSnapshotQuotasNegativeTestJSON-1151111991 None] /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-9b017876-282f-40d2-a656-b6e82922c70e.info is being set with open permissions: ugo+rw Apr 29 18:59:22 devstack cinder-volume[84538]: DEBUG oslo_concurrency.processutils [None req-081bf172-43b1-49a4-bca1-4ed957ae92f2 tempest-VolumeSnapshotQuotasNegativeTestJSON-1151111991 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-9b017876-282f-40d2-a656-b6e82922c70e.info {{(pid=84538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 18:59:22 devstack sudo[88690]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-9b017876-282f-40d2-a656-b6e82922c70e.info Apr 29 18:59:22 devstack sudo[88690]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 18:59:22 devstack cinder-volume[84538]: INFO cinder.volume.manager [req-c4e78ac0-b194-4825-b6cc-9886e0c5d0ae req-584b988f-409f-4125-a3ba-ce127244757e tempest-ServerBootFromVolumeStableRescueTest-1114355649 None] Terminate volume connection completed successfully. Apr 29 18:59:22 devstack cinder-volume[84538]: DEBUG cinder.volume.manager [req-c4e78ac0-b194-4825-b6cc-9886e0c5d0ae req-584b988f-409f-4125-a3ba-ce127244757e tempest-ServerBootFromVolumeStableRescueTest-1114355649 None] Deleting attachment 32dc924e-691f-4664-b5e5-21ef48e3de71. {{(pid=84538) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Apr 29 18:59:22 devstack sudo[88690]: pam_unix(sudo:session): session closed for user root Apr 29 18:59:22 devstack cinder-volume[84538]: DEBUG oslo_concurrency.processutils [None req-081bf172-43b1-49a4-bca1-4ed957ae92f2 tempest-VolumeSnapshotQuotasNegativeTestJSON-1151111991 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-9b017876-282f-40d2-a656-b6e82922c70e.info" returned: 0 in 0.745s {{(pid=84538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 18:59:23 devstack cinder-volume[84538]: DEBUG oslo_concurrency.lockutils [None req-081bf172-43b1-49a4-bca1-4ed957ae92f2 tempest-VolumeSnapshotQuotasNegativeTestJSON-1151111991 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 8.546s {{(pid=84538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 18:59:23 devstack cinder-volume[84538]: DEBUG oslo_concurrency.lockutils [None req-dc2a35e8-92de-4e5a-9032-369d57f3a3d9 tempest-ServerRescueNegativeTestJSON-1814105964 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.598s {{(pid=84538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 18:59:23 devstack cinder-volume[84538]: DEBUG cinder.volume.drivers.quobyte [None req-dc2a35e8-92de-4e5a-9032-369d57f3a3d9 tempest-ServerRescueNegativeTestJSON-1814105964 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-29T16:59:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServerRescueNegativeTestJSON-volume-12317049',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=92f3dc2e-8d80-4cbf-8884-3718e6ca1a50,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0475aeb7fd3642419cb4c734cd52e133',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T16:59:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T16:59:20Z,use_quota=True,user_id='e5a2a97e2e6349a99b6068aba3140a6a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(62b05900-93e3-4190-a88f-1d87324303d1),volume_type_id=62b05900-93e3-4190-a88f-1d87324303d1)}" {{(pid=84538) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 29 18:59:23 devstack cinder-volume[84538]: DEBUG cinder.volume.drivers.remotefs [None req-dc2a35e8-92de-4e5a-9032-369d57f3a3d9 tempest-ServerRescueNegativeTestJSON-1814105964 None] Creating volume 92f3dc2e-8d80-4cbf-8884-3718e6ca1a50 {{(pid=84538) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 29 18:59:23 devstack cinder-volume[84538]: DEBUG oslo_concurrency.lockutils [None req-dc2a35e8-92de-4e5a-9032-369d57f3a3d9 tempest-ServerRescueNegativeTestJSON-1814105964 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 18:59:23 devstack cinder-volume[84538]: DEBUG oslo_concurrency.lockutils [None req-dc2a35e8-92de-4e5a-9032-369d57f3a3d9 tempest-ServerRescueNegativeTestJSON-1814105964 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=84538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 18:59:23 devstack cinder-volume[84538]: DEBUG cinder.volume.drivers.quobyte [None req-dc2a35e8-92de-4e5a-9032-369d57f3a3d9 tempest-ServerRescueNegativeTestJSON-1814105964 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-34312b00-dd6d-45bb-af98-75855cea8e48': None} {{(pid=84538) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 18:59:23 devstack cinder-volume[84538]: DEBUG cinder.volume.drivers.quobyte [None req-dc2a35e8-92de-4e5a-9032-369d57f3a3d9 tempest-ServerRescueNegativeTestJSON-1814105964 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-34312b00-dd6d-45bb-af98-75855cea8e48'] {{(pid=84538) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 18:59:23 devstack cinder-volume[84538]: DEBUG oslo_concurrency.lockutils [None req-dc2a35e8-92de-4e5a-9032-369d57f3a3d9 tempest-ServerRescueNegativeTestJSON-1814105964 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=84538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 18:59:23 devstack cinder-volume[84538]: DEBUG cinder.volume.drivers.quobyte [None req-dc2a35e8-92de-4e5a-9032-369d57f3a3d9 tempest-ServerRescueNegativeTestJSON-1814105964 None] Selected osci02.corp.quobyte.com/cinder-vol-34312b00-dd6d-45bb-af98-75855cea8e48 as target Quobyte volume. {{(pid=84538) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 29 18:59:23 devstack cinder-volume[84538]: INFO cinder.volume.drivers.remotefs [None req-dc2a35e8-92de-4e5a-9032-369d57f3a3d9 tempest-ServerRescueNegativeTestJSON-1814105964 None] casted to osci02.corp.quobyte.com/cinder-vol-34312b00-dd6d-45bb-af98-75855cea8e48 Apr 29 18:59:23 devstack cinder-volume[84538]: DEBUG oslo_concurrency.processutils [None req-dc2a35e8-92de-4e5a-9032-369d57f3a3d9 tempest-ServerRescueNegativeTestJSON-1814105964 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-92f3dc2e-8d80-4cbf-8884-3718e6ca1a50 1073741824 {{(pid=84538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 18:59:23 devstack sudo[88694]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-92f3dc2e-8d80-4cbf-8884-3718e6ca1a50 1073741824 Apr 29 18:59:23 devstack sudo[88694]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 18:59:23 devstack cinder-volume[84538]: INFO cinder.volume.manager [None req-081bf172-43b1-49a4-bca1-4ed957ae92f2 tempest-VolumeSnapshotQuotasNegativeTestJSON-1151111991 None] Create snapshot completed successfully Apr 29 18:59:23 devstack cinder-volume[84538]: DEBUG cinder.coordination [req-c4e78ac0-b194-4825-b6cc-9886e0c5d0ae req-987b18ae-74bc-480c-a032-36c22f31da39 tempest-ServerBootFromVolumeStableRescueTest-1114355649 None] Acquiring lock "cinder-1adeda9a-0a54-42f8-b9f8-14806f72b985-delete_volume" by "delete_volume" {{(pid=84538) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 18:59:23 devstack cinder-volume[84538]: DEBUG cinder.coordination [req-c4e78ac0-b194-4825-b6cc-9886e0c5d0ae req-987b18ae-74bc-480c-a032-36c22f31da39 tempest-ServerBootFromVolumeStableRescueTest-1114355649 None] Lock "cinder-1adeda9a-0a54-42f8-b9f8-14806f72b985-delete_volume" acquired by "delete_volume" :: waited 0.032s {{(pid=84538) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 18:59:23 devstack cinder-volume[84538]: DEBUG cinder.coordination [req-c4e78ac0-b194-4825-b6cc-9886e0c5d0ae req-987b18ae-74bc-480c-a032-36c22f31da39 tempest-ServerBootFromVolumeStableRescueTest-1114355649 None] Acquiring lock "cinder-quobyte-1adeda9a-0a54-42f8-b9f8-14806f72b985" by "delete_volume" {{(pid=84538) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 18:59:23 devstack cinder-volume[84538]: DEBUG cinder.coordination [req-c4e78ac0-b194-4825-b6cc-9886e0c5d0ae req-987b18ae-74bc-480c-a032-36c22f31da39 tempest-ServerBootFromVolumeStableRescueTest-1114355649 None] Lock "cinder-quobyte-1adeda9a-0a54-42f8-b9f8-14806f72b985" acquired by "delete_volume" :: waited 0.040s {{(pid=84538) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 18:59:23 devstack cinder-volume[84538]: DEBUG oslo.privsep.daemon [-] privsep: reply[c96ab797-cca0-4153-a353-c8c44f7a8912]: (4, 'raw') {{(pid=85803) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 18:59:23 devstack cinder-volume[84538]: DEBUG oslo_concurrency.processutils [req-c4e78ac0-b194-4825-b6cc-9886e0c5d0ae req-987b18ae-74bc-480c-a032-36c22f31da39 tempest-ServerBootFromVolumeStableRescueTest-1114355649 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-1adeda9a-0a54-42f8-b9f8-14806f72b985 {{(pid=84538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 18:59:24 devstack sudo[88700]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-1adeda9a-0a54-42f8-b9f8-14806f72b985 Apr 29 18:59:24 devstack sudo[88700]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 18:59:24 devstack sudo[88694]: pam_unix(sudo:session): session closed for user root Apr 29 18:59:24 devstack cinder-volume[84538]: DEBUG oslo_concurrency.processutils [None req-dc2a35e8-92de-4e5a-9032-369d57f3a3d9 tempest-ServerRescueNegativeTestJSON-1814105964 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-92f3dc2e-8d80-4cbf-8884-3718e6ca1a50 1073741824" returned: 0 in 1.079s {{(pid=84538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 18:59:24 devstack cinder-volume[84538]: DEBUG oslo_concurrency.processutils [None req-dc2a35e8-92de-4e5a-9032-369d57f3a3d9 tempest-ServerRescueNegativeTestJSON-1814105964 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-92f3dc2e-8d80-4cbf-8884-3718e6ca1a50 {{(pid=84538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 18:59:24 devstack sudo[88705]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-92f3dc2e-8d80-4cbf-8884-3718e6ca1a50 Apr 29 18:59:24 devstack sudo[88705]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 18:59:25 devstack cinder-volume[84538]: DEBUG oslo_service.periodic_task [None req-a93183a6-1080-461c-84de-2fcb210d4f60 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=84538) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}} Apr 29 18:59:25 devstack cinder-volume[84538]: DEBUG oslo_concurrency.lockutils [None req-a93183a6-1080-461c-84de-2fcb210d4f60 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 18:59:25 devstack cinder-volume[84538]: DEBUG oslo_concurrency.lockutils [None req-a93183a6-1080-461c-84de-2fcb210d4f60 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=84538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 18:59:25 devstack cinder-volume[84538]: DEBUG cinder.volume.drivers.quobyte [None req-a93183a6-1080-461c-84de-2fcb210d4f60 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-34312b00-dd6d-45bb-af98-75855cea8e48': None} {{(pid=84538) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 18:59:25 devstack cinder-volume[84538]: DEBUG cinder.volume.drivers.quobyte [None req-a93183a6-1080-461c-84de-2fcb210d4f60 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-34312b00-dd6d-45bb-af98-75855cea8e48'] {{(pid=84538) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 18:59:25 devstack cinder-volume[84538]: DEBUG oslo_concurrency.lockutils [None req-a93183a6-1080-461c-84de-2fcb210d4f60 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.033s {{(pid=84538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 18:59:25 devstack cinder-volume[84538]: DEBUG oslo_concurrency.processutils [None req-a93183a6-1080-461c-84de-2fcb210d4f60 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d {{(pid=84538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 18:59:25 devstack sudo[88711]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d Apr 29 18:59:25 devstack sudo[88711]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 18:59:25 devstack cinder-volume[84538]: DEBUG cinder.volume.flows.manager.create_volume [None req-20595a64-a0bc-474c-ac25-dc163531f438 tempest-VolumeRetypeWithoutMigrationTest-400224339 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84538) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Apr 29 18:59:25 devstack cinder-volume[84538]: DEBUG cinder.volume.manager [None req-20595a64-a0bc-474c-ac25-dc163531f438 tempest-VolumeRetypeWithoutMigrationTest-400224339 None] Flow 'volume_create_manager' (348c6b42-fb4c-4803-a5d5-fe64f46aa4f9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84538) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 18:59:25 devstack cinder-volume[84538]: DEBUG cinder.volume.manager [None req-20595a64-a0bc-474c-ac25-dc163531f438 tempest-VolumeRetypeWithoutMigrationTest-400224339 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (819dbe23-8033-488e-b3fe-b190ade331fb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 18:59:25 devstack cinder-volume[84538]: DEBUG cinder.volume.manager [None req-20595a64-a0bc-474c-ac25-dc163531f438 tempest-VolumeRetypeWithoutMigrationTest-400224339 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (819dbe23-8033-488e-b3fe-b190ade331fb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-29T16:59:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeRetypeWithoutMigrationTest-Volume-1943494273',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4e251ea8-371e-445b-867d-23cf91aac9b8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e8c44105e97544f9a7e3c36946bc9cbc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T16:59:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T16:59:25Z,use_quota=True,user_id='2b066766fb7c4181812d57fc7fd7b400',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(877c508f-993d-4ad7-8379-38a15426a395),volume_type_id=877c508f-993d-4ad7-8379-38a15426a395)' {{(pid=84538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 18:59:25 devstack cinder-volume[84538]: DEBUG cinder.volume.manager [None req-20595a64-a0bc-474c-ac25-dc163531f438 tempest-VolumeRetypeWithoutMigrationTest-400224339 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1357fe5b-789b-4a31-a9bd-77e83d8d6c33) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 18:59:25 devstack cinder-volume[84538]: DEBUG cinder.volume.manager [None req-20595a64-a0bc-474c-ac25-dc163531f438 tempest-VolumeRetypeWithoutMigrationTest-400224339 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1357fe5b-789b-4a31-a9bd-77e83d8d6c33) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 18:59:25 devstack cinder-volume[84538]: DEBUG cinder.volume.manager [None req-20595a64-a0bc-474c-ac25-dc163531f438 tempest-VolumeRetypeWithoutMigrationTest-400224339 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d74f4ceb-84f3-4a3c-b197-9c27e21e279b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 18:59:25 devstack cinder-volume[84538]: DEBUG cinder.volume.manager [None req-20595a64-a0bc-474c-ac25-dc163531f438 tempest-VolumeRetypeWithoutMigrationTest-400224339 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d74f4ceb-84f3-4a3c-b197-9c27e21e279b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4e251ea8-371e-445b-867d-23cf91aac9b8', 'volume_name': 'volume-4e251ea8-371e-445b-867d-23cf91aac9b8', 'volume_size': 1}' {{(pid=84538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 18:59:25 devstack cinder-volume[84538]: DEBUG cinder.volume.manager [None req-20595a64-a0bc-474c-ac25-dc163531f438 tempest-VolumeRetypeWithoutMigrationTest-400224339 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e76854dd-7073-4218-9b46-0642f5ac1422) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 18:59:25 devstack cinder-volume[84538]: DEBUG cinder.volume.manager [None req-20595a64-a0bc-474c-ac25-dc163531f438 tempest-VolumeRetypeWithoutMigrationTest-400224339 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e76854dd-7073-4218-9b46-0642f5ac1422) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 18:59:25 devstack cinder-volume[84538]: DEBUG cinder.volume.manager [None req-20595a64-a0bc-474c-ac25-dc163531f438 tempest-VolumeRetypeWithoutMigrationTest-400224339 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2c933913-230c-42c4-b968-afa98cf1014c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 18:59:25 devstack cinder-volume[84538]: INFO cinder.volume.flows.manager.create_volume [None req-20595a64-a0bc-474c-ac25-dc163531f438 tempest-VolumeRetypeWithoutMigrationTest-400224339 None] Volume 4e251ea8-371e-445b-867d-23cf91aac9b8: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4e251ea8-371e-445b-867d-23cf91aac9b8', 'volume_size': 1} Apr 29 18:59:25 devstack cinder-volume[84538]: DEBUG oslo_concurrency.lockutils [None req-20595a64-a0bc-474c-ac25-dc163531f438 tempest-VolumeRetypeWithoutMigrationTest-400224339 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 18:59:25 devstack sudo[88705]: pam_unix(sudo:session): session closed for user root Apr 29 18:59:25 devstack cinder-volume[84538]: DEBUG cinder.coordination [None req-6a721d70-8796-47dc-b5ea-6880e72a0b90 tempest-VolumeSnapshotQuotasNegativeTestJSON-1151111991 None] Acquiring lock "cinder-26591671-ffa0-4d07-972c-8fd023827f2d-delete_snapshot" by "delete_snapshot" {{(pid=84538) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 18:59:25 devstack cinder-volume[84538]: DEBUG oslo_concurrency.processutils [None req-dc2a35e8-92de-4e5a-9032-369d57f3a3d9 tempest-ServerRescueNegativeTestJSON-1814105964 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-92f3dc2e-8d80-4cbf-8884-3718e6ca1a50" returned: 0 in 1.752s {{(pid=84538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 18:59:25 devstack cinder-volume[84538]: DEBUG cinder.volume.drivers.quobyte [None req-dc2a35e8-92de-4e5a-9032-369d57f3a3d9 tempest-ServerRescueNegativeTestJSON-1814105964 None] <== create_volume: return (2931ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-34312b00-dd6d-45bb-af98-75855cea8e48'} {{(pid=84538) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 29 18:59:25 devstack cinder-volume[84538]: DEBUG oslo_concurrency.lockutils [None req-dc2a35e8-92de-4e5a-9032-369d57f3a3d9 tempest-ServerRescueNegativeTestJSON-1814105964 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.936s {{(pid=84538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 18:59:25 devstack cinder-volume[84538]: DEBUG oslo_concurrency.lockutils [None req-20595a64-a0bc-474c-ac25-dc163531f438 tempest-VolumeRetypeWithoutMigrationTest-400224339 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.284s {{(pid=84538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 18:59:25 devstack cinder-volume[84538]: DEBUG cinder.volume.drivers.quobyte [None req-20595a64-a0bc-474c-ac25-dc163531f438 tempest-VolumeRetypeWithoutMigrationTest-400224339 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-29T16:59:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeRetypeWithoutMigrationTest-Volume-1943494273',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4e251ea8-371e-445b-867d-23cf91aac9b8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e8c44105e97544f9a7e3c36946bc9cbc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T16:59:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T16:59:25Z,use_quota=True,user_id='2b066766fb7c4181812d57fc7fd7b400',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(877c508f-993d-4ad7-8379-38a15426a395),volume_type_id=877c508f-993d-4ad7-8379-38a15426a395)}" {{(pid=84538) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 29 18:59:25 devstack cinder-volume[84538]: DEBUG cinder.volume.drivers.remotefs [None req-20595a64-a0bc-474c-ac25-dc163531f438 tempest-VolumeRetypeWithoutMigrationTest-400224339 None] Creating volume 4e251ea8-371e-445b-867d-23cf91aac9b8 {{(pid=84538) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 29 18:59:25 devstack cinder-volume[84538]: DEBUG oslo_concurrency.lockutils [None req-20595a64-a0bc-474c-ac25-dc163531f438 tempest-VolumeRetypeWithoutMigrationTest-400224339 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 18:59:25 devstack cinder-volume[84538]: DEBUG oslo_concurrency.lockutils [None req-20595a64-a0bc-474c-ac25-dc163531f438 tempest-VolumeRetypeWithoutMigrationTest-400224339 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 18:59:25 devstack cinder-volume[84538]: DEBUG cinder.volume.drivers.quobyte [None req-20595a64-a0bc-474c-ac25-dc163531f438 tempest-VolumeRetypeWithoutMigrationTest-400224339 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-34312b00-dd6d-45bb-af98-75855cea8e48': None} {{(pid=84538) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 18:59:25 devstack cinder-volume[84538]: DEBUG cinder.volume.drivers.quobyte [None req-20595a64-a0bc-474c-ac25-dc163531f438 tempest-VolumeRetypeWithoutMigrationTest-400224339 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-34312b00-dd6d-45bb-af98-75855cea8e48'] {{(pid=84538) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 18:59:25 devstack cinder-volume[84538]: DEBUG oslo_concurrency.lockutils [None req-20595a64-a0bc-474c-ac25-dc163531f438 tempest-VolumeRetypeWithoutMigrationTest-400224339 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=84538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 18:59:25 devstack cinder-volume[84538]: DEBUG cinder.volume.drivers.quobyte [None req-20595a64-a0bc-474c-ac25-dc163531f438 tempest-VolumeRetypeWithoutMigrationTest-400224339 None] Selected osci02.corp.quobyte.com/cinder-vol-34312b00-dd6d-45bb-af98-75855cea8e48 as target Quobyte volume. {{(pid=84538) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 29 18:59:25 devstack cinder-volume[84538]: INFO cinder.volume.drivers.remotefs [None req-20595a64-a0bc-474c-ac25-dc163531f438 tempest-VolumeRetypeWithoutMigrationTest-400224339 None] casted to osci02.corp.quobyte.com/cinder-vol-34312b00-dd6d-45bb-af98-75855cea8e48 Apr 29 18:59:25 devstack cinder-volume[84538]: DEBUG oslo_concurrency.processutils [None req-20595a64-a0bc-474c-ac25-dc163531f438 tempest-VolumeRetypeWithoutMigrationTest-400224339 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-4e251ea8-371e-445b-867d-23cf91aac9b8 1073741824 {{(pid=84538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 18:59:25 devstack sudo[88700]: pam_unix(sudo:session): session closed for user root Apr 29 18:59:26 devstack cinder-volume[84538]: DEBUG oslo_concurrency.processutils [req-c4e78ac0-b194-4825-b6cc-9886e0c5d0ae req-987b18ae-74bc-480c-a032-36c22f31da39 tempest-ServerBootFromVolumeStableRescueTest-1114355649 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-1adeda9a-0a54-42f8-b9f8-14806f72b985" returned: 0 in 2.158s {{(pid=84538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 18:59:26 devstack cinder-volume[84538]: DEBUG oslo_concurrency.processutils [req-c4e78ac0-b194-4825-b6cc-9886e0c5d0ae req-987b18ae-74bc-480c-a032-36c22f31da39 tempest-ServerBootFromVolumeStableRescueTest-1114355649 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-1adeda9a-0a54-42f8-b9f8-14806f72b985 {{(pid=84538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 18:59:26 devstack cinder-volume[84538]: DEBUG cinder.coordination [None req-6a721d70-8796-47dc-b5ea-6880e72a0b90 tempest-VolumeSnapshotQuotasNegativeTestJSON-1151111991 None] Lock "cinder-26591671-ffa0-4d07-972c-8fd023827f2d-delete_snapshot" acquired by "delete_snapshot" :: waited 0.129s {{(pid=84538) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 18:59:26 devstack cinder-volume[84538]: DEBUG cinder.coordination [None req-6a721d70-8796-47dc-b5ea-6880e72a0b90 tempest-VolumeSnapshotQuotasNegativeTestJSON-1151111991 None] Acquiring lock "cinder-quobyte-9b017876-282f-40d2-a656-b6e82922c70e" by "delete_snapshot" {{(pid=84538) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 18:59:26 devstack sudo[88723]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-4e251ea8-371e-445b-867d-23cf91aac9b8 1073741824 Apr 29 18:59:26 devstack sudo[88723]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 18:59:26 devstack cinder-volume[84538]: DEBUG cinder.volume.manager [None req-dc2a35e8-92de-4e5a-9032-369d57f3a3d9 tempest-ServerRescueNegativeTestJSON-1814105964 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (50eaa61e-d605-4219-9743-c21c4d75587c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-92f3dc2e-8d80-4cbf-8884-3718e6ca1a50', 'volume_size': 1}' {{(pid=84538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 18:59:26 devstack cinder-volume[84538]: DEBUG cinder.volume.manager [None req-dc2a35e8-92de-4e5a-9032-369d57f3a3d9 tempest-ServerRescueNegativeTestJSON-1814105964 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9df9f04f-2830-4a8b-a3bc-ca68168ebc95) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 18:59:26 devstack cinder-volume[84538]: DEBUG cinder.coordination [None req-6a721d70-8796-47dc-b5ea-6880e72a0b90 tempest-VolumeSnapshotQuotasNegativeTestJSON-1151111991 None] Lock "cinder-quobyte-9b017876-282f-40d2-a656-b6e82922c70e" acquired by "delete_snapshot" :: waited 0.196s {{(pid=84538) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 18:59:26 devstack cinder-volume[84538]: DEBUG cinder.coordination [None req-6a721d70-8796-47dc-b5ea-6880e72a0b90 tempest-VolumeSnapshotQuotasNegativeTestJSON-1151111991 None] Acquiring lock "cinder-quobyte-26591671-ffa0-4d07-972c-8fd023827f2d" by "_delete_snapshot" {{(pid=84538) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 18:59:26 devstack cinder-volume[84538]: INFO cinder.volume.flows.manager.create_volume [None req-dc2a35e8-92de-4e5a-9032-369d57f3a3d9 tempest-ServerRescueNegativeTestJSON-1814105964 None] Volume volume-92f3dc2e-8d80-4cbf-8884-3718e6ca1a50 (92f3dc2e-8d80-4cbf-8884-3718e6ca1a50): created successfully Apr 29 18:59:26 devstack cinder-volume[84538]: DEBUG cinder.volume.manager [None req-dc2a35e8-92de-4e5a-9032-369d57f3a3d9 tempest-ServerRescueNegativeTestJSON-1814105964 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9df9f04f-2830-4a8b-a3bc-ca68168ebc95) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 18:59:26 devstack cinder-volume[84538]: DEBUG cinder.volume.manager [None req-dc2a35e8-92de-4e5a-9032-369d57f3a3d9 tempest-ServerRescueNegativeTestJSON-1814105964 None] Flow 'volume_create_manager' (2adc52b8-6a24-4b1c-9d18-827cf901e87f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84538) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 18:59:26 devstack cinder-volume[84538]: DEBUG cinder.coordination [None req-6a721d70-8796-47dc-b5ea-6880e72a0b90 tempest-VolumeSnapshotQuotasNegativeTestJSON-1151111991 None] Lock "cinder-quobyte-26591671-ffa0-4d07-972c-8fd023827f2d" acquired by "_delete_snapshot" :: waited 0.167s {{(pid=84538) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 18:59:26 devstack cinder-volume[84538]: DEBUG cinder.volume.drivers.remotefs [None req-6a721d70-8796-47dc-b5ea-6880e72a0b90 tempest-VolumeSnapshotQuotasNegativeTestJSON-1151111991 None] Deleting offline snapshot 26591671-ffa0-4d07-972c-8fd023827f2d of volume 9b017876-282f-40d2-a656-b6e82922c70e {{(pid=84538) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 29 18:59:26 devstack cinder-volume[84538]: DEBUG cinder.volume.drivers.remotefs [None req-6a721d70-8796-47dc-b5ea-6880e72a0b90 tempest-VolumeSnapshotQuotasNegativeTestJSON-1151111991 None] snapshot_file for this snap is: volume-9b017876-282f-40d2-a656-b6e82922c70e.26591671-ffa0-4d07-972c-8fd023827f2d {{(pid=84538) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 29 18:59:26 devstack cinder-volume[84538]: INFO cinder.volume.manager [None req-dc2a35e8-92de-4e5a-9032-369d57f3a3d9 tempest-ServerRescueNegativeTestJSON-1814105964 None] Created volume successfully. Apr 29 18:59:26 devstack cinder-volume[84538]: DEBUG oslo.privsep.daemon [-] privsep: reply[fb1f9706-ffe3-4730-b470-c3c2626624a5]: (4, 'qcow2') {{(pid=85803) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 18:59:26 devstack cinder-volume[84538]: DEBUG oslo_concurrency.processutils [None req-6a721d70-8796-47dc-b5ea-6880e72a0b90 tempest-VolumeSnapshotQuotasNegativeTestJSON-1151111991 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-9b017876-282f-40d2-a656-b6e82922c70e.26591671-ffa0-4d07-972c-8fd023827f2d {{(pid=84538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 18:59:26 devstack sudo[88724]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-1adeda9a-0a54-42f8-b9f8-14806f72b985 Apr 29 18:59:26 devstack sudo[88724]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 18:59:26 devstack sudo[88711]: pam_unix(sudo:session): session closed for user root Apr 29 18:59:26 devstack cinder-volume[84538]: DEBUG oslo_concurrency.processutils [None req-a93183a6-1080-461c-84de-2fcb210d4f60 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d" returned: 0 in 1.677s {{(pid=84538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 18:59:26 devstack cinder-volume[84538]: DEBUG cinder.manager [None req-a93183a6-1080-461c-84de-2fcb210d4f60 None None] Notifying Schedulers of capabilities ... {{(pid=84538) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 29 18:59:26 devstack sudo[88735]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-9b017876-282f-40d2-a656-b6e82922c70e.26591671-ffa0-4d07-972c-8fd023827f2d Apr 29 18:59:26 devstack sudo[88735]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 18:59:28 devstack sudo[88723]: pam_unix(sudo:session): session closed for user root Apr 29 18:59:28 devstack cinder-volume[84538]: DEBUG oslo_concurrency.processutils [None req-20595a64-a0bc-474c-ac25-dc163531f438 tempest-VolumeRetypeWithoutMigrationTest-400224339 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-4e251ea8-371e-445b-867d-23cf91aac9b8 1073741824" returned: 0 in 2.136s {{(pid=84538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 18:59:28 devstack cinder-volume[84538]: DEBUG oslo_concurrency.processutils [None req-20595a64-a0bc-474c-ac25-dc163531f438 tempest-VolumeRetypeWithoutMigrationTest-400224339 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-4e251ea8-371e-445b-867d-23cf91aac9b8 {{(pid=84538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 18:59:28 devstack sudo[88764]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-4e251ea8-371e-445b-867d-23cf91aac9b8 Apr 29 18:59:28 devstack sudo[88764]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 18:59:28 devstack sudo[88735]: pam_unix(sudo:session): session closed for user root Apr 29 18:59:28 devstack cinder-volume[84538]: DEBUG oslo_concurrency.processutils [None req-6a721d70-8796-47dc-b5ea-6880e72a0b90 tempest-VolumeSnapshotQuotasNegativeTestJSON-1151111991 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-9b017876-282f-40d2-a656-b6e82922c70e.26591671-ffa0-4d07-972c-8fd023827f2d" returned: 0 in 1.892s {{(pid=84538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 18:59:28 devstack cinder-volume[84538]: DEBUG cinder.volume.drivers.remotefs [None req-6a721d70-8796-47dc-b5ea-6880e72a0b90 tempest-VolumeSnapshotQuotasNegativeTestJSON-1151111991 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-9b017876-282f-40d2-a656-b6e82922c70e(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=84538) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 29 18:59:28 devstack cinder-volume[84538]: DEBUG oslo.privsep.daemon [-] privsep: reply[d48ff252-0f9d-4e85-8f7b-02e23ff58164]: (4, 'qcow2') {{(pid=85803) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 18:59:28 devstack cinder-volume[84538]: DEBUG oslo_concurrency.processutils [None req-6a721d70-8796-47dc-b5ea-6880e72a0b90 tempest-VolumeSnapshotQuotasNegativeTestJSON-1151111991 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-9b017876-282f-40d2-a656-b6e82922c70e {{(pid=84538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 18:59:28 devstack sudo[88724]: pam_unix(sudo:session): session closed for user root Apr 29 18:59:28 devstack cinder-volume[84538]: DEBUG oslo_concurrency.processutils [req-c4e78ac0-b194-4825-b6cc-9886e0c5d0ae req-987b18ae-74bc-480c-a032-36c22f31da39 tempest-ServerBootFromVolumeStableRescueTest-1114355649 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-1adeda9a-0a54-42f8-b9f8-14806f72b985" returned: 1 in 2.500s {{(pid=84538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 18:59:28 devstack cinder-volume[84538]: DEBUG oslo_concurrency.processutils [req-c4e78ac0-b194-4825-b6cc-9886e0c5d0ae req-987b18ae-74bc-480c-a032-36c22f31da39 tempest-ServerBootFromVolumeStableRescueTest-1114355649 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-1adeda9a-0a54-42f8-b9f8-14806f72b985' failed. Not Retrying. {{(pid=84538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Apr 29 18:59:28 devstack cinder-volume[84538]: DEBUG oslo_concurrency.processutils [req-c4e78ac0-b194-4825-b6cc-9886e0c5d0ae req-987b18ae-74bc-480c-a032-36c22f31da39 tempest-ServerBootFromVolumeStableRescueTest-1114355649 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-1adeda9a-0a54-42f8-b9f8-14806f72b985 {{(pid=84538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 18:59:28 devstack sudo[88770]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-1adeda9a-0a54-42f8-b9f8-14806f72b985 Apr 29 18:59:28 devstack sudo[88770]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 18:59:28 devstack sudo[88769]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-9b017876-282f-40d2-a656-b6e82922c70e Apr 29 18:59:28 devstack sudo[88769]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 18:59:29 devstack sudo[88764]: pam_unix(sudo:session): session closed for user root Apr 29 18:59:29 devstack cinder-volume[84538]: DEBUG oslo_concurrency.processutils [None req-20595a64-a0bc-474c-ac25-dc163531f438 tempest-VolumeRetypeWithoutMigrationTest-400224339 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-4e251ea8-371e-445b-867d-23cf91aac9b8" returned: 0 in 1.411s {{(pid=84538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 18:59:29 devstack cinder-volume[84538]: DEBUG cinder.volume.drivers.quobyte [None req-20595a64-a0bc-474c-ac25-dc163531f438 tempest-VolumeRetypeWithoutMigrationTest-400224339 None] <== create_volume: return (3661ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-34312b00-dd6d-45bb-af98-75855cea8e48'} {{(pid=84538) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 29 18:59:29 devstack cinder-volume[84538]: DEBUG oslo_concurrency.lockutils [None req-20595a64-a0bc-474c-ac25-dc163531f438 tempest-VolumeRetypeWithoutMigrationTest-400224339 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 3.671s {{(pid=84538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 18:59:29 devstack cinder-volume[84538]: DEBUG cinder.volume.manager [None req-20595a64-a0bc-474c-ac25-dc163531f438 tempest-VolumeRetypeWithoutMigrationTest-400224339 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2c933913-230c-42c4-b968-afa98cf1014c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4e251ea8-371e-445b-867d-23cf91aac9b8', 'volume_size': 1}' {{(pid=84538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 18:59:29 devstack cinder-volume[84538]: DEBUG cinder.volume.manager [None req-20595a64-a0bc-474c-ac25-dc163531f438 tempest-VolumeRetypeWithoutMigrationTest-400224339 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f4da12d3-e04f-4163-9a98-92e92867bc44) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 18:59:29 devstack cinder-volume[84538]: INFO cinder.volume.flows.manager.create_volume [None req-20595a64-a0bc-474c-ac25-dc163531f438 tempest-VolumeRetypeWithoutMigrationTest-400224339 None] Volume volume-4e251ea8-371e-445b-867d-23cf91aac9b8 (4e251ea8-371e-445b-867d-23cf91aac9b8): created successfully Apr 29 18:59:29 devstack cinder-volume[84538]: DEBUG cinder.volume.manager [None req-20595a64-a0bc-474c-ac25-dc163531f438 tempest-VolumeRetypeWithoutMigrationTest-400224339 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f4da12d3-e04f-4163-9a98-92e92867bc44) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 18:59:29 devstack cinder-volume[84538]: DEBUG cinder.volume.manager [None req-20595a64-a0bc-474c-ac25-dc163531f438 tempest-VolumeRetypeWithoutMigrationTest-400224339 None] Flow 'volume_create_manager' (348c6b42-fb4c-4803-a5d5-fe64f46aa4f9) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84538) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 18:59:29 devstack cinder-volume[84538]: INFO cinder.volume.manager [None req-20595a64-a0bc-474c-ac25-dc163531f438 tempest-VolumeRetypeWithoutMigrationTest-400224339 None] Created volume successfully. Apr 29 18:59:30 devstack sudo[88770]: pam_unix(sudo:session): session closed for user root Apr 29 18:59:30 devstack cinder-volume[84538]: DEBUG oslo_concurrency.processutils [req-c4e78ac0-b194-4825-b6cc-9886e0c5d0ae req-987b18ae-74bc-480c-a032-36c22f31da39 tempest-ServerBootFromVolumeStableRescueTest-1114355649 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-1adeda9a-0a54-42f8-b9f8-14806f72b985" returned: 0 in 1.698s {{(pid=84538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 18:59:30 devstack cinder-volume[84538]: DEBUG cinder.coordination [req-c4e78ac0-b194-4825-b6cc-9886e0c5d0ae req-987b18ae-74bc-480c-a032-36c22f31da39 tempest-ServerBootFromVolumeStableRescueTest-1114355649 None] Lock "cinder-quobyte-1adeda9a-0a54-42f8-b9f8-14806f72b985" released by "delete_volume" :: held 6.519s {{(pid=84538) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 18:59:30 devstack sudo[88769]: pam_unix(sudo:session): session closed for user root Apr 29 18:59:30 devstack cinder-volume[84538]: DEBUG oslo_concurrency.processutils [None req-6a721d70-8796-47dc-b5ea-6880e72a0b90 tempest-VolumeSnapshotQuotasNegativeTestJSON-1151111991 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-9b017876-282f-40d2-a656-b6e82922c70e" returned: 0 in 1.888s {{(pid=84538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 18:59:30 devstack cinder-volume[84538]: DEBUG oslo_concurrency.processutils [None req-6a721d70-8796-47dc-b5ea-6880e72a0b90 tempest-VolumeSnapshotQuotasNegativeTestJSON-1151111991 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-9b017876-282f-40d2-a656-b6e82922c70e.26591671-ffa0-4d07-972c-8fd023827f2d {{(pid=84538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 18:59:30 devstack cinder-volume[84538]: DEBUG cinder.quota [req-c4e78ac0-b194-4825-b6cc-9886e0c5d0ae req-987b18ae-74bc-480c-a032-36c22f31da39 tempest-ServerBootFromVolumeStableRescueTest-1114355649 None] Created reservations ['4a5a922e-3e1e-4f6a-b7e2-8266ec116621', '4dcbf0c9-b4ef-42d0-9e95-ce1f5fde704c', 'e99654f9-d252-41f1-a245-f89060742b97', 'e8e50b92-d21b-4222-9ec9-b61788fc1bf4'] {{(pid=84538) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 29 18:59:30 devstack sudo[88808]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-9b017876-282f-40d2-a656-b6e82922c70e.26591671-ffa0-4d07-972c-8fd023827f2d Apr 29 18:59:30 devstack sudo[88808]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 18:59:30 devstack cinder-volume[84538]: DEBUG oslo_concurrency.lockutils [req-c4e78ac0-b194-4825-b6cc-9886e0c5d0ae req-987b18ae-74bc-480c-a032-36c22f31da39 tempest-ServerBootFromVolumeStableRescueTest-1114355649 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 18:59:30 devstack cinder-volume[84538]: DEBUG oslo_concurrency.lockutils [req-c4e78ac0-b194-4825-b6cc-9886e0c5d0ae req-987b18ae-74bc-480c-a032-36c22f31da39 tempest-ServerBootFromVolumeStableRescueTest-1114355649 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 18:59:30 devstack cinder-volume[84538]: DEBUG cinder.volume.drivers.quobyte [req-c4e78ac0-b194-4825-b6cc-9886e0c5d0ae req-987b18ae-74bc-480c-a032-36c22f31da39 tempest-ServerBootFromVolumeStableRescueTest-1114355649 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-34312b00-dd6d-45bb-af98-75855cea8e48': None} {{(pid=84538) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 18:59:30 devstack cinder-volume[84538]: DEBUG cinder.volume.drivers.quobyte [req-c4e78ac0-b194-4825-b6cc-9886e0c5d0ae req-987b18ae-74bc-480c-a032-36c22f31da39 tempest-ServerBootFromVolumeStableRescueTest-1114355649 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-34312b00-dd6d-45bb-af98-75855cea8e48'] {{(pid=84538) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 18:59:30 devstack cinder-volume[84538]: DEBUG oslo_concurrency.lockutils [req-c4e78ac0-b194-4825-b6cc-9886e0c5d0ae req-987b18ae-74bc-480c-a032-36c22f31da39 tempest-ServerBootFromVolumeStableRescueTest-1114355649 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.023s {{(pid=84538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 18:59:30 devstack cinder-volume[84538]: DEBUG oslo_concurrency.processutils [req-c4e78ac0-b194-4825-b6cc-9886e0c5d0ae req-987b18ae-74bc-480c-a032-36c22f31da39 tempest-ServerBootFromVolumeStableRescueTest-1114355649 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d {{(pid=84538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 18:59:30 devstack sudo[88815]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d Apr 29 18:59:30 devstack sudo[88815]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 18:59:31 devstack cinder-volume[84538]: DEBUG oslo_concurrency.lockutils [None req-53c6e135-e647-4ca9-b18e-f5343dbee6c3 tempest-VolumeRetypeWithoutMigrationTest-400224339 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 18:59:31 devstack cinder-volume[84538]: DEBUG oslo_concurrency.lockutils [None req-53c6e135-e647-4ca9-b18e-f5343dbee6c3 tempest-VolumeRetypeWithoutMigrationTest-400224339 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 18:59:31 devstack cinder-volume[84538]: DEBUG cinder.volume.drivers.quobyte [None req-53c6e135-e647-4ca9-b18e-f5343dbee6c3 tempest-VolumeRetypeWithoutMigrationTest-400224339 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-34312b00-dd6d-45bb-af98-75855cea8e48': None} {{(pid=84538) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 18:59:31 devstack cinder-volume[84538]: DEBUG cinder.volume.drivers.quobyte [None req-53c6e135-e647-4ca9-b18e-f5343dbee6c3 tempest-VolumeRetypeWithoutMigrationTest-400224339 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-34312b00-dd6d-45bb-af98-75855cea8e48'] {{(pid=84538) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 18:59:31 devstack cinder-volume[84538]: DEBUG oslo_concurrency.lockutils [None req-53c6e135-e647-4ca9-b18e-f5343dbee6c3 tempest-VolumeRetypeWithoutMigrationTest-400224339 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.035s {{(pid=84538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 18:59:31 devstack cinder-volume[84538]: DEBUG oslo_concurrency.processutils [None req-53c6e135-e647-4ca9-b18e-f5343dbee6c3 tempest-VolumeRetypeWithoutMigrationTest-400224339 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d {{(pid=84538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 18:59:31 devstack sudo[88848]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d Apr 29 18:59:31 devstack sudo[88848]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 18:59:31 devstack sudo[88815]: pam_unix(sudo:session): session closed for user root Apr 29 18:59:31 devstack cinder-volume[84538]: DEBUG oslo_concurrency.processutils [req-c4e78ac0-b194-4825-b6cc-9886e0c5d0ae req-987b18ae-74bc-480c-a032-36c22f31da39 tempest-ServerBootFromVolumeStableRescueTest-1114355649 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d" returned: 0 in 1.181s {{(pid=84538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 18:59:31 devstack cinder-volume[84538]: DEBUG cinder.manager [req-c4e78ac0-b194-4825-b6cc-9886e0c5d0ae req-987b18ae-74bc-480c-a032-36c22f31da39 tempest-ServerBootFromVolumeStableRescueTest-1114355649 None] Notifying Schedulers of capabilities ... {{(pid=84538) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 29 18:59:31 devstack cinder-volume[84538]: INFO cinder.volume.manager [req-c4e78ac0-b194-4825-b6cc-9886e0c5d0ae req-987b18ae-74bc-480c-a032-36c22f31da39 tempest-ServerBootFromVolumeStableRescueTest-1114355649 None] Deleted volume successfully. Apr 29 18:59:31 devstack cinder-volume[84538]: DEBUG cinder.coordination [req-c4e78ac0-b194-4825-b6cc-9886e0c5d0ae req-987b18ae-74bc-480c-a032-36c22f31da39 tempest-ServerBootFromVolumeStableRescueTest-1114355649 None] Lock "cinder-1adeda9a-0a54-42f8-b9f8-14806f72b985-delete_volume" released by "delete_volume" :: held 8.256s {{(pid=84538) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 18:59:32 devstack sudo[88808]: pam_unix(sudo:session): session closed for user root Apr 29 18:59:32 devstack cinder-volume[84538]: DEBUG oslo_concurrency.processutils [None req-6a721d70-8796-47dc-b5ea-6880e72a0b90 tempest-VolumeSnapshotQuotasNegativeTestJSON-1151111991 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-9b017876-282f-40d2-a656-b6e82922c70e.26591671-ffa0-4d07-972c-8fd023827f2d" returned: 0 in 1.842s {{(pid=84538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 18:59:32 devstack cinder-volume[84538]: DEBUG oslo_concurrency.processutils [None req-6a721d70-8796-47dc-b5ea-6880e72a0b90 tempest-VolumeSnapshotQuotasNegativeTestJSON-1151111991 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-9b017876-282f-40d2-a656-b6e82922c70e.26591671-ffa0-4d07-972c-8fd023827f2d {{(pid=84538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 18:59:32 devstack sudo[88882]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-9b017876-282f-40d2-a656-b6e82922c70e.26591671-ffa0-4d07-972c-8fd023827f2d Apr 29 18:59:32 devstack sudo[88882]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 18:59:32 devstack sudo[88848]: pam_unix(sudo:session): session closed for user root Apr 29 18:59:32 devstack cinder-volume[84538]: DEBUG oslo_concurrency.processutils [None req-53c6e135-e647-4ca9-b18e-f5343dbee6c3 tempest-VolumeRetypeWithoutMigrationTest-400224339 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d" returned: 0 in 1.103s {{(pid=84538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 18:59:32 devstack cinder-volume[84538]: DEBUG cinder.manager [None req-53c6e135-e647-4ca9-b18e-f5343dbee6c3 tempest-VolumeRetypeWithoutMigrationTest-400224339 None] Notifying Schedulers of capabilities ... {{(pid=84538) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 29 18:59:32 devstack cinder-volume[84538]: INFO cinder.volume.manager [None req-53c6e135-e647-4ca9-b18e-f5343dbee6c3 tempest-VolumeRetypeWithoutMigrationTest-400224339 None] Retype volume completed successfully. Apr 29 18:59:32 devstack cinder-volume[84538]: DEBUG cinder.coordination [None req-0315893d-b3c4-4539-81ec-8592b4213825 tempest-VolumeRetypeWithoutMigrationTest-400224339 None] Acquiring lock "cinder-4e251ea8-371e-445b-867d-23cf91aac9b8-delete_volume" by "delete_volume" {{(pid=84538) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 18:59:32 devstack cinder-volume[84538]: DEBUG cinder.coordination [None req-0315893d-b3c4-4539-81ec-8592b4213825 tempest-VolumeRetypeWithoutMigrationTest-400224339 None] Lock "cinder-4e251ea8-371e-445b-867d-23cf91aac9b8-delete_volume" acquired by "delete_volume" :: waited 0.042s {{(pid=84538) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 18:59:32 devstack cinder-volume[84538]: DEBUG dbcounter [-] [84538] Writing DB stats cinder:UPDATE=82,cinder:DELETE=8,cinder:SELECT=79,cinder:INSERT=22 {{(pid=84538) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Apr 29 18:59:32 devstack cinder-volume[84538]: DEBUG dbcounter [-] [84538] Writing DB stats cinder:UPDATE=86,cinder:SELECT=90,cinder:INSERT=28,cinder:DELETE=3 {{(pid=84538) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Apr 29 18:59:32 devstack cinder-volume[84538]: DEBUG cinder.coordination [None req-0315893d-b3c4-4539-81ec-8592b4213825 tempest-VolumeRetypeWithoutMigrationTest-400224339 None] Acquiring lock "cinder-quobyte-4e251ea8-371e-445b-867d-23cf91aac9b8" by "delete_volume" {{(pid=84538) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 18:59:32 devstack cinder-volume[84538]: DEBUG cinder.coordination [None req-0315893d-b3c4-4539-81ec-8592b4213825 tempest-VolumeRetypeWithoutMigrationTest-400224339 None] Lock "cinder-quobyte-4e251ea8-371e-445b-867d-23cf91aac9b8" acquired by "delete_volume" :: waited 0.031s {{(pid=84538) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 18:59:32 devstack cinder-volume[84538]: DEBUG oslo.privsep.daemon [-] privsep: reply[eba84a40-08cc-4cab-bce4-e6f2a3d92cf4]: (4, 'qcow2') {{(pid=85803) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 18:59:32 devstack cinder-volume[84538]: DEBUG oslo_concurrency.processutils [None req-0315893d-b3c4-4539-81ec-8592b4213825 tempest-VolumeRetypeWithoutMigrationTest-400224339 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-4e251ea8-371e-445b-867d-23cf91aac9b8 {{(pid=84538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 18:59:32 devstack sudo[88892]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-4e251ea8-371e-445b-867d-23cf91aac9b8 Apr 29 18:59:32 devstack sudo[88892]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 18:59:33 devstack sudo[88882]: pam_unix(sudo:session): session closed for user root Apr 29 18:59:33 devstack cinder-volume[84538]: DEBUG oslo_concurrency.processutils [None req-6a721d70-8796-47dc-b5ea-6880e72a0b90 tempest-VolumeSnapshotQuotasNegativeTestJSON-1151111991 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-9b017876-282f-40d2-a656-b6e82922c70e.26591671-ffa0-4d07-972c-8fd023827f2d" returned: 0 in 0.902s {{(pid=84538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 18:59:33 devstack cinder-volume[84538]: DEBUG cinder.coordination [None req-6a721d70-8796-47dc-b5ea-6880e72a0b90 tempest-VolumeSnapshotQuotasNegativeTestJSON-1151111991 None] Lock "cinder-quobyte-26591671-ffa0-4d07-972c-8fd023827f2d" released by "_delete_snapshot" :: held 6.746s {{(pid=84538) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 18:59:33 devstack cinder-volume[84538]: DEBUG cinder.coordination [None req-6a721d70-8796-47dc-b5ea-6880e72a0b90 tempest-VolumeSnapshotQuotasNegativeTestJSON-1151111991 None] Lock "cinder-quobyte-9b017876-282f-40d2-a656-b6e82922c70e" released by "delete_snapshot" :: held 6.943s {{(pid=84538) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 18:59:33 devstack cinder-volume[84538]: DEBUG cinder.quota [None req-6a721d70-8796-47dc-b5ea-6880e72a0b90 tempest-VolumeSnapshotQuotasNegativeTestJSON-1151111991 None] Created reservations ['f07ed63b-6e52-480c-b786-24fba97dc159', '498c32bc-e14b-484b-9a78-fcbac3128c12', '928fbd3d-04c9-4a77-9789-7bef02e7d713', '4985e8ca-d2c8-4e34-923a-92cd482116e9'] {{(pid=84538) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 29 18:59:33 devstack cinder-volume[84538]: INFO cinder.volume.manager [None req-6a721d70-8796-47dc-b5ea-6880e72a0b90 tempest-VolumeSnapshotQuotasNegativeTestJSON-1151111991 None] Delete snapshot completed successfully. Apr 29 18:59:33 devstack cinder-volume[84538]: DEBUG cinder.coordination [None req-6a721d70-8796-47dc-b5ea-6880e72a0b90 tempest-VolumeSnapshotQuotasNegativeTestJSON-1151111991 None] Lock "cinder-26591671-ffa0-4d07-972c-8fd023827f2d-delete_snapshot" released by "delete_snapshot" :: held 7.277s {{(pid=84538) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 18:59:33 devstack sudo[88892]: pam_unix(sudo:session): session closed for user root Apr 29 18:59:33 devstack cinder-volume[84538]: DEBUG oslo_concurrency.processutils [None req-0315893d-b3c4-4539-81ec-8592b4213825 tempest-VolumeRetypeWithoutMigrationTest-400224339 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-4e251ea8-371e-445b-867d-23cf91aac9b8" returned: 0 in 0.802s {{(pid=84538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 18:59:33 devstack cinder-volume[84538]: DEBUG oslo_concurrency.processutils [None req-0315893d-b3c4-4539-81ec-8592b4213825 tempest-VolumeRetypeWithoutMigrationTest-400224339 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-4e251ea8-371e-445b-867d-23cf91aac9b8 {{(pid=84538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 18:59:33 devstack sudo[88906]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-4e251ea8-371e-445b-867d-23cf91aac9b8 Apr 29 18:59:33 devstack sudo[88906]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 18:59:33 devstack cinder-volume[84538]: DEBUG cinder.coordination [None req-cce38951-473c-47a2-a3ae-ba55164d8ac7 tempest-VolumeSnapshotQuotasNegativeTestJSON-1151111991 None] Acquiring lock "cinder-9b017876-282f-40d2-a656-b6e82922c70e-delete_volume" by "delete_volume" {{(pid=84538) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 18:59:33 devstack cinder-volume[84538]: DEBUG cinder.coordination [None req-cce38951-473c-47a2-a3ae-ba55164d8ac7 tempest-VolumeSnapshotQuotasNegativeTestJSON-1151111991 None] Lock "cinder-9b017876-282f-40d2-a656-b6e82922c70e-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=84538) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 18:59:33 devstack cinder-volume[84538]: DEBUG cinder.coordination [None req-cce38951-473c-47a2-a3ae-ba55164d8ac7 tempest-VolumeSnapshotQuotasNegativeTestJSON-1151111991 None] Acquiring lock "cinder-quobyte-9b017876-282f-40d2-a656-b6e82922c70e" by "delete_volume" {{(pid=84538) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 18:59:33 devstack cinder-volume[84538]: DEBUG cinder.coordination [None req-cce38951-473c-47a2-a3ae-ba55164d8ac7 tempest-VolumeSnapshotQuotasNegativeTestJSON-1151111991 None] Lock "cinder-quobyte-9b017876-282f-40d2-a656-b6e82922c70e" acquired by "delete_volume" :: waited 0.030s {{(pid=84538) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 18:59:33 devstack cinder-volume[84538]: DEBUG oslo.privsep.daemon [-] privsep: reply[4874b384-0043-47ae-b9fd-e9bf5cbc0a2e]: (4, 'qcow2') {{(pid=85803) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 18:59:33 devstack cinder-volume[84538]: DEBUG oslo_concurrency.processutils [None req-cce38951-473c-47a2-a3ae-ba55164d8ac7 tempest-VolumeSnapshotQuotasNegativeTestJSON-1151111991 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-9b017876-282f-40d2-a656-b6e82922c70e {{(pid=84538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 18:59:33 devstack sudo[88908]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-9b017876-282f-40d2-a656-b6e82922c70e Apr 29 18:59:33 devstack sudo[88908]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 18:59:34 devstack sudo[88906]: pam_unix(sudo:session): session closed for user root Apr 29 18:59:34 devstack cinder-volume[84538]: DEBUG oslo_concurrency.processutils [None req-0315893d-b3c4-4539-81ec-8592b4213825 tempest-VolumeRetypeWithoutMigrationTest-400224339 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-4e251ea8-371e-445b-867d-23cf91aac9b8" returned: 0 in 0.675s {{(pid=84538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 18:59:34 devstack cinder-volume[84538]: DEBUG cinder.coordination [None req-0315893d-b3c4-4539-81ec-8592b4213825 tempest-VolumeRetypeWithoutMigrationTest-400224339 None] Lock "cinder-quobyte-4e251ea8-371e-445b-867d-23cf91aac9b8" released by "delete_volume" :: held 1.541s {{(pid=84538) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 18:59:34 devstack cinder-volume[84538]: WARNING cinder.quota [None req-0315893d-b3c4-4539-81ec-8592b4213825 tempest-VolumeRetypeWithoutMigrationTest-400224339 None] Deprecated: Default quota for resource: volumes_volume-type-2 is set by the default quota flag: quota_volumes_volume-type-2, it is now deprecated. Please use the default quota class for default quota. Apr 29 18:59:34 devstack cinder-volume[84538]: WARNING cinder.quota [None req-0315893d-b3c4-4539-81ec-8592b4213825 tempest-VolumeRetypeWithoutMigrationTest-400224339 None] Deprecated: Default quota for resource: gigabytes_volume-type-2 is set by the default quota flag: quota_gigabytes_volume-type-2, it is now deprecated. Please use the default quota class for default quota. Apr 29 18:59:34 devstack cinder-volume[84538]: DEBUG cinder.quota [None req-0315893d-b3c4-4539-81ec-8592b4213825 tempest-VolumeRetypeWithoutMigrationTest-400224339 None] Created reservations ['c3ceab12-4dfb-4fe2-8826-ae3120564f83', '708a08c2-43a8-4301-9f27-4bed53f4c92f', 'af77b5b8-2a32-4b5d-904b-e21be7b6844f', 'ebf6ae9a-6395-40db-8911-5ea7fc256de8'] {{(pid=84538) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 29 18:59:34 devstack cinder-volume[84538]: DEBUG oslo_concurrency.lockutils [None req-0315893d-b3c4-4539-81ec-8592b4213825 tempest-VolumeRetypeWithoutMigrationTest-400224339 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 18:59:34 devstack cinder-volume[84538]: DEBUG oslo_concurrency.lockutils [None req-0315893d-b3c4-4539-81ec-8592b4213825 tempest-VolumeRetypeWithoutMigrationTest-400224339 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 18:59:34 devstack cinder-volume[84538]: DEBUG cinder.volume.drivers.quobyte [None req-0315893d-b3c4-4539-81ec-8592b4213825 tempest-VolumeRetypeWithoutMigrationTest-400224339 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-34312b00-dd6d-45bb-af98-75855cea8e48': None} {{(pid=84538) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 18:59:34 devstack cinder-volume[84538]: DEBUG cinder.volume.drivers.quobyte [None req-0315893d-b3c4-4539-81ec-8592b4213825 tempest-VolumeRetypeWithoutMigrationTest-400224339 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-34312b00-dd6d-45bb-af98-75855cea8e48'] {{(pid=84538) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 18:59:34 devstack cinder-volume[84538]: DEBUG oslo_concurrency.lockutils [None req-0315893d-b3c4-4539-81ec-8592b4213825 tempest-VolumeRetypeWithoutMigrationTest-400224339 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=84538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 18:59:34 devstack cinder-volume[84538]: DEBUG oslo_concurrency.processutils [None req-0315893d-b3c4-4539-81ec-8592b4213825 tempest-VolumeRetypeWithoutMigrationTest-400224339 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d {{(pid=84538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 18:59:34 devstack sudo[88912]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d Apr 29 18:59:34 devstack sudo[88912]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 18:59:34 devstack sudo[88908]: pam_unix(sudo:session): session closed for user root Apr 29 18:59:34 devstack cinder-volume[84538]: DEBUG oslo_concurrency.processutils [None req-cce38951-473c-47a2-a3ae-ba55164d8ac7 tempest-VolumeSnapshotQuotasNegativeTestJSON-1151111991 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-9b017876-282f-40d2-a656-b6e82922c70e" returned: 0 in 0.794s {{(pid=84538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 18:59:34 devstack cinder-volume[84538]: DEBUG oslo_concurrency.processutils [None req-cce38951-473c-47a2-a3ae-ba55164d8ac7 tempest-VolumeSnapshotQuotasNegativeTestJSON-1151111991 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-9b017876-282f-40d2-a656-b6e82922c70e {{(pid=84538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 18:59:34 devstack sudo[88916]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-9b017876-282f-40d2-a656-b6e82922c70e Apr 29 18:59:34 devstack sudo[88916]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 18:59:35 devstack sudo[88912]: pam_unix(sudo:session): session closed for user root Apr 29 18:59:35 devstack cinder-volume[84538]: DEBUG oslo_concurrency.processutils [None req-0315893d-b3c4-4539-81ec-8592b4213825 tempest-VolumeRetypeWithoutMigrationTest-400224339 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d" returned: 0 in 0.703s {{(pid=84538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 18:59:35 devstack cinder-volume[84538]: DEBUG cinder.manager [None req-0315893d-b3c4-4539-81ec-8592b4213825 tempest-VolumeRetypeWithoutMigrationTest-400224339 None] Notifying Schedulers of capabilities ... {{(pid=84538) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 29 18:59:35 devstack cinder-volume[84538]: INFO cinder.volume.manager [None req-0315893d-b3c4-4539-81ec-8592b4213825 tempest-VolumeRetypeWithoutMigrationTest-400224339 None] Deleted volume successfully. Apr 29 18:59:35 devstack cinder-volume[84538]: DEBUG cinder.coordination [None req-0315893d-b3c4-4539-81ec-8592b4213825 tempest-VolumeRetypeWithoutMigrationTest-400224339 None] Lock "cinder-4e251ea8-371e-445b-867d-23cf91aac9b8-delete_volume" released by "delete_volume" :: held 2.547s {{(pid=84538) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 18:59:35 devstack sudo[88916]: pam_unix(sudo:session): session closed for user root Apr 29 18:59:35 devstack cinder-volume[84538]: DEBUG oslo_concurrency.processutils [None req-cce38951-473c-47a2-a3ae-ba55164d8ac7 tempest-VolumeSnapshotQuotasNegativeTestJSON-1151111991 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-9b017876-282f-40d2-a656-b6e82922c70e" returned: 0 in 0.638s {{(pid=84538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 18:59:35 devstack cinder-volume[84538]: DEBUG cinder.coordination [None req-cce38951-473c-47a2-a3ae-ba55164d8ac7 tempest-VolumeSnapshotQuotasNegativeTestJSON-1151111991 None] Lock "cinder-quobyte-9b017876-282f-40d2-a656-b6e82922c70e" released by "delete_volume" :: held 1.501s {{(pid=84538) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 18:59:35 devstack cinder-volume[84538]: DEBUG cinder.quota [None req-cce38951-473c-47a2-a3ae-ba55164d8ac7 tempest-VolumeSnapshotQuotasNegativeTestJSON-1151111991 None] Created reservations ['691a0eca-8fb2-4ea6-b4d8-857f872b6272', '4a8a4d73-19f6-4db9-aed4-0a4c49e49bcc', '52ffcb69-5662-4130-9605-28d062e31159', 'a97303f1-1063-4f89-8ecc-cffe4d9efb2a'] {{(pid=84538) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 29 18:59:35 devstack cinder-volume[84538]: DEBUG oslo_concurrency.lockutils [None req-cce38951-473c-47a2-a3ae-ba55164d8ac7 tempest-VolumeSnapshotQuotasNegativeTestJSON-1151111991 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 18:59:35 devstack cinder-volume[84538]: DEBUG oslo_concurrency.lockutils [None req-cce38951-473c-47a2-a3ae-ba55164d8ac7 tempest-VolumeSnapshotQuotasNegativeTestJSON-1151111991 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 18:59:35 devstack cinder-volume[84538]: DEBUG cinder.volume.drivers.quobyte [None req-cce38951-473c-47a2-a3ae-ba55164d8ac7 tempest-VolumeSnapshotQuotasNegativeTestJSON-1151111991 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-34312b00-dd6d-45bb-af98-75855cea8e48': None} {{(pid=84538) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 18:59:35 devstack cinder-volume[84538]: DEBUG cinder.volume.drivers.quobyte [None req-cce38951-473c-47a2-a3ae-ba55164d8ac7 tempest-VolumeSnapshotQuotasNegativeTestJSON-1151111991 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-34312b00-dd6d-45bb-af98-75855cea8e48'] {{(pid=84538) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 18:59:35 devstack cinder-volume[84538]: DEBUG oslo_concurrency.lockutils [None req-cce38951-473c-47a2-a3ae-ba55164d8ac7 tempest-VolumeSnapshotQuotasNegativeTestJSON-1151111991 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=84538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 18:59:35 devstack cinder-volume[84538]: DEBUG oslo_concurrency.processutils [None req-cce38951-473c-47a2-a3ae-ba55164d8ac7 tempest-VolumeSnapshotQuotasNegativeTestJSON-1151111991 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d {{(pid=84538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 18:59:35 devstack sudo[88921]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d Apr 29 18:59:35 devstack sudo[88921]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 18:59:36 devstack sudo[88921]: pam_unix(sudo:session): session closed for user root Apr 29 18:59:36 devstack cinder-volume[84538]: DEBUG oslo_concurrency.processutils [None req-cce38951-473c-47a2-a3ae-ba55164d8ac7 tempest-VolumeSnapshotQuotasNegativeTestJSON-1151111991 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d" returned: 0 in 0.662s {{(pid=84538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 18:59:36 devstack cinder-volume[84538]: DEBUG cinder.manager [None req-cce38951-473c-47a2-a3ae-ba55164d8ac7 tempest-VolumeSnapshotQuotasNegativeTestJSON-1151111991 None] Notifying Schedulers of capabilities ... {{(pid=84538) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 29 18:59:36 devstack cinder-volume[84538]: INFO cinder.volume.manager [None req-cce38951-473c-47a2-a3ae-ba55164d8ac7 tempest-VolumeSnapshotQuotasNegativeTestJSON-1151111991 None] Deleted volume successfully. Apr 29 18:59:36 devstack cinder-volume[84538]: DEBUG cinder.coordination [None req-cce38951-473c-47a2-a3ae-ba55164d8ac7 tempest-VolumeSnapshotQuotasNegativeTestJSON-1151111991 None] Lock "cinder-9b017876-282f-40d2-a656-b6e82922c70e-delete_volume" released by "delete_volume" :: held 2.400s {{(pid=84538) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 18:59:42 devstack cinder-volume[84538]: INFO cinder.volume.manager [req-0e7dc468-f833-4662-b3a9-a6dc1775ca87 req-128fe454-e742-45c6-a494-5eeafd8dd442 tempest-ServerBootFromVolumeStableRescueTest-1114355649 None] Terminate volume connection completed successfully. Apr 29 18:59:42 devstack cinder-volume[84538]: DEBUG cinder.volume.manager [req-0e7dc468-f833-4662-b3a9-a6dc1775ca87 req-128fe454-e742-45c6-a494-5eeafd8dd442 tempest-ServerBootFromVolumeStableRescueTest-1114355649 None] Deleting attachment 80426daa-2646-4970-a7b6-51b10b6106ea. {{(pid=84538) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Apr 29 18:59:42 devstack cinder-volume[84538]: DEBUG cinder.coordination [req-0e7dc468-f833-4662-b3a9-a6dc1775ca87 req-8f711a5d-4e27-464b-bfac-64adf0fa95de tempest-ServerBootFromVolumeStableRescueTest-1114355649 None] Acquiring lock "cinder-a9fdc1fd-9378-4813-a351-15da1e3bc986-delete_volume" by "delete_volume" {{(pid=84538) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 18:59:42 devstack cinder-volume[84538]: DEBUG cinder.coordination [req-0e7dc468-f833-4662-b3a9-a6dc1775ca87 req-8f711a5d-4e27-464b-bfac-64adf0fa95de tempest-ServerBootFromVolumeStableRescueTest-1114355649 None] Lock "cinder-a9fdc1fd-9378-4813-a351-15da1e3bc986-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=84538) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 18:59:42 devstack cinder-volume[84538]: DEBUG cinder.coordination [req-0e7dc468-f833-4662-b3a9-a6dc1775ca87 req-8f711a5d-4e27-464b-bfac-64adf0fa95de tempest-ServerBootFromVolumeStableRescueTest-1114355649 None] Acquiring lock "cinder-quobyte-a9fdc1fd-9378-4813-a351-15da1e3bc986" by "delete_volume" {{(pid=84538) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 18:59:42 devstack cinder-volume[84538]: DEBUG cinder.coordination [req-0e7dc468-f833-4662-b3a9-a6dc1775ca87 req-8f711a5d-4e27-464b-bfac-64adf0fa95de tempest-ServerBootFromVolumeStableRescueTest-1114355649 None] Lock "cinder-quobyte-a9fdc1fd-9378-4813-a351-15da1e3bc986" acquired by "delete_volume" :: waited 0.030s {{(pid=84538) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 18:59:43 devstack cinder-volume[84538]: DEBUG oslo.privsep.daemon [-] privsep: reply[cc8b3ed2-e371-4939-a780-9db87852771d]: (4, 'qcow2') {{(pid=85803) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 18:59:43 devstack cinder-volume[84538]: DEBUG oslo_concurrency.processutils [req-0e7dc468-f833-4662-b3a9-a6dc1775ca87 req-8f711a5d-4e27-464b-bfac-64adf0fa95de tempest-ServerBootFromVolumeStableRescueTest-1114355649 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-a9fdc1fd-9378-4813-a351-15da1e3bc986 {{(pid=84538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 18:59:43 devstack sudo[89050]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-a9fdc1fd-9378-4813-a351-15da1e3bc986 Apr 29 18:59:43 devstack sudo[89050]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 18:59:44 devstack sudo[89050]: pam_unix(sudo:session): session closed for user root Apr 29 18:59:44 devstack cinder-volume[84538]: DEBUG oslo_concurrency.processutils [req-0e7dc468-f833-4662-b3a9-a6dc1775ca87 req-8f711a5d-4e27-464b-bfac-64adf0fa95de tempest-ServerBootFromVolumeStableRescueTest-1114355649 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-a9fdc1fd-9378-4813-a351-15da1e3bc986" returned: 0 in 1.351s {{(pid=84538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 18:59:44 devstack cinder-volume[84538]: DEBUG oslo_concurrency.processutils [req-0e7dc468-f833-4662-b3a9-a6dc1775ca87 req-8f711a5d-4e27-464b-bfac-64adf0fa95de tempest-ServerBootFromVolumeStableRescueTest-1114355649 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-a9fdc1fd-9378-4813-a351-15da1e3bc986 {{(pid=84538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 18:59:44 devstack sudo[89055]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-a9fdc1fd-9378-4813-a351-15da1e3bc986 Apr 29 18:59:44 devstack sudo[89055]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 18:59:45 devstack cinder-volume[84538]: DEBUG cinder.volume.flows.manager.create_volume [None req-3cd2e4fe-3fb2-47c0-975e-124408071fce tempest-VolumesServicesTestJSON-542705041 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84538) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Apr 29 18:59:45 devstack cinder-volume[84538]: DEBUG cinder.volume.manager [None req-3cd2e4fe-3fb2-47c0-975e-124408071fce tempest-VolumesServicesTestJSON-542705041 None] Flow 'volume_create_manager' (c72f7279-b7c1-4b85-afb3-796b69118f63) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84538) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 18:59:45 devstack cinder-volume[84538]: DEBUG cinder.volume.manager [None req-3cd2e4fe-3fb2-47c0-975e-124408071fce tempest-VolumesServicesTestJSON-542705041 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5b62ff8c-690f-4740-aedd-61b75b1942a0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 18:59:45 devstack cinder-volume[84538]: DEBUG cinder.volume.manager [None req-3cd2e4fe-3fb2-47c0-975e-124408071fce tempest-VolumesServicesTestJSON-542705041 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5b62ff8c-690f-4740-aedd-61b75b1942a0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-29T16:59:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesServicesTestJSON-Volume-773455001',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7274d5a8-30e0-49bc-baa7-cc9b36883dfd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f19655241e3a40ba8b0ef11550bf326b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T16:59:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T16:59:45Z,use_quota=True,user_id='96b81d0bee1d42658cae45b4861e6dbc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(62b05900-93e3-4190-a88f-1d87324303d1),volume_type_id=62b05900-93e3-4190-a88f-1d87324303d1)' {{(pid=84538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 18:59:45 devstack cinder-volume[84538]: DEBUG cinder.volume.manager [None req-3cd2e4fe-3fb2-47c0-975e-124408071fce tempest-VolumesServicesTestJSON-542705041 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (452cae2a-c3c9-4d39-b02d-12cd42c5ecdd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 18:59:45 devstack cinder-volume[84538]: DEBUG cinder.volume.manager [None req-3cd2e4fe-3fb2-47c0-975e-124408071fce tempest-VolumesServicesTestJSON-542705041 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (452cae2a-c3c9-4d39-b02d-12cd42c5ecdd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 18:59:45 devstack cinder-volume[84538]: DEBUG cinder.volume.manager [None req-3cd2e4fe-3fb2-47c0-975e-124408071fce tempest-VolumesServicesTestJSON-542705041 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3115bcf9-ddd9-4c1b-b9f5-e158d8f2afdb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 18:59:45 devstack cinder-volume[84538]: DEBUG cinder.volume.manager [None req-3cd2e4fe-3fb2-47c0-975e-124408071fce tempest-VolumesServicesTestJSON-542705041 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3115bcf9-ddd9-4c1b-b9f5-e158d8f2afdb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7274d5a8-30e0-49bc-baa7-cc9b36883dfd', 'volume_name': 'volume-7274d5a8-30e0-49bc-baa7-cc9b36883dfd', 'volume_size': 1}' {{(pid=84538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 18:59:45 devstack cinder-volume[84538]: DEBUG cinder.volume.manager [None req-3cd2e4fe-3fb2-47c0-975e-124408071fce tempest-VolumesServicesTestJSON-542705041 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8526b488-f8e7-4cd6-bbe9-7050143fa33f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 18:59:45 devstack cinder-volume[84538]: DEBUG cinder.volume.manager [None req-3cd2e4fe-3fb2-47c0-975e-124408071fce tempest-VolumesServicesTestJSON-542705041 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8526b488-f8e7-4cd6-bbe9-7050143fa33f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 18:59:45 devstack cinder-volume[84538]: DEBUG cinder.volume.manager [None req-3cd2e4fe-3fb2-47c0-975e-124408071fce tempest-VolumesServicesTestJSON-542705041 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a7fed8c9-ea5c-428c-a3d6-d59b19629fcc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 18:59:45 devstack cinder-volume[84538]: INFO cinder.volume.flows.manager.create_volume [None req-3cd2e4fe-3fb2-47c0-975e-124408071fce tempest-VolumesServicesTestJSON-542705041 None] Volume 7274d5a8-30e0-49bc-baa7-cc9b36883dfd: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7274d5a8-30e0-49bc-baa7-cc9b36883dfd', 'volume_size': 1} Apr 29 18:59:45 devstack cinder-volume[84538]: DEBUG oslo_concurrency.lockutils [None req-3cd2e4fe-3fb2-47c0-975e-124408071fce tempest-VolumesServicesTestJSON-542705041 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 18:59:45 devstack cinder-volume[84538]: DEBUG oslo_concurrency.lockutils [None req-3cd2e4fe-3fb2-47c0-975e-124408071fce tempest-VolumesServicesTestJSON-542705041 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=84538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 18:59:45 devstack cinder-volume[84538]: DEBUG cinder.volume.drivers.quobyte [None req-3cd2e4fe-3fb2-47c0-975e-124408071fce tempest-VolumesServicesTestJSON-542705041 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-29T16:59:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesServicesTestJSON-Volume-773455001',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7274d5a8-30e0-49bc-baa7-cc9b36883dfd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f19655241e3a40ba8b0ef11550bf326b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T16:59:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T16:59:45Z,use_quota=True,user_id='96b81d0bee1d42658cae45b4861e6dbc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(62b05900-93e3-4190-a88f-1d87324303d1),volume_type_id=62b05900-93e3-4190-a88f-1d87324303d1)}" {{(pid=84538) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 29 18:59:45 devstack cinder-volume[84538]: DEBUG cinder.volume.drivers.remotefs [None req-3cd2e4fe-3fb2-47c0-975e-124408071fce tempest-VolumesServicesTestJSON-542705041 None] Creating volume 7274d5a8-30e0-49bc-baa7-cc9b36883dfd {{(pid=84538) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 29 18:59:45 devstack cinder-volume[84538]: DEBUG oslo_concurrency.lockutils [None req-3cd2e4fe-3fb2-47c0-975e-124408071fce tempest-VolumesServicesTestJSON-542705041 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 18:59:45 devstack cinder-volume[84538]: DEBUG oslo_concurrency.lockutils [None req-3cd2e4fe-3fb2-47c0-975e-124408071fce tempest-VolumesServicesTestJSON-542705041 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=84538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 18:59:45 devstack cinder-volume[84538]: DEBUG cinder.volume.drivers.quobyte [None req-3cd2e4fe-3fb2-47c0-975e-124408071fce tempest-VolumesServicesTestJSON-542705041 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-34312b00-dd6d-45bb-af98-75855cea8e48': None} {{(pid=84538) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 18:59:45 devstack cinder-volume[84538]: DEBUG cinder.volume.drivers.quobyte [None req-3cd2e4fe-3fb2-47c0-975e-124408071fce tempest-VolumesServicesTestJSON-542705041 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-34312b00-dd6d-45bb-af98-75855cea8e48'] {{(pid=84538) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 18:59:45 devstack cinder-volume[84538]: DEBUG oslo_concurrency.lockutils [None req-3cd2e4fe-3fb2-47c0-975e-124408071fce tempest-VolumesServicesTestJSON-542705041 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=84538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 18:59:45 devstack cinder-volume[84538]: DEBUG cinder.volume.drivers.quobyte [None req-3cd2e4fe-3fb2-47c0-975e-124408071fce tempest-VolumesServicesTestJSON-542705041 None] Selected osci02.corp.quobyte.com/cinder-vol-34312b00-dd6d-45bb-af98-75855cea8e48 as target Quobyte volume. {{(pid=84538) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 29 18:59:45 devstack cinder-volume[84538]: INFO cinder.volume.drivers.remotefs [None req-3cd2e4fe-3fb2-47c0-975e-124408071fce tempest-VolumesServicesTestJSON-542705041 None] casted to osci02.corp.quobyte.com/cinder-vol-34312b00-dd6d-45bb-af98-75855cea8e48 Apr 29 18:59:45 devstack cinder-volume[84538]: DEBUG oslo_concurrency.processutils [None req-3cd2e4fe-3fb2-47c0-975e-124408071fce tempest-VolumesServicesTestJSON-542705041 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-7274d5a8-30e0-49bc-baa7-cc9b36883dfd 1073741824 {{(pid=84538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 18:59:45 devstack sudo[89070]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-7274d5a8-30e0-49bc-baa7-cc9b36883dfd 1073741824 Apr 29 18:59:45 devstack sudo[89070]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 18:59:45 devstack sudo[89055]: pam_unix(sudo:session): session closed for user root Apr 29 18:59:45 devstack cinder-volume[84538]: DEBUG oslo_concurrency.processutils [req-0e7dc468-f833-4662-b3a9-a6dc1775ca87 req-8f711a5d-4e27-464b-bfac-64adf0fa95de tempest-ServerBootFromVolumeStableRescueTest-1114355649 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-a9fdc1fd-9378-4813-a351-15da1e3bc986" returned: 0 in 1.129s {{(pid=84538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 18:59:45 devstack cinder-volume[84538]: DEBUG cinder.coordination [req-0e7dc468-f833-4662-b3a9-a6dc1775ca87 req-8f711a5d-4e27-464b-bfac-64adf0fa95de tempest-ServerBootFromVolumeStableRescueTest-1114355649 None] Lock "cinder-quobyte-a9fdc1fd-9378-4813-a351-15da1e3bc986" released by "delete_volume" :: held 2.599s {{(pid=84538) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 18:59:45 devstack cinder-volume[84538]: DEBUG cinder.quota [req-0e7dc468-f833-4662-b3a9-a6dc1775ca87 req-8f711a5d-4e27-464b-bfac-64adf0fa95de tempest-ServerBootFromVolumeStableRescueTest-1114355649 None] Created reservations ['41d8e50f-e494-4bda-941a-eb3f0cf3301b', '1f967139-2f48-4f00-9ae6-9e61abcdf5d0', 'ffa5fd0b-0c00-44b7-a9e7-35b2d84a4d38', 'f2d1ac5a-7dac-4e66-bbc2-5320840d4f72'] {{(pid=84538) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 29 18:59:45 devstack cinder-volume[84538]: DEBUG oslo_concurrency.lockutils [req-0e7dc468-f833-4662-b3a9-a6dc1775ca87 req-8f711a5d-4e27-464b-bfac-64adf0fa95de tempest-ServerBootFromVolumeStableRescueTest-1114355649 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 18:59:45 devstack cinder-volume[84538]: DEBUG oslo_concurrency.lockutils [req-0e7dc468-f833-4662-b3a9-a6dc1775ca87 req-8f711a5d-4e27-464b-bfac-64adf0fa95de tempest-ServerBootFromVolumeStableRescueTest-1114355649 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 18:59:45 devstack cinder-volume[84538]: DEBUG cinder.volume.drivers.quobyte [req-0e7dc468-f833-4662-b3a9-a6dc1775ca87 req-8f711a5d-4e27-464b-bfac-64adf0fa95de tempest-ServerBootFromVolumeStableRescueTest-1114355649 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-34312b00-dd6d-45bb-af98-75855cea8e48': None} {{(pid=84538) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 18:59:45 devstack cinder-volume[84538]: DEBUG cinder.volume.drivers.quobyte [req-0e7dc468-f833-4662-b3a9-a6dc1775ca87 req-8f711a5d-4e27-464b-bfac-64adf0fa95de tempest-ServerBootFromVolumeStableRescueTest-1114355649 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-34312b00-dd6d-45bb-af98-75855cea8e48'] {{(pid=84538) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 18:59:45 devstack cinder-volume[84538]: DEBUG oslo_concurrency.lockutils [req-0e7dc468-f833-4662-b3a9-a6dc1775ca87 req-8f711a5d-4e27-464b-bfac-64adf0fa95de tempest-ServerBootFromVolumeStableRescueTest-1114355649 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=84538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 18:59:45 devstack cinder-volume[84538]: DEBUG oslo_concurrency.processutils [req-0e7dc468-f833-4662-b3a9-a6dc1775ca87 req-8f711a5d-4e27-464b-bfac-64adf0fa95de tempest-ServerBootFromVolumeStableRescueTest-1114355649 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d {{(pid=84538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 18:59:45 devstack sudo[89095]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d Apr 29 18:59:45 devstack sudo[89095]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 18:59:46 devstack sudo[89070]: pam_unix(sudo:session): session closed for user root Apr 29 18:59:46 devstack cinder-volume[84538]: DEBUG oslo_concurrency.processutils [None req-3cd2e4fe-3fb2-47c0-975e-124408071fce tempest-VolumesServicesTestJSON-542705041 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-7274d5a8-30e0-49bc-baa7-cc9b36883dfd 1073741824" returned: 0 in 1.635s {{(pid=84538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 18:59:47 devstack cinder-volume[84538]: DEBUG oslo_concurrency.processutils [None req-3cd2e4fe-3fb2-47c0-975e-124408071fce tempest-VolumesServicesTestJSON-542705041 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-7274d5a8-30e0-49bc-baa7-cc9b36883dfd {{(pid=84538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 18:59:47 devstack sudo[89136]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-7274d5a8-30e0-49bc-baa7-cc9b36883dfd Apr 29 18:59:47 devstack sudo[89136]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 18:59:47 devstack sudo[89095]: pam_unix(sudo:session): session closed for user root Apr 29 18:59:47 devstack cinder-volume[84538]: DEBUG oslo_concurrency.processutils [req-0e7dc468-f833-4662-b3a9-a6dc1775ca87 req-8f711a5d-4e27-464b-bfac-64adf0fa95de tempest-ServerBootFromVolumeStableRescueTest-1114355649 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d" returned: 0 in 1.544s {{(pid=84538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 18:59:47 devstack cinder-volume[84538]: DEBUG cinder.manager [req-0e7dc468-f833-4662-b3a9-a6dc1775ca87 req-8f711a5d-4e27-464b-bfac-64adf0fa95de tempest-ServerBootFromVolumeStableRescueTest-1114355649 None] Notifying Schedulers of capabilities ... {{(pid=84538) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 29 18:59:47 devstack cinder-volume[84538]: INFO cinder.volume.manager [req-0e7dc468-f833-4662-b3a9-a6dc1775ca87 req-8f711a5d-4e27-464b-bfac-64adf0fa95de tempest-ServerBootFromVolumeStableRescueTest-1114355649 None] Deleted volume successfully. Apr 29 18:59:47 devstack cinder-volume[84538]: DEBUG cinder.coordination [req-0e7dc468-f833-4662-b3a9-a6dc1775ca87 req-8f711a5d-4e27-464b-bfac-64adf0fa95de tempest-ServerBootFromVolumeStableRescueTest-1114355649 None] Lock "cinder-a9fdc1fd-9378-4813-a351-15da1e3bc986-delete_volume" released by "delete_volume" :: held 4.609s {{(pid=84538) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 18:59:48 devstack sudo[89136]: pam_unix(sudo:session): session closed for user root Apr 29 18:59:48 devstack cinder-volume[84538]: DEBUG oslo_concurrency.processutils [None req-3cd2e4fe-3fb2-47c0-975e-124408071fce tempest-VolumesServicesTestJSON-542705041 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-7274d5a8-30e0-49bc-baa7-cc9b36883dfd" returned: 0 in 1.012s {{(pid=84538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 18:59:48 devstack cinder-volume[84538]: DEBUG cinder.volume.drivers.quobyte [None req-3cd2e4fe-3fb2-47c0-975e-124408071fce tempest-VolumesServicesTestJSON-542705041 None] <== create_volume: return (2749ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-34312b00-dd6d-45bb-af98-75855cea8e48'} {{(pid=84538) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 29 18:59:48 devstack cinder-volume[84538]: DEBUG oslo_concurrency.lockutils [None req-3cd2e4fe-3fb2-47c0-975e-124408071fce tempest-VolumesServicesTestJSON-542705041 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.752s {{(pid=84538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 18:59:48 devstack cinder-volume[84538]: DEBUG cinder.volume.manager [None req-3cd2e4fe-3fb2-47c0-975e-124408071fce tempest-VolumesServicesTestJSON-542705041 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a7fed8c9-ea5c-428c-a3d6-d59b19629fcc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7274d5a8-30e0-49bc-baa7-cc9b36883dfd', 'volume_size': 1}' {{(pid=84538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 18:59:48 devstack cinder-volume[84538]: DEBUG cinder.volume.manager [None req-3cd2e4fe-3fb2-47c0-975e-124408071fce tempest-VolumesServicesTestJSON-542705041 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7eb1af77-1e2d-4472-b1f5-9ca910dffc3b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 18:59:48 devstack cinder-volume[84538]: INFO cinder.volume.flows.manager.create_volume [None req-3cd2e4fe-3fb2-47c0-975e-124408071fce tempest-VolumesServicesTestJSON-542705041 None] Volume volume-7274d5a8-30e0-49bc-baa7-cc9b36883dfd (7274d5a8-30e0-49bc-baa7-cc9b36883dfd): created successfully Apr 29 18:59:48 devstack cinder-volume[84538]: DEBUG cinder.volume.manager [None req-3cd2e4fe-3fb2-47c0-975e-124408071fce tempest-VolumesServicesTestJSON-542705041 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7eb1af77-1e2d-4472-b1f5-9ca910dffc3b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 18:59:48 devstack cinder-volume[84538]: DEBUG cinder.volume.manager [None req-3cd2e4fe-3fb2-47c0-975e-124408071fce tempest-VolumesServicesTestJSON-542705041 None] Flow 'volume_create_manager' (c72f7279-b7c1-4b85-afb3-796b69118f63) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84538) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 18:59:48 devstack cinder-volume[84538]: INFO cinder.volume.manager [None req-3cd2e4fe-3fb2-47c0-975e-124408071fce tempest-VolumesServicesTestJSON-542705041 None] Created volume successfully. Apr 29 18:59:48 devstack cinder-volume[84538]: DEBUG cinder.coordination [None req-8bccf78e-6fd2-4bc4-bab0-cc863d38479e tempest-VolumesServicesTestJSON-542705041 None] Acquiring lock "cinder-7274d5a8-30e0-49bc-baa7-cc9b36883dfd-delete_volume" by "delete_volume" {{(pid=84538) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 18:59:48 devstack cinder-volume[84538]: DEBUG cinder.coordination [None req-8bccf78e-6fd2-4bc4-bab0-cc863d38479e tempest-VolumesServicesTestJSON-542705041 None] Lock "cinder-7274d5a8-30e0-49bc-baa7-cc9b36883dfd-delete_volume" acquired by "delete_volume" :: waited 0.049s {{(pid=84538) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 18:59:49 devstack cinder-volume[84538]: DEBUG cinder.coordination [None req-8bccf78e-6fd2-4bc4-bab0-cc863d38479e tempest-VolumesServicesTestJSON-542705041 None] Acquiring lock "cinder-quobyte-7274d5a8-30e0-49bc-baa7-cc9b36883dfd" by "delete_volume" {{(pid=84538) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 18:59:49 devstack cinder-volume[84538]: DEBUG cinder.coordination [None req-8bccf78e-6fd2-4bc4-bab0-cc863d38479e tempest-VolumesServicesTestJSON-542705041 None] Lock "cinder-quobyte-7274d5a8-30e0-49bc-baa7-cc9b36883dfd" acquired by "delete_volume" :: waited 0.034s {{(pid=84538) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 18:59:49 devstack cinder-volume[84538]: DEBUG oslo.privsep.daemon [-] privsep: reply[44ddd847-cd25-446e-ae72-3b1d9b3e5f1a]: (4, 'qcow2') {{(pid=85803) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 18:59:49 devstack cinder-volume[84538]: DEBUG oslo_concurrency.processutils [None req-8bccf78e-6fd2-4bc4-bab0-cc863d38479e tempest-VolumesServicesTestJSON-542705041 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-7274d5a8-30e0-49bc-baa7-cc9b36883dfd {{(pid=84538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 18:59:49 devstack sudo[89185]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-7274d5a8-30e0-49bc-baa7-cc9b36883dfd Apr 29 18:59:49 devstack sudo[89185]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 18:59:49 devstack cinder-volume[84538]: DEBUG cinder.coordination [None req-7f58a225-e13d-4f43-9b2a-18a6996ec556 tempest-ServerRescueNegativeTestJSON-1814105964 None] Acquiring lock "cinder-92f3dc2e-8d80-4cbf-8884-3718e6ca1a50-delete_volume" by "delete_volume" {{(pid=84538) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 18:59:49 devstack cinder-volume[84538]: DEBUG cinder.coordination [None req-7f58a225-e13d-4f43-9b2a-18a6996ec556 tempest-ServerRescueNegativeTestJSON-1814105964 None] Lock "cinder-92f3dc2e-8d80-4cbf-8884-3718e6ca1a50-delete_volume" acquired by "delete_volume" :: waited 0.051s {{(pid=84538) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 18:59:49 devstack cinder-volume[84538]: DEBUG cinder.coordination [None req-7f58a225-e13d-4f43-9b2a-18a6996ec556 tempest-ServerRescueNegativeTestJSON-1814105964 None] Acquiring lock "cinder-quobyte-92f3dc2e-8d80-4cbf-8884-3718e6ca1a50" by "delete_volume" {{(pid=84538) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 18:59:49 devstack cinder-volume[84538]: DEBUG cinder.coordination [None req-7f58a225-e13d-4f43-9b2a-18a6996ec556 tempest-ServerRescueNegativeTestJSON-1814105964 None] Lock "cinder-quobyte-92f3dc2e-8d80-4cbf-8884-3718e6ca1a50" acquired by "delete_volume" :: waited 0.053s {{(pid=84538) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 18:59:49 devstack cinder-volume[84538]: DEBUG oslo.privsep.daemon [-] privsep: reply[a22c9dba-55b6-4c9e-b2f3-9010a787df8a]: (4, 'qcow2') {{(pid=85803) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 18:59:49 devstack cinder-volume[84538]: DEBUG oslo_concurrency.processutils [None req-7f58a225-e13d-4f43-9b2a-18a6996ec556 tempest-ServerRescueNegativeTestJSON-1814105964 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-92f3dc2e-8d80-4cbf-8884-3718e6ca1a50 {{(pid=84538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 18:59:50 devstack sudo[89188]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-92f3dc2e-8d80-4cbf-8884-3718e6ca1a50 Apr 29 18:59:50 devstack sudo[89188]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 18:59:50 devstack sudo[89185]: pam_unix(sudo:session): session closed for user root Apr 29 18:59:50 devstack cinder-volume[84538]: DEBUG oslo_concurrency.processutils [None req-8bccf78e-6fd2-4bc4-bab0-cc863d38479e tempest-VolumesServicesTestJSON-542705041 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-7274d5a8-30e0-49bc-baa7-cc9b36883dfd" returned: 0 in 1.379s {{(pid=84538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 18:59:50 devstack cinder-volume[84538]: DEBUG oslo_concurrency.processutils [None req-8bccf78e-6fd2-4bc4-bab0-cc863d38479e tempest-VolumesServicesTestJSON-542705041 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-7274d5a8-30e0-49bc-baa7-cc9b36883dfd {{(pid=84538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 18:59:50 devstack sudo[89194]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-7274d5a8-30e0-49bc-baa7-cc9b36883dfd Apr 29 18:59:50 devstack sudo[89194]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 18:59:51 devstack sudo[89188]: pam_unix(sudo:session): session closed for user root Apr 29 18:59:51 devstack cinder-volume[84538]: DEBUG oslo_concurrency.processutils [None req-7f58a225-e13d-4f43-9b2a-18a6996ec556 tempest-ServerRescueNegativeTestJSON-1814105964 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-92f3dc2e-8d80-4cbf-8884-3718e6ca1a50" returned: 0 in 1.310s {{(pid=84538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 18:59:51 devstack cinder-volume[84538]: DEBUG oslo_concurrency.processutils [None req-7f58a225-e13d-4f43-9b2a-18a6996ec556 tempest-ServerRescueNegativeTestJSON-1814105964 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-92f3dc2e-8d80-4cbf-8884-3718e6ca1a50 {{(pid=84538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 18:59:51 devstack sudo[89200]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-92f3dc2e-8d80-4cbf-8884-3718e6ca1a50 Apr 29 18:59:51 devstack sudo[89200]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 18:59:51 devstack sudo[89194]: pam_unix(sudo:session): session closed for user root Apr 29 18:59:51 devstack cinder-volume[84538]: DEBUG oslo_concurrency.processutils [None req-8bccf78e-6fd2-4bc4-bab0-cc863d38479e tempest-VolumesServicesTestJSON-542705041 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-7274d5a8-30e0-49bc-baa7-cc9b36883dfd" returned: 0 in 1.033s {{(pid=84538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 18:59:51 devstack cinder-volume[84538]: DEBUG cinder.coordination [None req-8bccf78e-6fd2-4bc4-bab0-cc863d38479e tempest-VolumesServicesTestJSON-542705041 None] Lock "cinder-quobyte-7274d5a8-30e0-49bc-baa7-cc9b36883dfd" released by "delete_volume" :: held 2.484s {{(pid=84538) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 18:59:51 devstack cinder-volume[84538]: DEBUG cinder.quota [None req-8bccf78e-6fd2-4bc4-bab0-cc863d38479e tempest-VolumesServicesTestJSON-542705041 None] Created reservations ['afbb1e9a-ac56-4f1e-b902-b107f18db3f5', '361680b0-81fe-4901-9e36-bfebe2625f6b', '6848e0d4-a65f-48ec-a54b-e0758129652e', '36708b03-4e93-48c0-9f67-94263bd4f763'] {{(pid=84538) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 29 18:59:51 devstack cinder-volume[84538]: DEBUG oslo_concurrency.lockutils [None req-8bccf78e-6fd2-4bc4-bab0-cc863d38479e tempest-VolumesServicesTestJSON-542705041 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 18:59:51 devstack cinder-volume[84538]: DEBUG oslo_concurrency.lockutils [None req-8bccf78e-6fd2-4bc4-bab0-cc863d38479e tempest-VolumesServicesTestJSON-542705041 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 18:59:51 devstack cinder-volume[84538]: DEBUG cinder.volume.drivers.quobyte [None req-8bccf78e-6fd2-4bc4-bab0-cc863d38479e tempest-VolumesServicesTestJSON-542705041 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-34312b00-dd6d-45bb-af98-75855cea8e48': None} {{(pid=84538) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 18:59:51 devstack cinder-volume[84538]: DEBUG cinder.volume.drivers.quobyte [None req-8bccf78e-6fd2-4bc4-bab0-cc863d38479e tempest-VolumesServicesTestJSON-542705041 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-34312b00-dd6d-45bb-af98-75855cea8e48'] {{(pid=84538) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 18:59:51 devstack cinder-volume[84538]: DEBUG oslo_concurrency.lockutils [None req-8bccf78e-6fd2-4bc4-bab0-cc863d38479e tempest-VolumesServicesTestJSON-542705041 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.028s {{(pid=84538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 18:59:51 devstack cinder-volume[84538]: DEBUG oslo_concurrency.processutils [None req-8bccf78e-6fd2-4bc4-bab0-cc863d38479e tempest-VolumesServicesTestJSON-542705041 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d {{(pid=84538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 18:59:51 devstack sudo[89203]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d Apr 29 18:59:51 devstack sudo[89203]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 18:59:52 devstack sudo[89200]: pam_unix(sudo:session): session closed for user root Apr 29 18:59:52 devstack cinder-volume[84538]: DEBUG oslo_concurrency.processutils [None req-7f58a225-e13d-4f43-9b2a-18a6996ec556 tempest-ServerRescueNegativeTestJSON-1814105964 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-92f3dc2e-8d80-4cbf-8884-3718e6ca1a50" returned: 0 in 0.819s {{(pid=84538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 18:59:52 devstack cinder-volume[84538]: DEBUG cinder.coordination [None req-7f58a225-e13d-4f43-9b2a-18a6996ec556 tempest-ServerRescueNegativeTestJSON-1814105964 None] Lock "cinder-quobyte-92f3dc2e-8d80-4cbf-8884-3718e6ca1a50" released by "delete_volume" :: held 2.222s {{(pid=84538) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 18:59:52 devstack cinder-volume[84538]: DEBUG cinder.quota [None req-7f58a225-e13d-4f43-9b2a-18a6996ec556 tempest-ServerRescueNegativeTestJSON-1814105964 None] Created reservations ['be888595-833f-49c0-9e63-69f151d77d97', 'cf98fae3-83f2-455f-851b-0a8e94c73253', 'b059e014-c25c-44ef-924d-9a1469fd0bdd', '77da8949-cd17-4d6b-aea6-633c47b7f3f1'] {{(pid=84538) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 29 18:59:52 devstack cinder-volume[84538]: DEBUG oslo_concurrency.lockutils [None req-7f58a225-e13d-4f43-9b2a-18a6996ec556 tempest-ServerRescueNegativeTestJSON-1814105964 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 18:59:52 devstack cinder-volume[84538]: DEBUG oslo_concurrency.lockutils [None req-7f58a225-e13d-4f43-9b2a-18a6996ec556 tempest-ServerRescueNegativeTestJSON-1814105964 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 18:59:52 devstack cinder-volume[84538]: DEBUG cinder.volume.drivers.quobyte [None req-7f58a225-e13d-4f43-9b2a-18a6996ec556 tempest-ServerRescueNegativeTestJSON-1814105964 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-34312b00-dd6d-45bb-af98-75855cea8e48': None} {{(pid=84538) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 18:59:52 devstack cinder-volume[84538]: DEBUG cinder.volume.drivers.quobyte [None req-7f58a225-e13d-4f43-9b2a-18a6996ec556 tempest-ServerRescueNegativeTestJSON-1814105964 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-34312b00-dd6d-45bb-af98-75855cea8e48'] {{(pid=84538) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 18:59:52 devstack cinder-volume[84538]: DEBUG oslo_concurrency.lockutils [None req-7f58a225-e13d-4f43-9b2a-18a6996ec556 tempest-ServerRescueNegativeTestJSON-1814105964 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=84538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 18:59:52 devstack cinder-volume[84538]: DEBUG oslo_concurrency.processutils [None req-7f58a225-e13d-4f43-9b2a-18a6996ec556 tempest-ServerRescueNegativeTestJSON-1814105964 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d {{(pid=84538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 18:59:52 devstack sudo[89206]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d Apr 29 18:59:52 devstack sudo[89206]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 18:59:52 devstack sudo[89203]: pam_unix(sudo:session): session closed for user root Apr 29 18:59:52 devstack cinder-volume[84538]: DEBUG oslo_concurrency.processutils [None req-8bccf78e-6fd2-4bc4-bab0-cc863d38479e tempest-VolumesServicesTestJSON-542705041 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d" returned: 0 in 1.138s {{(pid=84538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 18:59:52 devstack cinder-volume[84538]: DEBUG cinder.manager [None req-8bccf78e-6fd2-4bc4-bab0-cc863d38479e tempest-VolumesServicesTestJSON-542705041 None] Notifying Schedulers of capabilities ... {{(pid=84538) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 29 18:59:52 devstack cinder-volume[84538]: INFO cinder.volume.manager [None req-8bccf78e-6fd2-4bc4-bab0-cc863d38479e tempest-VolumesServicesTestJSON-542705041 None] Deleted volume successfully. Apr 29 18:59:52 devstack cinder-volume[84538]: DEBUG cinder.coordination [None req-8bccf78e-6fd2-4bc4-bab0-cc863d38479e tempest-VolumesServicesTestJSON-542705041 None] Lock "cinder-7274d5a8-30e0-49bc-baa7-cc9b36883dfd-delete_volume" released by "delete_volume" :: held 4.026s {{(pid=84538) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 18:59:53 devstack sudo[89206]: pam_unix(sudo:session): session closed for user root Apr 29 18:59:53 devstack cinder-volume[84538]: DEBUG oslo_concurrency.processutils [None req-7f58a225-e13d-4f43-9b2a-18a6996ec556 tempest-ServerRescueNegativeTestJSON-1814105964 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d" returned: 0 in 1.079s {{(pid=84538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 18:59:53 devstack cinder-volume[84538]: DEBUG cinder.manager [None req-7f58a225-e13d-4f43-9b2a-18a6996ec556 tempest-ServerRescueNegativeTestJSON-1814105964 None] Notifying Schedulers of capabilities ... {{(pid=84538) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 29 18:59:53 devstack cinder-volume[84538]: INFO cinder.volume.manager [None req-7f58a225-e13d-4f43-9b2a-18a6996ec556 tempest-ServerRescueNegativeTestJSON-1814105964 None] Deleted volume successfully. Apr 29 18:59:53 devstack cinder-volume[84538]: DEBUG cinder.coordination [None req-7f58a225-e13d-4f43-9b2a-18a6996ec556 tempest-ServerRescueNegativeTestJSON-1814105964 None] Lock "cinder-92f3dc2e-8d80-4cbf-8884-3718e6ca1a50-delete_volume" released by "delete_volume" :: held 3.691s {{(pid=84538) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 19:00:01 devstack cinder-volume[84538]: DEBUG cinder.volume.flows.manager.create_volume [None req-80deb62b-62b6-445c-be2b-803e18ee7d1c tempest-VolumeTypesAccessTest-1788704618 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84538) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Apr 29 19:00:01 devstack cinder-volume[84538]: DEBUG cinder.volume.manager [None req-80deb62b-62b6-445c-be2b-803e18ee7d1c tempest-VolumeTypesAccessTest-1788704618 None] Flow 'volume_create_manager' (f575472c-46ee-4a5a-8f1d-cee8179b449a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84538) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 19:00:01 devstack cinder-volume[84538]: DEBUG cinder.volume.manager [None req-80deb62b-62b6-445c-be2b-803e18ee7d1c tempest-VolumeTypesAccessTest-1788704618 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9f2547c4-d1c1-44ee-87e8-d71bb12ea7f9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 19:00:01 devstack cinder-volume[84538]: DEBUG cinder.volume.manager [None req-80deb62b-62b6-445c-be2b-803e18ee7d1c tempest-VolumeTypesAccessTest-1788704618 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9f2547c4-d1c1-44ee-87e8-d71bb12ea7f9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-29T17:00:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeTypesAccessTest-Volume-1239087746',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a6da96d3-e2df-43e1-8f9d-964c811d5a08,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='403b5c920d9f4fa0a72d7d3f2d59c17c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T17:00:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T17:00:02Z,use_quota=True,user_id='7bb7256126da4cebac74747f61fe9920',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5db8e451-ba70-48a1-aa6a-59f9d05a39f2),volume_type_id=5db8e451-ba70-48a1-aa6a-59f9d05a39f2)' {{(pid=84538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 19:00:01 devstack cinder-volume[84538]: DEBUG cinder.volume.manager [None req-80deb62b-62b6-445c-be2b-803e18ee7d1c tempest-VolumeTypesAccessTest-1788704618 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (379cd8ad-ffc7-4a50-964e-81eb51ecf14c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 19:00:01 devstack cinder-volume[84538]: DEBUG cinder.volume.manager [None req-80deb62b-62b6-445c-be2b-803e18ee7d1c tempest-VolumeTypesAccessTest-1788704618 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (379cd8ad-ffc7-4a50-964e-81eb51ecf14c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 19:00:01 devstack cinder-volume[84538]: DEBUG cinder.volume.manager [None req-80deb62b-62b6-445c-be2b-803e18ee7d1c tempest-VolumeTypesAccessTest-1788704618 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (12ab0ced-7c49-402b-b892-27be6403d330) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 19:00:01 devstack cinder-volume[84538]: DEBUG cinder.volume.manager [None req-80deb62b-62b6-445c-be2b-803e18ee7d1c tempest-VolumeTypesAccessTest-1788704618 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (12ab0ced-7c49-402b-b892-27be6403d330) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a6da96d3-e2df-43e1-8f9d-964c811d5a08', 'volume_name': 'volume-a6da96d3-e2df-43e1-8f9d-964c811d5a08', 'volume_size': 1}' {{(pid=84538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 19:00:01 devstack cinder-volume[84538]: DEBUG cinder.volume.manager [None req-80deb62b-62b6-445c-be2b-803e18ee7d1c tempest-VolumeTypesAccessTest-1788704618 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6e10695f-639f-407e-bb0d-29dcf791fca4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 19:00:01 devstack cinder-volume[84538]: DEBUG cinder.volume.manager [None req-80deb62b-62b6-445c-be2b-803e18ee7d1c tempest-VolumeTypesAccessTest-1788704618 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6e10695f-639f-407e-bb0d-29dcf791fca4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 19:00:01 devstack cinder-volume[84538]: DEBUG cinder.volume.manager [None req-80deb62b-62b6-445c-be2b-803e18ee7d1c tempest-VolumeTypesAccessTest-1788704618 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (af3d8e21-59af-43bb-b877-7a91f6e0173f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 19:00:01 devstack cinder-volume[84538]: INFO cinder.volume.flows.manager.create_volume [None req-80deb62b-62b6-445c-be2b-803e18ee7d1c tempest-VolumeTypesAccessTest-1788704618 None] Volume a6da96d3-e2df-43e1-8f9d-964c811d5a08: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a6da96d3-e2df-43e1-8f9d-964c811d5a08', 'volume_size': 1} Apr 29 19:00:01 devstack cinder-volume[84538]: DEBUG oslo_concurrency.lockutils [None req-80deb62b-62b6-445c-be2b-803e18ee7d1c tempest-VolumeTypesAccessTest-1788704618 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 19:00:01 devstack cinder-volume[84538]: DEBUG oslo_concurrency.lockutils [None req-80deb62b-62b6-445c-be2b-803e18ee7d1c tempest-VolumeTypesAccessTest-1788704618 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=84538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 19:00:01 devstack cinder-volume[84538]: DEBUG cinder.volume.drivers.quobyte [None req-80deb62b-62b6-445c-be2b-803e18ee7d1c tempest-VolumeTypesAccessTest-1788704618 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-29T17:00:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeTypesAccessTest-Volume-1239087746',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a6da96d3-e2df-43e1-8f9d-964c811d5a08,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='403b5c920d9f4fa0a72d7d3f2d59c17c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T17:00:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T17:00:02Z,use_quota=True,user_id='7bb7256126da4cebac74747f61fe9920',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5db8e451-ba70-48a1-aa6a-59f9d05a39f2),volume_type_id=5db8e451-ba70-48a1-aa6a-59f9d05a39f2)}" {{(pid=84538) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 29 19:00:01 devstack cinder-volume[84538]: DEBUG cinder.volume.drivers.remotefs [None req-80deb62b-62b6-445c-be2b-803e18ee7d1c tempest-VolumeTypesAccessTest-1788704618 None] Creating volume a6da96d3-e2df-43e1-8f9d-964c811d5a08 {{(pid=84538) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 29 19:00:01 devstack cinder-volume[84538]: DEBUG oslo_concurrency.lockutils [None req-80deb62b-62b6-445c-be2b-803e18ee7d1c tempest-VolumeTypesAccessTest-1788704618 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 19:00:01 devstack cinder-volume[84538]: DEBUG oslo_concurrency.lockutils [None req-80deb62b-62b6-445c-be2b-803e18ee7d1c tempest-VolumeTypesAccessTest-1788704618 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=84538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 19:00:01 devstack cinder-volume[84538]: DEBUG cinder.volume.drivers.quobyte [None req-80deb62b-62b6-445c-be2b-803e18ee7d1c tempest-VolumeTypesAccessTest-1788704618 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-34312b00-dd6d-45bb-af98-75855cea8e48': None} {{(pid=84538) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 19:00:01 devstack cinder-volume[84538]: DEBUG cinder.volume.drivers.quobyte [None req-80deb62b-62b6-445c-be2b-803e18ee7d1c tempest-VolumeTypesAccessTest-1788704618 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-34312b00-dd6d-45bb-af98-75855cea8e48'] {{(pid=84538) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 19:00:01 devstack cinder-volume[84538]: DEBUG oslo_concurrency.lockutils [None req-80deb62b-62b6-445c-be2b-803e18ee7d1c tempest-VolumeTypesAccessTest-1788704618 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=84538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 19:00:01 devstack cinder-volume[84538]: DEBUG cinder.volume.drivers.quobyte [None req-80deb62b-62b6-445c-be2b-803e18ee7d1c tempest-VolumeTypesAccessTest-1788704618 None] Selected osci02.corp.quobyte.com/cinder-vol-34312b00-dd6d-45bb-af98-75855cea8e48 as target Quobyte volume. {{(pid=84538) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 29 19:00:01 devstack cinder-volume[84538]: INFO cinder.volume.drivers.remotefs [None req-80deb62b-62b6-445c-be2b-803e18ee7d1c tempest-VolumeTypesAccessTest-1788704618 None] casted to osci02.corp.quobyte.com/cinder-vol-34312b00-dd6d-45bb-af98-75855cea8e48 Apr 29 19:00:01 devstack cinder-volume[84538]: DEBUG oslo_concurrency.processutils [None req-80deb62b-62b6-445c-be2b-803e18ee7d1c tempest-VolumeTypesAccessTest-1788704618 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-a6da96d3-e2df-43e1-8f9d-964c811d5a08 1073741824 {{(pid=84538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 19:00:01 devstack sudo[89261]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-a6da96d3-e2df-43e1-8f9d-964c811d5a08 1073741824 Apr 29 19:00:01 devstack sudo[89261]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 19:00:02 devstack sudo[89261]: pam_unix(sudo:session): session closed for user root Apr 29 19:00:02 devstack cinder-volume[84538]: DEBUG oslo_concurrency.processutils [None req-80deb62b-62b6-445c-be2b-803e18ee7d1c tempest-VolumeTypesAccessTest-1788704618 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-a6da96d3-e2df-43e1-8f9d-964c811d5a08 1073741824" returned: 0 in 1.141s {{(pid=84538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 19:00:02 devstack cinder-volume[84538]: DEBUG oslo_concurrency.processutils [None req-80deb62b-62b6-445c-be2b-803e18ee7d1c tempest-VolumeTypesAccessTest-1788704618 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-a6da96d3-e2df-43e1-8f9d-964c811d5a08 {{(pid=84538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 19:00:02 devstack sudo[89267]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-a6da96d3-e2df-43e1-8f9d-964c811d5a08 Apr 29 19:00:02 devstack sudo[89267]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 19:00:03 devstack sudo[89267]: pam_unix(sudo:session): session closed for user root Apr 29 19:00:03 devstack cinder-volume[84538]: DEBUG oslo_concurrency.processutils [None req-80deb62b-62b6-445c-be2b-803e18ee7d1c tempest-VolumeTypesAccessTest-1788704618 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-a6da96d3-e2df-43e1-8f9d-964c811d5a08" returned: 0 in 0.963s {{(pid=84538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 19:00:03 devstack cinder-volume[84538]: DEBUG cinder.volume.drivers.quobyte [None req-80deb62b-62b6-445c-be2b-803e18ee7d1c tempest-VolumeTypesAccessTest-1788704618 None] <== create_volume: return (2156ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-34312b00-dd6d-45bb-af98-75855cea8e48'} {{(pid=84538) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 29 19:00:03 devstack cinder-volume[84538]: DEBUG oslo_concurrency.lockutils [None req-80deb62b-62b6-445c-be2b-803e18ee7d1c tempest-VolumeTypesAccessTest-1788704618 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.159s {{(pid=84538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 19:00:03 devstack cinder-volume[84538]: DEBUG cinder.volume.manager [None req-80deb62b-62b6-445c-be2b-803e18ee7d1c tempest-VolumeTypesAccessTest-1788704618 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (af3d8e21-59af-43bb-b877-7a91f6e0173f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a6da96d3-e2df-43e1-8f9d-964c811d5a08', 'volume_size': 1}' {{(pid=84538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 19:00:03 devstack cinder-volume[84538]: DEBUG cinder.volume.manager [None req-80deb62b-62b6-445c-be2b-803e18ee7d1c tempest-VolumeTypesAccessTest-1788704618 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a55b9639-8157-4ff5-acea-845b3dc21aba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 19:00:03 devstack cinder-volume[84538]: INFO cinder.volume.flows.manager.create_volume [None req-80deb62b-62b6-445c-be2b-803e18ee7d1c tempest-VolumeTypesAccessTest-1788704618 None] Volume volume-a6da96d3-e2df-43e1-8f9d-964c811d5a08 (a6da96d3-e2df-43e1-8f9d-964c811d5a08): created successfully Apr 29 19:00:03 devstack cinder-volume[84538]: DEBUG cinder.volume.manager [None req-80deb62b-62b6-445c-be2b-803e18ee7d1c tempest-VolumeTypesAccessTest-1788704618 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a55b9639-8157-4ff5-acea-845b3dc21aba) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 19:00:03 devstack cinder-volume[84538]: DEBUG cinder.volume.manager [None req-80deb62b-62b6-445c-be2b-803e18ee7d1c tempest-VolumeTypesAccessTest-1788704618 None] Flow 'volume_create_manager' (f575472c-46ee-4a5a-8f1d-cee8179b449a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84538) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 19:00:03 devstack cinder-volume[84538]: INFO cinder.volume.manager [None req-80deb62b-62b6-445c-be2b-803e18ee7d1c tempest-VolumeTypesAccessTest-1788704618 None] Created volume successfully. Apr 29 19:00:04 devstack cinder-volume[84538]: DEBUG cinder.coordination [None req-a8f120ce-076e-4821-bd4c-997ba4ef5f08 tempest-VolumeTypesAccessTest-1788704618 None] Acquiring lock "cinder-a6da96d3-e2df-43e1-8f9d-964c811d5a08-delete_volume" by "delete_volume" {{(pid=84538) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 19:00:05 devstack cinder-volume[84538]: DEBUG cinder.coordination [None req-a8f120ce-076e-4821-bd4c-997ba4ef5f08 tempest-VolumeTypesAccessTest-1788704618 None] Lock "cinder-a6da96d3-e2df-43e1-8f9d-964c811d5a08-delete_volume" acquired by "delete_volume" :: waited 0.032s {{(pid=84538) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 19:00:05 devstack cinder-volume[84538]: DEBUG cinder.coordination [None req-a8f120ce-076e-4821-bd4c-997ba4ef5f08 tempest-VolumeTypesAccessTest-1788704618 None] Acquiring lock "cinder-quobyte-a6da96d3-e2df-43e1-8f9d-964c811d5a08" by "delete_volume" {{(pid=84538) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 19:00:05 devstack cinder-volume[84538]: DEBUG cinder.coordination [None req-a8f120ce-076e-4821-bd4c-997ba4ef5f08 tempest-VolumeTypesAccessTest-1788704618 None] Lock "cinder-quobyte-a6da96d3-e2df-43e1-8f9d-964c811d5a08" acquired by "delete_volume" :: waited 0.018s {{(pid=84538) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 19:00:05 devstack cinder-volume[84538]: DEBUG oslo.privsep.daemon [-] privsep: reply[bcc8e6bc-76b8-4d86-8c24-6cbafba382d7]: (4, 'qcow2') {{(pid=85803) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 19:00:05 devstack cinder-volume[84538]: DEBUG oslo_concurrency.processutils [None req-a8f120ce-076e-4821-bd4c-997ba4ef5f08 tempest-VolumeTypesAccessTest-1788704618 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-a6da96d3-e2df-43e1-8f9d-964c811d5a08 {{(pid=84538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 19:00:05 devstack sudo[89313]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-a6da96d3-e2df-43e1-8f9d-964c811d5a08 Apr 29 19:00:05 devstack sudo[89313]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 19:00:06 devstack sudo[89313]: pam_unix(sudo:session): session closed for user root Apr 29 19:00:06 devstack cinder-volume[84538]: DEBUG oslo_concurrency.processutils [None req-a8f120ce-076e-4821-bd4c-997ba4ef5f08 tempest-VolumeTypesAccessTest-1788704618 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-a6da96d3-e2df-43e1-8f9d-964c811d5a08" returned: 0 in 1.272s {{(pid=84538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 19:00:06 devstack cinder-volume[84538]: DEBUG oslo_concurrency.processutils [None req-a8f120ce-076e-4821-bd4c-997ba4ef5f08 tempest-VolumeTypesAccessTest-1788704618 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-a6da96d3-e2df-43e1-8f9d-964c811d5a08 {{(pid=84538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 19:00:06 devstack cinder-volume[84538]: DEBUG cinder.volume.flows.manager.create_volume [req-e06f5cce-c0d1-470d-b9a1-06123d13d23d req-0ee06b08-50e8-4586-adcc-867a172665a2 tempest-VolumesSnapshotsTestJSON-1657740841 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84538) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Apr 29 19:00:06 devstack sudo[89320]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-a6da96d3-e2df-43e1-8f9d-964c811d5a08 Apr 29 19:00:06 devstack sudo[89320]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 19:00:06 devstack cinder-volume[84538]: DEBUG cinder.volume.manager [req-e06f5cce-c0d1-470d-b9a1-06123d13d23d req-0ee06b08-50e8-4586-adcc-867a172665a2 tempest-VolumesSnapshotsTestJSON-1657740841 None] Flow 'volume_create_manager' (c9432065-d728-408d-8ce3-b5d1214cea69) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84538) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 19:00:06 devstack cinder-volume[84538]: DEBUG cinder.volume.manager [req-e06f5cce-c0d1-470d-b9a1-06123d13d23d req-0ee06b08-50e8-4586-adcc-867a172665a2 tempest-VolumesSnapshotsTestJSON-1657740841 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1e905cfc-6219-455f-be8f-3c198e1aa3fb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 19:00:06 devstack cinder-volume[84538]: DEBUG cinder.volume.manager [req-e06f5cce-c0d1-470d-b9a1-06123d13d23d req-0ee06b08-50e8-4586-adcc-867a172665a2 tempest-VolumesSnapshotsTestJSON-1657740841 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1e905cfc-6219-455f-be8f-3c198e1aa3fb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-29T17:00:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotsTestJSON-volume-1792799947',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=03705fd0-ab2b-409d-957e-45f3f12a0306,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4d46db46abf540a69b1f474a961e325c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T17:00:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T17:00:06Z,use_quota=True,user_id='291880aed8ae4970829eeb3565853650',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(62b05900-93e3-4190-a88f-1d87324303d1),volume_type_id=62b05900-93e3-4190-a88f-1d87324303d1)' {{(pid=84538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 19:00:06 devstack cinder-volume[84538]: DEBUG cinder.volume.manager [req-e06f5cce-c0d1-470d-b9a1-06123d13d23d req-0ee06b08-50e8-4586-adcc-867a172665a2 tempest-VolumesSnapshotsTestJSON-1657740841 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ce0e3116-393f-4623-ae23-8b78202c596b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 19:00:06 devstack cinder-volume[84538]: DEBUG cinder.volume.manager [req-e06f5cce-c0d1-470d-b9a1-06123d13d23d req-0ee06b08-50e8-4586-adcc-867a172665a2 tempest-VolumesSnapshotsTestJSON-1657740841 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ce0e3116-393f-4623-ae23-8b78202c596b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 19:00:06 devstack cinder-volume[84538]: DEBUG cinder.volume.manager [req-e06f5cce-c0d1-470d-b9a1-06123d13d23d req-0ee06b08-50e8-4586-adcc-867a172665a2 tempest-VolumesSnapshotsTestJSON-1657740841 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2e9abc8f-2ef7-4b5d-8150-6fff6607fed3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 19:00:06 devstack cinder-volume[84538]: DEBUG cinder.volume.manager [req-e06f5cce-c0d1-470d-b9a1-06123d13d23d req-0ee06b08-50e8-4586-adcc-867a172665a2 tempest-VolumesSnapshotsTestJSON-1657740841 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2e9abc8f-2ef7-4b5d-8150-6fff6607fed3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '03705fd0-ab2b-409d-957e-45f3f12a0306', 'volume_name': 'volume-03705fd0-ab2b-409d-957e-45f3f12a0306', 'volume_size': 1}' {{(pid=84538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 19:00:06 devstack cinder-volume[84538]: DEBUG cinder.volume.manager [req-e06f5cce-c0d1-470d-b9a1-06123d13d23d req-0ee06b08-50e8-4586-adcc-867a172665a2 tempest-VolumesSnapshotsTestJSON-1657740841 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2fc35ae6-5dc2-4f54-9cb0-9b0ef689dd18) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 19:00:06 devstack cinder-volume[84538]: DEBUG cinder.volume.manager [req-e06f5cce-c0d1-470d-b9a1-06123d13d23d req-0ee06b08-50e8-4586-adcc-867a172665a2 tempest-VolumesSnapshotsTestJSON-1657740841 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2fc35ae6-5dc2-4f54-9cb0-9b0ef689dd18) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 19:00:06 devstack cinder-volume[84538]: DEBUG cinder.volume.manager [req-e06f5cce-c0d1-470d-b9a1-06123d13d23d req-0ee06b08-50e8-4586-adcc-867a172665a2 tempest-VolumesSnapshotsTestJSON-1657740841 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fb644b41-7d97-4784-95a9-4003ca273efb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 19:00:06 devstack cinder-volume[84538]: INFO cinder.volume.flows.manager.create_volume [req-e06f5cce-c0d1-470d-b9a1-06123d13d23d req-0ee06b08-50e8-4586-adcc-867a172665a2 tempest-VolumesSnapshotsTestJSON-1657740841 None] Volume 03705fd0-ab2b-409d-957e-45f3f12a0306: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-03705fd0-ab2b-409d-957e-45f3f12a0306', 'volume_size': 1} Apr 29 19:00:06 devstack cinder-volume[84538]: DEBUG oslo_concurrency.lockutils [req-e06f5cce-c0d1-470d-b9a1-06123d13d23d req-0ee06b08-50e8-4586-adcc-867a172665a2 tempest-VolumesSnapshotsTestJSON-1657740841 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 19:00:06 devstack cinder-volume[84538]: DEBUG oslo_concurrency.lockutils [req-e06f5cce-c0d1-470d-b9a1-06123d13d23d req-0ee06b08-50e8-4586-adcc-867a172665a2 tempest-VolumesSnapshotsTestJSON-1657740841 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=84538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 19:00:06 devstack cinder-volume[84538]: DEBUG cinder.volume.drivers.quobyte [req-e06f5cce-c0d1-470d-b9a1-06123d13d23d req-0ee06b08-50e8-4586-adcc-867a172665a2 tempest-VolumesSnapshotsTestJSON-1657740841 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-29T17:00:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotsTestJSON-volume-1792799947',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=03705fd0-ab2b-409d-957e-45f3f12a0306,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4d46db46abf540a69b1f474a961e325c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T17:00:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T17:00:06Z,use_quota=True,user_id='291880aed8ae4970829eeb3565853650',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(62b05900-93e3-4190-a88f-1d87324303d1),volume_type_id=62b05900-93e3-4190-a88f-1d87324303d1)}" {{(pid=84538) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 29 19:00:06 devstack cinder-volume[84538]: DEBUG cinder.volume.drivers.remotefs [req-e06f5cce-c0d1-470d-b9a1-06123d13d23d req-0ee06b08-50e8-4586-adcc-867a172665a2 tempest-VolumesSnapshotsTestJSON-1657740841 None] Creating volume 03705fd0-ab2b-409d-957e-45f3f12a0306 {{(pid=84538) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 29 19:00:06 devstack cinder-volume[84538]: DEBUG oslo_concurrency.lockutils [req-e06f5cce-c0d1-470d-b9a1-06123d13d23d req-0ee06b08-50e8-4586-adcc-867a172665a2 tempest-VolumesSnapshotsTestJSON-1657740841 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 19:00:06 devstack cinder-volume[84538]: DEBUG oslo_concurrency.lockutils [req-e06f5cce-c0d1-470d-b9a1-06123d13d23d req-0ee06b08-50e8-4586-adcc-867a172665a2 tempest-VolumesSnapshotsTestJSON-1657740841 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=84538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 19:00:06 devstack cinder-volume[84538]: DEBUG cinder.volume.drivers.quobyte [req-e06f5cce-c0d1-470d-b9a1-06123d13d23d req-0ee06b08-50e8-4586-adcc-867a172665a2 tempest-VolumesSnapshotsTestJSON-1657740841 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-34312b00-dd6d-45bb-af98-75855cea8e48': None} {{(pid=84538) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 19:00:06 devstack cinder-volume[84538]: DEBUG cinder.volume.drivers.quobyte [req-e06f5cce-c0d1-470d-b9a1-06123d13d23d req-0ee06b08-50e8-4586-adcc-867a172665a2 tempest-VolumesSnapshotsTestJSON-1657740841 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-34312b00-dd6d-45bb-af98-75855cea8e48'] {{(pid=84538) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 19:00:06 devstack cinder-volume[84538]: DEBUG oslo_concurrency.lockutils [req-e06f5cce-c0d1-470d-b9a1-06123d13d23d req-0ee06b08-50e8-4586-adcc-867a172665a2 tempest-VolumesSnapshotsTestJSON-1657740841 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=84538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 19:00:06 devstack cinder-volume[84538]: DEBUG cinder.volume.drivers.quobyte [req-e06f5cce-c0d1-470d-b9a1-06123d13d23d req-0ee06b08-50e8-4586-adcc-867a172665a2 tempest-VolumesSnapshotsTestJSON-1657740841 None] Selected osci02.corp.quobyte.com/cinder-vol-34312b00-dd6d-45bb-af98-75855cea8e48 as target Quobyte volume. {{(pid=84538) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 29 19:00:06 devstack cinder-volume[84538]: INFO cinder.volume.drivers.remotefs [req-e06f5cce-c0d1-470d-b9a1-06123d13d23d req-0ee06b08-50e8-4586-adcc-867a172665a2 tempest-VolumesSnapshotsTestJSON-1657740841 None] casted to osci02.corp.quobyte.com/cinder-vol-34312b00-dd6d-45bb-af98-75855cea8e48 Apr 29 19:00:06 devstack cinder-volume[84538]: DEBUG oslo_concurrency.processutils [req-e06f5cce-c0d1-470d-b9a1-06123d13d23d req-0ee06b08-50e8-4586-adcc-867a172665a2 tempest-VolumesSnapshotsTestJSON-1657740841 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-03705fd0-ab2b-409d-957e-45f3f12a0306 1073741824 {{(pid=84538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 19:00:06 devstack sudo[89322]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-03705fd0-ab2b-409d-957e-45f3f12a0306 1073741824 Apr 29 19:00:06 devstack sudo[89322]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 19:00:07 devstack sudo[89320]: pam_unix(sudo:session): session closed for user root Apr 29 19:00:07 devstack cinder-volume[84538]: DEBUG oslo_concurrency.processutils [None req-a8f120ce-076e-4821-bd4c-997ba4ef5f08 tempest-VolumeTypesAccessTest-1788704618 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-a6da96d3-e2df-43e1-8f9d-964c811d5a08" returned: 0 in 1.021s {{(pid=84538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 19:00:07 devstack cinder-volume[84538]: DEBUG cinder.coordination [None req-a8f120ce-076e-4821-bd4c-997ba4ef5f08 tempest-VolumeTypesAccessTest-1788704618 None] Lock "cinder-quobyte-a6da96d3-e2df-43e1-8f9d-964c811d5a08" released by "delete_volume" :: held 2.392s {{(pid=84538) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 19:00:07 devstack cinder-volume[84538]: WARNING cinder.quota [None req-a8f120ce-076e-4821-bd4c-997ba4ef5f08 tempest-VolumeTypesAccessTest-1788704618 None] Deprecated: Default quota for resource: volumes_tempest-VolumeTypesAccessTest-volume-type-874964764 is set by the default quota flag: quota_volumes_tempest-VolumeTypesAccessTest-volume-type-874964764, it is now deprecated. Please use the default quota class for default quota. Apr 29 19:00:07 devstack cinder-volume[84538]: WARNING cinder.quota [None req-a8f120ce-076e-4821-bd4c-997ba4ef5f08 tempest-VolumeTypesAccessTest-1788704618 None] Deprecated: Default quota for resource: gigabytes_tempest-VolumeTypesAccessTest-volume-type-874964764 is set by the default quota flag: quota_gigabytes_tempest-VolumeTypesAccessTest-volume-type-874964764, it is now deprecated. Please use the default quota class for default quota. Apr 29 19:00:07 devstack cinder-volume[84538]: DEBUG cinder.quota [None req-a8f120ce-076e-4821-bd4c-997ba4ef5f08 tempest-VolumeTypesAccessTest-1788704618 None] Created reservations ['734c5bc4-bed5-4197-baa0-c6ca909a988e', '02abe60f-7362-4e1c-b9bd-c00b51867746', '6c649f4d-5a08-45fd-a98f-1f03b8db8006', '7f2af393-0efc-4fcd-a8ad-11c6efb75a4e'] {{(pid=84538) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 29 19:00:07 devstack cinder-volume[84538]: DEBUG oslo_concurrency.lockutils [None req-a8f120ce-076e-4821-bd4c-997ba4ef5f08 tempest-VolumeTypesAccessTest-1788704618 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 19:00:07 devstack cinder-volume[84538]: DEBUG oslo_concurrency.lockutils [None req-a8f120ce-076e-4821-bd4c-997ba4ef5f08 tempest-VolumeTypesAccessTest-1788704618 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 19:00:07 devstack cinder-volume[84538]: DEBUG cinder.volume.drivers.quobyte [None req-a8f120ce-076e-4821-bd4c-997ba4ef5f08 tempest-VolumeTypesAccessTest-1788704618 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-34312b00-dd6d-45bb-af98-75855cea8e48': None} {{(pid=84538) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 19:00:07 devstack cinder-volume[84538]: DEBUG cinder.volume.drivers.quobyte [None req-a8f120ce-076e-4821-bd4c-997ba4ef5f08 tempest-VolumeTypesAccessTest-1788704618 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-34312b00-dd6d-45bb-af98-75855cea8e48'] {{(pid=84538) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 19:00:07 devstack cinder-volume[84538]: DEBUG oslo_concurrency.lockutils [None req-a8f120ce-076e-4821-bd4c-997ba4ef5f08 tempest-VolumeTypesAccessTest-1788704618 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=84538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 19:00:07 devstack cinder-volume[84538]: DEBUG oslo_concurrency.processutils [None req-a8f120ce-076e-4821-bd4c-997ba4ef5f08 tempest-VolumeTypesAccessTest-1788704618 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d {{(pid=84538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 19:00:07 devstack sudo[89330]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d Apr 29 19:00:07 devstack sudo[89330]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 19:00:07 devstack sudo[89322]: pam_unix(sudo:session): session closed for user root Apr 29 19:00:07 devstack cinder-volume[84538]: DEBUG oslo_concurrency.processutils [req-e06f5cce-c0d1-470d-b9a1-06123d13d23d req-0ee06b08-50e8-4586-adcc-867a172665a2 tempest-VolumesSnapshotsTestJSON-1657740841 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-03705fd0-ab2b-409d-957e-45f3f12a0306 1073741824" returned: 0 in 1.164s {{(pid=84538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 19:00:07 devstack cinder-volume[84538]: DEBUG oslo_concurrency.processutils [req-e06f5cce-c0d1-470d-b9a1-06123d13d23d req-0ee06b08-50e8-4586-adcc-867a172665a2 tempest-VolumesSnapshotsTestJSON-1657740841 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-03705fd0-ab2b-409d-957e-45f3f12a0306 {{(pid=84538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 19:00:07 devstack sudo[89332]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-03705fd0-ab2b-409d-957e-45f3f12a0306 Apr 29 19:00:07 devstack sudo[89332]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 19:00:08 devstack sudo[89330]: pam_unix(sudo:session): session closed for user root Apr 29 19:00:08 devstack cinder-volume[84538]: DEBUG oslo_concurrency.processutils [None req-a8f120ce-076e-4821-bd4c-997ba4ef5f08 tempest-VolumeTypesAccessTest-1788704618 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d" returned: 0 in 1.036s {{(pid=84538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 19:00:08 devstack cinder-volume[84538]: DEBUG cinder.manager [None req-a8f120ce-076e-4821-bd4c-997ba4ef5f08 tempest-VolumeTypesAccessTest-1788704618 None] Notifying Schedulers of capabilities ... {{(pid=84538) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 29 19:00:08 devstack cinder-volume[84538]: INFO cinder.volume.manager [None req-a8f120ce-076e-4821-bd4c-997ba4ef5f08 tempest-VolumeTypesAccessTest-1788704618 None] Deleted volume successfully. Apr 29 19:00:08 devstack cinder-volume[84538]: DEBUG cinder.coordination [None req-a8f120ce-076e-4821-bd4c-997ba4ef5f08 tempest-VolumeTypesAccessTest-1788704618 None] Lock "cinder-a6da96d3-e2df-43e1-8f9d-964c811d5a08-delete_volume" released by "delete_volume" :: held 3.771s {{(pid=84538) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 19:00:08 devstack sudo[89332]: pam_unix(sudo:session): session closed for user root Apr 29 19:00:08 devstack cinder-volume[84538]: DEBUG oslo_concurrency.processutils [req-e06f5cce-c0d1-470d-b9a1-06123d13d23d req-0ee06b08-50e8-4586-adcc-867a172665a2 tempest-VolumesSnapshotsTestJSON-1657740841 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-03705fd0-ab2b-409d-957e-45f3f12a0306" returned: 0 in 1.035s {{(pid=84538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 19:00:08 devstack cinder-volume[84538]: DEBUG cinder.volume.drivers.quobyte [req-e06f5cce-c0d1-470d-b9a1-06123d13d23d req-0ee06b08-50e8-4586-adcc-867a172665a2 tempest-VolumesSnapshotsTestJSON-1657740841 None] <== create_volume: return (2271ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-34312b00-dd6d-45bb-af98-75855cea8e48'} {{(pid=84538) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 29 19:00:08 devstack cinder-volume[84538]: DEBUG oslo_concurrency.lockutils [req-e06f5cce-c0d1-470d-b9a1-06123d13d23d req-0ee06b08-50e8-4586-adcc-867a172665a2 tempest-VolumesSnapshotsTestJSON-1657740841 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.276s {{(pid=84538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 19:00:08 devstack cinder-volume[84538]: DEBUG cinder.volume.manager [req-e06f5cce-c0d1-470d-b9a1-06123d13d23d req-0ee06b08-50e8-4586-adcc-867a172665a2 tempest-VolumesSnapshotsTestJSON-1657740841 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fb644b41-7d97-4784-95a9-4003ca273efb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-03705fd0-ab2b-409d-957e-45f3f12a0306', 'volume_size': 1}' {{(pid=84538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 19:00:08 devstack cinder-volume[84538]: DEBUG cinder.volume.manager [req-e06f5cce-c0d1-470d-b9a1-06123d13d23d req-0ee06b08-50e8-4586-adcc-867a172665a2 tempest-VolumesSnapshotsTestJSON-1657740841 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d96ef447-6392-4005-a56f-ad5801cf22c0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 19:00:08 devstack cinder-volume[84538]: INFO cinder.volume.flows.manager.create_volume [req-e06f5cce-c0d1-470d-b9a1-06123d13d23d req-0ee06b08-50e8-4586-adcc-867a172665a2 tempest-VolumesSnapshotsTestJSON-1657740841 None] Volume volume-03705fd0-ab2b-409d-957e-45f3f12a0306 (03705fd0-ab2b-409d-957e-45f3f12a0306): created successfully Apr 29 19:00:08 devstack cinder-volume[84538]: DEBUG cinder.volume.manager [req-e06f5cce-c0d1-470d-b9a1-06123d13d23d req-0ee06b08-50e8-4586-adcc-867a172665a2 tempest-VolumesSnapshotsTestJSON-1657740841 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d96ef447-6392-4005-a56f-ad5801cf22c0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 19:00:08 devstack cinder-volume[84538]: DEBUG cinder.volume.manager [req-e06f5cce-c0d1-470d-b9a1-06123d13d23d req-0ee06b08-50e8-4586-adcc-867a172665a2 tempest-VolumesSnapshotsTestJSON-1657740841 None] Flow 'volume_create_manager' (c9432065-d728-408d-8ce3-b5d1214cea69) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84538) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 19:00:08 devstack cinder-volume[84538]: INFO cinder.volume.manager [req-e06f5cce-c0d1-470d-b9a1-06123d13d23d req-0ee06b08-50e8-4586-adcc-867a172665a2 tempest-VolumesSnapshotsTestJSON-1657740841 None] Created volume successfully. Apr 29 19:00:10 devstack cinder-volume[84538]: DEBUG oslo_concurrency.lockutils [req-3cdc13f8-ed60-4905-bcce-23ed7f192bdc req-fd75da9a-23c7-4631-b893-a8ac2b618b34 tempest-VolumesSnapshotsTestJSON-1657740841 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=84538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 19:00:10 devstack cinder-volume[84538]: DEBUG oslo_concurrency.lockutils [req-3cdc13f8-ed60-4905-bcce-23ed7f192bdc req-fd75da9a-23c7-4631-b893-a8ac2b618b34 tempest-VolumesSnapshotsTestJSON-1657740841 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=84538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 19:00:10 devstack cinder-volume[84538]: DEBUG cinder.volume.drivers.remotefs [req-3cdc13f8-ed60-4905-bcce-23ed7f192bdc req-fd75da9a-23c7-4631-b893-a8ac2b618b34 tempest-VolumesSnapshotsTestJSON-1657740841 None] Creating offline snapshot d071f03f-6218-4b8f-af1c-1354e9898681 of volume 03705fd0-ab2b-409d-957e-45f3f12a0306 {{(pid=84538) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}} Apr 29 19:00:10 devstack cinder-volume[84538]: DEBUG oslo.privsep.daemon [-] privsep: reply[710b6475-cd59-4a5a-8243-850aa81e1d3c]: (4, 'qcow2') {{(pid=85803) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 19:00:10 devstack cinder-volume[84538]: DEBUG oslo_concurrency.processutils [req-3cdc13f8-ed60-4905-bcce-23ed7f192bdc req-fd75da9a-23c7-4631-b893-a8ac2b618b34 tempest-VolumesSnapshotsTestJSON-1657740841 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-03705fd0-ab2b-409d-957e-45f3f12a0306 {{(pid=84538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 19:00:10 devstack sudo[89337]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-03705fd0-ab2b-409d-957e-45f3f12a0306 Apr 29 19:00:10 devstack sudo[89337]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 19:00:11 devstack sudo[89337]: pam_unix(sudo:session): session closed for user root Apr 29 19:00:11 devstack cinder-volume[84538]: DEBUG oslo_concurrency.processutils [req-3cdc13f8-ed60-4905-bcce-23ed7f192bdc req-fd75da9a-23c7-4631-b893-a8ac2b618b34 tempest-VolumesSnapshotsTestJSON-1657740841 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-03705fd0-ab2b-409d-957e-45f3f12a0306" returned: 0 in 0.926s {{(pid=84538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 19:00:11 devstack cinder-volume[84538]: DEBUG oslo_concurrency.processutils [req-3cdc13f8-ed60-4905-bcce-23ed7f192bdc req-fd75da9a-23c7-4631-b893-a8ac2b618b34 tempest-VolumesSnapshotsTestJSON-1657740841 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-03705fd0-ab2b-409d-957e-45f3f12a0306,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-03705fd0-ab2b-409d-957e-45f3f12a0306.d071f03f-6218-4b8f-af1c-1354e9898681 1G {{(pid=84538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 19:00:11 devstack sudo[89343]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-03705fd0-ab2b-409d-957e-45f3f12a0306,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-03705fd0-ab2b-409d-957e-45f3f12a0306.d071f03f-6218-4b8f-af1c-1354e9898681 1G Apr 29 19:00:11 devstack sudo[89343]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 19:00:12 devstack sudo[89343]: pam_unix(sudo:session): session closed for user root Apr 29 19:00:12 devstack cinder-volume[84538]: DEBUG oslo_concurrency.processutils [req-3cdc13f8-ed60-4905-bcce-23ed7f192bdc req-fd75da9a-23c7-4631-b893-a8ac2b618b34 tempest-VolumesSnapshotsTestJSON-1657740841 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-03705fd0-ab2b-409d-957e-45f3f12a0306,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-03705fd0-ab2b-409d-957e-45f3f12a0306.d071f03f-6218-4b8f-af1c-1354e9898681 1G" returned: 0 in 1.016s {{(pid=84538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 19:00:12 devstack cinder-volume[84538]: DEBUG oslo_concurrency.processutils [req-3cdc13f8-ed60-4905-bcce-23ed7f192bdc req-fd75da9a-23c7-4631-b893-a8ac2b618b34 tempest-VolumesSnapshotsTestJSON-1657740841 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-03705fd0-ab2b-409d-957e-45f3f12a0306 -F qcow2 /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-03705fd0-ab2b-409d-957e-45f3f12a0306.d071f03f-6218-4b8f-af1c-1354e9898681 {{(pid=84538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 19:00:12 devstack sudo[89349]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-03705fd0-ab2b-409d-957e-45f3f12a0306 -F qcow2 /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-03705fd0-ab2b-409d-957e-45f3f12a0306.d071f03f-6218-4b8f-af1c-1354e9898681 Apr 29 19:00:12 devstack sudo[89349]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 19:00:12 devstack sudo[89349]: pam_unix(sudo:session): session closed for user root Apr 29 19:00:12 devstack cinder-volume[84538]: DEBUG oslo_concurrency.processutils [req-3cdc13f8-ed60-4905-bcce-23ed7f192bdc req-fd75da9a-23c7-4631-b893-a8ac2b618b34 tempest-VolumesSnapshotsTestJSON-1657740841 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-03705fd0-ab2b-409d-957e-45f3f12a0306 -F qcow2 /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-03705fd0-ab2b-409d-957e-45f3f12a0306.d071f03f-6218-4b8f-af1c-1354e9898681" returned: 0 in 0.766s {{(pid=84538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 19:00:12 devstack cinder-volume[84538]: WARNING cinder.volume.drivers.remotefs [req-3cdc13f8-ed60-4905-bcce-23ed7f192bdc req-fd75da9a-23c7-4631-b893-a8ac2b618b34 tempest-VolumesSnapshotsTestJSON-1657740841 None] /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-03705fd0-ab2b-409d-957e-45f3f12a0306.d071f03f-6218-4b8f-af1c-1354e9898681 is being set with open permissions: ugo+rw Apr 29 19:00:12 devstack cinder-volume[84538]: DEBUG oslo_concurrency.processutils [req-3cdc13f8-ed60-4905-bcce-23ed7f192bdc req-fd75da9a-23c7-4631-b893-a8ac2b618b34 tempest-VolumesSnapshotsTestJSON-1657740841 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-03705fd0-ab2b-409d-957e-45f3f12a0306.d071f03f-6218-4b8f-af1c-1354e9898681 {{(pid=84538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 19:00:12 devstack sudo[89355]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-03705fd0-ab2b-409d-957e-45f3f12a0306.d071f03f-6218-4b8f-af1c-1354e9898681 Apr 29 19:00:12 devstack sudo[89355]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 19:00:13 devstack sudo[89355]: pam_unix(sudo:session): session closed for user root Apr 29 19:00:13 devstack cinder-volume[84538]: DEBUG oslo_concurrency.processutils [req-3cdc13f8-ed60-4905-bcce-23ed7f192bdc req-fd75da9a-23c7-4631-b893-a8ac2b618b34 tempest-VolumesSnapshotsTestJSON-1657740841 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-03705fd0-ab2b-409d-957e-45f3f12a0306.d071f03f-6218-4b8f-af1c-1354e9898681" returned: 0 in 0.765s {{(pid=84538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 19:00:13 devstack cinder-volume[84538]: DEBUG oslo_concurrency.processutils [req-3cdc13f8-ed60-4905-bcce-23ed7f192bdc req-fd75da9a-23c7-4631-b893-a8ac2b618b34 tempest-VolumesSnapshotsTestJSON-1657740841 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-03705fd0-ab2b-409d-957e-45f3f12a0306.info {{(pid=84538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 19:00:13 devstack sudo[89358]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-03705fd0-ab2b-409d-957e-45f3f12a0306.info Apr 29 19:00:13 devstack sudo[89358]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 19:00:14 devstack sudo[89358]: pam_unix(sudo:session): session closed for user root Apr 29 19:00:14 devstack cinder-volume[84538]: DEBUG oslo_concurrency.processutils [req-3cdc13f8-ed60-4905-bcce-23ed7f192bdc req-fd75da9a-23c7-4631-b893-a8ac2b618b34 tempest-VolumesSnapshotsTestJSON-1657740841 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-03705fd0-ab2b-409d-957e-45f3f12a0306.info" returned: 0 in 0.697s {{(pid=84538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 19:00:14 devstack cinder-volume[84538]: WARNING cinder.volume.drivers.remotefs [req-3cdc13f8-ed60-4905-bcce-23ed7f192bdc req-fd75da9a-23c7-4631-b893-a8ac2b618b34 tempest-VolumesSnapshotsTestJSON-1657740841 None] /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-03705fd0-ab2b-409d-957e-45f3f12a0306.info is being set with open permissions: ugo+rw Apr 29 19:00:14 devstack cinder-volume[84538]: DEBUG oslo_concurrency.processutils [req-3cdc13f8-ed60-4905-bcce-23ed7f192bdc req-fd75da9a-23c7-4631-b893-a8ac2b618b34 tempest-VolumesSnapshotsTestJSON-1657740841 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-03705fd0-ab2b-409d-957e-45f3f12a0306.info {{(pid=84538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 19:00:14 devstack sudo[89362]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-03705fd0-ab2b-409d-957e-45f3f12a0306.info Apr 29 19:00:14 devstack sudo[89362]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 19:00:15 devstack sudo[89362]: pam_unix(sudo:session): session closed for user root Apr 29 19:00:15 devstack cinder-volume[84538]: DEBUG oslo_concurrency.processutils [req-3cdc13f8-ed60-4905-bcce-23ed7f192bdc req-fd75da9a-23c7-4631-b893-a8ac2b618b34 tempest-VolumesSnapshotsTestJSON-1657740841 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-03705fd0-ab2b-409d-957e-45f3f12a0306.info" returned: 0 in 0.750s {{(pid=84538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 19:00:15 devstack cinder-volume[84538]: DEBUG oslo_concurrency.lockutils [req-3cdc13f8-ed60-4905-bcce-23ed7f192bdc req-fd75da9a-23c7-4631-b893-a8ac2b618b34 tempest-VolumesSnapshotsTestJSON-1657740841 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 5.054s {{(pid=84538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 19:00:15 devstack cinder-volume[84538]: INFO cinder.volume.manager [req-3cdc13f8-ed60-4905-bcce-23ed7f192bdc req-fd75da9a-23c7-4631-b893-a8ac2b618b34 tempest-VolumesSnapshotsTestJSON-1657740841 None] Create snapshot completed successfully Apr 29 19:00:16 devstack cinder-volume[84538]: DEBUG cinder.coordination [req-23f4fe7d-2ea7-447a-851e-54b20e6811f6 req-afbda5e2-87ea-4df8-8ada-99a526b889ad tempest-VolumesSnapshotsTestJSON-1657740841 None] Acquiring lock "cinder-d071f03f-6218-4b8f-af1c-1354e9898681-delete_snapshot" by "delete_snapshot" {{(pid=84538) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 19:00:16 devstack cinder-volume[84538]: DEBUG cinder.coordination [req-23f4fe7d-2ea7-447a-851e-54b20e6811f6 req-afbda5e2-87ea-4df8-8ada-99a526b889ad tempest-VolumesSnapshotsTestJSON-1657740841 None] Lock "cinder-d071f03f-6218-4b8f-af1c-1354e9898681-delete_snapshot" acquired by "delete_snapshot" :: waited 0.021s {{(pid=84538) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 19:00:16 devstack cinder-volume[84538]: DEBUG cinder.coordination [req-23f4fe7d-2ea7-447a-851e-54b20e6811f6 req-afbda5e2-87ea-4df8-8ada-99a526b889ad tempest-VolumesSnapshotsTestJSON-1657740841 None] Acquiring lock "cinder-quobyte-03705fd0-ab2b-409d-957e-45f3f12a0306" by "delete_snapshot" {{(pid=84538) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 19:00:16 devstack cinder-volume[84538]: DEBUG cinder.coordination [req-23f4fe7d-2ea7-447a-851e-54b20e6811f6 req-afbda5e2-87ea-4df8-8ada-99a526b889ad tempest-VolumesSnapshotsTestJSON-1657740841 None] Lock "cinder-quobyte-03705fd0-ab2b-409d-957e-45f3f12a0306" acquired by "delete_snapshot" :: waited 0.019s {{(pid=84538) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 19:00:16 devstack cinder-volume[84538]: DEBUG cinder.coordination [req-23f4fe7d-2ea7-447a-851e-54b20e6811f6 req-afbda5e2-87ea-4df8-8ada-99a526b889ad tempest-VolumesSnapshotsTestJSON-1657740841 None] Acquiring lock "cinder-quobyte-d071f03f-6218-4b8f-af1c-1354e9898681" by "_delete_snapshot" {{(pid=84538) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 19:00:16 devstack cinder-volume[84538]: DEBUG cinder.coordination [req-23f4fe7d-2ea7-447a-851e-54b20e6811f6 req-afbda5e2-87ea-4df8-8ada-99a526b889ad tempest-VolumesSnapshotsTestJSON-1657740841 None] Lock "cinder-quobyte-d071f03f-6218-4b8f-af1c-1354e9898681" acquired by "_delete_snapshot" :: waited 0.026s {{(pid=84538) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 19:00:16 devstack cinder-volume[84538]: DEBUG cinder.volume.drivers.remotefs [req-23f4fe7d-2ea7-447a-851e-54b20e6811f6 req-afbda5e2-87ea-4df8-8ada-99a526b889ad tempest-VolumesSnapshotsTestJSON-1657740841 None] Deleting offline snapshot d071f03f-6218-4b8f-af1c-1354e9898681 of volume 03705fd0-ab2b-409d-957e-45f3f12a0306 {{(pid=84538) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 29 19:00:16 devstack cinder-volume[84538]: DEBUG cinder.volume.drivers.remotefs [req-23f4fe7d-2ea7-447a-851e-54b20e6811f6 req-afbda5e2-87ea-4df8-8ada-99a526b889ad tempest-VolumesSnapshotsTestJSON-1657740841 None] snapshot_file for this snap is: volume-03705fd0-ab2b-409d-957e-45f3f12a0306.d071f03f-6218-4b8f-af1c-1354e9898681 {{(pid=84538) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 29 19:00:16 devstack cinder-volume[84538]: DEBUG oslo.privsep.daemon [-] privsep: reply[ff97bf11-123d-47a5-a4d1-97575f45e28c]: (4, 'qcow2') {{(pid=85803) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 19:00:16 devstack cinder-volume[84538]: DEBUG oslo_concurrency.processutils [req-23f4fe7d-2ea7-447a-851e-54b20e6811f6 req-afbda5e2-87ea-4df8-8ada-99a526b889ad tempest-VolumesSnapshotsTestJSON-1657740841 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-03705fd0-ab2b-409d-957e-45f3f12a0306.d071f03f-6218-4b8f-af1c-1354e9898681 {{(pid=84538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 19:00:16 devstack sudo[89365]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-03705fd0-ab2b-409d-957e-45f3f12a0306.d071f03f-6218-4b8f-af1c-1354e9898681 Apr 29 19:00:16 devstack sudo[89365]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 19:00:17 devstack sudo[89365]: pam_unix(sudo:session): session closed for user root Apr 29 19:00:17 devstack cinder-volume[84538]: DEBUG oslo_concurrency.processutils [req-23f4fe7d-2ea7-447a-851e-54b20e6811f6 req-afbda5e2-87ea-4df8-8ada-99a526b889ad tempest-VolumesSnapshotsTestJSON-1657740841 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-03705fd0-ab2b-409d-957e-45f3f12a0306.d071f03f-6218-4b8f-af1c-1354e9898681" returned: 0 in 0.932s {{(pid=84538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 19:00:17 devstack cinder-volume[84538]: DEBUG cinder.volume.drivers.remotefs [req-23f4fe7d-2ea7-447a-851e-54b20e6811f6 req-afbda5e2-87ea-4df8-8ada-99a526b889ad tempest-VolumesSnapshotsTestJSON-1657740841 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-03705fd0-ab2b-409d-957e-45f3f12a0306(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=84538) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 29 19:00:17 devstack cinder-volume[84538]: DEBUG oslo.privsep.daemon [-] privsep: reply[8fbe914d-48f7-4df1-9d95-0e6acc0af300]: (4, 'qcow2') {{(pid=85803) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 19:00:17 devstack cinder-volume[84538]: DEBUG oslo_concurrency.processutils [req-23f4fe7d-2ea7-447a-851e-54b20e6811f6 req-afbda5e2-87ea-4df8-8ada-99a526b889ad tempest-VolumesSnapshotsTestJSON-1657740841 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-03705fd0-ab2b-409d-957e-45f3f12a0306 {{(pid=84538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 19:00:17 devstack sudo[89371]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-03705fd0-ab2b-409d-957e-45f3f12a0306 Apr 29 19:00:17 devstack sudo[89371]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 19:00:18 devstack sudo[89371]: pam_unix(sudo:session): session closed for user root Apr 29 19:00:18 devstack cinder-volume[84538]: DEBUG oslo_concurrency.processutils [req-23f4fe7d-2ea7-447a-851e-54b20e6811f6 req-afbda5e2-87ea-4df8-8ada-99a526b889ad tempest-VolumesSnapshotsTestJSON-1657740841 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-03705fd0-ab2b-409d-957e-45f3f12a0306" returned: 0 in 1.034s {{(pid=84538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 19:00:18 devstack cinder-volume[84538]: DEBUG oslo_concurrency.processutils [req-23f4fe7d-2ea7-447a-851e-54b20e6811f6 req-afbda5e2-87ea-4df8-8ada-99a526b889ad tempest-VolumesSnapshotsTestJSON-1657740841 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-03705fd0-ab2b-409d-957e-45f3f12a0306.d071f03f-6218-4b8f-af1c-1354e9898681 {{(pid=84538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 19:00:18 devstack sudo[89380]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-03705fd0-ab2b-409d-957e-45f3f12a0306.d071f03f-6218-4b8f-af1c-1354e9898681 Apr 29 19:00:18 devstack sudo[89380]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 19:00:19 devstack sudo[89380]: pam_unix(sudo:session): session closed for user root Apr 29 19:00:19 devstack cinder-volume[84538]: DEBUG oslo_concurrency.processutils [req-23f4fe7d-2ea7-447a-851e-54b20e6811f6 req-afbda5e2-87ea-4df8-8ada-99a526b889ad tempest-VolumesSnapshotsTestJSON-1657740841 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-03705fd0-ab2b-409d-957e-45f3f12a0306.d071f03f-6218-4b8f-af1c-1354e9898681" returned: 0 in 0.966s {{(pid=84538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 19:00:19 devstack cinder-volume[84538]: DEBUG oslo_concurrency.processutils [req-23f4fe7d-2ea7-447a-851e-54b20e6811f6 req-afbda5e2-87ea-4df8-8ada-99a526b889ad tempest-VolumesSnapshotsTestJSON-1657740841 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-03705fd0-ab2b-409d-957e-45f3f12a0306.d071f03f-6218-4b8f-af1c-1354e9898681 {{(pid=84538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 19:00:19 devstack sudo[89385]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-03705fd0-ab2b-409d-957e-45f3f12a0306.d071f03f-6218-4b8f-af1c-1354e9898681 Apr 29 19:00:19 devstack sudo[89385]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 19:00:19 devstack sudo[89385]: pam_unix(sudo:session): session closed for user root Apr 29 19:00:19 devstack cinder-volume[84538]: DEBUG oslo_concurrency.processutils [req-23f4fe7d-2ea7-447a-851e-54b20e6811f6 req-afbda5e2-87ea-4df8-8ada-99a526b889ad tempest-VolumesSnapshotsTestJSON-1657740841 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-03705fd0-ab2b-409d-957e-45f3f12a0306.d071f03f-6218-4b8f-af1c-1354e9898681" returned: 0 in 0.753s {{(pid=84538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 19:00:19 devstack cinder-volume[84538]: DEBUG cinder.coordination [req-23f4fe7d-2ea7-447a-851e-54b20e6811f6 req-afbda5e2-87ea-4df8-8ada-99a526b889ad tempest-VolumesSnapshotsTestJSON-1657740841 None] Lock "cinder-quobyte-d071f03f-6218-4b8f-af1c-1354e9898681" released by "_delete_snapshot" :: held 3.878s {{(pid=84538) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 19:00:20 devstack cinder-volume[84538]: DEBUG cinder.coordination [req-23f4fe7d-2ea7-447a-851e-54b20e6811f6 req-afbda5e2-87ea-4df8-8ada-99a526b889ad tempest-VolumesSnapshotsTestJSON-1657740841 None] Lock "cinder-quobyte-03705fd0-ab2b-409d-957e-45f3f12a0306" released by "delete_snapshot" :: held 3.920s {{(pid=84538) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 19:00:20 devstack cinder-volume[84538]: DEBUG cinder.quota [req-23f4fe7d-2ea7-447a-851e-54b20e6811f6 req-afbda5e2-87ea-4df8-8ada-99a526b889ad tempest-VolumesSnapshotsTestJSON-1657740841 None] Created reservations ['c6f6686a-b0f1-4ebf-aa2e-ccc853783091', 'cef4d508-b653-435b-99e3-d25458b2286f', '054c78fe-d31f-4d1b-9993-64188423ac93', 'ddc45a1c-797e-44e8-90fc-4597618b58b7'] {{(pid=84538) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 29 19:00:20 devstack cinder-volume[84538]: INFO cinder.volume.manager [req-23f4fe7d-2ea7-447a-851e-54b20e6811f6 req-afbda5e2-87ea-4df8-8ada-99a526b889ad tempest-VolumesSnapshotsTestJSON-1657740841 None] Delete snapshot completed successfully. Apr 29 19:00:20 devstack cinder-volume[84538]: DEBUG cinder.coordination [req-23f4fe7d-2ea7-447a-851e-54b20e6811f6 req-afbda5e2-87ea-4df8-8ada-99a526b889ad tempest-VolumesSnapshotsTestJSON-1657740841 None] Lock "cinder-d071f03f-6218-4b8f-af1c-1354e9898681-delete_snapshot" released by "delete_snapshot" :: held 4.118s {{(pid=84538) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 19:00:20 devstack cinder-volume[84538]: DEBUG cinder.coordination [req-b4743aac-4912-4b1a-ba44-23e7084d82e5 req-e65a33b4-6de8-4581-8568-f52b97714475 tempest-VolumesSnapshotsTestJSON-1657740841 None] Acquiring lock "cinder-03705fd0-ab2b-409d-957e-45f3f12a0306-delete_volume" by "delete_volume" {{(pid=84538) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 19:00:20 devstack cinder-volume[84538]: DEBUG cinder.coordination [req-b4743aac-4912-4b1a-ba44-23e7084d82e5 req-e65a33b4-6de8-4581-8568-f52b97714475 tempest-VolumesSnapshotsTestJSON-1657740841 None] Lock "cinder-03705fd0-ab2b-409d-957e-45f3f12a0306-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=84538) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 19:00:20 devstack cinder-volume[84538]: DEBUG cinder.coordination [req-b4743aac-4912-4b1a-ba44-23e7084d82e5 req-e65a33b4-6de8-4581-8568-f52b97714475 tempest-VolumesSnapshotsTestJSON-1657740841 None] Acquiring lock "cinder-quobyte-03705fd0-ab2b-409d-957e-45f3f12a0306" by "delete_volume" {{(pid=84538) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 19:00:20 devstack cinder-volume[84538]: DEBUG cinder.coordination [req-b4743aac-4912-4b1a-ba44-23e7084d82e5 req-e65a33b4-6de8-4581-8568-f52b97714475 tempest-VolumesSnapshotsTestJSON-1657740841 None] Lock "cinder-quobyte-03705fd0-ab2b-409d-957e-45f3f12a0306" acquired by "delete_volume" :: waited 0.028s {{(pid=84538) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 19:00:20 devstack cinder-volume[84538]: DEBUG oslo.privsep.daemon [-] privsep: reply[a3f9c8b2-ae7a-446c-9910-8206bbe8de2b]: (4, 'qcow2') {{(pid=85803) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 19:00:20 devstack cinder-volume[84538]: DEBUG oslo_concurrency.processutils [req-b4743aac-4912-4b1a-ba44-23e7084d82e5 req-e65a33b4-6de8-4581-8568-f52b97714475 tempest-VolumesSnapshotsTestJSON-1657740841 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-03705fd0-ab2b-409d-957e-45f3f12a0306 {{(pid=84538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 19:00:20 devstack sudo[89388]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-03705fd0-ab2b-409d-957e-45f3f12a0306 Apr 29 19:00:20 devstack sudo[89388]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 19:00:21 devstack sudo[89388]: pam_unix(sudo:session): session closed for user root Apr 29 19:00:21 devstack cinder-volume[84538]: DEBUG oslo_concurrency.processutils [req-b4743aac-4912-4b1a-ba44-23e7084d82e5 req-e65a33b4-6de8-4581-8568-f52b97714475 tempest-VolumesSnapshotsTestJSON-1657740841 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-03705fd0-ab2b-409d-957e-45f3f12a0306" returned: 0 in 0.940s {{(pid=84538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 19:00:21 devstack cinder-volume[84538]: DEBUG oslo_concurrency.processutils [req-b4743aac-4912-4b1a-ba44-23e7084d82e5 req-e65a33b4-6de8-4581-8568-f52b97714475 tempest-VolumesSnapshotsTestJSON-1657740841 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-03705fd0-ab2b-409d-957e-45f3f12a0306 {{(pid=84538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 19:00:21 devstack sudo[89393]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-03705fd0-ab2b-409d-957e-45f3f12a0306 Apr 29 19:00:21 devstack sudo[89393]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 19:00:22 devstack sudo[89393]: pam_unix(sudo:session): session closed for user root Apr 29 19:00:22 devstack cinder-volume[84538]: DEBUG oslo_concurrency.processutils [req-b4743aac-4912-4b1a-ba44-23e7084d82e5 req-e65a33b4-6de8-4581-8568-f52b97714475 tempest-VolumesSnapshotsTestJSON-1657740841 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-03705fd0-ab2b-409d-957e-45f3f12a0306" returned: 0 in 0.875s {{(pid=84538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 19:00:22 devstack cinder-volume[84538]: DEBUG cinder.coordination [req-b4743aac-4912-4b1a-ba44-23e7084d82e5 req-e65a33b4-6de8-4581-8568-f52b97714475 tempest-VolumesSnapshotsTestJSON-1657740841 None] Lock "cinder-quobyte-03705fd0-ab2b-409d-957e-45f3f12a0306" released by "delete_volume" :: held 1.922s {{(pid=84538) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 19:00:22 devstack cinder-volume[84538]: DEBUG cinder.volume.flows.manager.create_volume [None req-4bc1ad2a-8cff-4648-abb9-a2bd646aaf31 tempest-VolumesTestJSON-961393749 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84538) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Apr 29 19:00:22 devstack cinder-volume[84538]: DEBUG cinder.volume.manager [None req-4bc1ad2a-8cff-4648-abb9-a2bd646aaf31 tempest-VolumesTestJSON-961393749 None] Flow 'volume_create_manager' (1563b2c6-b6ea-445d-a458-a4df4edcad38) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84538) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 19:00:22 devstack cinder-volume[84538]: DEBUG cinder.volume.manager [None req-4bc1ad2a-8cff-4648-abb9-a2bd646aaf31 tempest-VolumesTestJSON-961393749 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (abd93e42-0172-4f6c-a62e-a8ae5eeb2c26) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 19:00:22 devstack cinder-volume[84538]: DEBUG cinder.volume.manager [None req-4bc1ad2a-8cff-4648-abb9-a2bd646aaf31 tempest-VolumesTestJSON-961393749 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (abd93e42-0172-4f6c-a62e-a8ae5eeb2c26) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-29T17:00:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-1693818677',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=664ac39f-7a03-4c06-b91b-93d429806c49,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='301061e1b33245578019c012954a3703',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T17:00:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T17:00:23Z,use_quota=True,user_id='dd575de1b1b741edbf42730659d26476',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(62b05900-93e3-4190-a88f-1d87324303d1),volume_type_id=62b05900-93e3-4190-a88f-1d87324303d1)' {{(pid=84538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 19:00:22 devstack cinder-volume[84538]: DEBUG cinder.volume.manager [None req-4bc1ad2a-8cff-4648-abb9-a2bd646aaf31 tempest-VolumesTestJSON-961393749 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (16c536c2-fbe9-4103-95a5-37bcbb091af5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 19:00:22 devstack cinder-volume[84538]: DEBUG cinder.volume.manager [None req-4bc1ad2a-8cff-4648-abb9-a2bd646aaf31 tempest-VolumesTestJSON-961393749 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (16c536c2-fbe9-4103-95a5-37bcbb091af5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 19:00:22 devstack cinder-volume[84538]: DEBUG cinder.volume.manager [None req-4bc1ad2a-8cff-4648-abb9-a2bd646aaf31 tempest-VolumesTestJSON-961393749 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e3593cd3-de99-4049-926b-8e335bfe9ab5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 19:00:22 devstack cinder-volume[84538]: DEBUG cinder.volume.manager [None req-4bc1ad2a-8cff-4648-abb9-a2bd646aaf31 tempest-VolumesTestJSON-961393749 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e3593cd3-de99-4049-926b-8e335bfe9ab5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '664ac39f-7a03-4c06-b91b-93d429806c49', 'volume_name': 'volume-664ac39f-7a03-4c06-b91b-93d429806c49', 'volume_size': 1}' {{(pid=84538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 19:00:22 devstack cinder-volume[84538]: DEBUG cinder.volume.manager [None req-4bc1ad2a-8cff-4648-abb9-a2bd646aaf31 tempest-VolumesTestJSON-961393749 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (41b5fed1-2a41-42df-b14a-41462c879bf8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 19:00:22 devstack cinder-volume[84538]: DEBUG cinder.volume.manager [None req-4bc1ad2a-8cff-4648-abb9-a2bd646aaf31 tempest-VolumesTestJSON-961393749 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (41b5fed1-2a41-42df-b14a-41462c879bf8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 19:00:22 devstack cinder-volume[84538]: DEBUG cinder.volume.manager [None req-4bc1ad2a-8cff-4648-abb9-a2bd646aaf31 tempest-VolumesTestJSON-961393749 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fe389e8c-b5a6-47fa-9690-155d7d21d0e0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 19:00:22 devstack cinder-volume[84538]: INFO cinder.volume.flows.manager.create_volume [None req-4bc1ad2a-8cff-4648-abb9-a2bd646aaf31 tempest-VolumesTestJSON-961393749 None] Volume 664ac39f-7a03-4c06-b91b-93d429806c49: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-664ac39f-7a03-4c06-b91b-93d429806c49', 'volume_size': 1} Apr 29 19:00:22 devstack cinder-volume[84538]: DEBUG oslo_concurrency.lockutils [None req-4bc1ad2a-8cff-4648-abb9-a2bd646aaf31 tempest-VolumesTestJSON-961393749 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 19:00:22 devstack cinder-volume[84538]: DEBUG oslo_concurrency.lockutils [None req-4bc1ad2a-8cff-4648-abb9-a2bd646aaf31 tempest-VolumesTestJSON-961393749 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=84538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 19:00:22 devstack cinder-volume[84538]: DEBUG cinder.volume.drivers.quobyte [None req-4bc1ad2a-8cff-4648-abb9-a2bd646aaf31 tempest-VolumesTestJSON-961393749 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-29T17:00:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-1693818677',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=664ac39f-7a03-4c06-b91b-93d429806c49,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='301061e1b33245578019c012954a3703',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T17:00:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T17:00:23Z,use_quota=True,user_id='dd575de1b1b741edbf42730659d26476',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(62b05900-93e3-4190-a88f-1d87324303d1),volume_type_id=62b05900-93e3-4190-a88f-1d87324303d1)}" {{(pid=84538) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 29 19:00:22 devstack cinder-volume[84538]: DEBUG cinder.volume.drivers.remotefs [None req-4bc1ad2a-8cff-4648-abb9-a2bd646aaf31 tempest-VolumesTestJSON-961393749 None] Creating volume 664ac39f-7a03-4c06-b91b-93d429806c49 {{(pid=84538) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 29 19:00:22 devstack cinder-volume[84538]: DEBUG oslo_concurrency.lockutils [None req-4bc1ad2a-8cff-4648-abb9-a2bd646aaf31 tempest-VolumesTestJSON-961393749 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 19:00:22 devstack cinder-volume[84538]: DEBUG oslo_concurrency.lockutils [None req-4bc1ad2a-8cff-4648-abb9-a2bd646aaf31 tempest-VolumesTestJSON-961393749 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=84538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 19:00:22 devstack cinder-volume[84538]: DEBUG cinder.volume.drivers.quobyte [None req-4bc1ad2a-8cff-4648-abb9-a2bd646aaf31 tempest-VolumesTestJSON-961393749 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-34312b00-dd6d-45bb-af98-75855cea8e48': None} {{(pid=84538) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 19:00:22 devstack cinder-volume[84538]: DEBUG cinder.volume.drivers.quobyte [None req-4bc1ad2a-8cff-4648-abb9-a2bd646aaf31 tempest-VolumesTestJSON-961393749 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-34312b00-dd6d-45bb-af98-75855cea8e48'] {{(pid=84538) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 19:00:22 devstack cinder-volume[84538]: DEBUG oslo_concurrency.lockutils [None req-4bc1ad2a-8cff-4648-abb9-a2bd646aaf31 tempest-VolumesTestJSON-961393749 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=84538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 19:00:22 devstack cinder-volume[84538]: DEBUG cinder.volume.drivers.quobyte [None req-4bc1ad2a-8cff-4648-abb9-a2bd646aaf31 tempest-VolumesTestJSON-961393749 None] Selected osci02.corp.quobyte.com/cinder-vol-34312b00-dd6d-45bb-af98-75855cea8e48 as target Quobyte volume. {{(pid=84538) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 29 19:00:22 devstack cinder-volume[84538]: INFO cinder.volume.drivers.remotefs [None req-4bc1ad2a-8cff-4648-abb9-a2bd646aaf31 tempest-VolumesTestJSON-961393749 None] casted to osci02.corp.quobyte.com/cinder-vol-34312b00-dd6d-45bb-af98-75855cea8e48 Apr 29 19:00:22 devstack cinder-volume[84538]: DEBUG oslo_concurrency.processutils [None req-4bc1ad2a-8cff-4648-abb9-a2bd646aaf31 tempest-VolumesTestJSON-961393749 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-664ac39f-7a03-4c06-b91b-93d429806c49 1073741824 {{(pid=84538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 19:00:22 devstack sudo[89396]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-664ac39f-7a03-4c06-b91b-93d429806c49 1073741824 Apr 29 19:00:22 devstack sudo[89396]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 19:00:22 devstack cinder-volume[84538]: DEBUG cinder.quota [req-b4743aac-4912-4b1a-ba44-23e7084d82e5 req-e65a33b4-6de8-4581-8568-f52b97714475 tempest-VolumesSnapshotsTestJSON-1657740841 None] Created reservations ['3387e649-1594-417c-869a-708a7316962f', 'f5d5f678-ea22-41f0-a5ca-d450d353a0c7', 'ad3f1b3d-d083-4567-892c-2e943156b0dd', '5ed1b0fb-cc75-4f79-acf1-0711ef5e855a'] {{(pid=84538) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 29 19:00:22 devstack cinder-volume[84538]: DEBUG oslo_concurrency.lockutils [req-b4743aac-4912-4b1a-ba44-23e7084d82e5 req-e65a33b4-6de8-4581-8568-f52b97714475 tempest-VolumesSnapshotsTestJSON-1657740841 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 19:00:22 devstack cinder-volume[84538]: DEBUG oslo_concurrency.lockutils [req-b4743aac-4912-4b1a-ba44-23e7084d82e5 req-e65a33b4-6de8-4581-8568-f52b97714475 tempest-VolumesSnapshotsTestJSON-1657740841 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 19:00:22 devstack cinder-volume[84538]: DEBUG cinder.volume.drivers.quobyte [req-b4743aac-4912-4b1a-ba44-23e7084d82e5 req-e65a33b4-6de8-4581-8568-f52b97714475 tempest-VolumesSnapshotsTestJSON-1657740841 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-34312b00-dd6d-45bb-af98-75855cea8e48': None} {{(pid=84538) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 19:00:22 devstack cinder-volume[84538]: DEBUG cinder.volume.drivers.quobyte [req-b4743aac-4912-4b1a-ba44-23e7084d82e5 req-e65a33b4-6de8-4581-8568-f52b97714475 tempest-VolumesSnapshotsTestJSON-1657740841 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-34312b00-dd6d-45bb-af98-75855cea8e48'] {{(pid=84538) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 19:00:22 devstack cinder-volume[84538]: DEBUG oslo_concurrency.lockutils [req-b4743aac-4912-4b1a-ba44-23e7084d82e5 req-e65a33b4-6de8-4581-8568-f52b97714475 tempest-VolumesSnapshotsTestJSON-1657740841 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=84538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 19:00:22 devstack cinder-volume[84538]: DEBUG oslo_concurrency.processutils [req-b4743aac-4912-4b1a-ba44-23e7084d82e5 req-e65a33b4-6de8-4581-8568-f52b97714475 tempest-VolumesSnapshotsTestJSON-1657740841 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d {{(pid=84538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 19:00:23 devstack sudo[89398]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d Apr 29 19:00:23 devstack sudo[89398]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 19:00:24 devstack sudo[89396]: pam_unix(sudo:session): session closed for user root Apr 29 19:00:24 devstack cinder-volume[84538]: DEBUG oslo_concurrency.processutils [None req-4bc1ad2a-8cff-4648-abb9-a2bd646aaf31 tempest-VolumesTestJSON-961393749 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-664ac39f-7a03-4c06-b91b-93d429806c49 1073741824" returned: 0 in 1.241s {{(pid=84538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 19:00:24 devstack cinder-volume[84538]: DEBUG oslo_concurrency.processutils [None req-4bc1ad2a-8cff-4648-abb9-a2bd646aaf31 tempest-VolumesTestJSON-961393749 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-664ac39f-7a03-4c06-b91b-93d429806c49 {{(pid=84538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 19:00:24 devstack sudo[89405]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-664ac39f-7a03-4c06-b91b-93d429806c49 Apr 29 19:00:24 devstack sudo[89405]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 19:00:24 devstack sudo[89398]: pam_unix(sudo:session): session closed for user root Apr 29 19:00:24 devstack cinder-volume[84538]: DEBUG oslo_concurrency.processutils [req-b4743aac-4912-4b1a-ba44-23e7084d82e5 req-e65a33b4-6de8-4581-8568-f52b97714475 tempest-VolumesSnapshotsTestJSON-1657740841 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d" returned: 0 in 1.209s {{(pid=84538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 19:00:24 devstack cinder-volume[84538]: DEBUG cinder.manager [req-b4743aac-4912-4b1a-ba44-23e7084d82e5 req-e65a33b4-6de8-4581-8568-f52b97714475 tempest-VolumesSnapshotsTestJSON-1657740841 None] Notifying Schedulers of capabilities ... {{(pid=84538) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 29 19:00:24 devstack cinder-volume[84538]: INFO cinder.volume.manager [req-b4743aac-4912-4b1a-ba44-23e7084d82e5 req-e65a33b4-6de8-4581-8568-f52b97714475 tempest-VolumesSnapshotsTestJSON-1657740841 None] Deleted volume successfully. Apr 29 19:00:24 devstack cinder-volume[84538]: DEBUG cinder.coordination [req-b4743aac-4912-4b1a-ba44-23e7084d82e5 req-e65a33b4-6de8-4581-8568-f52b97714475 tempest-VolumesSnapshotsTestJSON-1657740841 None] Lock "cinder-03705fd0-ab2b-409d-957e-45f3f12a0306-delete_volume" released by "delete_volume" :: held 3.608s {{(pid=84538) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 19:00:24 devstack sudo[89405]: pam_unix(sudo:session): session closed for user root Apr 29 19:00:24 devstack cinder-volume[84538]: DEBUG oslo_concurrency.processutils [None req-4bc1ad2a-8cff-4648-abb9-a2bd646aaf31 tempest-VolumesTestJSON-961393749 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-664ac39f-7a03-4c06-b91b-93d429806c49" returned: 0 in 0.724s {{(pid=84538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 19:00:24 devstack cinder-volume[84538]: DEBUG cinder.volume.drivers.quobyte [None req-4bc1ad2a-8cff-4648-abb9-a2bd646aaf31 tempest-VolumesTestJSON-961393749 None] <== create_volume: return (2037ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-34312b00-dd6d-45bb-af98-75855cea8e48'} {{(pid=84538) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 29 19:00:24 devstack cinder-volume[84538]: DEBUG oslo_concurrency.lockutils [None req-4bc1ad2a-8cff-4648-abb9-a2bd646aaf31 tempest-VolumesTestJSON-961393749 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.040s {{(pid=84538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 19:00:24 devstack cinder-volume[84538]: DEBUG cinder.volume.manager [None req-4bc1ad2a-8cff-4648-abb9-a2bd646aaf31 tempest-VolumesTestJSON-961393749 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fe389e8c-b5a6-47fa-9690-155d7d21d0e0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-664ac39f-7a03-4c06-b91b-93d429806c49', 'volume_size': 1}' {{(pid=84538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 19:00:24 devstack cinder-volume[84538]: DEBUG cinder.volume.manager [None req-4bc1ad2a-8cff-4648-abb9-a2bd646aaf31 tempest-VolumesTestJSON-961393749 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (97fbba8e-d763-43ee-b816-4d52f350b1cc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 19:00:24 devstack cinder-volume[84538]: INFO cinder.volume.flows.manager.create_volume [None req-4bc1ad2a-8cff-4648-abb9-a2bd646aaf31 tempest-VolumesTestJSON-961393749 None] Volume volume-664ac39f-7a03-4c06-b91b-93d429806c49 (664ac39f-7a03-4c06-b91b-93d429806c49): created successfully Apr 29 19:00:24 devstack cinder-volume[84538]: DEBUG cinder.volume.manager [None req-4bc1ad2a-8cff-4648-abb9-a2bd646aaf31 tempest-VolumesTestJSON-961393749 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (97fbba8e-d763-43ee-b816-4d52f350b1cc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 19:00:24 devstack cinder-volume[84538]: DEBUG cinder.volume.manager [None req-4bc1ad2a-8cff-4648-abb9-a2bd646aaf31 tempest-VolumesTestJSON-961393749 None] Flow 'volume_create_manager' (1563b2c6-b6ea-445d-a458-a4df4edcad38) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84538) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 19:00:24 devstack cinder-volume[84538]: INFO cinder.volume.manager [None req-4bc1ad2a-8cff-4648-abb9-a2bd646aaf31 tempest-VolumesTestJSON-961393749 None] Created volume successfully. Apr 29 19:00:25 devstack cinder-volume[84538]: DEBUG oslo_service.periodic_task [None req-a93183a6-1080-461c-84de-2fcb210d4f60 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=84538) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}} Apr 29 19:00:25 devstack cinder-volume[84538]: DEBUG oslo_concurrency.lockutils [None req-a93183a6-1080-461c-84de-2fcb210d4f60 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 19:00:25 devstack cinder-volume[84538]: DEBUG oslo_concurrency.lockutils [None req-a93183a6-1080-461c-84de-2fcb210d4f60 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=84538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 19:00:25 devstack cinder-volume[84538]: DEBUG cinder.volume.drivers.quobyte [None req-a93183a6-1080-461c-84de-2fcb210d4f60 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-34312b00-dd6d-45bb-af98-75855cea8e48': None} {{(pid=84538) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 19:00:25 devstack cinder-volume[84538]: DEBUG cinder.volume.drivers.quobyte [None req-a93183a6-1080-461c-84de-2fcb210d4f60 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-34312b00-dd6d-45bb-af98-75855cea8e48'] {{(pid=84538) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 19:00:25 devstack cinder-volume[84538]: DEBUG oslo_concurrency.lockutils [None req-a93183a6-1080-461c-84de-2fcb210d4f60 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=84538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 19:00:25 devstack cinder-volume[84538]: DEBUG oslo_concurrency.processutils [None req-a93183a6-1080-461c-84de-2fcb210d4f60 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d {{(pid=84538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 19:00:25 devstack sudo[89408]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d Apr 29 19:00:25 devstack sudo[89408]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 19:00:25 devstack sudo[89408]: pam_unix(sudo:session): session closed for user root Apr 29 19:00:25 devstack cinder-volume[84538]: DEBUG oslo_concurrency.processutils [None req-a93183a6-1080-461c-84de-2fcb210d4f60 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d" returned: 0 in 0.754s {{(pid=84538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 19:00:25 devstack cinder-volume[84538]: DEBUG cinder.manager [None req-a93183a6-1080-461c-84de-2fcb210d4f60 None None] Notifying Schedulers of capabilities ... {{(pid=84538) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 29 19:00:26 devstack cinder-volume[84538]: DEBUG cinder.volume.flows.manager.create_volume [None req-2d065fd7-6dec-4ae1-8ffd-1c8c145ba3a8 tempest-VolumesTestJSON-961393749 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84538) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Apr 29 19:00:26 devstack cinder-volume[84538]: DEBUG cinder.volume.manager [None req-2d065fd7-6dec-4ae1-8ffd-1c8c145ba3a8 tempest-VolumesTestJSON-961393749 None] Flow 'volume_create_manager' (d4dd68f4-14c5-4532-8e9c-62a000fe82c5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84538) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 19:00:26 devstack cinder-volume[84538]: DEBUG cinder.volume.manager [None req-2d065fd7-6dec-4ae1-8ffd-1c8c145ba3a8 tempest-VolumesTestJSON-961393749 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (989f5cac-8e12-4137-a4b5-cd5f0bec0f10) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 19:00:26 devstack cinder-volume[84538]: DEBUG cinder.volume.manager [None req-2d065fd7-6dec-4ae1-8ffd-1c8c145ba3a8 tempest-VolumesTestJSON-961393749 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (989f5cac-8e12-4137-a4b5-cd5f0bec0f10) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-29T17:00:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-582919934',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=05521fc8-8935-4317-a12b-7224821762bd,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='301061e1b33245578019c012954a3703',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T17:00:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T17:00:26Z,use_quota=True,user_id='dd575de1b1b741edbf42730659d26476',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(62b05900-93e3-4190-a88f-1d87324303d1),volume_type_id=62b05900-93e3-4190-a88f-1d87324303d1)' {{(pid=84538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 19:00:26 devstack cinder-volume[84538]: DEBUG cinder.volume.manager [None req-2d065fd7-6dec-4ae1-8ffd-1c8c145ba3a8 tempest-VolumesTestJSON-961393749 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c12bd277-c4d1-4ce7-a607-6db76cb0d91b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 19:00:26 devstack cinder-volume[84538]: DEBUG cinder.volume.manager [None req-2d065fd7-6dec-4ae1-8ffd-1c8c145ba3a8 tempest-VolumesTestJSON-961393749 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c12bd277-c4d1-4ce7-a607-6db76cb0d91b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 19:00:26 devstack cinder-volume[84538]: DEBUG cinder.volume.manager [None req-2d065fd7-6dec-4ae1-8ffd-1c8c145ba3a8 tempest-VolumesTestJSON-961393749 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (af864e58-5261-4224-833c-4c1dbb7f2f33) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 19:00:26 devstack cinder-volume[84538]: DEBUG cinder.volume.manager [None req-2d065fd7-6dec-4ae1-8ffd-1c8c145ba3a8 tempest-VolumesTestJSON-961393749 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (af864e58-5261-4224-833c-4c1dbb7f2f33) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '05521fc8-8935-4317-a12b-7224821762bd', 'volume_name': 'volume-05521fc8-8935-4317-a12b-7224821762bd', 'volume_size': 1}' {{(pid=84538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 19:00:26 devstack cinder-volume[84538]: DEBUG cinder.volume.manager [None req-2d065fd7-6dec-4ae1-8ffd-1c8c145ba3a8 tempest-VolumesTestJSON-961393749 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8eb37283-6323-4134-9e31-2955e15d18ea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 19:00:26 devstack cinder-volume[84538]: DEBUG cinder.volume.manager [None req-2d065fd7-6dec-4ae1-8ffd-1c8c145ba3a8 tempest-VolumesTestJSON-961393749 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8eb37283-6323-4134-9e31-2955e15d18ea) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 19:00:26 devstack cinder-volume[84538]: DEBUG cinder.volume.manager [None req-2d065fd7-6dec-4ae1-8ffd-1c8c145ba3a8 tempest-VolumesTestJSON-961393749 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e284cbde-a94b-4d14-8eeb-d40e9142ef27) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 19:00:26 devstack cinder-volume[84538]: INFO cinder.volume.flows.manager.create_volume [None req-2d065fd7-6dec-4ae1-8ffd-1c8c145ba3a8 tempest-VolumesTestJSON-961393749 None] Volume 05521fc8-8935-4317-a12b-7224821762bd: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-05521fc8-8935-4317-a12b-7224821762bd', 'volume_size': 1} Apr 29 19:00:26 devstack cinder-volume[84538]: DEBUG oslo_concurrency.lockutils [None req-2d065fd7-6dec-4ae1-8ffd-1c8c145ba3a8 tempest-VolumesTestJSON-961393749 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 19:00:26 devstack cinder-volume[84538]: DEBUG oslo_concurrency.lockutils [None req-2d065fd7-6dec-4ae1-8ffd-1c8c145ba3a8 tempest-VolumesTestJSON-961393749 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=84538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 19:00:26 devstack cinder-volume[84538]: DEBUG cinder.volume.drivers.quobyte [None req-2d065fd7-6dec-4ae1-8ffd-1c8c145ba3a8 tempest-VolumesTestJSON-961393749 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-29T17:00:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-582919934',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=05521fc8-8935-4317-a12b-7224821762bd,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='301061e1b33245578019c012954a3703',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T17:00:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T17:00:26Z,use_quota=True,user_id='dd575de1b1b741edbf42730659d26476',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(62b05900-93e3-4190-a88f-1d87324303d1),volume_type_id=62b05900-93e3-4190-a88f-1d87324303d1)}" {{(pid=84538) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 29 19:00:26 devstack cinder-volume[84538]: DEBUG cinder.volume.drivers.remotefs [None req-2d065fd7-6dec-4ae1-8ffd-1c8c145ba3a8 tempest-VolumesTestJSON-961393749 None] Creating volume 05521fc8-8935-4317-a12b-7224821762bd {{(pid=84538) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 29 19:00:26 devstack cinder-volume[84538]: DEBUG oslo_concurrency.lockutils [None req-2d065fd7-6dec-4ae1-8ffd-1c8c145ba3a8 tempest-VolumesTestJSON-961393749 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 19:00:26 devstack cinder-volume[84538]: DEBUG oslo_concurrency.lockutils [None req-2d065fd7-6dec-4ae1-8ffd-1c8c145ba3a8 tempest-VolumesTestJSON-961393749 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=84538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 19:00:26 devstack cinder-volume[84538]: DEBUG cinder.volume.drivers.quobyte [None req-2d065fd7-6dec-4ae1-8ffd-1c8c145ba3a8 tempest-VolumesTestJSON-961393749 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-34312b00-dd6d-45bb-af98-75855cea8e48': None} {{(pid=84538) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 19:00:26 devstack cinder-volume[84538]: DEBUG cinder.volume.drivers.quobyte [None req-2d065fd7-6dec-4ae1-8ffd-1c8c145ba3a8 tempest-VolumesTestJSON-961393749 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-34312b00-dd6d-45bb-af98-75855cea8e48'] {{(pid=84538) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 19:00:26 devstack cinder-volume[84538]: DEBUG oslo_concurrency.lockutils [None req-2d065fd7-6dec-4ae1-8ffd-1c8c145ba3a8 tempest-VolumesTestJSON-961393749 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=84538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 19:00:26 devstack cinder-volume[84538]: DEBUG cinder.volume.drivers.quobyte [None req-2d065fd7-6dec-4ae1-8ffd-1c8c145ba3a8 tempest-VolumesTestJSON-961393749 None] Selected osci02.corp.quobyte.com/cinder-vol-34312b00-dd6d-45bb-af98-75855cea8e48 as target Quobyte volume. {{(pid=84538) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 29 19:00:26 devstack cinder-volume[84538]: INFO cinder.volume.drivers.remotefs [None req-2d065fd7-6dec-4ae1-8ffd-1c8c145ba3a8 tempest-VolumesTestJSON-961393749 None] casted to osci02.corp.quobyte.com/cinder-vol-34312b00-dd6d-45bb-af98-75855cea8e48 Apr 29 19:00:26 devstack cinder-volume[84538]: DEBUG oslo_concurrency.processutils [None req-2d065fd7-6dec-4ae1-8ffd-1c8c145ba3a8 tempest-VolumesTestJSON-961393749 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-05521fc8-8935-4317-a12b-7224821762bd 1073741824 {{(pid=84538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 19:00:26 devstack sudo[89415]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-05521fc8-8935-4317-a12b-7224821762bd 1073741824 Apr 29 19:00:26 devstack sudo[89415]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 19:00:27 devstack sudo[89415]: pam_unix(sudo:session): session closed for user root Apr 29 19:00:27 devstack cinder-volume[84538]: DEBUG oslo_concurrency.processutils [None req-2d065fd7-6dec-4ae1-8ffd-1c8c145ba3a8 tempest-VolumesTestJSON-961393749 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-05521fc8-8935-4317-a12b-7224821762bd 1073741824" returned: 0 in 0.978s {{(pid=84538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 19:00:27 devstack cinder-volume[84538]: DEBUG oslo_concurrency.processutils [None req-2d065fd7-6dec-4ae1-8ffd-1c8c145ba3a8 tempest-VolumesTestJSON-961393749 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-05521fc8-8935-4317-a12b-7224821762bd {{(pid=84538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 19:00:27 devstack sudo[89421]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-05521fc8-8935-4317-a12b-7224821762bd Apr 29 19:00:27 devstack sudo[89421]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 19:00:28 devstack cinder-volume[84538]: DEBUG cinder.volume.flows.manager.create_volume [req-a32d0b71-8a0d-4295-9362-146000f98333 req-af2f5dc4-9b27-48fd-975e-5c1dd8d570c0 tempest-VolumesGetTestJSON-1676765069 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84538) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Apr 29 19:00:28 devstack cinder-volume[84538]: DEBUG cinder.volume.manager [req-a32d0b71-8a0d-4295-9362-146000f98333 req-af2f5dc4-9b27-48fd-975e-5c1dd8d570c0 tempest-VolumesGetTestJSON-1676765069 None] Flow 'volume_create_manager' (2801b442-7ff7-4135-ade2-99573e595447) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84538) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 19:00:28 devstack cinder-volume[84538]: DEBUG cinder.volume.manager [req-a32d0b71-8a0d-4295-9362-146000f98333 req-af2f5dc4-9b27-48fd-975e-5c1dd8d570c0 tempest-VolumesGetTestJSON-1676765069 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c50e8335-e273-4d66-9cd7-76567e298434) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 19:00:28 devstack cinder-volume[84538]: DEBUG cinder.volume.manager [req-a32d0b71-8a0d-4295-9362-146000f98333 req-af2f5dc4-9b27-48fd-975e-5c1dd8d570c0 tempest-VolumesGetTestJSON-1676765069 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c50e8335-e273-4d66-9cd7-76567e298434) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-29T17:00:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTestJSON-Volume-246340648',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e649ee7d-640e-431f-b8fe-7e7c1365c60a,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='befffa55a4da493bba8306c715e5da85',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T17:00:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T17:00:28Z,use_quota=True,user_id='dab100498c5d49af8b1558fe76ae49dc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(62b05900-93e3-4190-a88f-1d87324303d1),volume_type_id=62b05900-93e3-4190-a88f-1d87324303d1)' {{(pid=84538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 19:00:28 devstack cinder-volume[84538]: DEBUG cinder.volume.manager [req-a32d0b71-8a0d-4295-9362-146000f98333 req-af2f5dc4-9b27-48fd-975e-5c1dd8d570c0 tempest-VolumesGetTestJSON-1676765069 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2ffdaf7e-1303-44a5-9ef0-624a1c2221e6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 19:00:28 devstack cinder-volume[84538]: DEBUG cinder.volume.manager [req-a32d0b71-8a0d-4295-9362-146000f98333 req-af2f5dc4-9b27-48fd-975e-5c1dd8d570c0 tempest-VolumesGetTestJSON-1676765069 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2ffdaf7e-1303-44a5-9ef0-624a1c2221e6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 19:00:28 devstack cinder-volume[84538]: DEBUG cinder.volume.manager [req-a32d0b71-8a0d-4295-9362-146000f98333 req-af2f5dc4-9b27-48fd-975e-5c1dd8d570c0 tempest-VolumesGetTestJSON-1676765069 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f338f568-974e-472f-b992-dbebacb4e71e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 19:00:28 devstack cinder-volume[84538]: DEBUG cinder.volume.manager [req-a32d0b71-8a0d-4295-9362-146000f98333 req-af2f5dc4-9b27-48fd-975e-5c1dd8d570c0 tempest-VolumesGetTestJSON-1676765069 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f338f568-974e-472f-b992-dbebacb4e71e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e649ee7d-640e-431f-b8fe-7e7c1365c60a', 'volume_name': 'volume-e649ee7d-640e-431f-b8fe-7e7c1365c60a', 'volume_size': 1}' {{(pid=84538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 19:00:28 devstack cinder-volume[84538]: DEBUG cinder.volume.manager [req-a32d0b71-8a0d-4295-9362-146000f98333 req-af2f5dc4-9b27-48fd-975e-5c1dd8d570c0 tempest-VolumesGetTestJSON-1676765069 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (db65fc90-0234-42f2-a29e-315eb423672d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 19:00:28 devstack cinder-volume[84538]: DEBUG cinder.volume.manager [req-a32d0b71-8a0d-4295-9362-146000f98333 req-af2f5dc4-9b27-48fd-975e-5c1dd8d570c0 tempest-VolumesGetTestJSON-1676765069 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (db65fc90-0234-42f2-a29e-315eb423672d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 19:00:28 devstack cinder-volume[84538]: DEBUG cinder.volume.manager [req-a32d0b71-8a0d-4295-9362-146000f98333 req-af2f5dc4-9b27-48fd-975e-5c1dd8d570c0 tempest-VolumesGetTestJSON-1676765069 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ec29f506-22fa-42ab-8586-faafc6495242) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 19:00:28 devstack cinder-volume[84538]: INFO cinder.volume.flows.manager.create_volume [req-a32d0b71-8a0d-4295-9362-146000f98333 req-af2f5dc4-9b27-48fd-975e-5c1dd8d570c0 tempest-VolumesGetTestJSON-1676765069 None] Volume e649ee7d-640e-431f-b8fe-7e7c1365c60a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e649ee7d-640e-431f-b8fe-7e7c1365c60a', 'volume_size': 1} Apr 29 19:00:28 devstack cinder-volume[84538]: DEBUG oslo_concurrency.lockutils [req-a32d0b71-8a0d-4295-9362-146000f98333 req-af2f5dc4-9b27-48fd-975e-5c1dd8d570c0 tempest-VolumesGetTestJSON-1676765069 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 19:00:28 devstack sudo[89421]: pam_unix(sudo:session): session closed for user root Apr 29 19:00:28 devstack cinder-volume[84538]: DEBUG oslo_concurrency.processutils [None req-2d065fd7-6dec-4ae1-8ffd-1c8c145ba3a8 tempest-VolumesTestJSON-961393749 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-05521fc8-8935-4317-a12b-7224821762bd" returned: 0 in 0.800s {{(pid=84538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 19:00:28 devstack cinder-volume[84538]: DEBUG cinder.volume.drivers.quobyte [None req-2d065fd7-6dec-4ae1-8ffd-1c8c145ba3a8 tempest-VolumesTestJSON-961393749 None] <== create_volume: return (1848ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-34312b00-dd6d-45bb-af98-75855cea8e48'} {{(pid=84538) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 29 19:00:28 devstack cinder-volume[84538]: DEBUG oslo_concurrency.lockutils [None req-2d065fd7-6dec-4ae1-8ffd-1c8c145ba3a8 tempest-VolumesTestJSON-961393749 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.851s {{(pid=84538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 19:00:28 devstack cinder-volume[84538]: DEBUG oslo_concurrency.lockutils [req-a32d0b71-8a0d-4295-9362-146000f98333 req-af2f5dc4-9b27-48fd-975e-5c1dd8d570c0 tempest-VolumesGetTestJSON-1676765069 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.143s {{(pid=84538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 19:00:28 devstack cinder-volume[84538]: DEBUG cinder.volume.drivers.quobyte [req-a32d0b71-8a0d-4295-9362-146000f98333 req-af2f5dc4-9b27-48fd-975e-5c1dd8d570c0 tempest-VolumesGetTestJSON-1676765069 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-29T17:00:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTestJSON-Volume-246340648',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e649ee7d-640e-431f-b8fe-7e7c1365c60a,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='befffa55a4da493bba8306c715e5da85',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T17:00:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T17:00:28Z,use_quota=True,user_id='dab100498c5d49af8b1558fe76ae49dc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(62b05900-93e3-4190-a88f-1d87324303d1),volume_type_id=62b05900-93e3-4190-a88f-1d87324303d1)}" {{(pid=84538) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 29 19:00:28 devstack cinder-volume[84538]: DEBUG cinder.volume.drivers.remotefs [req-a32d0b71-8a0d-4295-9362-146000f98333 req-af2f5dc4-9b27-48fd-975e-5c1dd8d570c0 tempest-VolumesGetTestJSON-1676765069 None] Creating volume e649ee7d-640e-431f-b8fe-7e7c1365c60a {{(pid=84538) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 29 19:00:28 devstack cinder-volume[84538]: DEBUG oslo_concurrency.lockutils [req-a32d0b71-8a0d-4295-9362-146000f98333 req-af2f5dc4-9b27-48fd-975e-5c1dd8d570c0 tempest-VolumesGetTestJSON-1676765069 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 19:00:28 devstack cinder-volume[84538]: DEBUG oslo_concurrency.lockutils [req-a32d0b71-8a0d-4295-9362-146000f98333 req-af2f5dc4-9b27-48fd-975e-5c1dd8d570c0 tempest-VolumesGetTestJSON-1676765069 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=84538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 19:00:28 devstack cinder-volume[84538]: DEBUG cinder.volume.drivers.quobyte [req-a32d0b71-8a0d-4295-9362-146000f98333 req-af2f5dc4-9b27-48fd-975e-5c1dd8d570c0 tempest-VolumesGetTestJSON-1676765069 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-34312b00-dd6d-45bb-af98-75855cea8e48': None} {{(pid=84538) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 19:00:28 devstack cinder-volume[84538]: DEBUG cinder.volume.drivers.quobyte [req-a32d0b71-8a0d-4295-9362-146000f98333 req-af2f5dc4-9b27-48fd-975e-5c1dd8d570c0 tempest-VolumesGetTestJSON-1676765069 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-34312b00-dd6d-45bb-af98-75855cea8e48'] {{(pid=84538) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 19:00:28 devstack cinder-volume[84538]: DEBUG oslo_concurrency.lockutils [req-a32d0b71-8a0d-4295-9362-146000f98333 req-af2f5dc4-9b27-48fd-975e-5c1dd8d570c0 tempest-VolumesGetTestJSON-1676765069 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=84538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 19:00:28 devstack cinder-volume[84538]: DEBUG cinder.volume.drivers.quobyte [req-a32d0b71-8a0d-4295-9362-146000f98333 req-af2f5dc4-9b27-48fd-975e-5c1dd8d570c0 tempest-VolumesGetTestJSON-1676765069 None] Selected osci02.corp.quobyte.com/cinder-vol-34312b00-dd6d-45bb-af98-75855cea8e48 as target Quobyte volume. {{(pid=84538) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 29 19:00:28 devstack cinder-volume[84538]: INFO cinder.volume.drivers.remotefs [req-a32d0b71-8a0d-4295-9362-146000f98333 req-af2f5dc4-9b27-48fd-975e-5c1dd8d570c0 tempest-VolumesGetTestJSON-1676765069 None] casted to osci02.corp.quobyte.com/cinder-vol-34312b00-dd6d-45bb-af98-75855cea8e48 Apr 29 19:00:28 devstack cinder-volume[84538]: DEBUG oslo_concurrency.processutils [req-a32d0b71-8a0d-4295-9362-146000f98333 req-af2f5dc4-9b27-48fd-975e-5c1dd8d570c0 tempest-VolumesGetTestJSON-1676765069 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-e649ee7d-640e-431f-b8fe-7e7c1365c60a 1073741824 {{(pid=84538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 19:00:28 devstack cinder-volume[84538]: DEBUG cinder.volume.manager [None req-2d065fd7-6dec-4ae1-8ffd-1c8c145ba3a8 tempest-VolumesTestJSON-961393749 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e284cbde-a94b-4d14-8eeb-d40e9142ef27) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-05521fc8-8935-4317-a12b-7224821762bd', 'volume_size': 1}' {{(pid=84538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 19:00:28 devstack cinder-volume[84538]: DEBUG cinder.volume.manager [None req-2d065fd7-6dec-4ae1-8ffd-1c8c145ba3a8 tempest-VolumesTestJSON-961393749 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7969b3a9-8ada-42e5-b992-980ef4f7ca80) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 19:00:28 devstack sudo[89425]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-e649ee7d-640e-431f-b8fe-7e7c1365c60a 1073741824 Apr 29 19:00:28 devstack sudo[89425]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 19:00:28 devstack cinder-volume[84538]: INFO cinder.volume.flows.manager.create_volume [None req-2d065fd7-6dec-4ae1-8ffd-1c8c145ba3a8 tempest-VolumesTestJSON-961393749 None] Volume volume-05521fc8-8935-4317-a12b-7224821762bd (05521fc8-8935-4317-a12b-7224821762bd): created successfully Apr 29 19:00:28 devstack cinder-volume[84538]: DEBUG cinder.volume.manager [None req-2d065fd7-6dec-4ae1-8ffd-1c8c145ba3a8 tempest-VolumesTestJSON-961393749 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7969b3a9-8ada-42e5-b992-980ef4f7ca80) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 19:00:28 devstack cinder-volume[84538]: DEBUG cinder.volume.manager [None req-2d065fd7-6dec-4ae1-8ffd-1c8c145ba3a8 tempest-VolumesTestJSON-961393749 None] Flow 'volume_create_manager' (d4dd68f4-14c5-4532-8e9c-62a000fe82c5) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84538) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 19:00:28 devstack cinder-volume[84538]: INFO cinder.volume.manager [None req-2d065fd7-6dec-4ae1-8ffd-1c8c145ba3a8 tempest-VolumesTestJSON-961393749 None] Created volume successfully. Apr 29 19:00:29 devstack cinder-volume[84538]: DEBUG cinder.volume.flows.manager.create_volume [None req-7a96a2e1-4efd-4aeb-8a17-8851496d7a99 tempest-VolumesTestJSON-961393749 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84538) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Apr 29 19:00:29 devstack cinder-volume[84538]: DEBUG cinder.volume.manager [None req-7a96a2e1-4efd-4aeb-8a17-8851496d7a99 tempest-VolumesTestJSON-961393749 None] Flow 'volume_create_manager' (0a347293-0e36-4764-9265-ffba8d517453) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84538) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 19:00:29 devstack cinder-volume[84538]: DEBUG cinder.volume.manager [None req-7a96a2e1-4efd-4aeb-8a17-8851496d7a99 tempest-VolumesTestJSON-961393749 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (71168268-86f6-4726-a76d-321f636556f2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 19:00:29 devstack cinder-volume[84538]: DEBUG cinder.volume.manager [None req-7a96a2e1-4efd-4aeb-8a17-8851496d7a99 tempest-VolumesTestJSON-961393749 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (71168268-86f6-4726-a76d-321f636556f2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-29T17:00:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-228303978',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=949b4a2b-d43f-46d4-b94e-d321d20ef8d8,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='301061e1b33245578019c012954a3703',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T17:00:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T17:00:29Z,use_quota=True,user_id='dd575de1b1b741edbf42730659d26476',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(62b05900-93e3-4190-a88f-1d87324303d1),volume_type_id=62b05900-93e3-4190-a88f-1d87324303d1)' {{(pid=84538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 19:00:29 devstack cinder-volume[84538]: DEBUG cinder.volume.manager [None req-7a96a2e1-4efd-4aeb-8a17-8851496d7a99 tempest-VolumesTestJSON-961393749 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e6319419-30c4-4c0e-9b31-90740a65b500) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 19:00:29 devstack cinder-volume[84538]: DEBUG cinder.volume.manager [None req-7a96a2e1-4efd-4aeb-8a17-8851496d7a99 tempest-VolumesTestJSON-961393749 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e6319419-30c4-4c0e-9b31-90740a65b500) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 19:00:29 devstack cinder-volume[84538]: DEBUG cinder.volume.manager [None req-7a96a2e1-4efd-4aeb-8a17-8851496d7a99 tempest-VolumesTestJSON-961393749 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (11a0c7a4-e92c-4076-81bc-ae695db811c4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 19:00:29 devstack cinder-volume[84538]: DEBUG cinder.volume.manager [None req-7a96a2e1-4efd-4aeb-8a17-8851496d7a99 tempest-VolumesTestJSON-961393749 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (11a0c7a4-e92c-4076-81bc-ae695db811c4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '949b4a2b-d43f-46d4-b94e-d321d20ef8d8', 'volume_name': 'volume-949b4a2b-d43f-46d4-b94e-d321d20ef8d8', 'volume_size': 1}' {{(pid=84538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 19:00:29 devstack cinder-volume[84538]: DEBUG cinder.volume.manager [None req-7a96a2e1-4efd-4aeb-8a17-8851496d7a99 tempest-VolumesTestJSON-961393749 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (891f38bb-b849-4f60-9644-a7fffe701f82) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 19:00:29 devstack cinder-volume[84538]: DEBUG cinder.volume.manager [None req-7a96a2e1-4efd-4aeb-8a17-8851496d7a99 tempest-VolumesTestJSON-961393749 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (891f38bb-b849-4f60-9644-a7fffe701f82) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 19:00:29 devstack cinder-volume[84538]: DEBUG cinder.volume.manager [None req-7a96a2e1-4efd-4aeb-8a17-8851496d7a99 tempest-VolumesTestJSON-961393749 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0a78a691-6d58-4db7-9591-33ad79fc10e4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 19:00:29 devstack cinder-volume[84538]: INFO cinder.volume.flows.manager.create_volume [None req-7a96a2e1-4efd-4aeb-8a17-8851496d7a99 tempest-VolumesTestJSON-961393749 None] Volume 949b4a2b-d43f-46d4-b94e-d321d20ef8d8: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-949b4a2b-d43f-46d4-b94e-d321d20ef8d8', 'volume_size': 1} Apr 29 19:00:29 devstack cinder-volume[84538]: DEBUG oslo_concurrency.lockutils [None req-7a96a2e1-4efd-4aeb-8a17-8851496d7a99 tempest-VolumesTestJSON-961393749 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 19:00:29 devstack sudo[89425]: pam_unix(sudo:session): session closed for user root Apr 29 19:00:29 devstack cinder-volume[84538]: DEBUG oslo_concurrency.processutils [req-a32d0b71-8a0d-4295-9362-146000f98333 req-af2f5dc4-9b27-48fd-975e-5c1dd8d570c0 tempest-VolumesGetTestJSON-1676765069 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-e649ee7d-640e-431f-b8fe-7e7c1365c60a 1073741824" returned: 0 in 1.173s {{(pid=84538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 19:00:29 devstack cinder-volume[84538]: DEBUG oslo_concurrency.processutils [req-a32d0b71-8a0d-4295-9362-146000f98333 req-af2f5dc4-9b27-48fd-975e-5c1dd8d570c0 tempest-VolumesGetTestJSON-1676765069 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-e649ee7d-640e-431f-b8fe-7e7c1365c60a {{(pid=84538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 19:00:29 devstack sudo[89430]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-e649ee7d-640e-431f-b8fe-7e7c1365c60a Apr 29 19:00:29 devstack sudo[89430]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 19:00:30 devstack sudo[89430]: pam_unix(sudo:session): session closed for user root Apr 29 19:00:30 devstack cinder-volume[84538]: DEBUG oslo_concurrency.processutils [req-a32d0b71-8a0d-4295-9362-146000f98333 req-af2f5dc4-9b27-48fd-975e-5c1dd8d570c0 tempest-VolumesGetTestJSON-1676765069 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-e649ee7d-640e-431f-b8fe-7e7c1365c60a" returned: 0 in 0.706s {{(pid=84538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 19:00:30 devstack cinder-volume[84538]: DEBUG cinder.volume.drivers.quobyte [req-a32d0b71-8a0d-4295-9362-146000f98333 req-af2f5dc4-9b27-48fd-975e-5c1dd8d570c0 tempest-VolumesGetTestJSON-1676765069 None] <== create_volume: return (1929ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-34312b00-dd6d-45bb-af98-75855cea8e48'} {{(pid=84538) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 29 19:00:30 devstack cinder-volume[84538]: DEBUG oslo_concurrency.lockutils [req-a32d0b71-8a0d-4295-9362-146000f98333 req-af2f5dc4-9b27-48fd-975e-5c1dd8d570c0 tempest-VolumesGetTestJSON-1676765069 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.932s {{(pid=84538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 19:00:30 devstack cinder-volume[84538]: DEBUG oslo_concurrency.lockutils [None req-7a96a2e1-4efd-4aeb-8a17-8851496d7a99 tempest-VolumesTestJSON-961393749 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.042s {{(pid=84538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 19:00:30 devstack cinder-volume[84538]: DEBUG cinder.volume.drivers.quobyte [None req-7a96a2e1-4efd-4aeb-8a17-8851496d7a99 tempest-VolumesTestJSON-961393749 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-29T17:00:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-228303978',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=949b4a2b-d43f-46d4-b94e-d321d20ef8d8,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='301061e1b33245578019c012954a3703',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T17:00:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T17:00:29Z,use_quota=True,user_id='dd575de1b1b741edbf42730659d26476',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(62b05900-93e3-4190-a88f-1d87324303d1),volume_type_id=62b05900-93e3-4190-a88f-1d87324303d1)}" {{(pid=84538) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 29 19:00:30 devstack cinder-volume[84538]: DEBUG cinder.volume.drivers.remotefs [None req-7a96a2e1-4efd-4aeb-8a17-8851496d7a99 tempest-VolumesTestJSON-961393749 None] Creating volume 949b4a2b-d43f-46d4-b94e-d321d20ef8d8 {{(pid=84538) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 29 19:00:30 devstack cinder-volume[84538]: DEBUG oslo_concurrency.lockutils [None req-7a96a2e1-4efd-4aeb-8a17-8851496d7a99 tempest-VolumesTestJSON-961393749 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 19:00:30 devstack cinder-volume[84538]: DEBUG oslo_concurrency.lockutils [None req-7a96a2e1-4efd-4aeb-8a17-8851496d7a99 tempest-VolumesTestJSON-961393749 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 19:00:30 devstack cinder-volume[84538]: DEBUG cinder.volume.drivers.quobyte [None req-7a96a2e1-4efd-4aeb-8a17-8851496d7a99 tempest-VolumesTestJSON-961393749 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-34312b00-dd6d-45bb-af98-75855cea8e48': None} {{(pid=84538) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 19:00:30 devstack cinder-volume[84538]: DEBUG cinder.volume.drivers.quobyte [None req-7a96a2e1-4efd-4aeb-8a17-8851496d7a99 tempest-VolumesTestJSON-961393749 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-34312b00-dd6d-45bb-af98-75855cea8e48'] {{(pid=84538) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 19:00:30 devstack cinder-volume[84538]: DEBUG oslo_concurrency.lockutils [None req-7a96a2e1-4efd-4aeb-8a17-8851496d7a99 tempest-VolumesTestJSON-961393749 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=84538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 19:00:30 devstack cinder-volume[84538]: DEBUG cinder.volume.drivers.quobyte [None req-7a96a2e1-4efd-4aeb-8a17-8851496d7a99 tempest-VolumesTestJSON-961393749 None] Selected osci02.corp.quobyte.com/cinder-vol-34312b00-dd6d-45bb-af98-75855cea8e48 as target Quobyte volume. {{(pid=84538) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 29 19:00:30 devstack cinder-volume[84538]: INFO cinder.volume.drivers.remotefs [None req-7a96a2e1-4efd-4aeb-8a17-8851496d7a99 tempest-VolumesTestJSON-961393749 None] casted to osci02.corp.quobyte.com/cinder-vol-34312b00-dd6d-45bb-af98-75855cea8e48 Apr 29 19:00:30 devstack cinder-volume[84538]: DEBUG oslo_concurrency.processutils [None req-7a96a2e1-4efd-4aeb-8a17-8851496d7a99 tempest-VolumesTestJSON-961393749 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-949b4a2b-d43f-46d4-b94e-d321d20ef8d8 1073741824 {{(pid=84538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 19:00:30 devstack cinder-volume[84538]: DEBUG cinder.volume.manager [req-a32d0b71-8a0d-4295-9362-146000f98333 req-af2f5dc4-9b27-48fd-975e-5c1dd8d570c0 tempest-VolumesGetTestJSON-1676765069 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ec29f506-22fa-42ab-8586-faafc6495242) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e649ee7d-640e-431f-b8fe-7e7c1365c60a', 'volume_size': 1}' {{(pid=84538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 19:00:30 devstack sudo[89433]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-949b4a2b-d43f-46d4-b94e-d321d20ef8d8 1073741824 Apr 29 19:00:30 devstack sudo[89433]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 19:00:30 devstack cinder-volume[84538]: DEBUG cinder.volume.manager [req-a32d0b71-8a0d-4295-9362-146000f98333 req-af2f5dc4-9b27-48fd-975e-5c1dd8d570c0 tempest-VolumesGetTestJSON-1676765069 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c68cbe99-8fc1-4ba8-b266-4d82a364c96b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 19:00:30 devstack cinder-volume[84538]: INFO cinder.volume.flows.manager.create_volume [req-a32d0b71-8a0d-4295-9362-146000f98333 req-af2f5dc4-9b27-48fd-975e-5c1dd8d570c0 tempest-VolumesGetTestJSON-1676765069 None] Volume volume-e649ee7d-640e-431f-b8fe-7e7c1365c60a (e649ee7d-640e-431f-b8fe-7e7c1365c60a): created successfully Apr 29 19:00:30 devstack cinder-volume[84538]: DEBUG cinder.volume.manager [req-a32d0b71-8a0d-4295-9362-146000f98333 req-af2f5dc4-9b27-48fd-975e-5c1dd8d570c0 tempest-VolumesGetTestJSON-1676765069 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c68cbe99-8fc1-4ba8-b266-4d82a364c96b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 19:00:30 devstack cinder-volume[84538]: DEBUG cinder.volume.manager [req-a32d0b71-8a0d-4295-9362-146000f98333 req-af2f5dc4-9b27-48fd-975e-5c1dd8d570c0 tempest-VolumesGetTestJSON-1676765069 None] Flow 'volume_create_manager' (2801b442-7ff7-4135-ade2-99573e595447) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84538) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 19:00:30 devstack cinder-volume[84538]: INFO cinder.volume.manager [req-a32d0b71-8a0d-4295-9362-146000f98333 req-af2f5dc4-9b27-48fd-975e-5c1dd8d570c0 tempest-VolumesGetTestJSON-1676765069 None] Created volume successfully. Apr 29 19:00:31 devstack sudo[89433]: pam_unix(sudo:session): session closed for user root Apr 29 19:00:31 devstack cinder-volume[84538]: DEBUG oslo_concurrency.processutils [None req-7a96a2e1-4efd-4aeb-8a17-8851496d7a99 tempest-VolumesTestJSON-961393749 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-949b4a2b-d43f-46d4-b94e-d321d20ef8d8 1073741824" returned: 0 in 1.088s {{(pid=84538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 19:00:31 devstack cinder-volume[84538]: DEBUG oslo_concurrency.processutils [None req-7a96a2e1-4efd-4aeb-8a17-8851496d7a99 tempest-VolumesTestJSON-961393749 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-949b4a2b-d43f-46d4-b94e-d321d20ef8d8 {{(pid=84538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 19:00:31 devstack sudo[89438]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-949b4a2b-d43f-46d4-b94e-d321d20ef8d8 Apr 29 19:00:31 devstack sudo[89438]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 19:00:32 devstack sudo[89438]: pam_unix(sudo:session): session closed for user root Apr 29 19:00:32 devstack cinder-volume[84538]: DEBUG cinder.coordination [req-f37bf6c8-3332-4d3e-b40b-c23117619596 req-e5856527-9b6c-4d71-b336-3be995d6acf0 tempest-VolumesGetTestJSON-1676765069 None] Acquiring lock "cinder-e649ee7d-640e-431f-b8fe-7e7c1365c60a-delete_volume" by "delete_volume" {{(pid=84538) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 19:00:32 devstack cinder-volume[84538]: DEBUG oslo_concurrency.processutils [None req-7a96a2e1-4efd-4aeb-8a17-8851496d7a99 tempest-VolumesTestJSON-961393749 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-949b4a2b-d43f-46d4-b94e-d321d20ef8d8" returned: 0 in 0.815s {{(pid=84538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 19:00:32 devstack cinder-volume[84538]: DEBUG cinder.volume.drivers.quobyte [None req-7a96a2e1-4efd-4aeb-8a17-8851496d7a99 tempest-VolumesTestJSON-961393749 None] <== create_volume: return (1967ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-34312b00-dd6d-45bb-af98-75855cea8e48'} {{(pid=84538) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 29 19:00:32 devstack cinder-volume[84538]: DEBUG oslo_concurrency.lockutils [None req-7a96a2e1-4efd-4aeb-8a17-8851496d7a99 tempest-VolumesTestJSON-961393749 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.971s {{(pid=84538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 19:00:32 devstack cinder-volume[84538]: DEBUG cinder.volume.manager [None req-7a96a2e1-4efd-4aeb-8a17-8851496d7a99 tempest-VolumesTestJSON-961393749 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0a78a691-6d58-4db7-9591-33ad79fc10e4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-949b4a2b-d43f-46d4-b94e-d321d20ef8d8', 'volume_size': 1}' {{(pid=84538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 19:00:32 devstack cinder-volume[84538]: DEBUG cinder.volume.manager [None req-7a96a2e1-4efd-4aeb-8a17-8851496d7a99 tempest-VolumesTestJSON-961393749 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (dd3649b2-e95e-41cf-8f2a-00935300af15) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 19:00:32 devstack cinder-volume[84538]: DEBUG cinder.coordination [req-f37bf6c8-3332-4d3e-b40b-c23117619596 req-e5856527-9b6c-4d71-b336-3be995d6acf0 tempest-VolumesGetTestJSON-1676765069 None] Lock "cinder-e649ee7d-640e-431f-b8fe-7e7c1365c60a-delete_volume" acquired by "delete_volume" :: waited 0.034s {{(pid=84538) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 19:00:32 devstack cinder-volume[84538]: INFO cinder.volume.flows.manager.create_volume [None req-7a96a2e1-4efd-4aeb-8a17-8851496d7a99 tempest-VolumesTestJSON-961393749 None] Volume volume-949b4a2b-d43f-46d4-b94e-d321d20ef8d8 (949b4a2b-d43f-46d4-b94e-d321d20ef8d8): created successfully Apr 29 19:00:32 devstack cinder-volume[84538]: DEBUG cinder.volume.manager [None req-7a96a2e1-4efd-4aeb-8a17-8851496d7a99 tempest-VolumesTestJSON-961393749 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (dd3649b2-e95e-41cf-8f2a-00935300af15) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 19:00:32 devstack cinder-volume[84538]: DEBUG cinder.volume.manager [None req-7a96a2e1-4efd-4aeb-8a17-8851496d7a99 tempest-VolumesTestJSON-961393749 None] Flow 'volume_create_manager' (0a347293-0e36-4764-9265-ffba8d517453) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84538) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 19:00:32 devstack cinder-volume[84538]: INFO cinder.volume.manager [None req-7a96a2e1-4efd-4aeb-8a17-8851496d7a99 tempest-VolumesTestJSON-961393749 None] Created volume successfully. Apr 29 19:00:32 devstack cinder-volume[84538]: DEBUG cinder.coordination [req-f37bf6c8-3332-4d3e-b40b-c23117619596 req-e5856527-9b6c-4d71-b336-3be995d6acf0 tempest-VolumesGetTestJSON-1676765069 None] Acquiring lock "cinder-quobyte-e649ee7d-640e-431f-b8fe-7e7c1365c60a" by "delete_volume" {{(pid=84538) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 19:00:32 devstack cinder-volume[84538]: DEBUG cinder.coordination [req-f37bf6c8-3332-4d3e-b40b-c23117619596 req-e5856527-9b6c-4d71-b336-3be995d6acf0 tempest-VolumesGetTestJSON-1676765069 None] Lock "cinder-quobyte-e649ee7d-640e-431f-b8fe-7e7c1365c60a" acquired by "delete_volume" :: waited 0.020s {{(pid=84538) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 19:00:32 devstack cinder-volume[84538]: DEBUG oslo.privsep.daemon [-] privsep: reply[2bce6da9-7dab-4485-83dc-d5c128878e15]: (4, 'qcow2') {{(pid=85803) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 19:00:32 devstack cinder-volume[84538]: DEBUG oslo_concurrency.processutils [req-f37bf6c8-3332-4d3e-b40b-c23117619596 req-e5856527-9b6c-4d71-b336-3be995d6acf0 tempest-VolumesGetTestJSON-1676765069 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-e649ee7d-640e-431f-b8fe-7e7c1365c60a {{(pid=84538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 19:00:32 devstack sudo[89445]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-e649ee7d-640e-431f-b8fe-7e7c1365c60a Apr 29 19:00:32 devstack sudo[89445]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 19:00:33 devstack cinder-volume[84538]: DEBUG dbcounter [-] [84538] Writing DB stats cinder:SELECT=67,cinder:INSERT=17,cinder:UPDATE=94,cinder:DELETE=5 {{(pid=84538) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Apr 29 19:00:33 devstack cinder-volume[84538]: DEBUG dbcounter [-] [84538] Writing DB stats cinder:SELECT=64,cinder:INSERT=27,cinder:UPDATE=86,cinder:DELETE=10 {{(pid=84538) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Apr 29 19:00:33 devstack cinder-volume[84538]: DEBUG cinder.volume.flows.manager.create_volume [None req-a37e3f26-d8a1-4d7e-b1af-6b95af636131 tempest-VolumesImageMetadata-273877373 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84538) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Apr 29 19:00:33 devstack cinder-volume[84538]: DEBUG cinder.volume.manager [None req-a37e3f26-d8a1-4d7e-b1af-6b95af636131 tempest-VolumesImageMetadata-273877373 None] Flow 'volume_create_manager' (e9899b9a-6304-4808-9751-b7606f828bd0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84538) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 19:00:33 devstack cinder-volume[84538]: DEBUG cinder.volume.manager [None req-a37e3f26-d8a1-4d7e-b1af-6b95af636131 tempest-VolumesImageMetadata-273877373 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3f8bf3c7-865e-4b95-903c-b1c6980043db) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 19:00:33 devstack cinder-volume[84538]: DEBUG cinder.volume.manager [None req-a37e3f26-d8a1-4d7e-b1af-6b95af636131 tempest-VolumesImageMetadata-273877373 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3f8bf3c7-865e-4b95-903c-b1c6980043db) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-29T17:00:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesImageMetadata-Volume-2034613163',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1817e622-6c32-4a74-a412-0387c4b992a1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6c021687781249389a302ef6d0eb7190',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T17:00:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T17:00:33Z,use_quota=True,user_id='5c3e1244343b4f1082b0d60194c2bb28',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(62b05900-93e3-4190-a88f-1d87324303d1),volume_type_id=62b05900-93e3-4190-a88f-1d87324303d1)' {{(pid=84538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 19:00:33 devstack cinder-volume[84538]: DEBUG cinder.volume.manager [None req-a37e3f26-d8a1-4d7e-b1af-6b95af636131 tempest-VolumesImageMetadata-273877373 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0faed63b-dd9b-4c83-b848-43a47623e683) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 19:00:33 devstack cinder-volume[84538]: DEBUG cinder.volume.manager [None req-a37e3f26-d8a1-4d7e-b1af-6b95af636131 tempest-VolumesImageMetadata-273877373 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0faed63b-dd9b-4c83-b848-43a47623e683) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 19:00:33 devstack cinder-volume[84538]: DEBUG cinder.volume.manager [None req-a37e3f26-d8a1-4d7e-b1af-6b95af636131 tempest-VolumesImageMetadata-273877373 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (979713ee-8df6-4c40-897d-9e244171f07e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 19:00:33 devstack cinder-volume[84538]: DEBUG cinder.image.glance [None req-a37e3f26-d8a1-4d7e-b1af-6b95af636131 tempest-VolumesImageMetadata-273877373 None] Creating Keystone auth plugin from conf {{(pid=84538) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Apr 29 19:00:33 devstack cinder-volume[84538]: DEBUG cinder.volume.manager [None req-a37e3f26-d8a1-4d7e-b1af-6b95af636131 tempest-VolumesImageMetadata-273877373 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (979713ee-8df6-4c40-897d-9e244171f07e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '1817e622-6c32-4a74-a412-0387c4b992a1', 'volume_name': 'volume-1817e622-6c32-4a74-a412-0387c4b992a1', 'volume_size': 1, 'image_id': '11605644-0a6a-4a0a-b123-c09ab01cd4db', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/11605644-0a6a-4a0a-b123-c09ab01cd4db', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '853afc5ea27148009f8c02d351cf4d80', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '11605644-0a6a-4a0a-b123-c09ab01cd4db', 'created_at': datetime.datetime(2026, 4, 29, 16, 52, 8, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 4, 29, 16, 52, 10, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/11605644-0a6a-4a0a-b123-c09ab01cd4db/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=84538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 19:00:33 devstack cinder-volume[84538]: DEBUG cinder.volume.manager [None req-a37e3f26-d8a1-4d7e-b1af-6b95af636131 tempest-VolumesImageMetadata-273877373 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b003045a-5138-49e3-a0fd-3f28fc401b83) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 19:00:33 devstack cinder-volume[84538]: DEBUG cinder.volume.manager [None req-a37e3f26-d8a1-4d7e-b1af-6b95af636131 tempest-VolumesImageMetadata-273877373 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b003045a-5138-49e3-a0fd-3f28fc401b83) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 19:00:33 devstack sudo[89445]: pam_unix(sudo:session): session closed for user root Apr 29 19:00:33 devstack cinder-volume[84538]: DEBUG cinder.volume.manager [None req-a37e3f26-d8a1-4d7e-b1af-6b95af636131 tempest-VolumesImageMetadata-273877373 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d4855d7b-987a-4e93-9a69-1225b04fd3b0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 19:00:33 devstack cinder-volume[84538]: INFO cinder.volume.flows.manager.create_volume [None req-a37e3f26-d8a1-4d7e-b1af-6b95af636131 tempest-VolumesImageMetadata-273877373 None] Volume 1817e622-6c32-4a74-a412-0387c4b992a1: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-1817e622-6c32-4a74-a412-0387c4b992a1', 'volume_size': 1, 'image_id': '11605644-0a6a-4a0a-b123-c09ab01cd4db', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/11605644-0a6a-4a0a-b123-c09ab01cd4db', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '853afc5ea27148009f8c02d351cf4d80', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '11605644-0a6a-4a0a-b123-c09ab01cd4db', 'created_at': datetime.datetime(2026, 4, 29, 16, 52, 8, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 4, 29, 16, 52, 10, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/11605644-0a6a-4a0a-b123-c09ab01cd4db/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': } Apr 29 19:00:33 devstack cinder-volume[84538]: DEBUG cinder.volume.flows.manager.create_volume [None req-a37e3f26-d8a1-4d7e-b1af-6b95af636131 tempest-VolumesImageMetadata-273877373 None] Trying to clone 1817e622-6c32-4a74-a412-0387c4b992a1 from image 11605644-0a6a-4a0a-b123-c09ab01cd4db at location (None, [{'url': 'file:///opt/stack/data/glance/images/11605644-0a6a-4a0a-b123-c09ab01cd4db', 'metadata': {}}]). {{(pid=84538) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1082}} Apr 29 19:00:33 devstack cinder-volume[84538]: DEBUG oslo_concurrency.processutils [req-f37bf6c8-3332-4d3e-b40b-c23117619596 req-e5856527-9b6c-4d71-b336-3be995d6acf0 tempest-VolumesGetTestJSON-1676765069 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-e649ee7d-640e-431f-b8fe-7e7c1365c60a" returned: 0 in 0.925s {{(pid=84538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 19:00:33 devstack cinder-volume[84538]: DEBUG oslo_concurrency.processutils [req-f37bf6c8-3332-4d3e-b40b-c23117619596 req-e5856527-9b6c-4d71-b336-3be995d6acf0 tempest-VolumesGetTestJSON-1676765069 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-e649ee7d-640e-431f-b8fe-7e7c1365c60a {{(pid=84538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 19:00:33 devstack sudo[89463]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-e649ee7d-640e-431f-b8fe-7e7c1365c60a Apr 29 19:00:33 devstack sudo[89463]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 19:00:33 devstack cinder-volume[84538]: DEBUG cinder.image.image_utils [None req-a37e3f26-d8a1-4d7e-b1af-6b95af636131 tempest-VolumesImageMetadata-273877373 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_11605644-0a6a-4a0a-b123-c09ab01cd4db_hv6v0btzdevstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=84538) fetch /opt/stack/cinder/cinder/image/image_utils.py:732}} Apr 29 19:00:33 devstack cinder-volume[84538]: INFO cinder.image.image_utils [None req-a37e3f26-d8a1-4d7e-b1af-6b95af636131 tempest-VolumesImageMetadata-273877373 None] Image download 20.69 MB at 20.69 MB/s Apr 29 19:00:33 devstack cinder-volume[84538]: DEBUG oslo.privsep.daemon [-] privsep: reply[5a6cba3e-e5bf-4c0f-8139-26ede0c5a9ab]: (4, 'qcow2') {{(pid=85803) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 19:00:33 devstack cinder-volume[84538]: DEBUG oslo_concurrency.processutils [None req-a37e3f26-d8a1-4d7e-b1af-6b95af636131 tempest-VolumesImageMetadata-273877373 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_11605644-0a6a-4a0a-b123-c09ab01cd4db_hv6v0btzdevstack@QuobyteHD {{(pid=84538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 19:00:34 devstack sudo[89466]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_11605644-0a6a-4a0a-b123-c09ab01cd4db_hv6v0btzdevstack@QuobyteHD Apr 29 19:00:34 devstack sudo[89466]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 19:00:34 devstack sudo[89463]: pam_unix(sudo:session): session closed for user root Apr 29 19:00:34 devstack cinder-volume[84538]: DEBUG oslo_concurrency.processutils [req-f37bf6c8-3332-4d3e-b40b-c23117619596 req-e5856527-9b6c-4d71-b336-3be995d6acf0 tempest-VolumesGetTestJSON-1676765069 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-e649ee7d-640e-431f-b8fe-7e7c1365c60a" returned: 0 in 0.707s {{(pid=84538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 19:00:34 devstack cinder-volume[84538]: DEBUG cinder.coordination [req-f37bf6c8-3332-4d3e-b40b-c23117619596 req-e5856527-9b6c-4d71-b336-3be995d6acf0 tempest-VolumesGetTestJSON-1676765069 None] Lock "cinder-quobyte-e649ee7d-640e-431f-b8fe-7e7c1365c60a" released by "delete_volume" :: held 1.705s {{(pid=84538) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 19:00:34 devstack cinder-volume[84538]: DEBUG cinder.quota [req-f37bf6c8-3332-4d3e-b40b-c23117619596 req-e5856527-9b6c-4d71-b336-3be995d6acf0 tempest-VolumesGetTestJSON-1676765069 None] Created reservations ['33b14755-affd-4ea5-b393-36a7732eb94e', '1a56359c-6883-4c89-bbd1-ee9e6baa1fb9', 'ce737e67-e7eb-4669-9671-42e66a3a4fc0', '79e82371-5a0b-4d86-a885-b52ddc6755d2'] {{(pid=84538) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 29 19:00:34 devstack cinder-volume[84538]: DEBUG oslo_concurrency.lockutils [req-f37bf6c8-3332-4d3e-b40b-c23117619596 req-e5856527-9b6c-4d71-b336-3be995d6acf0 tempest-VolumesGetTestJSON-1676765069 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 19:00:34 devstack cinder-volume[84538]: DEBUG oslo_concurrency.lockutils [req-f37bf6c8-3332-4d3e-b40b-c23117619596 req-e5856527-9b6c-4d71-b336-3be995d6acf0 tempest-VolumesGetTestJSON-1676765069 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 19:00:34 devstack cinder-volume[84538]: DEBUG cinder.volume.drivers.quobyte [req-f37bf6c8-3332-4d3e-b40b-c23117619596 req-e5856527-9b6c-4d71-b336-3be995d6acf0 tempest-VolumesGetTestJSON-1676765069 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-34312b00-dd6d-45bb-af98-75855cea8e48': None} {{(pid=84538) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 19:00:34 devstack cinder-volume[84538]: DEBUG cinder.volume.drivers.quobyte [req-f37bf6c8-3332-4d3e-b40b-c23117619596 req-e5856527-9b6c-4d71-b336-3be995d6acf0 tempest-VolumesGetTestJSON-1676765069 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-34312b00-dd6d-45bb-af98-75855cea8e48'] {{(pid=84538) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 19:00:34 devstack cinder-volume[84538]: DEBUG oslo_concurrency.lockutils [req-f37bf6c8-3332-4d3e-b40b-c23117619596 req-e5856527-9b6c-4d71-b336-3be995d6acf0 tempest-VolumesGetTestJSON-1676765069 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=84538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 19:00:34 devstack cinder-volume[84538]: DEBUG oslo_concurrency.processutils [req-f37bf6c8-3332-4d3e-b40b-c23117619596 req-e5856527-9b6c-4d71-b336-3be995d6acf0 tempest-VolumesGetTestJSON-1676765069 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d {{(pid=84538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 19:00:34 devstack sudo[89469]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d Apr 29 19:00:34 devstack sudo[89469]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 19:00:34 devstack cinder-volume[84538]: DEBUG cinder.coordination [None req-46d803a3-948b-4878-8f1c-39f78f5cc842 tempest-VolumesTestJSON-961393749 None] Acquiring lock "cinder-949b4a2b-d43f-46d4-b94e-d321d20ef8d8-delete_volume" by "delete_volume" {{(pid=84538) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 19:00:34 devstack cinder-volume[84538]: DEBUG cinder.coordination [None req-46d803a3-948b-4878-8f1c-39f78f5cc842 tempest-VolumesTestJSON-961393749 None] Lock "cinder-949b4a2b-d43f-46d4-b94e-d321d20ef8d8-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=84538) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 19:00:34 devstack cinder-volume[84538]: DEBUG cinder.coordination [None req-46d803a3-948b-4878-8f1c-39f78f5cc842 tempest-VolumesTestJSON-961393749 None] Acquiring lock "cinder-quobyte-949b4a2b-d43f-46d4-b94e-d321d20ef8d8" by "delete_volume" {{(pid=84538) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 19:00:34 devstack cinder-volume[84538]: DEBUG cinder.coordination [None req-46d803a3-948b-4878-8f1c-39f78f5cc842 tempest-VolumesTestJSON-961393749 None] Lock "cinder-quobyte-949b4a2b-d43f-46d4-b94e-d321d20ef8d8" acquired by "delete_volume" :: waited 0.047s {{(pid=84538) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 19:00:34 devstack cinder-volume[84538]: DEBUG oslo.privsep.daemon [-] privsep: reply[623f46aa-b600-4547-887a-18e7e69e34b8]: (4, 'qcow2') {{(pid=85803) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 19:00:34 devstack cinder-volume[84538]: DEBUG oslo_concurrency.processutils [None req-46d803a3-948b-4878-8f1c-39f78f5cc842 tempest-VolumesTestJSON-961393749 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-949b4a2b-d43f-46d4-b94e-d321d20ef8d8 {{(pid=84538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 19:00:34 devstack sudo[89466]: pam_unix(sudo:session): session closed for user root Apr 29 19:00:34 devstack cinder-volume[84538]: DEBUG oslo_concurrency.processutils [None req-a37e3f26-d8a1-4d7e-b1af-6b95af636131 tempest-VolumesImageMetadata-273877373 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_11605644-0a6a-4a0a-b123-c09ab01cd4db_hv6v0btzdevstack@QuobyteHD" returned: 0 in 0.849s {{(pid=84538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 19:00:34 devstack cinder-volume[84538]: DEBUG cinder.image.image_utils [None req-a37e3f26-d8a1-4d7e-b1af-6b95af636131 tempest-VolumesImageMetadata-273877373 None] Temporary image 11605644-0a6a-4a0a-b123-c09ab01cd4db is fetched for user 5c3e1244343b4f1082b0d60194c2bb28. {{(pid=84538) fetch /opt/stack/cinder/cinder/image/image_utils.py:1431}} Apr 29 19:00:34 devstack sudo[89475]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-949b4a2b-d43f-46d4-b94e-d321d20ef8d8 Apr 29 19:00:34 devstack sudo[89475]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 19:00:34 devstack cinder-volume[84538]: DEBUG oslo.privsep.daemon [-] privsep: reply[6117d3aa-b559-4a8e-8297-b1967bc36d75]: (4, 'qcow2') {{(pid=85803) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 19:00:34 devstack cinder-volume[84538]: DEBUG oslo_concurrency.processutils [None req-a37e3f26-d8a1-4d7e-b1af-6b95af636131 tempest-VolumesImageMetadata-273877373 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_11605644-0a6a-4a0a-b123-c09ab01cd4db_hv6v0btzdevstack@QuobyteHD {{(pid=84538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 19:00:35 devstack sudo[89477]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_11605644-0a6a-4a0a-b123-c09ab01cd4db_hv6v0btzdevstack@QuobyteHD Apr 29 19:00:35 devstack sudo[89477]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 19:00:35 devstack sudo[89469]: pam_unix(sudo:session): session closed for user root Apr 29 19:00:35 devstack cinder-volume[84538]: DEBUG oslo_concurrency.processutils [req-f37bf6c8-3332-4d3e-b40b-c23117619596 req-e5856527-9b6c-4d71-b336-3be995d6acf0 tempest-VolumesGetTestJSON-1676765069 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d" returned: 0 in 0.896s {{(pid=84538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 19:00:35 devstack cinder-volume[84538]: DEBUG cinder.manager [req-f37bf6c8-3332-4d3e-b40b-c23117619596 req-e5856527-9b6c-4d71-b336-3be995d6acf0 tempest-VolumesGetTestJSON-1676765069 None] Notifying Schedulers of capabilities ... {{(pid=84538) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 29 19:00:35 devstack cinder-volume[84538]: INFO cinder.volume.manager [req-f37bf6c8-3332-4d3e-b40b-c23117619596 req-e5856527-9b6c-4d71-b336-3be995d6acf0 tempest-VolumesGetTestJSON-1676765069 None] Deleted volume successfully. Apr 29 19:00:35 devstack cinder-volume[84538]: DEBUG cinder.coordination [req-f37bf6c8-3332-4d3e-b40b-c23117619596 req-e5856527-9b6c-4d71-b336-3be995d6acf0 tempest-VolumesGetTestJSON-1676765069 None] Lock "cinder-e649ee7d-640e-431f-b8fe-7e7c1365c60a-delete_volume" released by "delete_volume" :: held 2.944s {{(pid=84538) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 19:00:35 devstack sudo[89475]: pam_unix(sudo:session): session closed for user root Apr 29 19:00:35 devstack cinder-volume[84538]: DEBUG oslo_concurrency.processutils [None req-46d803a3-948b-4878-8f1c-39f78f5cc842 tempest-VolumesTestJSON-961393749 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-949b4a2b-d43f-46d4-b94e-d321d20ef8d8" returned: 0 in 1.044s {{(pid=84538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 19:00:35 devstack cinder-volume[84538]: DEBUG oslo_concurrency.processutils [None req-46d803a3-948b-4878-8f1c-39f78f5cc842 tempest-VolumesTestJSON-961393749 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-949b4a2b-d43f-46d4-b94e-d321d20ef8d8 {{(pid=84538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 19:00:35 devstack sudo[89486]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-949b4a2b-d43f-46d4-b94e-d321d20ef8d8 Apr 29 19:00:35 devstack sudo[89486]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 19:00:35 devstack sudo[89477]: pam_unix(sudo:session): session closed for user root Apr 29 19:00:35 devstack cinder-volume[84538]: DEBUG oslo_concurrency.processutils [None req-a37e3f26-d8a1-4d7e-b1af-6b95af636131 tempest-VolumesImageMetadata-273877373 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_11605644-0a6a-4a0a-b123-c09ab01cd4db_hv6v0btzdevstack@QuobyteHD" returned: 0 in 0.903s {{(pid=84538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 19:00:35 devstack cinder-volume[84538]: DEBUG oslo_concurrency.lockutils [None req-a37e3f26-d8a1-4d7e-b1af-6b95af636131 tempest-VolumesImageMetadata-273877373 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 19:00:35 devstack cinder-volume[84538]: DEBUG oslo_concurrency.lockutils [None req-a37e3f26-d8a1-4d7e-b1af-6b95af636131 tempest-VolumesImageMetadata-273877373 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=84538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 19:00:35 devstack cinder-volume[84538]: DEBUG cinder.volume.drivers.quobyte [None req-a37e3f26-d8a1-4d7e-b1af-6b95af636131 tempest-VolumesImageMetadata-273877373 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-29T17:00:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesImageMetadata-Volume-2034613163',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1817e622-6c32-4a74-a412-0387c4b992a1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6c021687781249389a302ef6d0eb7190',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T17:00:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T17:00:33Z,use_quota=True,user_id='5c3e1244343b4f1082b0d60194c2bb28',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(62b05900-93e3-4190-a88f-1d87324303d1),volume_type_id=62b05900-93e3-4190-a88f-1d87324303d1)}" {{(pid=84538) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 29 19:00:35 devstack cinder-volume[84538]: DEBUG cinder.volume.drivers.remotefs [None req-a37e3f26-d8a1-4d7e-b1af-6b95af636131 tempest-VolumesImageMetadata-273877373 None] Creating volume 1817e622-6c32-4a74-a412-0387c4b992a1 {{(pid=84538) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 29 19:00:35 devstack cinder-volume[84538]: DEBUG oslo_concurrency.lockutils [None req-a37e3f26-d8a1-4d7e-b1af-6b95af636131 tempest-VolumesImageMetadata-273877373 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 19:00:35 devstack cinder-volume[84538]: DEBUG oslo_concurrency.lockutils [None req-a37e3f26-d8a1-4d7e-b1af-6b95af636131 tempest-VolumesImageMetadata-273877373 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=84538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 19:00:35 devstack cinder-volume[84538]: DEBUG cinder.volume.drivers.quobyte [None req-a37e3f26-d8a1-4d7e-b1af-6b95af636131 tempest-VolumesImageMetadata-273877373 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-34312b00-dd6d-45bb-af98-75855cea8e48': None} {{(pid=84538) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 19:00:35 devstack cinder-volume[84538]: DEBUG cinder.volume.drivers.quobyte [None req-a37e3f26-d8a1-4d7e-b1af-6b95af636131 tempest-VolumesImageMetadata-273877373 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-34312b00-dd6d-45bb-af98-75855cea8e48'] {{(pid=84538) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 19:00:35 devstack cinder-volume[84538]: DEBUG oslo_concurrency.lockutils [None req-a37e3f26-d8a1-4d7e-b1af-6b95af636131 tempest-VolumesImageMetadata-273877373 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=84538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 19:00:35 devstack cinder-volume[84538]: DEBUG cinder.volume.drivers.quobyte [None req-a37e3f26-d8a1-4d7e-b1af-6b95af636131 tempest-VolumesImageMetadata-273877373 None] Selected osci02.corp.quobyte.com/cinder-vol-34312b00-dd6d-45bb-af98-75855cea8e48 as target Quobyte volume. {{(pid=84538) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 29 19:00:35 devstack cinder-volume[84538]: INFO cinder.volume.drivers.remotefs [None req-a37e3f26-d8a1-4d7e-b1af-6b95af636131 tempest-VolumesImageMetadata-273877373 None] casted to osci02.corp.quobyte.com/cinder-vol-34312b00-dd6d-45bb-af98-75855cea8e48 Apr 29 19:00:35 devstack cinder-volume[84538]: DEBUG oslo_concurrency.processutils [None req-a37e3f26-d8a1-4d7e-b1af-6b95af636131 tempest-VolumesImageMetadata-273877373 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-1817e622-6c32-4a74-a412-0387c4b992a1 1073741824 {{(pid=84538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 19:00:35 devstack sudo[89488]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-1817e622-6c32-4a74-a412-0387c4b992a1 1073741824 Apr 29 19:00:35 devstack sudo[89488]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 19:00:36 devstack sudo[89486]: pam_unix(sudo:session): session closed for user root Apr 29 19:00:36 devstack cinder-volume[84538]: DEBUG oslo_concurrency.processutils [None req-46d803a3-948b-4878-8f1c-39f78f5cc842 tempest-VolumesTestJSON-961393749 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-949b4a2b-d43f-46d4-b94e-d321d20ef8d8" returned: 0 in 0.743s {{(pid=84538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 19:00:36 devstack cinder-volume[84538]: DEBUG cinder.coordination [None req-46d803a3-948b-4878-8f1c-39f78f5cc842 tempest-VolumesTestJSON-961393749 None] Lock "cinder-quobyte-949b4a2b-d43f-46d4-b94e-d321d20ef8d8" released by "delete_volume" :: held 1.846s {{(pid=84538) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 19:00:36 devstack cinder-volume[84538]: DEBUG cinder.quota [None req-46d803a3-948b-4878-8f1c-39f78f5cc842 tempest-VolumesTestJSON-961393749 None] Created reservations ['45e2298b-4b8f-4836-9359-4fd1ff1b7991', '95f408b2-fb7b-4fce-9a3a-d419b8d2006e', '0082639e-700c-48d9-a99d-21d4cc715dfa', 'a8aa5c5e-b6cb-479f-a524-9288170f75c0'] {{(pid=84538) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 29 19:00:36 devstack cinder-volume[84538]: DEBUG oslo_concurrency.lockutils [None req-46d803a3-948b-4878-8f1c-39f78f5cc842 tempest-VolumesTestJSON-961393749 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 19:00:36 devstack cinder-volume[84538]: DEBUG oslo_concurrency.lockutils [None req-46d803a3-948b-4878-8f1c-39f78f5cc842 tempest-VolumesTestJSON-961393749 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 19:00:36 devstack cinder-volume[84538]: DEBUG cinder.volume.drivers.quobyte [None req-46d803a3-948b-4878-8f1c-39f78f5cc842 tempest-VolumesTestJSON-961393749 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-34312b00-dd6d-45bb-af98-75855cea8e48': None} {{(pid=84538) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 19:00:36 devstack cinder-volume[84538]: DEBUG cinder.volume.drivers.quobyte [None req-46d803a3-948b-4878-8f1c-39f78f5cc842 tempest-VolumesTestJSON-961393749 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-34312b00-dd6d-45bb-af98-75855cea8e48'] {{(pid=84538) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 19:00:36 devstack cinder-volume[84538]: DEBUG oslo_concurrency.lockutils [None req-46d803a3-948b-4878-8f1c-39f78f5cc842 tempest-VolumesTestJSON-961393749 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=84538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 19:00:36 devstack cinder-volume[84538]: DEBUG oslo_concurrency.processutils [None req-46d803a3-948b-4878-8f1c-39f78f5cc842 tempest-VolumesTestJSON-961393749 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d {{(pid=84538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 19:00:36 devstack sudo[89498]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d Apr 29 19:00:36 devstack sudo[89498]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 19:00:36 devstack sudo[89488]: pam_unix(sudo:session): session closed for user root Apr 29 19:00:36 devstack cinder-volume[84538]: DEBUG oslo_concurrency.processutils [None req-a37e3f26-d8a1-4d7e-b1af-6b95af636131 tempest-VolumesImageMetadata-273877373 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-1817e622-6c32-4a74-a412-0387c4b992a1 1073741824" returned: 0 in 1.060s {{(pid=84538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 19:00:36 devstack cinder-volume[84538]: DEBUG cinder.coordination [None req-6ab88643-6451-4d50-8615-a80a313f4b4d tempest-VolumesTestJSON-961393749 None] Acquiring lock "cinder-05521fc8-8935-4317-a12b-7224821762bd-delete_volume" by "delete_volume" {{(pid=84538) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 19:00:36 devstack cinder-volume[84538]: DEBUG oslo_concurrency.processutils [None req-a37e3f26-d8a1-4d7e-b1af-6b95af636131 tempest-VolumesImageMetadata-273877373 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-1817e622-6c32-4a74-a412-0387c4b992a1 {{(pid=84538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 19:00:36 devstack cinder-volume[84538]: DEBUG cinder.coordination [None req-6ab88643-6451-4d50-8615-a80a313f4b4d tempest-VolumesTestJSON-961393749 None] Lock "cinder-05521fc8-8935-4317-a12b-7224821762bd-delete_volume" acquired by "delete_volume" :: waited 0.059s {{(pid=84538) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 19:00:36 devstack sudo[89500]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-1817e622-6c32-4a74-a412-0387c4b992a1 Apr 29 19:00:36 devstack sudo[89500]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 19:00:37 devstack cinder-volume[84538]: DEBUG cinder.coordination [None req-6ab88643-6451-4d50-8615-a80a313f4b4d tempest-VolumesTestJSON-961393749 None] Acquiring lock "cinder-quobyte-05521fc8-8935-4317-a12b-7224821762bd" by "delete_volume" {{(pid=84538) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 19:00:37 devstack cinder-volume[84538]: DEBUG cinder.coordination [None req-6ab88643-6451-4d50-8615-a80a313f4b4d tempest-VolumesTestJSON-961393749 None] Lock "cinder-quobyte-05521fc8-8935-4317-a12b-7224821762bd" acquired by "delete_volume" :: waited 0.016s {{(pid=84538) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 19:00:37 devstack cinder-volume[84538]: DEBUG oslo.privsep.daemon [-] privsep: reply[a4191366-636a-4eb3-9c5f-ff6ad8e51796]: (4, 'qcow2') {{(pid=85803) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 19:00:37 devstack cinder-volume[84538]: DEBUG oslo_concurrency.processutils [None req-6ab88643-6451-4d50-8615-a80a313f4b4d tempest-VolumesTestJSON-961393749 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-05521fc8-8935-4317-a12b-7224821762bd {{(pid=84538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 19:00:37 devstack sudo[89502]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-05521fc8-8935-4317-a12b-7224821762bd Apr 29 19:00:37 devstack sudo[89502]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 19:00:37 devstack sudo[89498]: pam_unix(sudo:session): session closed for user root Apr 29 19:00:37 devstack cinder-volume[84538]: DEBUG oslo_concurrency.processutils [None req-46d803a3-948b-4878-8f1c-39f78f5cc842 tempest-VolumesTestJSON-961393749 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d" returned: 0 in 0.817s {{(pid=84538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 19:00:37 devstack cinder-volume[84538]: DEBUG cinder.manager [None req-46d803a3-948b-4878-8f1c-39f78f5cc842 tempest-VolumesTestJSON-961393749 None] Notifying Schedulers of capabilities ... {{(pid=84538) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 29 19:00:37 devstack cinder-volume[84538]: INFO cinder.volume.manager [None req-46d803a3-948b-4878-8f1c-39f78f5cc842 tempest-VolumesTestJSON-961393749 None] Deleted volume successfully. Apr 29 19:00:37 devstack cinder-volume[84538]: DEBUG cinder.coordination [None req-46d803a3-948b-4878-8f1c-39f78f5cc842 tempest-VolumesTestJSON-961393749 None] Lock "cinder-949b4a2b-d43f-46d4-b94e-d321d20ef8d8-delete_volume" released by "delete_volume" :: held 2.978s {{(pid=84538) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 19:00:37 devstack sudo[89500]: pam_unix(sudo:session): session closed for user root Apr 29 19:00:37 devstack cinder-volume[84538]: DEBUG oslo_concurrency.processutils [None req-a37e3f26-d8a1-4d7e-b1af-6b95af636131 tempest-VolumesImageMetadata-273877373 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-1817e622-6c32-4a74-a412-0387c4b992a1" returned: 0 in 0.807s {{(pid=84538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 19:00:37 devstack cinder-volume[84538]: DEBUG cinder.volume.drivers.quobyte [None req-a37e3f26-d8a1-4d7e-b1af-6b95af636131 tempest-VolumesImageMetadata-273877373 None] <== create_volume: return (1932ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-34312b00-dd6d-45bb-af98-75855cea8e48'} {{(pid=84538) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 29 19:00:37 devstack cinder-volume[84538]: DEBUG oslo_concurrency.lockutils [None req-a37e3f26-d8a1-4d7e-b1af-6b95af636131 tempest-VolumesImageMetadata-273877373 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.935s {{(pid=84538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 19:00:37 devstack cinder-volume[84538]: DEBUG cinder.volume.volume_utils [None req-a37e3f26-d8a1-4d7e-b1af-6b95af636131 tempest-VolumesImageMetadata-273877373 None] Attempting download of 11605644-0a6a-4a0a-b123-c09ab01cd4db ((None, [{'url': 'file:///opt/stack/data/glance/images/11605644-0a6a-4a0a-b123-c09ab01cd4db', 'metadata': {}}])) to volume 1817e622-6c32-4a74-a412-0387c4b992a1. {{(pid=84538) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1189}} Apr 29 19:00:37 devstack cinder-volume[84538]: DEBUG oslo.privsep.daemon [-] privsep: reply[4010143c-b870-47cc-b1ce-a7fafb40d889]: (4, 'raw') {{(pid=85803) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 19:00:37 devstack cinder-volume[84538]: DEBUG oslo_concurrency.processutils [None req-a37e3f26-d8a1-4d7e-b1af-6b95af636131 tempest-VolumesImageMetadata-273877373 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_11605644-0a6a-4a0a-b123-c09ab01cd4db_rskrcn9k {{(pid=84538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 19:00:37 devstack sudo[89502]: pam_unix(sudo:session): session closed for user root Apr 29 19:00:37 devstack cinder-volume[84538]: DEBUG oslo_concurrency.processutils [None req-6ab88643-6451-4d50-8615-a80a313f4b4d tempest-VolumesTestJSON-961393749 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-05521fc8-8935-4317-a12b-7224821762bd" returned: 0 in 0.804s {{(pid=84538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 19:00:37 devstack cinder-volume[84538]: DEBUG oslo_concurrency.processutils [None req-6ab88643-6451-4d50-8615-a80a313f4b4d tempest-VolumesTestJSON-961393749 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-05521fc8-8935-4317-a12b-7224821762bd {{(pid=84538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 19:00:37 devstack sudo[89519]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-05521fc8-8935-4317-a12b-7224821762bd Apr 29 19:00:37 devstack sudo[89519]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 19:00:38 devstack sudo[89515]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_11605644-0a6a-4a0a-b123-c09ab01cd4db_rskrcn9k Apr 29 19:00:38 devstack sudo[89515]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 19:00:39 devstack sudo[89519]: pam_unix(sudo:session): session closed for user root Apr 29 19:00:39 devstack cinder-volume[84538]: DEBUG oslo_concurrency.processutils [None req-6ab88643-6451-4d50-8615-a80a313f4b4d tempest-VolumesTestJSON-961393749 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-05521fc8-8935-4317-a12b-7224821762bd" returned: 0 in 1.521s {{(pid=84538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 19:00:39 devstack sudo[89515]: pam_unix(sudo:session): session closed for user root Apr 29 19:00:39 devstack cinder-volume[84538]: DEBUG oslo_concurrency.processutils [None req-a37e3f26-d8a1-4d7e-b1af-6b95af636131 tempest-VolumesImageMetadata-273877373 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_11605644-0a6a-4a0a-b123-c09ab01cd4db_rskrcn9k" returned: 0 in 1.558s {{(pid=84538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 19:00:39 devstack cinder-volume[84538]: DEBUG oslo_concurrency.processutils [None req-a37e3f26-d8a1-4d7e-b1af-6b95af636131 tempest-VolumesImageMetadata-273877373 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_11605644-0a6a-4a0a-b123-c09ab01cd4db_rskrcn9k {{(pid=84538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 19:00:39 devstack cinder-volume[84538]: DEBUG cinder.coordination [None req-6ab88643-6451-4d50-8615-a80a313f4b4d tempest-VolumesTestJSON-961393749 None] Lock "cinder-quobyte-05521fc8-8935-4317-a12b-7224821762bd" released by "delete_volume" :: held 2.395s {{(pid=84538) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 19:00:39 devstack cinder-volume[84538]: DEBUG cinder.quota [None req-6ab88643-6451-4d50-8615-a80a313f4b4d tempest-VolumesTestJSON-961393749 None] Created reservations ['78abd469-c4eb-41e4-bba7-0bf6fb5c3132', '503587e6-8f10-483f-957e-8b5f51349731', '2aa0542b-b068-407b-99d0-a02efd3f3bd8', 'fd58ac0e-67f0-4cec-93e5-8151832184c5'] {{(pid=84538) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 29 19:00:39 devstack sudo[89582]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_11605644-0a6a-4a0a-b123-c09ab01cd4db_rskrcn9k Apr 29 19:00:39 devstack sudo[89582]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 19:00:39 devstack cinder-volume[84538]: DEBUG oslo_concurrency.lockutils [None req-6ab88643-6451-4d50-8615-a80a313f4b4d tempest-VolumesTestJSON-961393749 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 19:00:39 devstack cinder-volume[84538]: DEBUG oslo_concurrency.lockutils [None req-6ab88643-6451-4d50-8615-a80a313f4b4d tempest-VolumesTestJSON-961393749 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 19:00:39 devstack cinder-volume[84538]: DEBUG cinder.volume.drivers.quobyte [None req-6ab88643-6451-4d50-8615-a80a313f4b4d tempest-VolumesTestJSON-961393749 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-34312b00-dd6d-45bb-af98-75855cea8e48': None} {{(pid=84538) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 19:00:39 devstack cinder-volume[84538]: DEBUG cinder.volume.drivers.quobyte [None req-6ab88643-6451-4d50-8615-a80a313f4b4d tempest-VolumesTestJSON-961393749 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-34312b00-dd6d-45bb-af98-75855cea8e48'] {{(pid=84538) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 19:00:39 devstack cinder-volume[84538]: DEBUG oslo_concurrency.lockutils [None req-6ab88643-6451-4d50-8615-a80a313f4b4d tempest-VolumesTestJSON-961393749 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.021s {{(pid=84538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 19:00:39 devstack cinder-volume[84538]: DEBUG oslo_concurrency.processutils [None req-6ab88643-6451-4d50-8615-a80a313f4b4d tempest-VolumesTestJSON-961393749 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d {{(pid=84538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 19:00:39 devstack sudo[89586]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d Apr 29 19:00:39 devstack sudo[89586]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 19:00:40 devstack cinder-volume[84538]: INFO cinder.volume.manager [None req-63e28eb8-f6a1-424d-9014-b29421c6c464 tempest-GroupSnapshotsTest-1835037466 None] Group tempest-GroupSnapshotsTest-Group-1800782101: creating Apr 29 19:00:40 devstack cinder-volume[84538]: INFO cinder.volume.manager [None req-63e28eb8-f6a1-424d-9014-b29421c6c464 tempest-GroupSnapshotsTest-1835037466 None] Group tempest-GroupSnapshotsTest-Group-1800782101: created successfully Apr 29 19:00:40 devstack cinder-volume[84538]: INFO cinder.volume.manager [None req-63e28eb8-f6a1-424d-9014-b29421c6c464 tempest-GroupSnapshotsTest-1835037466 None] Create group completed successfully. Apr 29 19:00:40 devstack cinder-volume[84538]: DEBUG cinder.coordination [None req-48e658af-b0e9-4731-9522-b7c1aa968f57 tempest-VolumesTestJSON-961393749 None] Acquiring lock "cinder-664ac39f-7a03-4c06-b91b-93d429806c49-delete_volume" by "delete_volume" {{(pid=84538) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 19:00:40 devstack sudo[89586]: pam_unix(sudo:session): session closed for user root Apr 29 19:00:40 devstack cinder-volume[84538]: DEBUG cinder.coordination [None req-48e658af-b0e9-4731-9522-b7c1aa968f57 tempest-VolumesTestJSON-961393749 None] Lock "cinder-664ac39f-7a03-4c06-b91b-93d429806c49-delete_volume" acquired by "delete_volume" :: waited 0.042s {{(pid=84538) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 19:00:40 devstack cinder-volume[84538]: DEBUG oslo_concurrency.processutils [None req-6ab88643-6451-4d50-8615-a80a313f4b4d tempest-VolumesTestJSON-961393749 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d" returned: 0 in 0.918s {{(pid=84538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 19:00:40 devstack cinder-volume[84538]: DEBUG cinder.manager [None req-6ab88643-6451-4d50-8615-a80a313f4b4d tempest-VolumesTestJSON-961393749 None] Notifying Schedulers of capabilities ... {{(pid=84538) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 29 19:00:40 devstack sudo[89582]: pam_unix(sudo:session): session closed for user root Apr 29 19:00:40 devstack cinder-volume[84538]: DEBUG oslo_concurrency.processutils [None req-a37e3f26-d8a1-4d7e-b1af-6b95af636131 tempest-VolumesImageMetadata-273877373 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_11605644-0a6a-4a0a-b123-c09ab01cd4db_rskrcn9k" returned: 1 in 1.153s {{(pid=84538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 19:00:40 devstack cinder-volume[84538]: DEBUG oslo_concurrency.processutils [None req-a37e3f26-d8a1-4d7e-b1af-6b95af636131 tempest-VolumesImageMetadata-273877373 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_11605644-0a6a-4a0a-b123-c09ab01cd4db_rskrcn9k' failed. Not Retrying. {{(pid=84538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Apr 29 19:00:40 devstack cinder-volume[84538]: INFO cinder.volume.manager [None req-6ab88643-6451-4d50-8615-a80a313f4b4d tempest-VolumesTestJSON-961393749 None] Deleted volume successfully. Apr 29 19:00:40 devstack cinder-volume[84538]: DEBUG oslo.privsep.daemon [-] privsep: reply[8847185e-9e2d-4da1-b0b2-07d25c7fb0b8]: (4, 'qcow2') {{(pid=85803) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 19:00:40 devstack cinder-volume[84538]: DEBUG oslo_concurrency.processutils [None req-a37e3f26-d8a1-4d7e-b1af-6b95af636131 tempest-VolumesImageMetadata-273877373 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_11605644-0a6a-4a0a-b123-c09ab01cd4db_hv6v0btzdevstack@QuobyteHD {{(pid=84538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 19:00:40 devstack cinder-volume[84538]: DEBUG cinder.coordination [None req-6ab88643-6451-4d50-8615-a80a313f4b4d tempest-VolumesTestJSON-961393749 None] Lock "cinder-05521fc8-8935-4317-a12b-7224821762bd-delete_volume" released by "delete_volume" :: held 3.686s {{(pid=84538) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 19:00:40 devstack cinder-volume[84538]: DEBUG cinder.coordination [None req-48e658af-b0e9-4731-9522-b7c1aa968f57 tempest-VolumesTestJSON-961393749 None] Acquiring lock "cinder-quobyte-664ac39f-7a03-4c06-b91b-93d429806c49" by "delete_volume" {{(pid=84538) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 19:00:40 devstack cinder-volume[84538]: DEBUG cinder.coordination [None req-48e658af-b0e9-4731-9522-b7c1aa968f57 tempest-VolumesTestJSON-961393749 None] Lock "cinder-quobyte-664ac39f-7a03-4c06-b91b-93d429806c49" acquired by "delete_volume" :: waited 0.025s {{(pid=84538) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 19:00:40 devstack cinder-volume[84538]: DEBUG oslo.privsep.daemon [-] privsep: reply[80fc78df-5a30-42f5-93b1-a22c1f30b899]: (4, 'qcow2') {{(pid=85803) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 19:00:40 devstack cinder-volume[84538]: DEBUG oslo_concurrency.processutils [None req-48e658af-b0e9-4731-9522-b7c1aa968f57 tempest-VolumesTestJSON-961393749 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-664ac39f-7a03-4c06-b91b-93d429806c49 {{(pid=84538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 19:00:40 devstack sudo[89591]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_11605644-0a6a-4a0a-b123-c09ab01cd4db_hv6v0btzdevstack@QuobyteHD Apr 29 19:00:40 devstack sudo[89591]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 19:00:40 devstack sudo[89592]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-664ac39f-7a03-4c06-b91b-93d429806c49 Apr 29 19:00:40 devstack sudo[89592]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 19:00:41 devstack sudo[89591]: pam_unix(sudo:session): session closed for user root Apr 29 19:00:41 devstack cinder-volume[84538]: DEBUG oslo_concurrency.processutils [None req-a37e3f26-d8a1-4d7e-b1af-6b95af636131 tempest-VolumesImageMetadata-273877373 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_11605644-0a6a-4a0a-b123-c09ab01cd4db_hv6v0btzdevstack@QuobyteHD" returned: 0 in 0.841s {{(pid=84538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 19:00:41 devstack cinder-volume[84538]: DEBUG cinder.image.image_utils [None req-a37e3f26-d8a1-4d7e-b1af-6b95af636131 tempest-VolumesImageMetadata-273877373 None] 11605644-0a6a-4a0a-b123-c09ab01cd4db was qcow2, converting to raw {{(pid=84538) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1120}} Apr 29 19:00:41 devstack cinder-volume[84538]: DEBUG oslo_concurrency.processutils [None req-a37e3f26-d8a1-4d7e-b1af-6b95af636131 tempest-VolumesImageMetadata-273877373 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_11605644-0a6a-4a0a-b123-c09ab01cd4db_hv6v0btzdevstack@QuobyteHD /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-1817e622-6c32-4a74-a412-0387c4b992a1 {{(pid=84538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 19:00:41 devstack sudo[89603]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_11605644-0a6a-4a0a-b123-c09ab01cd4db_hv6v0btzdevstack@QuobyteHD /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-1817e622-6c32-4a74-a412-0387c4b992a1 Apr 29 19:00:41 devstack sudo[89603]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 19:00:41 devstack sudo[89592]: pam_unix(sudo:session): session closed for user root Apr 29 19:00:41 devstack cinder-volume[84538]: DEBUG oslo_concurrency.processutils [None req-48e658af-b0e9-4731-9522-b7c1aa968f57 tempest-VolumesTestJSON-961393749 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-664ac39f-7a03-4c06-b91b-93d429806c49" returned: 0 in 0.922s {{(pid=84538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 19:00:41 devstack cinder-volume[84538]: DEBUG oslo_concurrency.processutils [None req-48e658af-b0e9-4731-9522-b7c1aa968f57 tempest-VolumesTestJSON-961393749 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-664ac39f-7a03-4c06-b91b-93d429806c49 {{(pid=84538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 19:00:41 devstack sudo[89608]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-664ac39f-7a03-4c06-b91b-93d429806c49 Apr 29 19:00:41 devstack sudo[89608]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 19:00:42 devstack cinder-volume[84538]: DEBUG cinder.volume.flows.manager.create_volume [None req-e6d53eb5-170b-4ddf-9298-34633a09b0c4 tempest-GroupSnapshotsTest-1835037466 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84538) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Apr 29 19:00:42 devstack cinder-volume[84538]: DEBUG cinder.volume.manager [None req-e6d53eb5-170b-4ddf-9298-34633a09b0c4 tempest-GroupSnapshotsTest-1835037466 None] Flow 'volume_create_manager' (ee9ed43a-fd58-4cb9-8561-5e90803c28a5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84538) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 19:00:42 devstack cinder-volume[84538]: DEBUG cinder.volume.manager [None req-e6d53eb5-170b-4ddf-9298-34633a09b0c4 tempest-GroupSnapshotsTest-1835037466 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e4964531-9e94-4c95-935a-ac74531003d7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 19:00:42 devstack cinder-volume[84538]: DEBUG cinder.volume.manager [None req-e6d53eb5-170b-4ddf-9298-34633a09b0c4 tempest-GroupSnapshotsTest-1835037466 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e4964531-9e94-4c95-935a-ac74531003d7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-29T17:00:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1198710689',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=f157561c-5a2b-4f38-b0d8-1075581f0f04,host='devstack@QuobyteHD#QuobyteHD',id=80fda4c5-5bad-4f1a-a0a6-8c24f1f84323,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='14dd90144b0b4dcc8def965ebf4ada62',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T17:00:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T17:00:42Z,use_quota=True,user_id='616bcc255f9c4e89963a9ff70ca5ab6c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3faa5e45-0de2-4bc5-a235-8e1fba5a3c7e),volume_type_id=3faa5e45-0de2-4bc5-a235-8e1fba5a3c7e)' {{(pid=84538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 19:00:42 devstack cinder-volume[84538]: DEBUG cinder.volume.manager [None req-e6d53eb5-170b-4ddf-9298-34633a09b0c4 tempest-GroupSnapshotsTest-1835037466 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (554f9c37-19f1-4fad-86ba-6b9e26457036) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 19:00:42 devstack cinder-volume[84538]: DEBUG cinder.volume.manager [None req-e6d53eb5-170b-4ddf-9298-34633a09b0c4 tempest-GroupSnapshotsTest-1835037466 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (554f9c37-19f1-4fad-86ba-6b9e26457036) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 19:00:42 devstack cinder-volume[84538]: DEBUG cinder.volume.manager [None req-e6d53eb5-170b-4ddf-9298-34633a09b0c4 tempest-GroupSnapshotsTest-1835037466 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (65d17e70-a9b2-409f-b4e5-4a16557290fe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 19:00:42 devstack cinder-volume[84538]: DEBUG cinder.volume.manager [None req-e6d53eb5-170b-4ddf-9298-34633a09b0c4 tempest-GroupSnapshotsTest-1835037466 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (65d17e70-a9b2-409f-b4e5-4a16557290fe) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '80fda4c5-5bad-4f1a-a0a6-8c24f1f84323', 'volume_name': 'volume-80fda4c5-5bad-4f1a-a0a6-8c24f1f84323', 'volume_size': 1}' {{(pid=84538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 19:00:42 devstack cinder-volume[84538]: DEBUG cinder.volume.manager [None req-e6d53eb5-170b-4ddf-9298-34633a09b0c4 tempest-GroupSnapshotsTest-1835037466 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b5a03769-398b-4876-af52-55f981f25bcc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 19:00:42 devstack cinder-volume[84538]: DEBUG cinder.volume.manager [None req-e6d53eb5-170b-4ddf-9298-34633a09b0c4 tempest-GroupSnapshotsTest-1835037466 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b5a03769-398b-4876-af52-55f981f25bcc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 19:00:42 devstack cinder-volume[84538]: DEBUG cinder.volume.manager [None req-e6d53eb5-170b-4ddf-9298-34633a09b0c4 tempest-GroupSnapshotsTest-1835037466 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6e1e02d3-0b29-4f74-aa2e-1f812bef9e37) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 19:00:42 devstack cinder-volume[84538]: INFO cinder.volume.flows.manager.create_volume [None req-e6d53eb5-170b-4ddf-9298-34633a09b0c4 tempest-GroupSnapshotsTest-1835037466 None] Volume 80fda4c5-5bad-4f1a-a0a6-8c24f1f84323: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-80fda4c5-5bad-4f1a-a0a6-8c24f1f84323', 'volume_size': 1} Apr 29 19:00:42 devstack cinder-volume[84538]: DEBUG oslo_concurrency.lockutils [None req-e6d53eb5-170b-4ddf-9298-34633a09b0c4 tempest-GroupSnapshotsTest-1835037466 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 19:00:42 devstack cinder-volume[84538]: DEBUG oslo_concurrency.lockutils [None req-e6d53eb5-170b-4ddf-9298-34633a09b0c4 tempest-GroupSnapshotsTest-1835037466 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=84538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 19:00:42 devstack cinder-volume[84538]: DEBUG cinder.volume.drivers.quobyte [None req-e6d53eb5-170b-4ddf-9298-34633a09b0c4 tempest-GroupSnapshotsTest-1835037466 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=f157561c-5a2b-4f38-b0d8-1075581f0f04,created_at=2026-04-29T17:00:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1198710689',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=f157561c-5a2b-4f38-b0d8-1075581f0f04,host='devstack@QuobyteHD#QuobyteHD',id=80fda4c5-5bad-4f1a-a0a6-8c24f1f84323,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='14dd90144b0b4dcc8def965ebf4ada62',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T17:00:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T17:00:42Z,use_quota=True,user_id='616bcc255f9c4e89963a9ff70ca5ab6c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3faa5e45-0de2-4bc5-a235-8e1fba5a3c7e),volume_type_id=3faa5e45-0de2-4bc5-a235-8e1fba5a3c7e)}" {{(pid=84538) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 29 19:00:42 devstack cinder-volume[84538]: DEBUG cinder.volume.drivers.remotefs [None req-e6d53eb5-170b-4ddf-9298-34633a09b0c4 tempest-GroupSnapshotsTest-1835037466 None] Creating volume 80fda4c5-5bad-4f1a-a0a6-8c24f1f84323 {{(pid=84538) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 29 19:00:42 devstack cinder-volume[84538]: DEBUG oslo_concurrency.lockutils [None req-e6d53eb5-170b-4ddf-9298-34633a09b0c4 tempest-GroupSnapshotsTest-1835037466 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 19:00:42 devstack cinder-volume[84538]: DEBUG oslo_concurrency.lockutils [None req-e6d53eb5-170b-4ddf-9298-34633a09b0c4 tempest-GroupSnapshotsTest-1835037466 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=84538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 19:00:42 devstack cinder-volume[84538]: DEBUG cinder.volume.drivers.quobyte [None req-e6d53eb5-170b-4ddf-9298-34633a09b0c4 tempest-GroupSnapshotsTest-1835037466 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-34312b00-dd6d-45bb-af98-75855cea8e48': None} {{(pid=84538) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 19:00:42 devstack cinder-volume[84538]: DEBUG cinder.volume.drivers.quobyte [None req-e6d53eb5-170b-4ddf-9298-34633a09b0c4 tempest-GroupSnapshotsTest-1835037466 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-34312b00-dd6d-45bb-af98-75855cea8e48'] {{(pid=84538) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 19:00:42 devstack cinder-volume[84538]: DEBUG oslo_concurrency.lockutils [None req-e6d53eb5-170b-4ddf-9298-34633a09b0c4 tempest-GroupSnapshotsTest-1835037466 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=84538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 19:00:42 devstack cinder-volume[84538]: DEBUG cinder.volume.drivers.quobyte [None req-e6d53eb5-170b-4ddf-9298-34633a09b0c4 tempest-GroupSnapshotsTest-1835037466 None] Selected osci02.corp.quobyte.com/cinder-vol-34312b00-dd6d-45bb-af98-75855cea8e48 as target Quobyte volume. {{(pid=84538) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 29 19:00:42 devstack cinder-volume[84538]: INFO cinder.volume.drivers.remotefs [None req-e6d53eb5-170b-4ddf-9298-34633a09b0c4 tempest-GroupSnapshotsTest-1835037466 None] casted to osci02.corp.quobyte.com/cinder-vol-34312b00-dd6d-45bb-af98-75855cea8e48 Apr 29 19:00:42 devstack cinder-volume[84538]: DEBUG oslo_concurrency.processutils [None req-e6d53eb5-170b-4ddf-9298-34633a09b0c4 tempest-GroupSnapshotsTest-1835037466 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-80fda4c5-5bad-4f1a-a0a6-8c24f1f84323 1073741824 {{(pid=84538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 19:00:42 devstack sudo[89649]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-80fda4c5-5bad-4f1a-a0a6-8c24f1f84323 1073741824 Apr 29 19:00:42 devstack sudo[89649]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 19:00:42 devstack cinder-volume[84538]: DEBUG cinder.volume.flows.manager.create_volume [None req-c865a424-bfd3-42cd-8e5a-43993fdc4170 tempest-VolumesActionsTest-1687831653 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84538) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Apr 29 19:00:42 devstack cinder-volume[84538]: DEBUG cinder.volume.manager [None req-c865a424-bfd3-42cd-8e5a-43993fdc4170 tempest-VolumesActionsTest-1687831653 None] Flow 'volume_create_manager' (e452add9-b33a-4f8c-bad1-d510431663ad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84538) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 19:00:42 devstack cinder-volume[84538]: DEBUG cinder.volume.manager [None req-c865a424-bfd3-42cd-8e5a-43993fdc4170 tempest-VolumesActionsTest-1687831653 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fe220698-ea09-441b-9238-b110cf746021) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 19:00:42 devstack cinder-volume[84538]: DEBUG cinder.volume.manager [None req-c865a424-bfd3-42cd-8e5a-43993fdc4170 tempest-VolumesActionsTest-1687831653 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fe220698-ea09-441b-9238-b110cf746021) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-29T17:00:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1010129714',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cd1cc196-c983-4e22-aa7b-7d04a91a7349,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a39f1f9e4e364982af869dd2b24dfe70',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T17:00:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T17:00:43Z,use_quota=True,user_id='0feaa082ee4740958e7eb31611d1e836',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(62b05900-93e3-4190-a88f-1d87324303d1),volume_type_id=62b05900-93e3-4190-a88f-1d87324303d1)' {{(pid=84538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 19:00:42 devstack cinder-volume[84538]: DEBUG cinder.volume.manager [None req-c865a424-bfd3-42cd-8e5a-43993fdc4170 tempest-VolumesActionsTest-1687831653 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (78f94ce7-4dac-48d4-b3d3-09a99abef9ae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 19:00:42 devstack cinder-volume[84538]: DEBUG cinder.volume.manager [None req-c865a424-bfd3-42cd-8e5a-43993fdc4170 tempest-VolumesActionsTest-1687831653 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (78f94ce7-4dac-48d4-b3d3-09a99abef9ae) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 19:00:42 devstack cinder-volume[84538]: DEBUG cinder.volume.manager [None req-c865a424-bfd3-42cd-8e5a-43993fdc4170 tempest-VolumesActionsTest-1687831653 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f576a2ee-70fd-4d62-a0ff-025e7ce4bd81) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 19:00:42 devstack cinder-volume[84538]: DEBUG cinder.volume.manager [None req-c865a424-bfd3-42cd-8e5a-43993fdc4170 tempest-VolumesActionsTest-1687831653 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f576a2ee-70fd-4d62-a0ff-025e7ce4bd81) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'cd1cc196-c983-4e22-aa7b-7d04a91a7349', 'volume_name': 'volume-cd1cc196-c983-4e22-aa7b-7d04a91a7349', 'volume_size': 1}' {{(pid=84538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 19:00:42 devstack cinder-volume[84538]: DEBUG cinder.volume.manager [None req-c865a424-bfd3-42cd-8e5a-43993fdc4170 tempest-VolumesActionsTest-1687831653 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (24958f75-6422-4587-8114-43e1e843c415) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 19:00:42 devstack cinder-volume[84538]: DEBUG cinder.volume.manager [None req-c865a424-bfd3-42cd-8e5a-43993fdc4170 tempest-VolumesActionsTest-1687831653 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (24958f75-6422-4587-8114-43e1e843c415) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 19:00:42 devstack cinder-volume[84538]: DEBUG cinder.volume.manager [None req-c865a424-bfd3-42cd-8e5a-43993fdc4170 tempest-VolumesActionsTest-1687831653 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7400f473-1d82-4666-9be7-c85d6b2dabcd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 19:00:42 devstack cinder-volume[84538]: INFO cinder.volume.flows.manager.create_volume [None req-c865a424-bfd3-42cd-8e5a-43993fdc4170 tempest-VolumesActionsTest-1687831653 None] Volume cd1cc196-c983-4e22-aa7b-7d04a91a7349: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-cd1cc196-c983-4e22-aa7b-7d04a91a7349', 'volume_size': 1} Apr 29 19:00:42 devstack cinder-volume[84538]: DEBUG oslo_concurrency.lockutils [None req-c865a424-bfd3-42cd-8e5a-43993fdc4170 tempest-VolumesActionsTest-1687831653 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 19:00:42 devstack sudo[89608]: pam_unix(sudo:session): session closed for user root Apr 29 19:00:42 devstack cinder-volume[84538]: DEBUG oslo_concurrency.processutils [None req-48e658af-b0e9-4731-9522-b7c1aa968f57 tempest-VolumesTestJSON-961393749 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-664ac39f-7a03-4c06-b91b-93d429806c49" returned: 0 in 1.211s {{(pid=84538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 19:00:42 devstack cinder-volume[84538]: DEBUG cinder.coordination [None req-48e658af-b0e9-4731-9522-b7c1aa968f57 tempest-VolumesTestJSON-961393749 None] Lock "cinder-quobyte-664ac39f-7a03-4c06-b91b-93d429806c49" released by "delete_volume" :: held 2.208s {{(pid=84538) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 19:00:42 devstack cinder-volume[84538]: DEBUG cinder.quota [None req-48e658af-b0e9-4731-9522-b7c1aa968f57 tempest-VolumesTestJSON-961393749 None] Created reservations ['678e7cea-0c93-4041-b51f-43a5028ef098', '522c2ad3-3fe4-45f7-af44-4f13db03e760', '291c07f0-f8dc-4b7e-80ec-036646b2237d', 'cb880d4a-db9e-42bc-8867-d1e8f3715a3e'] {{(pid=84538) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 29 19:00:43 devstack cinder-volume[84538]: DEBUG oslo_concurrency.lockutils [None req-48e658af-b0e9-4731-9522-b7c1aa968f57 tempest-VolumesTestJSON-961393749 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 19:00:43 devstack cinder-volume[84538]: DEBUG oslo_concurrency.lockutils [None req-48e658af-b0e9-4731-9522-b7c1aa968f57 tempest-VolumesTestJSON-961393749 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 19:00:43 devstack cinder-volume[84538]: DEBUG cinder.volume.drivers.quobyte [None req-48e658af-b0e9-4731-9522-b7c1aa968f57 tempest-VolumesTestJSON-961393749 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-34312b00-dd6d-45bb-af98-75855cea8e48': None} {{(pid=84538) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 19:00:43 devstack cinder-volume[84538]: DEBUG cinder.volume.drivers.quobyte [None req-48e658af-b0e9-4731-9522-b7c1aa968f57 tempest-VolumesTestJSON-961393749 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-34312b00-dd6d-45bb-af98-75855cea8e48'] {{(pid=84538) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 19:00:43 devstack cinder-volume[84538]: DEBUG oslo_concurrency.lockutils [None req-48e658af-b0e9-4731-9522-b7c1aa968f57 tempest-VolumesTestJSON-961393749 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=84538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 19:00:43 devstack cinder-volume[84538]: DEBUG oslo_concurrency.processutils [None req-48e658af-b0e9-4731-9522-b7c1aa968f57 tempest-VolumesTestJSON-961393749 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d {{(pid=84538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 19:00:43 devstack sudo[89654]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d Apr 29 19:00:43 devstack sudo[89654]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 19:00:43 devstack sudo[89654]: pam_unix(sudo:session): session closed for user root Apr 29 19:00:43 devstack cinder-volume[84538]: DEBUG oslo_concurrency.processutils [None req-48e658af-b0e9-4731-9522-b7c1aa968f57 tempest-VolumesTestJSON-961393749 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d" returned: 0 in 0.835s {{(pid=84538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 19:00:43 devstack cinder-volume[84538]: DEBUG cinder.manager [None req-48e658af-b0e9-4731-9522-b7c1aa968f57 tempest-VolumesTestJSON-961393749 None] Notifying Schedulers of capabilities ... {{(pid=84538) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 29 19:00:43 devstack cinder-volume[84538]: INFO cinder.volume.manager [None req-48e658af-b0e9-4731-9522-b7c1aa968f57 tempest-VolumesTestJSON-961393749 None] Deleted volume successfully. Apr 29 19:00:43 devstack sudo[89649]: pam_unix(sudo:session): session closed for user root Apr 29 19:00:43 devstack cinder-volume[84538]: DEBUG cinder.coordination [None req-48e658af-b0e9-4731-9522-b7c1aa968f57 tempest-VolumesTestJSON-961393749 None] Lock "cinder-664ac39f-7a03-4c06-b91b-93d429806c49-delete_volume" released by "delete_volume" :: held 3.403s {{(pid=84538) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 19:00:43 devstack cinder-volume[84538]: DEBUG oslo_concurrency.processutils [None req-e6d53eb5-170b-4ddf-9298-34633a09b0c4 tempest-GroupSnapshotsTest-1835037466 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-80fda4c5-5bad-4f1a-a0a6-8c24f1f84323 1073741824" returned: 0 in 1.394s {{(pid=84538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 19:00:43 devstack cinder-volume[84538]: DEBUG oslo_concurrency.processutils [None req-e6d53eb5-170b-4ddf-9298-34633a09b0c4 tempest-GroupSnapshotsTest-1835037466 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-80fda4c5-5bad-4f1a-a0a6-8c24f1f84323 {{(pid=84538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 19:00:44 devstack sudo[89661]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-80fda4c5-5bad-4f1a-a0a6-8c24f1f84323 Apr 29 19:00:44 devstack sudo[89661]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 19:00:44 devstack sudo[89603]: pam_unix(sudo:session): session closed for user root Apr 29 19:00:44 devstack cinder-volume[84538]: DEBUG oslo_concurrency.processutils [None req-a37e3f26-d8a1-4d7e-b1af-6b95af636131 tempest-VolumesImageMetadata-273877373 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_11605644-0a6a-4a0a-b123-c09ab01cd4db_hv6v0btzdevstack@QuobyteHD /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-1817e622-6c32-4a74-a412-0387c4b992a1" returned: 0 in 2.842s {{(pid=84538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 19:00:44 devstack cinder-volume[84538]: DEBUG cinder.image.image_utils [None req-a37e3f26-d8a1-4d7e-b1af-6b95af636131 tempest-VolumesImageMetadata-273877373 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_11605644-0a6a-4a0a-b123-c09ab01cd4db_hv6v0btzdevstack@QuobyteHD, size 112.00 MB, duration 2.84 sec, destination /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-1817e622-6c32-4a74-a412-0387c4b992a1 {{(pid=84538) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}} Apr 29 19:00:44 devstack cinder-volume[84538]: INFO cinder.image.image_utils [None req-a37e3f26-d8a1-4d7e-b1af-6b95af636131 tempest-VolumesImageMetadata-273877373 None] Converted 112.00 MB image at 39.39 MB/s Apr 29 19:00:44 devstack cinder-volume[84538]: DEBUG oslo_concurrency.processutils [None req-a37e3f26-d8a1-4d7e-b1af-6b95af636131 tempest-VolumesImageMetadata-273877373 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-1817e622-6c32-4a74-a412-0387c4b992a1 1G {{(pid=84538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 19:00:44 devstack sudo[89663]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-1817e622-6c32-4a74-a412-0387c4b992a1 1G Apr 29 19:00:44 devstack sudo[89663]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 19:00:44 devstack sudo[89661]: pam_unix(sudo:session): session closed for user root Apr 29 19:00:44 devstack cinder-volume[84538]: DEBUG oslo_concurrency.processutils [None req-e6d53eb5-170b-4ddf-9298-34633a09b0c4 tempest-GroupSnapshotsTest-1835037466 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-80fda4c5-5bad-4f1a-a0a6-8c24f1f84323" returned: 0 in 0.894s {{(pid=84538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 19:00:44 devstack cinder-volume[84538]: DEBUG cinder.volume.drivers.quobyte [None req-e6d53eb5-170b-4ddf-9298-34633a09b0c4 tempest-GroupSnapshotsTest-1835037466 None] <== create_volume: return (2339ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-34312b00-dd6d-45bb-af98-75855cea8e48'} {{(pid=84538) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 29 19:00:44 devstack cinder-volume[84538]: DEBUG oslo_concurrency.lockutils [None req-e6d53eb5-170b-4ddf-9298-34633a09b0c4 tempest-GroupSnapshotsTest-1835037466 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.342s {{(pid=84538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 19:00:44 devstack cinder-volume[84538]: DEBUG oslo_concurrency.lockutils [None req-c865a424-bfd3-42cd-8e5a-43993fdc4170 tempest-VolumesActionsTest-1687831653 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.177s {{(pid=84538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 19:00:44 devstack cinder-volume[84538]: DEBUG cinder.volume.drivers.quobyte [None req-c865a424-bfd3-42cd-8e5a-43993fdc4170 tempest-VolumesActionsTest-1687831653 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-29T17:00:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1010129714',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cd1cc196-c983-4e22-aa7b-7d04a91a7349,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a39f1f9e4e364982af869dd2b24dfe70',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T17:00:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T17:00:43Z,use_quota=True,user_id='0feaa082ee4740958e7eb31611d1e836',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(62b05900-93e3-4190-a88f-1d87324303d1),volume_type_id=62b05900-93e3-4190-a88f-1d87324303d1)}" {{(pid=84538) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 29 19:00:44 devstack cinder-volume[84538]: DEBUG cinder.volume.drivers.remotefs [None req-c865a424-bfd3-42cd-8e5a-43993fdc4170 tempest-VolumesActionsTest-1687831653 None] Creating volume cd1cc196-c983-4e22-aa7b-7d04a91a7349 {{(pid=84538) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 29 19:00:44 devstack cinder-volume[84538]: DEBUG oslo_concurrency.lockutils [None req-c865a424-bfd3-42cd-8e5a-43993fdc4170 tempest-VolumesActionsTest-1687831653 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 19:00:44 devstack cinder-volume[84538]: DEBUG oslo_concurrency.lockutils [None req-c865a424-bfd3-42cd-8e5a-43993fdc4170 tempest-VolumesActionsTest-1687831653 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=84538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 19:00:44 devstack cinder-volume[84538]: DEBUG cinder.volume.drivers.quobyte [None req-c865a424-bfd3-42cd-8e5a-43993fdc4170 tempest-VolumesActionsTest-1687831653 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-34312b00-dd6d-45bb-af98-75855cea8e48': None} {{(pid=84538) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 19:00:44 devstack cinder-volume[84538]: DEBUG cinder.volume.drivers.quobyte [None req-c865a424-bfd3-42cd-8e5a-43993fdc4170 tempest-VolumesActionsTest-1687831653 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-34312b00-dd6d-45bb-af98-75855cea8e48'] {{(pid=84538) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 19:00:44 devstack cinder-volume[84538]: DEBUG oslo_concurrency.lockutils [None req-c865a424-bfd3-42cd-8e5a-43993fdc4170 tempest-VolumesActionsTest-1687831653 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=84538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 19:00:44 devstack cinder-volume[84538]: DEBUG cinder.volume.drivers.quobyte [None req-c865a424-bfd3-42cd-8e5a-43993fdc4170 tempest-VolumesActionsTest-1687831653 None] Selected osci02.corp.quobyte.com/cinder-vol-34312b00-dd6d-45bb-af98-75855cea8e48 as target Quobyte volume. {{(pid=84538) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 29 19:00:44 devstack cinder-volume[84538]: INFO cinder.volume.drivers.remotefs [None req-c865a424-bfd3-42cd-8e5a-43993fdc4170 tempest-VolumesActionsTest-1687831653 None] casted to osci02.corp.quobyte.com/cinder-vol-34312b00-dd6d-45bb-af98-75855cea8e48 Apr 29 19:00:44 devstack cinder-volume[84538]: DEBUG oslo_concurrency.processutils [None req-c865a424-bfd3-42cd-8e5a-43993fdc4170 tempest-VolumesActionsTest-1687831653 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-cd1cc196-c983-4e22-aa7b-7d04a91a7349 1073741824 {{(pid=84538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 19:00:44 devstack cinder-volume[84538]: DEBUG cinder.volume.manager [None req-e6d53eb5-170b-4ddf-9298-34633a09b0c4 tempest-GroupSnapshotsTest-1835037466 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6e1e02d3-0b29-4f74-aa2e-1f812bef9e37) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-80fda4c5-5bad-4f1a-a0a6-8c24f1f84323', 'volume_size': 1}' {{(pid=84538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 19:00:44 devstack cinder-volume[84538]: DEBUG cinder.volume.manager [None req-e6d53eb5-170b-4ddf-9298-34633a09b0c4 tempest-GroupSnapshotsTest-1835037466 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e262514d-9f49-4b66-8b3e-13f9c8ca38ce) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 19:00:44 devstack sudo[89666]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-cd1cc196-c983-4e22-aa7b-7d04a91a7349 1073741824 Apr 29 19:00:44 devstack sudo[89666]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 19:00:45 devstack cinder-volume[84538]: INFO cinder.volume.flows.manager.create_volume [None req-e6d53eb5-170b-4ddf-9298-34633a09b0c4 tempest-GroupSnapshotsTest-1835037466 None] Volume volume-80fda4c5-5bad-4f1a-a0a6-8c24f1f84323 (80fda4c5-5bad-4f1a-a0a6-8c24f1f84323): created successfully Apr 29 19:00:45 devstack cinder-volume[84538]: DEBUG cinder.volume.manager [None req-e6d53eb5-170b-4ddf-9298-34633a09b0c4 tempest-GroupSnapshotsTest-1835037466 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e262514d-9f49-4b66-8b3e-13f9c8ca38ce) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 19:00:45 devstack cinder-volume[84538]: DEBUG cinder.volume.manager [None req-e6d53eb5-170b-4ddf-9298-34633a09b0c4 tempest-GroupSnapshotsTest-1835037466 None] Flow 'volume_create_manager' (ee9ed43a-fd58-4cb9-8561-5e90803c28a5) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84538) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 19:00:45 devstack cinder-volume[84538]: INFO cinder.volume.manager [None req-e6d53eb5-170b-4ddf-9298-34633a09b0c4 tempest-GroupSnapshotsTest-1835037466 None] Created volume successfully. Apr 29 19:00:45 devstack sudo[89663]: pam_unix(sudo:session): session closed for user root Apr 29 19:00:45 devstack cinder-volume[84538]: DEBUG oslo_concurrency.processutils [None req-a37e3f26-d8a1-4d7e-b1af-6b95af636131 tempest-VolumesImageMetadata-273877373 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-1817e622-6c32-4a74-a412-0387c4b992a1 1G" returned: 0 in 0.985s {{(pid=84538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 19:00:45 devstack cinder-volume[84538]: DEBUG oslo.privsep.daemon [-] privsep: reply[214c1a64-d6cc-487d-89c1-ebd52ea59bbb]: (4, 'raw') {{(pid=85803) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 19:00:45 devstack cinder-volume[84538]: DEBUG oslo_concurrency.processutils [None req-a37e3f26-d8a1-4d7e-b1af-6b95af636131 tempest-VolumesImageMetadata-273877373 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-1817e622-6c32-4a74-a412-0387c4b992a1 {{(pid=84538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 19:00:45 devstack sudo[89671]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-1817e622-6c32-4a74-a412-0387c4b992a1 Apr 29 19:00:45 devstack sudo[89671]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 19:00:46 devstack sudo[89666]: pam_unix(sudo:session): session closed for user root Apr 29 19:00:46 devstack cinder-volume[84538]: DEBUG oslo_concurrency.processutils [None req-c865a424-bfd3-42cd-8e5a-43993fdc4170 tempest-VolumesActionsTest-1687831653 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-cd1cc196-c983-4e22-aa7b-7d04a91a7349 1073741824" returned: 0 in 1.110s {{(pid=84538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 19:00:46 devstack cinder-volume[84538]: DEBUG oslo_concurrency.processutils [None req-c865a424-bfd3-42cd-8e5a-43993fdc4170 tempest-VolumesActionsTest-1687831653 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-cd1cc196-c983-4e22-aa7b-7d04a91a7349 {{(pid=84538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 19:00:46 devstack sudo[89677]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-cd1cc196-c983-4e22-aa7b-7d04a91a7349 Apr 29 19:00:46 devstack sudo[89677]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 19:00:46 devstack cinder-volume[84538]: INFO cinder.volume.manager [None req-a4b2f610-a45a-44a5-aaac-45ed3a1ec3c1 tempest-GroupSnapshotsTest-1835037466 None] GroupSnapshot 841b0d13-8022-43a1-a07e-3b592a0c3029: creating. Apr 29 19:00:46 devstack cinder-volume[84538]: DEBUG cinder.volume.manager [None req-a4b2f610-a45a-44a5-aaac-45ed3a1ec3c1 tempest-GroupSnapshotsTest-1835037466 None] Group snapshot 841b0d13-8022-43a1-a07e-3b592a0c3029: creating. {{(pid=84538) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4175}} Apr 29 19:00:46 devstack cinder-volume[84538]: DEBUG oslo_concurrency.lockutils [None req-a4b2f610-a45a-44a5-aaac-45ed3a1ec3c1 tempest-GroupSnapshotsTest-1835037466 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=84538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 19:00:46 devstack sudo[89671]: pam_unix(sudo:session): session closed for user root Apr 29 19:00:46 devstack cinder-volume[84538]: DEBUG oslo_concurrency.processutils [None req-a37e3f26-d8a1-4d7e-b1af-6b95af636131 tempest-VolumesImageMetadata-273877373 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-1817e622-6c32-4a74-a412-0387c4b992a1" returned: 0 in 1.199s {{(pid=84538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 19:00:46 devstack cinder-volume[84538]: DEBUG oslo_concurrency.processutils [None req-a37e3f26-d8a1-4d7e-b1af-6b95af636131 tempest-VolumesImageMetadata-273877373 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-1817e622-6c32-4a74-a412-0387c4b992a1 {{(pid=84538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 19:00:46 devstack sudo[89681]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-1817e622-6c32-4a74-a412-0387c4b992a1 Apr 29 19:00:46 devstack sudo[89681]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 19:00:46 devstack sudo[89677]: pam_unix(sudo:session): session closed for user root Apr 29 19:00:46 devstack cinder-volume[84538]: DEBUG oslo_concurrency.processutils [None req-c865a424-bfd3-42cd-8e5a-43993fdc4170 tempest-VolumesActionsTest-1687831653 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-cd1cc196-c983-4e22-aa7b-7d04a91a7349" returned: 0 in 0.762s {{(pid=84538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 19:00:46 devstack cinder-volume[84538]: DEBUG cinder.volume.drivers.quobyte [None req-c865a424-bfd3-42cd-8e5a-43993fdc4170 tempest-VolumesActionsTest-1687831653 None] <== create_volume: return (1946ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-34312b00-dd6d-45bb-af98-75855cea8e48'} {{(pid=84538) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 29 19:00:46 devstack cinder-volume[84538]: DEBUG oslo_concurrency.lockutils [None req-c865a424-bfd3-42cd-8e5a-43993fdc4170 tempest-VolumesActionsTest-1687831653 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.949s {{(pid=84538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 19:00:46 devstack cinder-volume[84538]: DEBUG oslo_concurrency.lockutils [None req-a4b2f610-a45a-44a5-aaac-45ed3a1ec3c1 tempest-GroupSnapshotsTest-1835037466 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.439s {{(pid=84538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 19:00:46 devstack cinder-volume[84538]: DEBUG cinder.volume.manager [None req-c865a424-bfd3-42cd-8e5a-43993fdc4170 tempest-VolumesActionsTest-1687831653 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7400f473-1d82-4666-9be7-c85d6b2dabcd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-cd1cc196-c983-4e22-aa7b-7d04a91a7349', 'volume_size': 1}' {{(pid=84538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 19:00:46 devstack cinder-volume[84538]: DEBUG cinder.volume.manager [None req-c865a424-bfd3-42cd-8e5a-43993fdc4170 tempest-VolumesActionsTest-1687831653 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (53aa02bd-0627-4083-835e-6ce366e6230b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 19:00:46 devstack cinder-volume[84538]: DEBUG cinder.volume.drivers.remotefs [None req-a4b2f610-a45a-44a5-aaac-45ed3a1ec3c1 tempest-GroupSnapshotsTest-1835037466 None] Creating offline snapshot 76a10f6b-93a6-4121-8532-58c93351a064 of volume 80fda4c5-5bad-4f1a-a0a6-8c24f1f84323 {{(pid=84538) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}} Apr 29 19:00:46 devstack cinder-volume[84538]: INFO cinder.volume.flows.manager.create_volume [None req-c865a424-bfd3-42cd-8e5a-43993fdc4170 tempest-VolumesActionsTest-1687831653 None] Volume volume-cd1cc196-c983-4e22-aa7b-7d04a91a7349 (cd1cc196-c983-4e22-aa7b-7d04a91a7349): created successfully Apr 29 19:00:46 devstack cinder-volume[84538]: DEBUG cinder.volume.manager [None req-c865a424-bfd3-42cd-8e5a-43993fdc4170 tempest-VolumesActionsTest-1687831653 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (53aa02bd-0627-4083-835e-6ce366e6230b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 19:00:46 devstack cinder-volume[84538]: DEBUG cinder.volume.manager [None req-c865a424-bfd3-42cd-8e5a-43993fdc4170 tempest-VolumesActionsTest-1687831653 None] Flow 'volume_create_manager' (e452add9-b33a-4f8c-bad1-d510431663ad) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84538) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 19:00:46 devstack cinder-volume[84538]: DEBUG oslo.privsep.daemon [-] privsep: reply[0d352f75-7a11-4051-ac60-d5e1d02cd718]: (4, 'qcow2') {{(pid=85803) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 19:00:46 devstack cinder-volume[84538]: DEBUG oslo_concurrency.processutils [None req-a4b2f610-a45a-44a5-aaac-45ed3a1ec3c1 tempest-GroupSnapshotsTest-1835037466 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-80fda4c5-5bad-4f1a-a0a6-8c24f1f84323 {{(pid=84538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 19:00:46 devstack cinder-volume[84538]: INFO cinder.volume.manager [None req-c865a424-bfd3-42cd-8e5a-43993fdc4170 tempest-VolumesActionsTest-1687831653 None] Created volume successfully. Apr 29 19:00:47 devstack sudo[89684]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-80fda4c5-5bad-4f1a-a0a6-8c24f1f84323 Apr 29 19:00:47 devstack sudo[89684]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 19:00:47 devstack sudo[89681]: pam_unix(sudo:session): session closed for user root Apr 29 19:00:47 devstack cinder-volume[84538]: DEBUG oslo_concurrency.processutils [None req-a37e3f26-d8a1-4d7e-b1af-6b95af636131 tempest-VolumesImageMetadata-273877373 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-1817e622-6c32-4a74-a412-0387c4b992a1" returned: 1 in 1.032s {{(pid=84538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 19:00:47 devstack cinder-volume[84538]: DEBUG oslo_concurrency.processutils [None req-a37e3f26-d8a1-4d7e-b1af-6b95af636131 tempest-VolumesImageMetadata-273877373 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-1817e622-6c32-4a74-a412-0387c4b992a1' failed. Not Retrying. {{(pid=84538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Apr 29 19:00:47 devstack cinder-volume[84538]: DEBUG cinder.volume.volume_utils [None req-a37e3f26-d8a1-4d7e-b1af-6b95af636131 tempest-VolumesImageMetadata-273877373 None] Downloaded image 11605644-0a6a-4a0a-b123-c09ab01cd4db ((None, [{'url': 'file:///opt/stack/data/glance/images/11605644-0a6a-4a0a-b123-c09ab01cd4db', 'metadata': {}}])) to volume 1817e622-6c32-4a74-a412-0387c4b992a1 successfully. {{(pid=84538) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1234}} Apr 29 19:00:47 devstack cinder-volume[84538]: DEBUG cinder.image.image_utils [None req-a37e3f26-d8a1-4d7e-b1af-6b95af636131 tempest-VolumesImageMetadata-273877373 None] Temporary image 11605644-0a6a-4a0a-b123-c09ab01cd4db for user 5c3e1244343b4f1082b0d60194c2bb28 is deleted. {{(pid=84538) fetch /opt/stack/cinder/cinder/image/image_utils.py:1435}} Apr 29 19:00:47 devstack cinder-volume[84538]: DEBUG cinder.volume.volume_utils [None req-a37e3f26-d8a1-4d7e-b1af-6b95af636131 tempest-VolumesImageMetadata-273877373 None] Marking volume 1817e622-6c32-4a74-a412-0387c4b992a1 as bootable. {{(pid=84538) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1138}} Apr 29 19:00:47 devstack cinder-volume[84538]: DEBUG cinder.volume.flows.manager.create_volume [None req-a37e3f26-d8a1-4d7e-b1af-6b95af636131 tempest-VolumesImageMetadata-273877373 None] Copying metadata from image 11605644-0a6a-4a0a-b123-c09ab01cd4db to 1817e622-6c32-4a74-a412-0387c4b992a1. {{(pid=84538) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Apr 29 19:00:47 devstack cinder-volume[84538]: DEBUG cinder.volume.flows.manager.create_volume [None req-a37e3f26-d8a1-4d7e-b1af-6b95af636131 tempest-VolumesImageMetadata-273877373 None] Creating volume glance metadata for volume 1817e622-6c32-4a74-a412-0387c4b992a1 backed by image 11605644-0a6a-4a0a-b123-c09ab01cd4db with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': '11605644-0a6a-4a0a-b123-c09ab01cd4db', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=84538) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Apr 29 19:00:47 devstack cinder-volume[84538]: DEBUG cinder.volume.manager [None req-a37e3f26-d8a1-4d7e-b1af-6b95af636131 tempest-VolumesImageMetadata-273877373 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d4855d7b-987a-4e93-9a69-1225b04fd3b0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1817e622-6c32-4a74-a412-0387c4b992a1', 'volume_size': 1, 'image_id': '11605644-0a6a-4a0a-b123-c09ab01cd4db', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/11605644-0a6a-4a0a-b123-c09ab01cd4db', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '853afc5ea27148009f8c02d351cf4d80', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '11605644-0a6a-4a0a-b123-c09ab01cd4db', 'created_at': datetime.datetime(2026, 4, 29, 16, 52, 8, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 4, 29, 16, 52, 10, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/11605644-0a6a-4a0a-b123-c09ab01cd4db/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=84538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 19:00:47 devstack cinder-volume[84538]: DEBUG cinder.volume.manager [None req-a37e3f26-d8a1-4d7e-b1af-6b95af636131 tempest-VolumesImageMetadata-273877373 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c2f3877e-005c-4df5-9798-c72666ae9555) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 19:00:47 devstack cinder-volume[84538]: INFO cinder.volume.flows.manager.create_volume [None req-a37e3f26-d8a1-4d7e-b1af-6b95af636131 tempest-VolumesImageMetadata-273877373 None] Volume volume-1817e622-6c32-4a74-a412-0387c4b992a1 (1817e622-6c32-4a74-a412-0387c4b992a1): created successfully Apr 29 19:00:47 devstack cinder-volume[84538]: DEBUG cinder.volume.manager [None req-a37e3f26-d8a1-4d7e-b1af-6b95af636131 tempest-VolumesImageMetadata-273877373 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c2f3877e-005c-4df5-9798-c72666ae9555) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 19:00:47 devstack cinder-volume[84538]: DEBUG cinder.volume.manager [None req-a37e3f26-d8a1-4d7e-b1af-6b95af636131 tempest-VolumesImageMetadata-273877373 None] Flow 'volume_create_manager' (e9899b9a-6304-4808-9751-b7606f828bd0) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84538) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 19:00:47 devstack cinder-volume[84538]: INFO cinder.volume.manager [None req-a37e3f26-d8a1-4d7e-b1af-6b95af636131 tempest-VolumesImageMetadata-273877373 None] Created volume successfully. Apr 29 19:00:47 devstack sudo[89684]: pam_unix(sudo:session): session closed for user root Apr 29 19:00:47 devstack cinder-volume[84538]: DEBUG oslo_concurrency.processutils [None req-a4b2f610-a45a-44a5-aaac-45ed3a1ec3c1 tempest-GroupSnapshotsTest-1835037466 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-80fda4c5-5bad-4f1a-a0a6-8c24f1f84323" returned: 0 in 0.915s {{(pid=84538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 19:00:47 devstack cinder-volume[84538]: DEBUG oslo_concurrency.processutils [None req-a4b2f610-a45a-44a5-aaac-45ed3a1ec3c1 tempest-GroupSnapshotsTest-1835037466 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-80fda4c5-5bad-4f1a-a0a6-8c24f1f84323,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-80fda4c5-5bad-4f1a-a0a6-8c24f1f84323.76a10f6b-93a6-4121-8532-58c93351a064 1G {{(pid=84538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 19:00:47 devstack sudo[89692]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-80fda4c5-5bad-4f1a-a0a6-8c24f1f84323,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-80fda4c5-5bad-4f1a-a0a6-8c24f1f84323.76a10f6b-93a6-4121-8532-58c93351a064 1G Apr 29 19:00:47 devstack sudo[89692]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 19:00:48 devstack cinder-volume[84538]: DEBUG cinder.coordination [None req-fb3fb858-8b5c-4728-b7e2-aa78d7fa1a0a tempest-VolumesActionsTest-1687831653 None] Acquiring lock "cinder-cd1cc196-c983-4e22-aa7b-7d04a91a7349" by "attach_volume" {{(pid=84538) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 19:00:48 devstack cinder-volume[84538]: DEBUG cinder.coordination [None req-fb3fb858-8b5c-4728-b7e2-aa78d7fa1a0a tempest-VolumesActionsTest-1687831653 None] Lock "cinder-cd1cc196-c983-4e22-aa7b-7d04a91a7349" acquired by "attach_volume" :: waited 0.036s {{(pid=84538) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 19:00:48 devstack cinder-volume[84538]: INFO cinder.volume.manager [None req-fb3fb858-8b5c-4728-b7e2-aa78d7fa1a0a tempest-VolumesActionsTest-1687831653 None] Attaching volume cd1cc196-c983-4e22-aa7b-7d04a91a7349 to instance a71b701a-1e83-4c67-bdba-ad6844a5bfa6 at mountpoint /dev/vdb on host None. Apr 29 19:00:48 devstack cinder-volume[84538]: INFO cinder.volume.manager [None req-fb3fb858-8b5c-4728-b7e2-aa78d7fa1a0a tempest-VolumesActionsTest-1687831653 None] Attach volume completed successfully. Apr 29 19:00:48 devstack cinder-volume[84538]: DEBUG cinder.coordination [None req-fb3fb858-8b5c-4728-b7e2-aa78d7fa1a0a tempest-VolumesActionsTest-1687831653 None] Lock "cinder-cd1cc196-c983-4e22-aa7b-7d04a91a7349" released by "attach_volume" :: held 0.192s {{(pid=84538) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 19:00:48 devstack cinder-volume[84538]: DEBUG cinder.coordination [None req-6140c91c-e74c-4690-b2d2-ccd7135f5a4c tempest-VolumesImageMetadata-273877373 None] Acquiring lock "cinder-1817e622-6c32-4a74-a412-0387c4b992a1-delete_volume" by "delete_volume" {{(pid=84538) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 19:00:48 devstack sudo[89692]: pam_unix(sudo:session): session closed for user root Apr 29 19:00:48 devstack cinder-volume[84538]: DEBUG oslo_concurrency.processutils [None req-a4b2f610-a45a-44a5-aaac-45ed3a1ec3c1 tempest-GroupSnapshotsTest-1835037466 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-80fda4c5-5bad-4f1a-a0a6-8c24f1f84323,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-80fda4c5-5bad-4f1a-a0a6-8c24f1f84323.76a10f6b-93a6-4121-8532-58c93351a064 1G" returned: 0 in 0.974s {{(pid=84538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 19:00:48 devstack cinder-volume[84538]: DEBUG oslo_concurrency.processutils [None req-a4b2f610-a45a-44a5-aaac-45ed3a1ec3c1 tempest-GroupSnapshotsTest-1835037466 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-80fda4c5-5bad-4f1a-a0a6-8c24f1f84323 -F qcow2 /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-80fda4c5-5bad-4f1a-a0a6-8c24f1f84323.76a10f6b-93a6-4121-8532-58c93351a064 {{(pid=84538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 19:00:48 devstack cinder-volume[84538]: DEBUG cinder.coordination [None req-6140c91c-e74c-4690-b2d2-ccd7135f5a4c tempest-VolumesImageMetadata-273877373 None] Lock "cinder-1817e622-6c32-4a74-a412-0387c4b992a1-delete_volume" acquired by "delete_volume" :: waited 0.057s {{(pid=84538) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 19:00:48 devstack sudo[89701]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-80fda4c5-5bad-4f1a-a0a6-8c24f1f84323 -F qcow2 /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-80fda4c5-5bad-4f1a-a0a6-8c24f1f84323.76a10f6b-93a6-4121-8532-58c93351a064 Apr 29 19:00:48 devstack sudo[89701]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 19:00:48 devstack cinder-volume[84538]: DEBUG cinder.coordination [None req-6140c91c-e74c-4690-b2d2-ccd7135f5a4c tempest-VolumesImageMetadata-273877373 None] Acquiring lock "cinder-quobyte-1817e622-6c32-4a74-a412-0387c4b992a1" by "delete_volume" {{(pid=84538) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 19:00:48 devstack cinder-volume[84538]: DEBUG cinder.coordination [None req-6140c91c-e74c-4690-b2d2-ccd7135f5a4c tempest-VolumesImageMetadata-273877373 None] Lock "cinder-quobyte-1817e622-6c32-4a74-a412-0387c4b992a1" acquired by "delete_volume" :: waited 0.034s {{(pid=84538) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 19:00:49 devstack cinder-volume[84538]: DEBUG oslo.privsep.daemon [-] privsep: reply[7d8c3131-f80a-4c7f-97c1-c7984c8fa60b]: (4, 'raw') {{(pid=85803) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 19:00:49 devstack cinder-volume[84538]: DEBUG oslo_concurrency.processutils [None req-6140c91c-e74c-4690-b2d2-ccd7135f5a4c tempest-VolumesImageMetadata-273877373 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-1817e622-6c32-4a74-a412-0387c4b992a1 {{(pid=84538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 19:00:49 devstack sudo[89703]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-1817e622-6c32-4a74-a412-0387c4b992a1 Apr 29 19:00:49 devstack sudo[89703]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 19:00:49 devstack cinder-volume[84538]: INFO cinder.volume.manager [None req-741306b2-3dcb-4c3d-bd4d-3eb53cb24003 tempest-GroupsV314Test-669337307 None] Group tempest-GroupsV314Test-Group-801237894: creating Apr 29 19:00:49 devstack cinder-volume[84538]: INFO cinder.volume.manager [None req-741306b2-3dcb-4c3d-bd4d-3eb53cb24003 tempest-GroupsV314Test-669337307 None] Group tempest-GroupsV314Test-Group-801237894: created successfully Apr 29 19:00:49 devstack cinder-volume[84538]: INFO cinder.volume.manager [None req-741306b2-3dcb-4c3d-bd4d-3eb53cb24003 tempest-GroupsV314Test-669337307 None] Create group completed successfully. Apr 29 19:00:49 devstack cinder-volume[84538]: INFO cinder.volume.manager [None req-1eb20537-8b1a-4334-b541-6cc65f3c1def tempest-VolumesActionsTest-927532498 None] Terminate volume connection completed successfully. Apr 29 19:00:49 devstack sudo[89701]: pam_unix(sudo:session): session closed for user root Apr 29 19:00:49 devstack cinder-volume[84538]: DEBUG oslo_concurrency.processutils [None req-a4b2f610-a45a-44a5-aaac-45ed3a1ec3c1 tempest-GroupSnapshotsTest-1835037466 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-80fda4c5-5bad-4f1a-a0a6-8c24f1f84323 -F qcow2 /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-80fda4c5-5bad-4f1a-a0a6-8c24f1f84323.76a10f6b-93a6-4121-8532-58c93351a064" returned: 0 in 0.922s {{(pid=84538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 19:00:49 devstack cinder-volume[84538]: WARNING cinder.volume.drivers.remotefs [None req-a4b2f610-a45a-44a5-aaac-45ed3a1ec3c1 tempest-GroupSnapshotsTest-1835037466 None] /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-80fda4c5-5bad-4f1a-a0a6-8c24f1f84323.76a10f6b-93a6-4121-8532-58c93351a064 is being set with open permissions: ugo+rw: NotImplementedError Apr 29 19:00:49 devstack cinder-volume[84538]: DEBUG oslo_concurrency.processutils [None req-a4b2f610-a45a-44a5-aaac-45ed3a1ec3c1 tempest-GroupSnapshotsTest-1835037466 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-80fda4c5-5bad-4f1a-a0a6-8c24f1f84323.76a10f6b-93a6-4121-8532-58c93351a064 {{(pid=84538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 19:00:49 devstack sudo[89709]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-80fda4c5-5bad-4f1a-a0a6-8c24f1f84323.76a10f6b-93a6-4121-8532-58c93351a064 Apr 29 19:00:49 devstack sudo[89709]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 19:00:49 devstack sudo[89703]: pam_unix(sudo:session): session closed for user root Apr 29 19:00:49 devstack cinder-volume[84538]: DEBUG oslo_concurrency.processutils [None req-6140c91c-e74c-4690-b2d2-ccd7135f5a4c tempest-VolumesImageMetadata-273877373 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-1817e622-6c32-4a74-a412-0387c4b992a1" returned: 0 in 0.902s {{(pid=84538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 19:00:49 devstack cinder-volume[84538]: DEBUG oslo_concurrency.processutils [None req-6140c91c-e74c-4690-b2d2-ccd7135f5a4c tempest-VolumesImageMetadata-273877373 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-1817e622-6c32-4a74-a412-0387c4b992a1 {{(pid=84538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 19:00:50 devstack sudo[89712]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-1817e622-6c32-4a74-a412-0387c4b992a1 Apr 29 19:00:50 devstack sudo[89712]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 19:00:50 devstack cinder-volume[84538]: DEBUG cinder.coordination [None req-1eb20537-8b1a-4334-b541-6cc65f3c1def tempest-VolumesActionsTest-927532498 None] Acquiring lock "cinder-cd1cc196-c983-4e22-aa7b-7d04a91a7349-detach_volume" by "detach_volume" {{(pid=84538) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 19:00:50 devstack cinder-volume[84538]: DEBUG cinder.coordination [None req-1eb20537-8b1a-4334-b541-6cc65f3c1def tempest-VolumesActionsTest-927532498 None] Lock "cinder-cd1cc196-c983-4e22-aa7b-7d04a91a7349-detach_volume" acquired by "detach_volume" :: waited 0.027s {{(pid=84538) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 19:00:50 devstack cinder-volume[84538]: INFO cinder.volume.manager [None req-1eb20537-8b1a-4334-b541-6cc65f3c1def tempest-VolumesActionsTest-927532498 None] Detaching volume cd1cc196-c983-4e22-aa7b-7d04a91a7349 from instance a71b701a-1e83-4c67-bdba-ad6844a5bfa6. Apr 29 19:00:50 devstack cinder-volume[84538]: INFO cinder.volume.manager [None req-1eb20537-8b1a-4334-b541-6cc65f3c1def tempest-VolumesActionsTest-927532498 None] Detach volume completed successfully. Apr 29 19:00:50 devstack cinder-volume[84538]: DEBUG cinder.coordination [None req-1eb20537-8b1a-4334-b541-6cc65f3c1def tempest-VolumesActionsTest-927532498 None] Lock "cinder-cd1cc196-c983-4e22-aa7b-7d04a91a7349-detach_volume" released by "detach_volume" :: held 0.128s {{(pid=84538) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 19:00:50 devstack sudo[89709]: pam_unix(sudo:session): session closed for user root Apr 29 19:00:50 devstack cinder-volume[84538]: DEBUG oslo_concurrency.processutils [None req-a4b2f610-a45a-44a5-aaac-45ed3a1ec3c1 tempest-GroupSnapshotsTest-1835037466 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-80fda4c5-5bad-4f1a-a0a6-8c24f1f84323.76a10f6b-93a6-4121-8532-58c93351a064" returned: 0 in 0.729s {{(pid=84538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 19:00:50 devstack cinder-volume[84538]: DEBUG oslo_concurrency.processutils [None req-a4b2f610-a45a-44a5-aaac-45ed3a1ec3c1 tempest-GroupSnapshotsTest-1835037466 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-80fda4c5-5bad-4f1a-a0a6-8c24f1f84323.info {{(pid=84538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 19:00:50 devstack sudo[89715]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-80fda4c5-5bad-4f1a-a0a6-8c24f1f84323.info Apr 29 19:00:50 devstack sudo[89715]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 19:00:50 devstack cinder-volume[84538]: DEBUG cinder.coordination [None req-02a6fddd-ffb2-4f20-b88f-2195928d3b13 tempest-VolumesActionsTest-1687831653 None] Acquiring lock "cinder-cd1cc196-c983-4e22-aa7b-7d04a91a7349-detach_volume" by "detach_volume" {{(pid=84538) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 19:00:50 devstack cinder-volume[84538]: DEBUG cinder.coordination [None req-02a6fddd-ffb2-4f20-b88f-2195928d3b13 tempest-VolumesActionsTest-1687831653 None] Lock "cinder-cd1cc196-c983-4e22-aa7b-7d04a91a7349-detach_volume" acquired by "detach_volume" :: waited 0.040s {{(pid=84538) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 19:00:50 devstack cinder-volume[84538]: INFO cinder.volume.manager [None req-02a6fddd-ffb2-4f20-b88f-2195928d3b13 tempest-VolumesActionsTest-1687831653 None] Volume detach called, but volume not attached. Apr 29 19:00:50 devstack cinder-volume[84538]: DEBUG cinder.coordination [None req-02a6fddd-ffb2-4f20-b88f-2195928d3b13 tempest-VolumesActionsTest-1687831653 None] Lock "cinder-cd1cc196-c983-4e22-aa7b-7d04a91a7349-detach_volume" released by "detach_volume" :: held 0.056s {{(pid=84538) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 19:00:50 devstack sudo[89712]: pam_unix(sudo:session): session closed for user root Apr 29 19:00:51 devstack cinder-volume[84538]: DEBUG oslo_concurrency.processutils [None req-6140c91c-e74c-4690-b2d2-ccd7135f5a4c tempest-VolumesImageMetadata-273877373 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-1817e622-6c32-4a74-a412-0387c4b992a1" returned: 1 in 1.084s {{(pid=84538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 19:00:51 devstack cinder-volume[84538]: DEBUG oslo_concurrency.processutils [None req-6140c91c-e74c-4690-b2d2-ccd7135f5a4c tempest-VolumesImageMetadata-273877373 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-1817e622-6c32-4a74-a412-0387c4b992a1' failed. Not Retrying. {{(pid=84538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Apr 29 19:00:51 devstack cinder-volume[84538]: DEBUG oslo_concurrency.processutils [None req-6140c91c-e74c-4690-b2d2-ccd7135f5a4c tempest-VolumesImageMetadata-273877373 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-1817e622-6c32-4a74-a412-0387c4b992a1 {{(pid=84538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 19:00:51 devstack cinder-volume[84538]: DEBUG cinder.volume.flows.manager.create_volume [None req-67cdeacd-368f-4e81-b403-4b1dc86892ee tempest-GroupsV314Test-669337307 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84538) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Apr 29 19:00:51 devstack sudo[89720]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-1817e622-6c32-4a74-a412-0387c4b992a1 Apr 29 19:00:51 devstack sudo[89720]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 19:00:51 devstack cinder-volume[84538]: DEBUG cinder.volume.manager [None req-67cdeacd-368f-4e81-b403-4b1dc86892ee tempest-GroupsV314Test-669337307 None] Flow 'volume_create_manager' (2176b6a2-a4b3-46f3-9ec0-3e1b3b66f9a7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84538) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 19:00:51 devstack cinder-volume[84538]: DEBUG cinder.volume.manager [None req-67cdeacd-368f-4e81-b403-4b1dc86892ee tempest-GroupsV314Test-669337307 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (51da1d36-7800-421f-9da4-6321a5d71299) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 19:00:51 devstack cinder-volume[84538]: DEBUG cinder.volume.manager [None req-67cdeacd-368f-4e81-b403-4b1dc86892ee tempest-GroupsV314Test-669337307 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (51da1d36-7800-421f-9da4-6321a5d71299) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-29T17:00:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-912018763',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=49225968-4245-483a-93c1-4a147923e6c6,host='devstack@QuobyteHD#QuobyteHD',id=bb883f83-2cb7-4bf9-979f-03d3f29cbd7a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ac290de8f8c64bbab7933aca6d23a214',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T17:00:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T17:00:51Z,use_quota=True,user_id='4b1d7c0951e8490d84022bdcc0e59d65',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e1af1262-5772-465a-8112-4f5f50809add),volume_type_id=e1af1262-5772-465a-8112-4f5f50809add)' {{(pid=84538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 19:00:51 devstack cinder-volume[84538]: DEBUG cinder.volume.manager [None req-67cdeacd-368f-4e81-b403-4b1dc86892ee tempest-GroupsV314Test-669337307 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e12544e5-adaa-4825-9294-4d57d9ddc72f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 19:00:51 devstack cinder-volume[84538]: DEBUG cinder.volume.manager [None req-67cdeacd-368f-4e81-b403-4b1dc86892ee tempest-GroupsV314Test-669337307 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e12544e5-adaa-4825-9294-4d57d9ddc72f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 19:00:51 devstack cinder-volume[84538]: DEBUG cinder.volume.manager [None req-67cdeacd-368f-4e81-b403-4b1dc86892ee tempest-GroupsV314Test-669337307 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c79a0e73-8cbf-45f5-88f4-0ecfaa233f26) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 19:00:51 devstack cinder-volume[84538]: DEBUG cinder.volume.manager [None req-67cdeacd-368f-4e81-b403-4b1dc86892ee tempest-GroupsV314Test-669337307 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c79a0e73-8cbf-45f5-88f4-0ecfaa233f26) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'bb883f83-2cb7-4bf9-979f-03d3f29cbd7a', 'volume_name': 'volume-bb883f83-2cb7-4bf9-979f-03d3f29cbd7a', 'volume_size': 1}' {{(pid=84538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 19:00:51 devstack cinder-volume[84538]: DEBUG cinder.volume.manager [None req-67cdeacd-368f-4e81-b403-4b1dc86892ee tempest-GroupsV314Test-669337307 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (923b07e4-9694-4b07-87e1-106fae94505e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 19:00:51 devstack cinder-volume[84538]: DEBUG cinder.volume.manager [None req-67cdeacd-368f-4e81-b403-4b1dc86892ee tempest-GroupsV314Test-669337307 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (923b07e4-9694-4b07-87e1-106fae94505e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 19:00:51 devstack cinder-volume[84538]: DEBUG cinder.volume.manager [None req-67cdeacd-368f-4e81-b403-4b1dc86892ee tempest-GroupsV314Test-669337307 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2ddbb74e-9412-44e1-bef8-cdbc0c228c26) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 19:00:51 devstack cinder-volume[84538]: INFO cinder.volume.flows.manager.create_volume [None req-67cdeacd-368f-4e81-b403-4b1dc86892ee tempest-GroupsV314Test-669337307 None] Volume bb883f83-2cb7-4bf9-979f-03d3f29cbd7a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-bb883f83-2cb7-4bf9-979f-03d3f29cbd7a', 'volume_size': 1} Apr 29 19:00:51 devstack cinder-volume[84538]: DEBUG oslo_concurrency.lockutils [None req-67cdeacd-368f-4e81-b403-4b1dc86892ee tempest-GroupsV314Test-669337307 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 19:00:51 devstack sudo[89715]: pam_unix(sudo:session): session closed for user root Apr 29 19:00:51 devstack cinder-volume[84538]: DEBUG oslo_concurrency.processutils [None req-a4b2f610-a45a-44a5-aaac-45ed3a1ec3c1 tempest-GroupSnapshotsTest-1835037466 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-80fda4c5-5bad-4f1a-a0a6-8c24f1f84323.info" returned: 0 in 0.960s {{(pid=84538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 19:00:51 devstack cinder-volume[84538]: WARNING cinder.volume.drivers.remotefs [None req-a4b2f610-a45a-44a5-aaac-45ed3a1ec3c1 tempest-GroupSnapshotsTest-1835037466 None] /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-80fda4c5-5bad-4f1a-a0a6-8c24f1f84323.info is being set with open permissions: ugo+rw: NotImplementedError Apr 29 19:00:51 devstack cinder-volume[84538]: DEBUG oslo_concurrency.processutils [None req-a4b2f610-a45a-44a5-aaac-45ed3a1ec3c1 tempest-GroupSnapshotsTest-1835037466 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-80fda4c5-5bad-4f1a-a0a6-8c24f1f84323.info {{(pid=84538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 19:00:51 devstack sudo[89723]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-80fda4c5-5bad-4f1a-a0a6-8c24f1f84323.info Apr 29 19:00:51 devstack sudo[89723]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 19:00:51 devstack cinder-volume[84538]: DEBUG cinder.coordination [None req-b5c8b130-204d-4ad9-b002-3305fdfa378d tempest-VolumesActionsTest-1687831653 None] Acquiring lock "cinder-cd1cc196-c983-4e22-aa7b-7d04a91a7349-delete_volume" by "delete_volume" {{(pid=84538) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 19:00:51 devstack cinder-volume[84538]: DEBUG cinder.coordination [None req-b5c8b130-204d-4ad9-b002-3305fdfa378d tempest-VolumesActionsTest-1687831653 None] Lock "cinder-cd1cc196-c983-4e22-aa7b-7d04a91a7349-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=84538) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 19:00:51 devstack cinder-volume[84538]: DEBUG cinder.coordination [None req-b5c8b130-204d-4ad9-b002-3305fdfa378d tempest-VolumesActionsTest-1687831653 None] Acquiring lock "cinder-quobyte-cd1cc196-c983-4e22-aa7b-7d04a91a7349" by "delete_volume" {{(pid=84538) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 19:00:51 devstack cinder-volume[84538]: DEBUG cinder.coordination [None req-b5c8b130-204d-4ad9-b002-3305fdfa378d tempest-VolumesActionsTest-1687831653 None] Lock "cinder-quobyte-cd1cc196-c983-4e22-aa7b-7d04a91a7349" acquired by "delete_volume" :: waited 0.035s {{(pid=84538) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 19:00:51 devstack cinder-volume[84538]: DEBUG oslo.privsep.daemon [-] privsep: reply[63a69dd3-a270-4dfe-953e-949cd154ca10]: (4, 'qcow2') {{(pid=85803) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 19:00:51 devstack cinder-volume[84538]: DEBUG oslo_concurrency.processutils [None req-b5c8b130-204d-4ad9-b002-3305fdfa378d tempest-VolumesActionsTest-1687831653 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-cd1cc196-c983-4e22-aa7b-7d04a91a7349 {{(pid=84538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 19:00:51 devstack sudo[89720]: pam_unix(sudo:session): session closed for user root Apr 29 19:00:51 devstack cinder-volume[84538]: DEBUG oslo_concurrency.processutils [None req-6140c91c-e74c-4690-b2d2-ccd7135f5a4c tempest-VolumesImageMetadata-273877373 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-1817e622-6c32-4a74-a412-0387c4b992a1" returned: 0 in 0.737s {{(pid=84538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 19:00:51 devstack cinder-volume[84538]: DEBUG cinder.coordination [None req-6140c91c-e74c-4690-b2d2-ccd7135f5a4c tempest-VolumesImageMetadata-273877373 None] Lock "cinder-quobyte-1817e622-6c32-4a74-a412-0387c4b992a1" released by "delete_volume" :: held 2.826s {{(pid=84538) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 19:00:51 devstack cinder-volume[84538]: DEBUG cinder.quota [None req-6140c91c-e74c-4690-b2d2-ccd7135f5a4c tempest-VolumesImageMetadata-273877373 None] Created reservations ['e10cd929-be76-415b-bfae-4a74d4807ed3', '5065d38f-7167-4aa9-9748-613c1caa7695', 'f86f2114-073f-4b9c-92ef-439f79738635', 'c0219126-233c-4624-b069-fa736bd6ba26'] {{(pid=84538) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 29 19:00:51 devstack sudo[89726]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-cd1cc196-c983-4e22-aa7b-7d04a91a7349 Apr 29 19:00:51 devstack sudo[89726]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 19:00:51 devstack cinder-volume[84538]: DEBUG oslo_concurrency.lockutils [None req-6140c91c-e74c-4690-b2d2-ccd7135f5a4c tempest-VolumesImageMetadata-273877373 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 19:00:51 devstack cinder-volume[84538]: DEBUG oslo_concurrency.lockutils [None req-6140c91c-e74c-4690-b2d2-ccd7135f5a4c tempest-VolumesImageMetadata-273877373 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 19:00:51 devstack cinder-volume[84538]: DEBUG cinder.volume.drivers.quobyte [None req-6140c91c-e74c-4690-b2d2-ccd7135f5a4c tempest-VolumesImageMetadata-273877373 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-34312b00-dd6d-45bb-af98-75855cea8e48': None} {{(pid=84538) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 19:00:51 devstack cinder-volume[84538]: DEBUG cinder.volume.drivers.quobyte [None req-6140c91c-e74c-4690-b2d2-ccd7135f5a4c tempest-VolumesImageMetadata-273877373 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-34312b00-dd6d-45bb-af98-75855cea8e48'] {{(pid=84538) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 19:00:51 devstack cinder-volume[84538]: DEBUG oslo_concurrency.lockutils [None req-6140c91c-e74c-4690-b2d2-ccd7135f5a4c tempest-VolumesImageMetadata-273877373 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=84538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 19:00:51 devstack cinder-volume[84538]: DEBUG oslo_concurrency.processutils [None req-6140c91c-e74c-4690-b2d2-ccd7135f5a4c tempest-VolumesImageMetadata-273877373 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d {{(pid=84538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 19:00:51 devstack sudo[89729]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d Apr 29 19:00:51 devstack sudo[89729]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 19:00:52 devstack sudo[89723]: pam_unix(sudo:session): session closed for user root Apr 29 19:00:52 devstack cinder-volume[84538]: DEBUG oslo_concurrency.processutils [None req-a4b2f610-a45a-44a5-aaac-45ed3a1ec3c1 tempest-GroupSnapshotsTest-1835037466 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-80fda4c5-5bad-4f1a-a0a6-8c24f1f84323.info" returned: 0 in 1.022s {{(pid=84538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 19:00:52 devstack cinder-volume[84538]: DEBUG oslo_concurrency.lockutils [None req-a4b2f610-a45a-44a5-aaac-45ed3a1ec3c1 tempest-GroupSnapshotsTest-1835037466 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 5.689s {{(pid=84538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 19:00:52 devstack cinder-volume[84538]: DEBUG oslo_concurrency.lockutils [None req-67cdeacd-368f-4e81-b403-4b1dc86892ee tempest-GroupsV314Test-669337307 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.358s {{(pid=84538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 19:00:52 devstack cinder-volume[84538]: DEBUG cinder.volume.drivers.quobyte [None req-67cdeacd-368f-4e81-b403-4b1dc86892ee tempest-GroupsV314Test-669337307 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=49225968-4245-483a-93c1-4a147923e6c6,created_at=2026-04-29T17:00:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-912018763',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=49225968-4245-483a-93c1-4a147923e6c6,host='devstack@QuobyteHD#QuobyteHD',id=bb883f83-2cb7-4bf9-979f-03d3f29cbd7a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ac290de8f8c64bbab7933aca6d23a214',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T17:00:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T17:00:51Z,use_quota=True,user_id='4b1d7c0951e8490d84022bdcc0e59d65',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e1af1262-5772-465a-8112-4f5f50809add),volume_type_id=e1af1262-5772-465a-8112-4f5f50809add)}" {{(pid=84538) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 29 19:00:52 devstack cinder-volume[84538]: DEBUG cinder.volume.drivers.remotefs [None req-67cdeacd-368f-4e81-b403-4b1dc86892ee tempest-GroupsV314Test-669337307 None] Creating volume bb883f83-2cb7-4bf9-979f-03d3f29cbd7a {{(pid=84538) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 29 19:00:52 devstack cinder-volume[84538]: DEBUG oslo_concurrency.lockutils [None req-67cdeacd-368f-4e81-b403-4b1dc86892ee tempest-GroupsV314Test-669337307 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 19:00:52 devstack cinder-volume[84538]: DEBUG oslo_concurrency.lockutils [None req-67cdeacd-368f-4e81-b403-4b1dc86892ee tempest-GroupsV314Test-669337307 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 19:00:52 devstack cinder-volume[84538]: DEBUG cinder.volume.drivers.quobyte [None req-67cdeacd-368f-4e81-b403-4b1dc86892ee tempest-GroupsV314Test-669337307 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-34312b00-dd6d-45bb-af98-75855cea8e48': None} {{(pid=84538) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 19:00:52 devstack cinder-volume[84538]: DEBUG cinder.volume.drivers.quobyte [None req-67cdeacd-368f-4e81-b403-4b1dc86892ee tempest-GroupsV314Test-669337307 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-34312b00-dd6d-45bb-af98-75855cea8e48'] {{(pid=84538) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 19:00:52 devstack cinder-volume[84538]: DEBUG oslo_concurrency.lockutils [None req-67cdeacd-368f-4e81-b403-4b1dc86892ee tempest-GroupsV314Test-669337307 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=84538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 19:00:52 devstack cinder-volume[84538]: DEBUG cinder.volume.drivers.quobyte [None req-67cdeacd-368f-4e81-b403-4b1dc86892ee tempest-GroupsV314Test-669337307 None] Selected osci02.corp.quobyte.com/cinder-vol-34312b00-dd6d-45bb-af98-75855cea8e48 as target Quobyte volume. {{(pid=84538) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 29 19:00:52 devstack cinder-volume[84538]: INFO cinder.volume.drivers.remotefs [None req-67cdeacd-368f-4e81-b403-4b1dc86892ee tempest-GroupsV314Test-669337307 None] casted to osci02.corp.quobyte.com/cinder-vol-34312b00-dd6d-45bb-af98-75855cea8e48 Apr 29 19:00:52 devstack cinder-volume[84538]: DEBUG oslo_concurrency.processutils [None req-67cdeacd-368f-4e81-b403-4b1dc86892ee tempest-GroupsV314Test-669337307 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-bb883f83-2cb7-4bf9-979f-03d3f29cbd7a 1073741824 {{(pid=84538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 19:00:52 devstack sudo[89771]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-bb883f83-2cb7-4bf9-979f-03d3f29cbd7a 1073741824 Apr 29 19:00:52 devstack sudo[89771]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 19:00:52 devstack sudo[89726]: pam_unix(sudo:session): session closed for user root Apr 29 19:00:52 devstack sudo[89729]: pam_unix(sudo:session): session closed for user root Apr 29 19:00:52 devstack cinder-volume[84538]: DEBUG oslo_concurrency.processutils [None req-b5c8b130-204d-4ad9-b002-3305fdfa378d tempest-VolumesActionsTest-1687831653 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-cd1cc196-c983-4e22-aa7b-7d04a91a7349" returned: 0 in 0.943s {{(pid=84538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 19:00:52 devstack cinder-volume[84538]: DEBUG oslo_concurrency.processutils [None req-b5c8b130-204d-4ad9-b002-3305fdfa378d tempest-VolumesActionsTest-1687831653 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-cd1cc196-c983-4e22-aa7b-7d04a91a7349 {{(pid=84538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 19:00:52 devstack cinder-volume[84538]: DEBUG oslo_concurrency.processutils [None req-6140c91c-e74c-4690-b2d2-ccd7135f5a4c tempest-VolumesImageMetadata-273877373 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d" returned: 0 in 0.773s {{(pid=84538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 19:00:52 devstack cinder-volume[84538]: DEBUG cinder.manager [None req-6140c91c-e74c-4690-b2d2-ccd7135f5a4c tempest-VolumesImageMetadata-273877373 None] Notifying Schedulers of capabilities ... {{(pid=84538) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 29 19:00:52 devstack cinder-volume[84538]: INFO cinder.volume.manager [None req-6140c91c-e74c-4690-b2d2-ccd7135f5a4c tempest-VolumesImageMetadata-273877373 None] Deleted volume successfully. Apr 29 19:00:52 devstack sudo[89773]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-cd1cc196-c983-4e22-aa7b-7d04a91a7349 Apr 29 19:00:52 devstack sudo[89773]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 19:00:52 devstack cinder-volume[84538]: DEBUG cinder.coordination [None req-6140c91c-e74c-4690-b2d2-ccd7135f5a4c tempest-VolumesImageMetadata-273877373 None] Lock "cinder-1817e622-6c32-4a74-a412-0387c4b992a1-delete_volume" released by "delete_volume" :: held 3.893s {{(pid=84538) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 19:00:52 devstack cinder-volume[84538]: INFO cinder.volume.manager [None req-a4b2f610-a45a-44a5-aaac-45ed3a1ec3c1 tempest-GroupSnapshotsTest-1835037466 None] group_snapshot 841b0d13-8022-43a1-a07e-3b592a0c3029: created successfully Apr 29 19:00:53 devstack sudo[89773]: pam_unix(sudo:session): session closed for user root Apr 29 19:00:53 devstack cinder-volume[84538]: DEBUG oslo_concurrency.processutils [None req-b5c8b130-204d-4ad9-b002-3305fdfa378d tempest-VolumesActionsTest-1687831653 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-cd1cc196-c983-4e22-aa7b-7d04a91a7349" returned: 0 in 0.768s {{(pid=84538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 19:00:53 devstack cinder-volume[84538]: DEBUG cinder.coordination [None req-b5c8b130-204d-4ad9-b002-3305fdfa378d tempest-VolumesActionsTest-1687831653 None] Lock "cinder-quobyte-cd1cc196-c983-4e22-aa7b-7d04a91a7349" released by "delete_volume" :: held 1.758s {{(pid=84538) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 19:00:53 devstack cinder-volume[84538]: DEBUG cinder.quota [None req-b5c8b130-204d-4ad9-b002-3305fdfa378d tempest-VolumesActionsTest-1687831653 None] Created reservations ['0cf6d781-435e-4546-be38-b80974fbebd0', '5fc0b4a0-d9fb-4a64-b22f-12c911aeec9a', '8bcb13ab-2042-4352-bc5c-57bc45b37db7', '4c8f56e6-e2fa-49a9-a70a-998506667802'] {{(pid=84538) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 29 19:00:53 devstack sudo[89771]: pam_unix(sudo:session): session closed for user root Apr 29 19:00:53 devstack cinder-volume[84538]: DEBUG oslo_concurrency.processutils [None req-67cdeacd-368f-4e81-b403-4b1dc86892ee tempest-GroupsV314Test-669337307 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-bb883f83-2cb7-4bf9-979f-03d3f29cbd7a 1073741824" returned: 0 in 0.949s {{(pid=84538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 19:00:53 devstack cinder-volume[84538]: DEBUG oslo_concurrency.processutils [None req-67cdeacd-368f-4e81-b403-4b1dc86892ee tempest-GroupsV314Test-669337307 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-bb883f83-2cb7-4bf9-979f-03d3f29cbd7a {{(pid=84538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 19:00:53 devstack cinder-volume[84538]: DEBUG oslo_concurrency.lockutils [None req-b5c8b130-204d-4ad9-b002-3305fdfa378d tempest-VolumesActionsTest-1687831653 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 19:00:53 devstack cinder-volume[84538]: DEBUG oslo_concurrency.lockutils [None req-b5c8b130-204d-4ad9-b002-3305fdfa378d tempest-VolumesActionsTest-1687831653 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 19:00:53 devstack cinder-volume[84538]: DEBUG cinder.volume.drivers.quobyte [None req-b5c8b130-204d-4ad9-b002-3305fdfa378d tempest-VolumesActionsTest-1687831653 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-34312b00-dd6d-45bb-af98-75855cea8e48': None} {{(pid=84538) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 19:00:53 devstack cinder-volume[84538]: DEBUG cinder.volume.drivers.quobyte [None req-b5c8b130-204d-4ad9-b002-3305fdfa378d tempest-VolumesActionsTest-1687831653 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-34312b00-dd6d-45bb-af98-75855cea8e48'] {{(pid=84538) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 19:00:53 devstack cinder-volume[84538]: DEBUG oslo_concurrency.lockutils [None req-b5c8b130-204d-4ad9-b002-3305fdfa378d tempest-VolumesActionsTest-1687831653 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=84538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 19:00:53 devstack sudo[89780]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-bb883f83-2cb7-4bf9-979f-03d3f29cbd7a Apr 29 19:00:53 devstack cinder-volume[84538]: DEBUG oslo_concurrency.processutils [None req-b5c8b130-204d-4ad9-b002-3305fdfa378d tempest-VolumesActionsTest-1687831653 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d {{(pid=84538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 19:00:53 devstack sudo[89780]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 19:00:53 devstack sudo[89782]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d Apr 29 19:00:53 devstack sudo[89782]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 19:00:54 devstack sudo[89780]: pam_unix(sudo:session): session closed for user root Apr 29 19:00:54 devstack cinder-volume[84538]: DEBUG oslo_concurrency.processutils [None req-67cdeacd-368f-4e81-b403-4b1dc86892ee tempest-GroupsV314Test-669337307 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-bb883f83-2cb7-4bf9-979f-03d3f29cbd7a" returned: 0 in 0.834s {{(pid=84538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 19:00:54 devstack cinder-volume[84538]: DEBUG cinder.volume.drivers.quobyte [None req-67cdeacd-368f-4e81-b403-4b1dc86892ee tempest-GroupsV314Test-669337307 None] <== create_volume: return (1844ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-34312b00-dd6d-45bb-af98-75855cea8e48'} {{(pid=84538) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 29 19:00:54 devstack cinder-volume[84538]: DEBUG oslo_concurrency.lockutils [None req-67cdeacd-368f-4e81-b403-4b1dc86892ee tempest-GroupsV314Test-669337307 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.846s {{(pid=84538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 19:00:54 devstack cinder-volume[84538]: DEBUG oslo_concurrency.lockutils [None req-0909cae9-ed23-45c1-a51f-688ae1b69bc7 tempest-GroupSnapshotsTest-1835037466 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=84538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 19:00:54 devstack cinder-volume[84538]: DEBUG oslo_concurrency.lockutils [None req-0909cae9-ed23-45c1-a51f-688ae1b69bc7 tempest-GroupSnapshotsTest-1835037466 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=84538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 19:00:54 devstack cinder-volume[84538]: DEBUG cinder.coordination [None req-0909cae9-ed23-45c1-a51f-688ae1b69bc7 tempest-GroupSnapshotsTest-1835037466 None] Acquiring lock "cinder-quobyte-76a10f6b-93a6-4121-8532-58c93351a064-1153db26-7fc0-40ab-860c-bf005add3496" by "_create_volume_from_snapshot" {{(pid=84538) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 19:00:54 devstack cinder-volume[84538]: DEBUG cinder.volume.manager [None req-67cdeacd-368f-4e81-b403-4b1dc86892ee tempest-GroupsV314Test-669337307 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2ddbb74e-9412-44e1-bef8-cdbc0c228c26) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-bb883f83-2cb7-4bf9-979f-03d3f29cbd7a', 'volume_size': 1}' {{(pid=84538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 19:00:54 devstack cinder-volume[84538]: DEBUG cinder.volume.manager [None req-67cdeacd-368f-4e81-b403-4b1dc86892ee tempest-GroupsV314Test-669337307 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (791d229d-7cb8-4d84-bd08-070578232db2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 19:00:54 devstack cinder-volume[84538]: INFO cinder.volume.flows.manager.create_volume [None req-67cdeacd-368f-4e81-b403-4b1dc86892ee tempest-GroupsV314Test-669337307 None] Volume volume-bb883f83-2cb7-4bf9-979f-03d3f29cbd7a (bb883f83-2cb7-4bf9-979f-03d3f29cbd7a): created successfully Apr 29 19:00:54 devstack cinder-volume[84538]: DEBUG cinder.volume.manager [None req-67cdeacd-368f-4e81-b403-4b1dc86892ee tempest-GroupsV314Test-669337307 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (791d229d-7cb8-4d84-bd08-070578232db2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 19:00:54 devstack cinder-volume[84538]: DEBUG cinder.volume.manager [None req-67cdeacd-368f-4e81-b403-4b1dc86892ee tempest-GroupsV314Test-669337307 None] Flow 'volume_create_manager' (2176b6a2-a4b3-46f3-9ec0-3e1b3b66f9a7) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84538) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 19:00:54 devstack cinder-volume[84538]: DEBUG cinder.coordination [None req-0909cae9-ed23-45c1-a51f-688ae1b69bc7 tempest-GroupSnapshotsTest-1835037466 None] Lock "cinder-quobyte-76a10f6b-93a6-4121-8532-58c93351a064-1153db26-7fc0-40ab-860c-bf005add3496" acquired by "_create_volume_from_snapshot" :: waited 0.076s {{(pid=84538) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 19:00:54 devstack cinder-volume[84538]: DEBUG cinder.volume.drivers.quobyte [None req-0909cae9-ed23-45c1-a51f-688ae1b69bc7 tempest-GroupSnapshotsTest-1835037466 None] Creating volume 1153db26-7fc0-40ab-860c-bf005add3496 from snapshot 76a10f6b-93a6-4121-8532-58c93351a064 {{(pid=84538) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:356}} Apr 29 19:00:54 devstack cinder-volume[84538]: DEBUG oslo_concurrency.lockutils [None req-0909cae9-ed23-45c1-a51f-688ae1b69bc7 tempest-GroupSnapshotsTest-1835037466 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 19:00:54 devstack cinder-volume[84538]: DEBUG oslo_concurrency.lockutils [None req-0909cae9-ed23-45c1-a51f-688ae1b69bc7 tempest-GroupSnapshotsTest-1835037466 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=84538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 19:00:54 devstack cinder-volume[84538]: DEBUG cinder.volume.drivers.quobyte [None req-0909cae9-ed23-45c1-a51f-688ae1b69bc7 tempest-GroupSnapshotsTest-1835037466 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-34312b00-dd6d-45bb-af98-75855cea8e48': None} {{(pid=84538) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 19:00:54 devstack cinder-volume[84538]: DEBUG cinder.volume.drivers.quobyte [None req-0909cae9-ed23-45c1-a51f-688ae1b69bc7 tempest-GroupSnapshotsTest-1835037466 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-34312b00-dd6d-45bb-af98-75855cea8e48'] {{(pid=84538) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 19:00:54 devstack cinder-volume[84538]: DEBUG oslo_concurrency.lockutils [None req-0909cae9-ed23-45c1-a51f-688ae1b69bc7 tempest-GroupSnapshotsTest-1835037466 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=84538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 19:00:54 devstack cinder-volume[84538]: DEBUG cinder.volume.drivers.quobyte [None req-0909cae9-ed23-45c1-a51f-688ae1b69bc7 tempest-GroupSnapshotsTest-1835037466 None] Selected osci02.corp.quobyte.com/cinder-vol-34312b00-dd6d-45bb-af98-75855cea8e48 as target Quobyte volume. {{(pid=84538) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 29 19:00:54 devstack cinder-volume[84538]: DEBUG cinder.coordination [None req-0909cae9-ed23-45c1-a51f-688ae1b69bc7 tempest-GroupSnapshotsTest-1835037466 None] Acquiring lock "cinder-quobyte-1153db26-7fc0-40ab-860c-bf005add3496" by "_copy_volume_from_snapshot" {{(pid=84538) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 19:00:54 devstack cinder-volume[84538]: INFO cinder.volume.manager [None req-67cdeacd-368f-4e81-b403-4b1dc86892ee tempest-GroupsV314Test-669337307 None] Created volume successfully. Apr 29 19:00:54 devstack cinder-volume[84538]: DEBUG cinder.coordination [None req-0909cae9-ed23-45c1-a51f-688ae1b69bc7 tempest-GroupSnapshotsTest-1835037466 None] Lock "cinder-quobyte-1153db26-7fc0-40ab-860c-bf005add3496" acquired by "_copy_volume_from_snapshot" :: waited 0.038s {{(pid=84538) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 19:00:54 devstack cinder-volume[84538]: DEBUG cinder.volume.drivers.quobyte [None req-0909cae9-ed23-45c1-a51f-688ae1b69bc7 tempest-GroupSnapshotsTest-1835037466 None] snapshot: 76a10f6b-93a6-4121-8532-58c93351a064, volume: 1153db26-7fc0-40ab-860c-bf005add3496, {{(pid=84538) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Apr 29 19:00:54 devstack cinder-volume[84538]: DEBUG oslo_concurrency.lockutils [None req-0909cae9-ed23-45c1-a51f-688ae1b69bc7 tempest-GroupSnapshotsTest-1835037466 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 19:00:54 devstack cinder-volume[84538]: DEBUG oslo_concurrency.lockutils [None req-0909cae9-ed23-45c1-a51f-688ae1b69bc7 tempest-GroupSnapshotsTest-1835037466 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=84538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 19:00:54 devstack cinder-volume[84538]: DEBUG cinder.volume.drivers.quobyte [None req-0909cae9-ed23-45c1-a51f-688ae1b69bc7 tempest-GroupSnapshotsTest-1835037466 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-34312b00-dd6d-45bb-af98-75855cea8e48': None} {{(pid=84538) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 19:00:54 devstack cinder-volume[84538]: DEBUG cinder.volume.drivers.quobyte [None req-0909cae9-ed23-45c1-a51f-688ae1b69bc7 tempest-GroupSnapshotsTest-1835037466 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-34312b00-dd6d-45bb-af98-75855cea8e48'] {{(pid=84538) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 19:00:54 devstack cinder-volume[84538]: DEBUG oslo_concurrency.lockutils [None req-0909cae9-ed23-45c1-a51f-688ae1b69bc7 tempest-GroupSnapshotsTest-1835037466 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=84538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 19:00:54 devstack sudo[89782]: pam_unix(sudo:session): session closed for user root Apr 29 19:00:54 devstack cinder-volume[84538]: DEBUG oslo_concurrency.processutils [None req-b5c8b130-204d-4ad9-b002-3305fdfa378d tempest-VolumesActionsTest-1687831653 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d" returned: 0 in 1.019s {{(pid=84538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 19:00:54 devstack cinder-volume[84538]: DEBUG cinder.manager [None req-b5c8b130-204d-4ad9-b002-3305fdfa378d tempest-VolumesActionsTest-1687831653 None] Notifying Schedulers of capabilities ... {{(pid=84538) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 29 19:00:54 devstack cinder-volume[84538]: DEBUG oslo.privsep.daemon [-] privsep: reply[da7007cf-306e-4b4e-a5e3-2ad611dd68dc]: (4, 'qcow2') {{(pid=85803) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 19:00:54 devstack cinder-volume[84538]: DEBUG oslo_concurrency.processutils [None req-0909cae9-ed23-45c1-a51f-688ae1b69bc7 tempest-GroupSnapshotsTest-1835037466 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-80fda4c5-5bad-4f1a-a0a6-8c24f1f84323.76a10f6b-93a6-4121-8532-58c93351a064 {{(pid=84538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 19:00:54 devstack cinder-volume[84538]: INFO cinder.volume.manager [None req-b5c8b130-204d-4ad9-b002-3305fdfa378d tempest-VolumesActionsTest-1687831653 None] Deleted volume successfully. Apr 29 19:00:54 devstack cinder-volume[84538]: DEBUG cinder.coordination [None req-b5c8b130-204d-4ad9-b002-3305fdfa378d tempest-VolumesActionsTest-1687831653 None] Lock "cinder-cd1cc196-c983-4e22-aa7b-7d04a91a7349-delete_volume" released by "delete_volume" :: held 3.069s {{(pid=84538) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 19:00:54 devstack sudo[89793]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-80fda4c5-5bad-4f1a-a0a6-8c24f1f84323.76a10f6b-93a6-4121-8532-58c93351a064 Apr 29 19:00:54 devstack sudo[89793]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 19:00:55 devstack sudo[89793]: pam_unix(sudo:session): session closed for user root Apr 29 19:00:55 devstack cinder-volume[84538]: DEBUG oslo_concurrency.processutils [None req-0909cae9-ed23-45c1-a51f-688ae1b69bc7 tempest-GroupSnapshotsTest-1835037466 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-80fda4c5-5bad-4f1a-a0a6-8c24f1f84323.76a10f6b-93a6-4121-8532-58c93351a064" returned: 0 in 1.000s {{(pid=84538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 19:00:55 devstack cinder-volume[84538]: DEBUG cinder.volume.drivers.remotefs [None req-0909cae9-ed23-45c1-a51f-688ae1b69bc7 tempest-GroupSnapshotsTest-1835037466 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-80fda4c5-5bad-4f1a-a0a6-8c24f1f84323(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=84538) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 29 19:00:55 devstack cinder-volume[84538]: DEBUG cinder.volume.drivers.quobyte [None req-0909cae9-ed23-45c1-a51f-688ae1b69bc7 tempest-GroupSnapshotsTest-1835037466 None] will copy from snapshot at /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-80fda4c5-5bad-4f1a-a0a6-8c24f1f84323 {{(pid=84538) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Apr 29 19:00:55 devstack cinder-volume[84538]: DEBUG cinder.volume.drivers.quobyte [None req-0909cae9-ed23-45c1-a51f-688ae1b69bc7 tempest-GroupSnapshotsTest-1835037466 None] Creating direct copy from snapshot {{(pid=84538) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Apr 29 19:00:55 devstack cinder-volume[84538]: DEBUG oslo.privsep.daemon [-] privsep: reply[12d36913-f3cb-4052-852a-d586784a9164]: (4, 'qcow2') {{(pid=85803) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 19:00:55 devstack cinder-volume[84538]: DEBUG oslo_concurrency.processutils [None req-0909cae9-ed23-45c1-a51f-688ae1b69bc7 tempest-GroupSnapshotsTest-1835037466 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-80fda4c5-5bad-4f1a-a0a6-8c24f1f84323 {{(pid=84538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 19:00:55 devstack sudo[89838]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-80fda4c5-5bad-4f1a-a0a6-8c24f1f84323 Apr 29 19:00:55 devstack sudo[89838]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 19:00:56 devstack cinder-volume[84538]: DEBUG cinder.volume.flows.manager.create_volume [None req-2268d953-03da-4f19-a4a2-cbd6280f0b56 tempest-SnapshotMetadataTestJSON-944613313 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84538) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Apr 29 19:00:56 devstack cinder-volume[84538]: DEBUG cinder.volume.manager [None req-2268d953-03da-4f19-a4a2-cbd6280f0b56 tempest-SnapshotMetadataTestJSON-944613313 None] Flow 'volume_create_manager' (60c65009-1c00-4f6d-ae71-47907dcba57f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84538) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 19:00:56 devstack cinder-volume[84538]: DEBUG cinder.volume.manager [None req-2268d953-03da-4f19-a4a2-cbd6280f0b56 tempest-SnapshotMetadataTestJSON-944613313 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (885510f1-28cc-431e-b64e-1be50221c563) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 19:00:56 devstack cinder-volume[84538]: DEBUG cinder.volume.manager [None req-2268d953-03da-4f19-a4a2-cbd6280f0b56 tempest-SnapshotMetadataTestJSON-944613313 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (885510f1-28cc-431e-b64e-1be50221c563) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-29T17:00:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotMetadataTestJSON-Volume-1937677604',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6064853c-432e-401f-9fc0-7921731f1049,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b16ab0f3e31a4024ab50df8331b5cb2e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T17:00:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T17:00:56Z,use_quota=True,user_id='85886bb2d5724ad48ee761f0bb0650ff',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(62b05900-93e3-4190-a88f-1d87324303d1),volume_type_id=62b05900-93e3-4190-a88f-1d87324303d1)' {{(pid=84538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 19:00:56 devstack cinder-volume[84538]: DEBUG cinder.volume.manager [None req-2268d953-03da-4f19-a4a2-cbd6280f0b56 tempest-SnapshotMetadataTestJSON-944613313 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7becdb82-0e9d-42db-832d-057428fbdd74) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 19:00:56 devstack cinder-volume[84538]: DEBUG cinder.volume.manager [None req-2268d953-03da-4f19-a4a2-cbd6280f0b56 tempest-SnapshotMetadataTestJSON-944613313 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7becdb82-0e9d-42db-832d-057428fbdd74) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 19:00:56 devstack cinder-volume[84538]: DEBUG cinder.volume.manager [None req-2268d953-03da-4f19-a4a2-cbd6280f0b56 tempest-SnapshotMetadataTestJSON-944613313 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (28c55b07-13e4-4769-9a8c-f59144300ede) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 19:00:56 devstack cinder-volume[84538]: DEBUG cinder.volume.manager [None req-2268d953-03da-4f19-a4a2-cbd6280f0b56 tempest-SnapshotMetadataTestJSON-944613313 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (28c55b07-13e4-4769-9a8c-f59144300ede) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6064853c-432e-401f-9fc0-7921731f1049', 'volume_name': 'volume-6064853c-432e-401f-9fc0-7921731f1049', 'volume_size': 1}' {{(pid=84538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 19:00:56 devstack cinder-volume[84538]: DEBUG cinder.volume.manager [None req-2268d953-03da-4f19-a4a2-cbd6280f0b56 tempest-SnapshotMetadataTestJSON-944613313 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3aff8f3c-0d95-453d-9cac-250177d609a5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 19:00:56 devstack cinder-volume[84538]: DEBUG cinder.volume.manager [None req-2268d953-03da-4f19-a4a2-cbd6280f0b56 tempest-SnapshotMetadataTestJSON-944613313 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3aff8f3c-0d95-453d-9cac-250177d609a5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 19:00:56 devstack cinder-volume[84538]: DEBUG cinder.volume.manager [None req-2268d953-03da-4f19-a4a2-cbd6280f0b56 tempest-SnapshotMetadataTestJSON-944613313 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (86084dab-784f-427d-9817-6a264fdf59b6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 19:00:56 devstack cinder-volume[84538]: INFO cinder.volume.flows.manager.create_volume [None req-2268d953-03da-4f19-a4a2-cbd6280f0b56 tempest-SnapshotMetadataTestJSON-944613313 None] Volume 6064853c-432e-401f-9fc0-7921731f1049: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6064853c-432e-401f-9fc0-7921731f1049', 'volume_size': 1} Apr 29 19:00:56 devstack cinder-volume[84538]: DEBUG oslo_concurrency.lockutils [None req-2268d953-03da-4f19-a4a2-cbd6280f0b56 tempest-SnapshotMetadataTestJSON-944613313 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 19:00:56 devstack sudo[89838]: pam_unix(sudo:session): session closed for user root Apr 29 19:00:56 devstack cinder-volume[84538]: DEBUG oslo_concurrency.processutils [None req-0909cae9-ed23-45c1-a51f-688ae1b69bc7 tempest-GroupSnapshotsTest-1835037466 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-80fda4c5-5bad-4f1a-a0a6-8c24f1f84323" returned: 0 in 0.858s {{(pid=84538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 19:00:56 devstack cinder-volume[84538]: DEBUG cinder.utils [None req-0909cae9-ed23-45c1-a51f-688ae1b69bc7 tempest-GroupSnapshotsTest-1835037466 None] Path /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-1153db26-7fc0-40ab-860c-bf005add3496 not found in is_blk_device check {{(pid=84538) is_blk_device /opt/stack/cinder/cinder/utils.py:602}} Apr 29 19:00:56 devstack cinder-volume[84538]: DEBUG oslo_concurrency.processutils [None req-0909cae9-ed23-45c1-a51f-688ae1b69bc7 tempest-GroupSnapshotsTest-1835037466 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-80fda4c5-5bad-4f1a-a0a6-8c24f1f84323 /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-1153db26-7fc0-40ab-860c-bf005add3496 {{(pid=84538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 19:00:56 devstack sudo[89845]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-80fda4c5-5bad-4f1a-a0a6-8c24f1f84323 /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-1153db26-7fc0-40ab-860c-bf005add3496 Apr 29 19:00:56 devstack sudo[89845]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 19:00:56 devstack cinder-volume[84538]: DEBUG oslo_concurrency.lockutils [None req-946fe2bd-1184-435d-b5d2-1b7494dda606 tempest-GroupsV314Test-669337307 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" {{(pid=84538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 19:01:01 devstack sudo[89845]: pam_unix(sudo:session): session closed for user root Apr 29 19:01:01 devstack cinder-volume[84538]: DEBUG oslo_concurrency.processutils [None req-0909cae9-ed23-45c1-a51f-688ae1b69bc7 tempest-GroupSnapshotsTest-1835037466 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-80fda4c5-5bad-4f1a-a0a6-8c24f1f84323 /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-1153db26-7fc0-40ab-860c-bf005add3496" returned: 0 in 5.276s {{(pid=84538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 19:01:01 devstack cinder-volume[84538]: DEBUG oslo.privsep.daemon [-] privsep: reply[62096023-7424-4083-82ad-79a2a0e52de7]: (4, 'qcow2') {{(pid=85803) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 19:01:01 devstack cinder-volume[84538]: DEBUG oslo_concurrency.processutils [None req-0909cae9-ed23-45c1-a51f-688ae1b69bc7 tempest-GroupSnapshotsTest-1835037466 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-80fda4c5-5bad-4f1a-a0a6-8c24f1f84323 {{(pid=84538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 19:01:01 devstack sudo[89873]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-80fda4c5-5bad-4f1a-a0a6-8c24f1f84323 Apr 29 19:01:01 devstack sudo[89873]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 19:01:02 devstack cinder-volume[84538]: DEBUG cinder.volume.flows.manager.create_volume [None req-d3fd9f6b-aa96-44a3-9f65-312889a61ea7 tempest-VolumesActionsTest-1687831653 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84538) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Apr 29 19:01:02 devstack cinder-volume[84538]: DEBUG cinder.volume.manager [None req-d3fd9f6b-aa96-44a3-9f65-312889a61ea7 tempest-VolumesActionsTest-1687831653 None] Flow 'volume_create_manager' (8bbf22ed-ee0f-4456-9135-d9788df7811a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84538) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 19:01:02 devstack cinder-volume[84538]: DEBUG cinder.volume.manager [None req-d3fd9f6b-aa96-44a3-9f65-312889a61ea7 tempest-VolumesActionsTest-1687831653 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6372bc8c-8916-4b93-b0d9-4338bcadf616) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 19:01:02 devstack cinder-volume[84538]: DEBUG cinder.volume.manager [None req-d3fd9f6b-aa96-44a3-9f65-312889a61ea7 tempest-VolumesActionsTest-1687831653 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6372bc8c-8916-4b93-b0d9-4338bcadf616) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-29T17:01:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-401530977',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3990413b-cd16-4cfe-952d-9cccc4ee7f10,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a39f1f9e4e364982af869dd2b24dfe70',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T17:01:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T17:01:02Z,use_quota=True,user_id='0feaa082ee4740958e7eb31611d1e836',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(62b05900-93e3-4190-a88f-1d87324303d1),volume_type_id=62b05900-93e3-4190-a88f-1d87324303d1)' {{(pid=84538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 19:01:02 devstack cinder-volume[84538]: DEBUG cinder.volume.manager [None req-d3fd9f6b-aa96-44a3-9f65-312889a61ea7 tempest-VolumesActionsTest-1687831653 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a46b4a00-67c6-45b1-aede-e9f084c046d6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 19:01:02 devstack cinder-volume[84538]: DEBUG cinder.volume.manager [None req-d3fd9f6b-aa96-44a3-9f65-312889a61ea7 tempest-VolumesActionsTest-1687831653 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a46b4a00-67c6-45b1-aede-e9f084c046d6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 19:01:02 devstack cinder-volume[84538]: DEBUG cinder.volume.manager [None req-d3fd9f6b-aa96-44a3-9f65-312889a61ea7 tempest-VolumesActionsTest-1687831653 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (50af71a9-666e-40fe-9335-d88eab887285) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 19:01:02 devstack cinder-volume[84538]: DEBUG cinder.volume.manager [None req-d3fd9f6b-aa96-44a3-9f65-312889a61ea7 tempest-VolumesActionsTest-1687831653 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (50af71a9-666e-40fe-9335-d88eab887285) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3990413b-cd16-4cfe-952d-9cccc4ee7f10', 'volume_name': 'volume-3990413b-cd16-4cfe-952d-9cccc4ee7f10', 'volume_size': 1}' {{(pid=84538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 19:01:02 devstack cinder-volume[84538]: DEBUG cinder.volume.manager [None req-d3fd9f6b-aa96-44a3-9f65-312889a61ea7 tempest-VolumesActionsTest-1687831653 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d5b15e76-68b7-4a86-b01d-c7a9ee1f169a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 19:01:02 devstack cinder-volume[84538]: DEBUG cinder.volume.manager [None req-d3fd9f6b-aa96-44a3-9f65-312889a61ea7 tempest-VolumesActionsTest-1687831653 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d5b15e76-68b7-4a86-b01d-c7a9ee1f169a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 19:01:02 devstack cinder-volume[84538]: DEBUG cinder.volume.manager [None req-d3fd9f6b-aa96-44a3-9f65-312889a61ea7 tempest-VolumesActionsTest-1687831653 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c40dd33f-a15d-4a55-81be-e560d4706047) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 19:01:02 devstack cinder-volume[84538]: INFO cinder.volume.flows.manager.create_volume [None req-d3fd9f6b-aa96-44a3-9f65-312889a61ea7 tempest-VolumesActionsTest-1687831653 None] Volume 3990413b-cd16-4cfe-952d-9cccc4ee7f10: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3990413b-cd16-4cfe-952d-9cccc4ee7f10', 'volume_size': 1} Apr 29 19:01:02 devstack cinder-volume[84538]: DEBUG oslo_concurrency.lockutils [None req-d3fd9f6b-aa96-44a3-9f65-312889a61ea7 tempest-VolumesActionsTest-1687831653 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 19:01:02 devstack sudo[89873]: pam_unix(sudo:session): session closed for user root Apr 29 19:01:02 devstack cinder-volume[84538]: DEBUG oslo_concurrency.processutils [None req-0909cae9-ed23-45c1-a51f-688ae1b69bc7 tempest-GroupSnapshotsTest-1835037466 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-80fda4c5-5bad-4f1a-a0a6-8c24f1f84323" returned: 0 in 0.904s {{(pid=84538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 19:01:02 devstack cinder-volume[84538]: DEBUG cinder.image.image_utils [None req-0909cae9-ed23-45c1-a51f-688ae1b69bc7 tempest-GroupSnapshotsTest-1835037466 None] Image conversion details: src /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-80fda4c5-5bad-4f1a-a0a6-8c24f1f84323, size 1024.00 MB, duration 5.28 sec, destination /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-1153db26-7fc0-40ab-860c-bf005add3496 {{(pid=84538) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}} Apr 29 19:01:02 devstack cinder-volume[84538]: INFO cinder.image.image_utils [None req-0909cae9-ed23-45c1-a51f-688ae1b69bc7 tempest-GroupSnapshotsTest-1835037466 None] Converted 1024.00 MB image at 194.05 MB/s Apr 29 19:01:02 devstack cinder-volume[84538]: WARNING cinder.volume.drivers.remotefs [None req-0909cae9-ed23-45c1-a51f-688ae1b69bc7 tempest-GroupSnapshotsTest-1835037466 None] /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-1153db26-7fc0-40ab-860c-bf005add3496 is being set with open permissions: ugo+rw: NotImplementedError Apr 29 19:01:02 devstack cinder-volume[84538]: DEBUG oslo_concurrency.processutils [None req-0909cae9-ed23-45c1-a51f-688ae1b69bc7 tempest-GroupSnapshotsTest-1835037466 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-1153db26-7fc0-40ab-860c-bf005add3496 {{(pid=84538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 19:01:02 devstack sudo[89878]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-1153db26-7fc0-40ab-860c-bf005add3496 Apr 29 19:01:02 devstack sudo[89878]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 19:01:03 devstack sudo[89878]: pam_unix(sudo:session): session closed for user root Apr 29 19:01:03 devstack cinder-volume[84538]: DEBUG oslo_concurrency.processutils [None req-0909cae9-ed23-45c1-a51f-688ae1b69bc7 tempest-GroupSnapshotsTest-1835037466 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-1153db26-7fc0-40ab-860c-bf005add3496" returned: 0 in 0.597s {{(pid=84538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 19:01:03 devstack cinder-volume[84538]: DEBUG cinder.coordination [None req-0909cae9-ed23-45c1-a51f-688ae1b69bc7 tempest-GroupSnapshotsTest-1835037466 None] Lock "cinder-quobyte-1153db26-7fc0-40ab-860c-bf005add3496" released by "_copy_volume_from_snapshot" :: held 8.781s {{(pid=84538) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 19:01:03 devstack cinder-volume[84538]: DEBUG cinder.coordination [None req-0909cae9-ed23-45c1-a51f-688ae1b69bc7 tempest-GroupSnapshotsTest-1835037466 None] Lock "cinder-quobyte-76a10f6b-93a6-4121-8532-58c93351a064-1153db26-7fc0-40ab-860c-bf005add3496" released by "_create_volume_from_snapshot" :: held 8.835s {{(pid=84538) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 19:01:03 devstack cinder-volume[84538]: DEBUG oslo_concurrency.lockutils [None req-0909cae9-ed23-45c1-a51f-688ae1b69bc7 tempest-GroupSnapshotsTest-1835037466 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 8.911s {{(pid=84538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 19:01:03 devstack cinder-volume[84538]: DEBUG oslo_concurrency.lockutils [None req-2268d953-03da-4f19-a4a2-cbd6280f0b56 tempest-SnapshotMetadataTestJSON-944613313 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 7.087s {{(pid=84538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 19:01:03 devstack cinder-volume[84538]: DEBUG cinder.volume.drivers.quobyte [None req-2268d953-03da-4f19-a4a2-cbd6280f0b56 tempest-SnapshotMetadataTestJSON-944613313 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-29T17:00:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotMetadataTestJSON-Volume-1937677604',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6064853c-432e-401f-9fc0-7921731f1049,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b16ab0f3e31a4024ab50df8331b5cb2e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T17:00:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T17:00:56Z,use_quota=True,user_id='85886bb2d5724ad48ee761f0bb0650ff',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(62b05900-93e3-4190-a88f-1d87324303d1),volume_type_id=62b05900-93e3-4190-a88f-1d87324303d1)}" {{(pid=84538) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 29 19:01:03 devstack cinder-volume[84538]: DEBUG cinder.volume.drivers.remotefs [None req-2268d953-03da-4f19-a4a2-cbd6280f0b56 tempest-SnapshotMetadataTestJSON-944613313 None] Creating volume 6064853c-432e-401f-9fc0-7921731f1049 {{(pid=84538) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 29 19:01:03 devstack cinder-volume[84538]: DEBUG oslo_concurrency.lockutils [None req-2268d953-03da-4f19-a4a2-cbd6280f0b56 tempest-SnapshotMetadataTestJSON-944613313 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 19:01:03 devstack cinder-volume[84538]: DEBUG oslo_concurrency.lockutils [None req-2268d953-03da-4f19-a4a2-cbd6280f0b56 tempest-SnapshotMetadataTestJSON-944613313 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 19:01:03 devstack cinder-volume[84538]: DEBUG cinder.volume.drivers.quobyte [None req-2268d953-03da-4f19-a4a2-cbd6280f0b56 tempest-SnapshotMetadataTestJSON-944613313 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-34312b00-dd6d-45bb-af98-75855cea8e48': None} {{(pid=84538) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 19:01:03 devstack cinder-volume[84538]: DEBUG cinder.volume.drivers.quobyte [None req-2268d953-03da-4f19-a4a2-cbd6280f0b56 tempest-SnapshotMetadataTestJSON-944613313 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-34312b00-dd6d-45bb-af98-75855cea8e48'] {{(pid=84538) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 19:01:03 devstack cinder-volume[84538]: DEBUG oslo_concurrency.lockutils [None req-2268d953-03da-4f19-a4a2-cbd6280f0b56 tempest-SnapshotMetadataTestJSON-944613313 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=84538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 19:01:03 devstack cinder-volume[84538]: DEBUG cinder.volume.drivers.quobyte [None req-2268d953-03da-4f19-a4a2-cbd6280f0b56 tempest-SnapshotMetadataTestJSON-944613313 None] Selected osci02.corp.quobyte.com/cinder-vol-34312b00-dd6d-45bb-af98-75855cea8e48 as target Quobyte volume. {{(pid=84538) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 29 19:01:03 devstack cinder-volume[84538]: INFO cinder.volume.drivers.remotefs [None req-2268d953-03da-4f19-a4a2-cbd6280f0b56 tempest-SnapshotMetadataTestJSON-944613313 None] casted to osci02.corp.quobyte.com/cinder-vol-34312b00-dd6d-45bb-af98-75855cea8e48 Apr 29 19:01:03 devstack cinder-volume[84538]: DEBUG oslo_concurrency.processutils [None req-2268d953-03da-4f19-a4a2-cbd6280f0b56 tempest-SnapshotMetadataTestJSON-944613313 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-6064853c-432e-401f-9fc0-7921731f1049 1073741824 {{(pid=84538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 19:01:03 devstack sudo[89881]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-6064853c-432e-401f-9fc0-7921731f1049 1073741824 Apr 29 19:01:03 devstack sudo[89881]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 19:01:03 devstack cinder-volume[84538]: INFO cinder.volume.manager [None req-0909cae9-ed23-45c1-a51f-688ae1b69bc7 tempest-GroupSnapshotsTest-1835037466 None] Create group from source-snapshot-841b0d13-8022-43a1-a07e-3b592a0c3029 completed successfully. Apr 29 19:01:04 devstack sudo[89881]: pam_unix(sudo:session): session closed for user root Apr 29 19:01:04 devstack cinder-volume[84538]: DEBUG oslo_concurrency.processutils [None req-2268d953-03da-4f19-a4a2-cbd6280f0b56 tempest-SnapshotMetadataTestJSON-944613313 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-6064853c-432e-401f-9fc0-7921731f1049 1073741824" returned: 0 in 0.789s {{(pid=84538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 19:01:04 devstack cinder-volume[84538]: DEBUG oslo_concurrency.processutils [None req-2268d953-03da-4f19-a4a2-cbd6280f0b56 tempest-SnapshotMetadataTestJSON-944613313 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-6064853c-432e-401f-9fc0-7921731f1049 {{(pid=84538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 19:01:04 devstack sudo[89886]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-6064853c-432e-401f-9fc0-7921731f1049 Apr 29 19:01:04 devstack sudo[89886]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 19:01:04 devstack cinder-volume[84538]: DEBUG cinder.coordination [None req-5b6ff717-db6e-42b5-9f42-1eb8c0fccf86 tempest-GroupSnapshotsTest-1835037466 None] Acquiring lock "cinder-quobyte-1153db26-7fc0-40ab-860c-bf005add3496" by "delete_volume" {{(pid=84538) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 19:01:04 devstack cinder-volume[84538]: DEBUG cinder.coordination [None req-5b6ff717-db6e-42b5-9f42-1eb8c0fccf86 tempest-GroupSnapshotsTest-1835037466 None] Lock "cinder-quobyte-1153db26-7fc0-40ab-860c-bf005add3496" acquired by "delete_volume" :: waited 0.017s {{(pid=84538) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 19:01:04 devstack cinder-volume[84538]: DEBUG oslo.privsep.daemon [-] privsep: reply[aba92470-b6c9-4829-959c-ef0d68fddbe6]: (4, 'qcow2') {{(pid=85803) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 19:01:04 devstack cinder-volume[84538]: DEBUG oslo_concurrency.processutils [None req-5b6ff717-db6e-42b5-9f42-1eb8c0fccf86 tempest-GroupSnapshotsTest-1835037466 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-1153db26-7fc0-40ab-860c-bf005add3496 {{(pid=84538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 19:01:04 devstack sudo[89888]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-1153db26-7fc0-40ab-860c-bf005add3496 Apr 29 19:01:04 devstack sudo[89888]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 19:01:04 devstack sudo[89886]: pam_unix(sudo:session): session closed for user root Apr 29 19:01:04 devstack cinder-volume[84538]: DEBUG oslo_concurrency.processutils [None req-2268d953-03da-4f19-a4a2-cbd6280f0b56 tempest-SnapshotMetadataTestJSON-944613313 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-6064853c-432e-401f-9fc0-7921731f1049" returned: 0 in 0.614s {{(pid=84538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 19:01:04 devstack cinder-volume[84538]: DEBUG cinder.volume.drivers.quobyte [None req-2268d953-03da-4f19-a4a2-cbd6280f0b56 tempest-SnapshotMetadataTestJSON-944613313 None] <== create_volume: return (1450ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-34312b00-dd6d-45bb-af98-75855cea8e48'} {{(pid=84538) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 29 19:01:04 devstack cinder-volume[84538]: DEBUG oslo_concurrency.lockutils [None req-2268d953-03da-4f19-a4a2-cbd6280f0b56 tempest-SnapshotMetadataTestJSON-944613313 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.454s {{(pid=84538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 19:01:04 devstack cinder-volume[84538]: DEBUG oslo_concurrency.lockutils [None req-946fe2bd-1184-435d-b5d2-1b7494dda606 tempest-GroupsV314Test-669337307 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: waited 7.997s {{(pid=84538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 19:01:04 devstack cinder-volume[84538]: INFO cinder.volume.drivers.remotefs [None req-946fe2bd-1184-435d-b5d2-1b7494dda606 tempest-GroupsV314Test-669337307 None] Cloning volume bb883f83-2cb7-4bf9-979f-03d3f29cbd7a to volume d6e91205-4536-431a-9b68-ae1d9393e89d Apr 29 19:01:04 devstack cinder-volume[84538]: DEBUG cinder.volume.manager [None req-2268d953-03da-4f19-a4a2-cbd6280f0b56 tempest-SnapshotMetadataTestJSON-944613313 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (86084dab-784f-427d-9817-6a264fdf59b6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6064853c-432e-401f-9fc0-7921731f1049', 'volume_size': 1}' {{(pid=84538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 19:01:04 devstack cinder-volume[84538]: DEBUG cinder.volume.manager [None req-2268d953-03da-4f19-a4a2-cbd6280f0b56 tempest-SnapshotMetadataTestJSON-944613313 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ea156db5-8212-4a08-b440-d34460030cc0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 19:01:04 devstack cinder-volume[84538]: INFO cinder.volume.flows.manager.create_volume [None req-2268d953-03da-4f19-a4a2-cbd6280f0b56 tempest-SnapshotMetadataTestJSON-944613313 None] Volume volume-6064853c-432e-401f-9fc0-7921731f1049 (6064853c-432e-401f-9fc0-7921731f1049): created successfully Apr 29 19:01:04 devstack cinder-volume[84538]: DEBUG cinder.volume.manager [None req-2268d953-03da-4f19-a4a2-cbd6280f0b56 tempest-SnapshotMetadataTestJSON-944613313 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ea156db5-8212-4a08-b440-d34460030cc0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 19:01:04 devstack cinder-volume[84538]: DEBUG cinder.volume.manager [None req-2268d953-03da-4f19-a4a2-cbd6280f0b56 tempest-SnapshotMetadataTestJSON-944613313 None] Flow 'volume_create_manager' (60c65009-1c00-4f6d-ae71-47907dcba57f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84538) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 19:01:04 devstack cinder-volume[84538]: DEBUG cinder.volume.drivers.remotefs [None req-946fe2bd-1184-435d-b5d2-1b7494dda606 tempest-GroupsV314Test-669337307 None] Creating offline snapshot e44ba06c-3216-4998-b8d8-ad782e6f0e4d of volume bb883f83-2cb7-4bf9-979f-03d3f29cbd7a {{(pid=84538) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}} Apr 29 19:01:04 devstack cinder-volume[84538]: INFO cinder.volume.manager [None req-2268d953-03da-4f19-a4a2-cbd6280f0b56 tempest-SnapshotMetadataTestJSON-944613313 None] Created volume successfully. Apr 29 19:01:04 devstack cinder-volume[84538]: DEBUG oslo.privsep.daemon [-] privsep: reply[4d602f44-625c-4d58-959e-11f0440c426a]: (4, 'qcow2') {{(pid=85803) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 19:01:04 devstack cinder-volume[84538]: DEBUG oslo_concurrency.processutils [None req-946fe2bd-1184-435d-b5d2-1b7494dda606 tempest-GroupsV314Test-669337307 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-bb883f83-2cb7-4bf9-979f-03d3f29cbd7a {{(pid=84538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 19:01:05 devstack sudo[89891]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-bb883f83-2cb7-4bf9-979f-03d3f29cbd7a Apr 29 19:01:05 devstack sudo[89891]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 19:01:05 devstack cinder-volume[84538]: DEBUG oslo_concurrency.lockutils [None req-a3882886-3f19-405a-803d-866ec8f0568e tempest-SnapshotMetadataTestJSON-944613313 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=84538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 19:01:05 devstack sudo[89888]: pam_unix(sudo:session): session closed for user root Apr 29 19:01:05 devstack cinder-volume[84538]: DEBUG oslo_concurrency.processutils [None req-5b6ff717-db6e-42b5-9f42-1eb8c0fccf86 tempest-GroupSnapshotsTest-1835037466 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-1153db26-7fc0-40ab-860c-bf005add3496" returned: 0 in 0.794s {{(pid=84538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 19:01:05 devstack cinder-volume[84538]: DEBUG oslo_concurrency.processutils [None req-5b6ff717-db6e-42b5-9f42-1eb8c0fccf86 tempest-GroupSnapshotsTest-1835037466 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-1153db26-7fc0-40ab-860c-bf005add3496 {{(pid=84538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 19:01:05 devstack sudo[89896]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-1153db26-7fc0-40ab-860c-bf005add3496 Apr 29 19:01:05 devstack sudo[89896]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 19:01:05 devstack sudo[89891]: pam_unix(sudo:session): session closed for user root Apr 29 19:01:05 devstack cinder-volume[84538]: DEBUG oslo_concurrency.processutils [None req-946fe2bd-1184-435d-b5d2-1b7494dda606 tempest-GroupsV314Test-669337307 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-bb883f83-2cb7-4bf9-979f-03d3f29cbd7a" returned: 0 in 0.804s {{(pid=84538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 19:01:05 devstack cinder-volume[84538]: DEBUG oslo_concurrency.processutils [None req-946fe2bd-1184-435d-b5d2-1b7494dda606 tempest-GroupsV314Test-669337307 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-bb883f83-2cb7-4bf9-979f-03d3f29cbd7a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-bb883f83-2cb7-4bf9-979f-03d3f29cbd7a.e44ba06c-3216-4998-b8d8-ad782e6f0e4d 1G {{(pid=84538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 19:01:05 devstack sudo[89901]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-bb883f83-2cb7-4bf9-979f-03d3f29cbd7a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-bb883f83-2cb7-4bf9-979f-03d3f29cbd7a.e44ba06c-3216-4998-b8d8-ad782e6f0e4d 1G Apr 29 19:01:05 devstack sudo[89901]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 19:01:05 devstack sudo[89896]: pam_unix(sudo:session): session closed for user root Apr 29 19:01:05 devstack cinder-volume[84538]: DEBUG oslo_concurrency.processutils [None req-5b6ff717-db6e-42b5-9f42-1eb8c0fccf86 tempest-GroupSnapshotsTest-1835037466 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-1153db26-7fc0-40ab-860c-bf005add3496" returned: 0 in 0.660s {{(pid=84538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 19:01:05 devstack cinder-volume[84538]: DEBUG cinder.coordination [None req-5b6ff717-db6e-42b5-9f42-1eb8c0fccf86 tempest-GroupSnapshotsTest-1835037466 None] Lock "cinder-quobyte-1153db26-7fc0-40ab-860c-bf005add3496" released by "delete_volume" :: held 1.504s {{(pid=84538) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 19:01:05 devstack cinder-volume[84538]: DEBUG cinder.quota [None req-5b6ff717-db6e-42b5-9f42-1eb8c0fccf86 tempest-GroupSnapshotsTest-1835037466 None] Created reservations ['5b986f37-b903-471a-b024-85f39429b9c8'] {{(pid=84538) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 29 19:01:05 devstack cinder-volume[84538]: WARNING cinder.quota [None req-5b6ff717-db6e-42b5-9f42-1eb8c0fccf86 tempest-GroupSnapshotsTest-1835037466 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsTest-volume-type-454418730 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsTest-volume-type-454418730, it is now deprecated. Please use the default quota class for default quota. Apr 29 19:01:05 devstack cinder-volume[84538]: WARNING cinder.quota [None req-5b6ff717-db6e-42b5-9f42-1eb8c0fccf86 tempest-GroupSnapshotsTest-1835037466 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsTest-volume-type-454418730 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsTest-volume-type-454418730, it is now deprecated. Please use the default quota class for default quota. Apr 29 19:01:06 devstack cinder-volume[84538]: DEBUG cinder.quota [None req-5b6ff717-db6e-42b5-9f42-1eb8c0fccf86 tempest-GroupSnapshotsTest-1835037466 None] Created reservations ['9cdfb2dc-ceff-4e10-ad75-561fc1530f68', '08e8886a-b8d0-4d86-af15-5d944f55746e', 'c356eb63-d2b9-4a8f-b6b4-d962c1a23e85', 'de6b6a2e-2eba-4660-9722-4b747411a5a0'] {{(pid=84538) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 29 19:01:06 devstack cinder-volume[84538]: DEBUG oslo_concurrency.lockutils [None req-5b6ff717-db6e-42b5-9f42-1eb8c0fccf86 tempest-GroupSnapshotsTest-1835037466 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 19:01:06 devstack cinder-volume[84538]: DEBUG oslo_concurrency.lockutils [None req-5b6ff717-db6e-42b5-9f42-1eb8c0fccf86 tempest-GroupSnapshotsTest-1835037466 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 19:01:06 devstack cinder-volume[84538]: DEBUG cinder.volume.drivers.quobyte [None req-5b6ff717-db6e-42b5-9f42-1eb8c0fccf86 tempest-GroupSnapshotsTest-1835037466 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-34312b00-dd6d-45bb-af98-75855cea8e48': None} {{(pid=84538) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 19:01:06 devstack cinder-volume[84538]: DEBUG cinder.volume.drivers.quobyte [None req-5b6ff717-db6e-42b5-9f42-1eb8c0fccf86 tempest-GroupSnapshotsTest-1835037466 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-34312b00-dd6d-45bb-af98-75855cea8e48'] {{(pid=84538) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 19:01:06 devstack cinder-volume[84538]: DEBUG oslo_concurrency.lockutils [None req-5b6ff717-db6e-42b5-9f42-1eb8c0fccf86 tempest-GroupSnapshotsTest-1835037466 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=84538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 19:01:06 devstack cinder-volume[84538]: DEBUG oslo_concurrency.processutils [None req-5b6ff717-db6e-42b5-9f42-1eb8c0fccf86 tempest-GroupSnapshotsTest-1835037466 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d {{(pid=84538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 19:01:06 devstack sudo[89904]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d Apr 29 19:01:06 devstack sudo[89904]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 19:01:06 devstack sudo[89901]: pam_unix(sudo:session): session closed for user root Apr 29 19:01:06 devstack cinder-volume[84538]: DEBUG oslo_concurrency.processutils [None req-946fe2bd-1184-435d-b5d2-1b7494dda606 tempest-GroupsV314Test-669337307 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-bb883f83-2cb7-4bf9-979f-03d3f29cbd7a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-bb883f83-2cb7-4bf9-979f-03d3f29cbd7a.e44ba06c-3216-4998-b8d8-ad782e6f0e4d 1G" returned: 0 in 0.781s {{(pid=84538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 19:01:06 devstack cinder-volume[84538]: DEBUG oslo_concurrency.processutils [None req-946fe2bd-1184-435d-b5d2-1b7494dda606 tempest-GroupsV314Test-669337307 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-bb883f83-2cb7-4bf9-979f-03d3f29cbd7a -F qcow2 /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-bb883f83-2cb7-4bf9-979f-03d3f29cbd7a.e44ba06c-3216-4998-b8d8-ad782e6f0e4d {{(pid=84538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 19:01:06 devstack sudo[89909]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-bb883f83-2cb7-4bf9-979f-03d3f29cbd7a -F qcow2 /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-bb883f83-2cb7-4bf9-979f-03d3f29cbd7a.e44ba06c-3216-4998-b8d8-ad782e6f0e4d Apr 29 19:01:06 devstack sudo[89909]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 19:01:06 devstack cinder-volume[84538]: INFO cinder.volume.manager [None req-0c44dade-75b0-4d74-859a-7432ec5e8f35 tempest-GroupSnapshotsTest-1835037466 None] group_snapshot 841b0d13-8022-43a1-a07e-3b592a0c3029: deleting Apr 29 19:01:06 devstack cinder-volume[84538]: DEBUG cinder.volume.manager [None req-0c44dade-75b0-4d74-859a-7432ec5e8f35 tempest-GroupSnapshotsTest-1835037466 None] group_snapshot 841b0d13-8022-43a1-a07e-3b592a0c3029: deleting {{(pid=84538) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4350}} Apr 29 19:01:06 devstack cinder-volume[84538]: DEBUG cinder.coordination [None req-0c44dade-75b0-4d74-859a-7432ec5e8f35 tempest-GroupSnapshotsTest-1835037466 None] Acquiring lock "cinder-quobyte-80fda4c5-5bad-4f1a-a0a6-8c24f1f84323" by "delete_snapshot" {{(pid=84538) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 19:01:06 devstack cinder-volume[84538]: DEBUG cinder.coordination [None req-0c44dade-75b0-4d74-859a-7432ec5e8f35 tempest-GroupSnapshotsTest-1835037466 None] Lock "cinder-quobyte-80fda4c5-5bad-4f1a-a0a6-8c24f1f84323" acquired by "delete_snapshot" :: waited 0.029s {{(pid=84538) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 19:01:06 devstack cinder-volume[84538]: DEBUG cinder.coordination [None req-0c44dade-75b0-4d74-859a-7432ec5e8f35 tempest-GroupSnapshotsTest-1835037466 None] Acquiring lock "cinder-quobyte-76a10f6b-93a6-4121-8532-58c93351a064" by "_delete_snapshot" {{(pid=84538) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 19:01:06 devstack sudo[89904]: pam_unix(sudo:session): session closed for user root Apr 29 19:01:06 devstack cinder-volume[84538]: DEBUG oslo_concurrency.processutils [None req-5b6ff717-db6e-42b5-9f42-1eb8c0fccf86 tempest-GroupSnapshotsTest-1835037466 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d" returned: 0 in 0.657s {{(pid=84538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 19:01:06 devstack cinder-volume[84538]: DEBUG cinder.manager [None req-5b6ff717-db6e-42b5-9f42-1eb8c0fccf86 tempest-GroupSnapshotsTest-1835037466 None] Notifying Schedulers of capabilities ... {{(pid=84538) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 29 19:01:06 devstack cinder-volume[84538]: INFO cinder.volume.manager [None req-5b6ff717-db6e-42b5-9f42-1eb8c0fccf86 tempest-GroupSnapshotsTest-1835037466 None] Delete group completed successfully. Apr 29 19:01:06 devstack cinder-volume[84538]: DEBUG cinder.coordination [None req-0c44dade-75b0-4d74-859a-7432ec5e8f35 tempest-GroupSnapshotsTest-1835037466 None] Lock "cinder-quobyte-76a10f6b-93a6-4121-8532-58c93351a064" acquired by "_delete_snapshot" :: waited 0.023s {{(pid=84538) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 19:01:06 devstack cinder-volume[84538]: DEBUG cinder.volume.drivers.remotefs [None req-0c44dade-75b0-4d74-859a-7432ec5e8f35 tempest-GroupSnapshotsTest-1835037466 None] Deleting offline snapshot 76a10f6b-93a6-4121-8532-58c93351a064 of volume 80fda4c5-5bad-4f1a-a0a6-8c24f1f84323 {{(pid=84538) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 29 19:01:06 devstack cinder-volume[84538]: DEBUG cinder.volume.drivers.remotefs [None req-0c44dade-75b0-4d74-859a-7432ec5e8f35 tempest-GroupSnapshotsTest-1835037466 None] snapshot_file for this snap is: volume-80fda4c5-5bad-4f1a-a0a6-8c24f1f84323.76a10f6b-93a6-4121-8532-58c93351a064 {{(pid=84538) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 29 19:01:06 devstack cinder-volume[84538]: DEBUG oslo.privsep.daemon [-] privsep: reply[51d42969-8c51-4a39-af50-98d411512ece]: (4, 'qcow2') {{(pid=85803) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 19:01:06 devstack cinder-volume[84538]: DEBUG oslo_concurrency.processutils [None req-0c44dade-75b0-4d74-859a-7432ec5e8f35 tempest-GroupSnapshotsTest-1835037466 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-80fda4c5-5bad-4f1a-a0a6-8c24f1f84323.76a10f6b-93a6-4121-8532-58c93351a064 {{(pid=84538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 19:01:06 devstack sudo[89912]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-80fda4c5-5bad-4f1a-a0a6-8c24f1f84323.76a10f6b-93a6-4121-8532-58c93351a064 Apr 29 19:01:06 devstack sudo[89912]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 19:01:07 devstack sudo[89909]: pam_unix(sudo:session): session closed for user root Apr 29 19:01:07 devstack cinder-volume[84538]: DEBUG oslo_concurrency.processutils [None req-946fe2bd-1184-435d-b5d2-1b7494dda606 tempest-GroupsV314Test-669337307 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-bb883f83-2cb7-4bf9-979f-03d3f29cbd7a -F qcow2 /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-bb883f83-2cb7-4bf9-979f-03d3f29cbd7a.e44ba06c-3216-4998-b8d8-ad782e6f0e4d" returned: 0 in 0.715s {{(pid=84538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 19:01:07 devstack cinder-volume[84538]: WARNING cinder.volume.drivers.remotefs [None req-946fe2bd-1184-435d-b5d2-1b7494dda606 tempest-GroupsV314Test-669337307 None] /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-bb883f83-2cb7-4bf9-979f-03d3f29cbd7a.e44ba06c-3216-4998-b8d8-ad782e6f0e4d is being set with open permissions: ugo+rw: NotImplementedError Apr 29 19:01:07 devstack cinder-volume[84538]: DEBUG oslo_concurrency.processutils [None req-946fe2bd-1184-435d-b5d2-1b7494dda606 tempest-GroupsV314Test-669337307 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-bb883f83-2cb7-4bf9-979f-03d3f29cbd7a.e44ba06c-3216-4998-b8d8-ad782e6f0e4d {{(pid=84538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 19:01:07 devstack sudo[89917]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-bb883f83-2cb7-4bf9-979f-03d3f29cbd7a.e44ba06c-3216-4998-b8d8-ad782e6f0e4d Apr 29 19:01:07 devstack sudo[89917]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 19:01:07 devstack sudo[89912]: pam_unix(sudo:session): session closed for user root Apr 29 19:01:07 devstack cinder-volume[84538]: DEBUG oslo_concurrency.processutils [None req-0c44dade-75b0-4d74-859a-7432ec5e8f35 tempest-GroupSnapshotsTest-1835037466 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-80fda4c5-5bad-4f1a-a0a6-8c24f1f84323.76a10f6b-93a6-4121-8532-58c93351a064" returned: 0 in 0.738s {{(pid=84538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 19:01:07 devstack cinder-volume[84538]: DEBUG cinder.volume.drivers.remotefs [None req-0c44dade-75b0-4d74-859a-7432ec5e8f35 tempest-GroupSnapshotsTest-1835037466 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-80fda4c5-5bad-4f1a-a0a6-8c24f1f84323(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=84538) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 29 19:01:07 devstack cinder-volume[84538]: DEBUG oslo.privsep.daemon [-] privsep: reply[2fbebedd-49aa-4f0a-ad66-09637e491b53]: (4, 'qcow2') {{(pid=85803) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 19:01:07 devstack cinder-volume[84538]: DEBUG oslo_concurrency.processutils [None req-0c44dade-75b0-4d74-859a-7432ec5e8f35 tempest-GroupSnapshotsTest-1835037466 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-80fda4c5-5bad-4f1a-a0a6-8c24f1f84323 {{(pid=84538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 19:01:07 devstack sudo[89922]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-80fda4c5-5bad-4f1a-a0a6-8c24f1f84323 Apr 29 19:01:07 devstack sudo[89922]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 19:01:07 devstack sudo[89917]: pam_unix(sudo:session): session closed for user root Apr 29 19:01:07 devstack cinder-volume[84538]: DEBUG oslo_concurrency.processutils [None req-946fe2bd-1184-435d-b5d2-1b7494dda606 tempest-GroupsV314Test-669337307 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-bb883f83-2cb7-4bf9-979f-03d3f29cbd7a.e44ba06c-3216-4998-b8d8-ad782e6f0e4d" returned: 0 in 0.605s {{(pid=84538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 19:01:07 devstack cinder-volume[84538]: DEBUG oslo_concurrency.processutils [None req-946fe2bd-1184-435d-b5d2-1b7494dda606 tempest-GroupsV314Test-669337307 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-bb883f83-2cb7-4bf9-979f-03d3f29cbd7a.info {{(pid=84538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 19:01:07 devstack sudo[89925]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-bb883f83-2cb7-4bf9-979f-03d3f29cbd7a.info Apr 29 19:01:07 devstack sudo[89925]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 19:01:08 devstack sudo[89922]: pam_unix(sudo:session): session closed for user root Apr 29 19:01:08 devstack cinder-volume[84538]: DEBUG oslo_concurrency.processutils [None req-0c44dade-75b0-4d74-859a-7432ec5e8f35 tempest-GroupSnapshotsTest-1835037466 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-80fda4c5-5bad-4f1a-a0a6-8c24f1f84323" returned: 0 in 0.762s {{(pid=84538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 19:01:08 devstack cinder-volume[84538]: DEBUG oslo_concurrency.processutils [None req-0c44dade-75b0-4d74-859a-7432ec5e8f35 tempest-GroupSnapshotsTest-1835037466 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-80fda4c5-5bad-4f1a-a0a6-8c24f1f84323.76a10f6b-93a6-4121-8532-58c93351a064 {{(pid=84538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 19:01:08 devstack sudo[89933]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-80fda4c5-5bad-4f1a-a0a6-8c24f1f84323.76a10f6b-93a6-4121-8532-58c93351a064 Apr 29 19:01:08 devstack sudo[89933]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 19:01:08 devstack sudo[89925]: pam_unix(sudo:session): session closed for user root Apr 29 19:01:08 devstack cinder-volume[84538]: DEBUG oslo_concurrency.processutils [None req-946fe2bd-1184-435d-b5d2-1b7494dda606 tempest-GroupsV314Test-669337307 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-bb883f83-2cb7-4bf9-979f-03d3f29cbd7a.info" returned: 0 in 0.620s {{(pid=84538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 19:01:08 devstack cinder-volume[84538]: WARNING cinder.volume.drivers.remotefs [None req-946fe2bd-1184-435d-b5d2-1b7494dda606 tempest-GroupsV314Test-669337307 None] /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-bb883f83-2cb7-4bf9-979f-03d3f29cbd7a.info is being set with open permissions: ugo+rw: NotImplementedError Apr 29 19:01:08 devstack cinder-volume[84538]: DEBUG oslo_concurrency.processutils [None req-946fe2bd-1184-435d-b5d2-1b7494dda606 tempest-GroupsV314Test-669337307 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-bb883f83-2cb7-4bf9-979f-03d3f29cbd7a.info {{(pid=84538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 19:01:08 devstack sudo[89935]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-bb883f83-2cb7-4bf9-979f-03d3f29cbd7a.info Apr 29 19:01:08 devstack sudo[89935]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 19:01:09 devstack sudo[89935]: pam_unix(sudo:session): session closed for user root Apr 29 19:01:09 devstack cinder-volume[84538]: DEBUG oslo_concurrency.processutils [None req-946fe2bd-1184-435d-b5d2-1b7494dda606 tempest-GroupsV314Test-669337307 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-bb883f83-2cb7-4bf9-979f-03d3f29cbd7a.info" returned: 0 in 0.612s {{(pid=84538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 19:01:09 devstack cinder-volume[84538]: DEBUG cinder.coordination [None req-946fe2bd-1184-435d-b5d2-1b7494dda606 tempest-GroupsV314Test-669337307 None] Acquiring lock "cinder-quobyte-d6e91205-4536-431a-9b68-ae1d9393e89d" by "_copy_volume_from_snapshot" {{(pid=84538) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 19:01:09 devstack sudo[89933]: pam_unix(sudo:session): session closed for user root Apr 29 19:01:09 devstack cinder-volume[84538]: DEBUG cinder.coordination [None req-946fe2bd-1184-435d-b5d2-1b7494dda606 tempest-GroupsV314Test-669337307 None] Lock "cinder-quobyte-d6e91205-4536-431a-9b68-ae1d9393e89d" acquired by "_copy_volume_from_snapshot" :: waited 0.016s {{(pid=84538) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 19:01:09 devstack cinder-volume[84538]: DEBUG cinder.volume.drivers.quobyte [None req-946fe2bd-1184-435d-b5d2-1b7494dda606 tempest-GroupsV314Test-669337307 None] snapshot: e44ba06c-3216-4998-b8d8-ad782e6f0e4d, volume: d6e91205-4536-431a-9b68-ae1d9393e89d, {{(pid=84538) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Apr 29 19:01:09 devstack cinder-volume[84538]: DEBUG oslo_concurrency.lockutils [None req-946fe2bd-1184-435d-b5d2-1b7494dda606 tempest-GroupsV314Test-669337307 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 19:01:09 devstack cinder-volume[84538]: DEBUG oslo_concurrency.lockutils [None req-946fe2bd-1184-435d-b5d2-1b7494dda606 tempest-GroupsV314Test-669337307 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 19:01:09 devstack cinder-volume[84538]: DEBUG cinder.volume.drivers.quobyte [None req-946fe2bd-1184-435d-b5d2-1b7494dda606 tempest-GroupsV314Test-669337307 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-34312b00-dd6d-45bb-af98-75855cea8e48': None} {{(pid=84538) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 19:01:09 devstack cinder-volume[84538]: DEBUG cinder.volume.drivers.quobyte [None req-946fe2bd-1184-435d-b5d2-1b7494dda606 tempest-GroupsV314Test-669337307 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-34312b00-dd6d-45bb-af98-75855cea8e48'] {{(pid=84538) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 19:01:09 devstack cinder-volume[84538]: DEBUG oslo_concurrency.lockutils [None req-946fe2bd-1184-435d-b5d2-1b7494dda606 tempest-GroupsV314Test-669337307 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=84538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 19:01:09 devstack cinder-volume[84538]: DEBUG oslo_concurrency.processutils [None req-0c44dade-75b0-4d74-859a-7432ec5e8f35 tempest-GroupSnapshotsTest-1835037466 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-80fda4c5-5bad-4f1a-a0a6-8c24f1f84323.76a10f6b-93a6-4121-8532-58c93351a064" returned: 0 in 0.756s {{(pid=84538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 19:01:09 devstack cinder-volume[84538]: DEBUG oslo_concurrency.processutils [None req-0c44dade-75b0-4d74-859a-7432ec5e8f35 tempest-GroupSnapshotsTest-1835037466 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-80fda4c5-5bad-4f1a-a0a6-8c24f1f84323.76a10f6b-93a6-4121-8532-58c93351a064 {{(pid=84538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 19:01:09 devstack cinder-volume[84538]: DEBUG oslo.privsep.daemon [-] privsep: reply[430f3c56-bcb1-44a7-87df-c7cf079c25fc]: (4, 'qcow2') {{(pid=85803) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 19:01:09 devstack cinder-volume[84538]: DEBUG oslo_concurrency.processutils [None req-946fe2bd-1184-435d-b5d2-1b7494dda606 tempest-GroupsV314Test-669337307 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-bb883f83-2cb7-4bf9-979f-03d3f29cbd7a.e44ba06c-3216-4998-b8d8-ad782e6f0e4d {{(pid=84538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 19:01:09 devstack sudo[89941]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-80fda4c5-5bad-4f1a-a0a6-8c24f1f84323.76a10f6b-93a6-4121-8532-58c93351a064 Apr 29 19:01:09 devstack sudo[89941]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 19:01:09 devstack sudo[89942]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-bb883f83-2cb7-4bf9-979f-03d3f29cbd7a.e44ba06c-3216-4998-b8d8-ad782e6f0e4d Apr 29 19:01:09 devstack sudo[89942]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 19:01:09 devstack sudo[89941]: pam_unix(sudo:session): session closed for user root Apr 29 19:01:09 devstack cinder-volume[84538]: DEBUG oslo_concurrency.processutils [None req-0c44dade-75b0-4d74-859a-7432ec5e8f35 tempest-GroupSnapshotsTest-1835037466 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-80fda4c5-5bad-4f1a-a0a6-8c24f1f84323.76a10f6b-93a6-4121-8532-58c93351a064" returned: 0 in 0.623s {{(pid=84538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 19:01:09 devstack cinder-volume[84538]: DEBUG cinder.coordination [None req-0c44dade-75b0-4d74-859a-7432ec5e8f35 tempest-GroupSnapshotsTest-1835037466 None] Lock "cinder-quobyte-76a10f6b-93a6-4121-8532-58c93351a064" released by "_delete_snapshot" :: held 2.989s {{(pid=84538) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 19:01:09 devstack cinder-volume[84538]: DEBUG cinder.coordination [None req-0c44dade-75b0-4d74-859a-7432ec5e8f35 tempest-GroupSnapshotsTest-1835037466 None] Lock "cinder-quobyte-80fda4c5-5bad-4f1a-a0a6-8c24f1f84323" released by "delete_snapshot" :: held 3.025s {{(pid=84538) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 19:01:09 devstack cinder-volume[84538]: WARNING cinder.quota [None req-0c44dade-75b0-4d74-859a-7432ec5e8f35 tempest-GroupSnapshotsTest-1835037466 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsTest-volume-type-454418730 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsTest-volume-type-454418730, it is now deprecated. Please use the default quota class for default quota. Apr 29 19:01:09 devstack cinder-volume[84538]: DEBUG cinder.quota [None req-0c44dade-75b0-4d74-859a-7432ec5e8f35 tempest-GroupSnapshotsTest-1835037466 None] Created reservations ['93786ce5-d29b-417a-b958-d0645428391f', '5322593d-48ca-43ff-b2ea-9dd5490383cd', '3961bd17-d240-4ec4-bffa-e72961cb9e05', 'b0dc0bee-0cb6-49e8-812b-bd962f5d615d'] {{(pid=84538) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 29 19:01:09 devstack sudo[89942]: pam_unix(sudo:session): session closed for user root Apr 29 19:01:09 devstack cinder-volume[84538]: DEBUG oslo_concurrency.processutils [None req-946fe2bd-1184-435d-b5d2-1b7494dda606 tempest-GroupsV314Test-669337307 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-bb883f83-2cb7-4bf9-979f-03d3f29cbd7a.e44ba06c-3216-4998-b8d8-ad782e6f0e4d" returned: 0 in 0.764s {{(pid=84538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 19:01:09 devstack cinder-volume[84538]: DEBUG cinder.volume.drivers.remotefs [None req-946fe2bd-1184-435d-b5d2-1b7494dda606 tempest-GroupsV314Test-669337307 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-bb883f83-2cb7-4bf9-979f-03d3f29cbd7a(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=84538) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 29 19:01:09 devstack cinder-volume[84538]: DEBUG cinder.volume.drivers.quobyte [None req-946fe2bd-1184-435d-b5d2-1b7494dda606 tempest-GroupsV314Test-669337307 None] will copy from snapshot at /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-bb883f83-2cb7-4bf9-979f-03d3f29cbd7a {{(pid=84538) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Apr 29 19:01:09 devstack cinder-volume[84538]: DEBUG cinder.volume.drivers.quobyte [None req-946fe2bd-1184-435d-b5d2-1b7494dda606 tempest-GroupsV314Test-669337307 None] Creating direct copy from snapshot {{(pid=84538) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Apr 29 19:01:09 devstack cinder-volume[84538]: DEBUG oslo.privsep.daemon [-] privsep: reply[330f48e6-c582-4509-83ea-dcedc2205237]: (4, 'qcow2') {{(pid=85803) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 19:01:09 devstack cinder-volume[84538]: DEBUG oslo_concurrency.processutils [None req-946fe2bd-1184-435d-b5d2-1b7494dda606 tempest-GroupsV314Test-669337307 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-bb883f83-2cb7-4bf9-979f-03d3f29cbd7a {{(pid=84538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 19:01:09 devstack cinder-volume[84538]: INFO cinder.volume.manager [None req-0c44dade-75b0-4d74-859a-7432ec5e8f35 tempest-GroupSnapshotsTest-1835037466 None] group_snapshot 841b0d13-8022-43a1-a07e-3b592a0c3029: deleted successfully Apr 29 19:01:10 devstack sudo[89949]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-bb883f83-2cb7-4bf9-979f-03d3f29cbd7a Apr 29 19:01:10 devstack sudo[89949]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 19:01:10 devstack cinder-volume[84538]: DEBUG cinder.coordination [None req-c9b9d1e5-f4de-4abb-98d9-8d91506cafdf tempest-GroupSnapshotsTest-1835037466 None] Acquiring lock "cinder-quobyte-80fda4c5-5bad-4f1a-a0a6-8c24f1f84323" by "delete_volume" {{(pid=84538) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 19:01:10 devstack cinder-volume[84538]: DEBUG cinder.coordination [None req-c9b9d1e5-f4de-4abb-98d9-8d91506cafdf tempest-GroupSnapshotsTest-1835037466 None] Lock "cinder-quobyte-80fda4c5-5bad-4f1a-a0a6-8c24f1f84323" acquired by "delete_volume" :: waited 0.017s {{(pid=84538) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 19:01:10 devstack cinder-volume[84538]: DEBUG oslo.privsep.daemon [-] privsep: reply[aea16076-9295-41b8-a339-2dff7dc44e74]: (4, 'qcow2') {{(pid=85803) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 19:01:10 devstack cinder-volume[84538]: DEBUG oslo_concurrency.processutils [None req-c9b9d1e5-f4de-4abb-98d9-8d91506cafdf tempest-GroupSnapshotsTest-1835037466 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-80fda4c5-5bad-4f1a-a0a6-8c24f1f84323 {{(pid=84538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 19:01:10 devstack sudo[89951]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-80fda4c5-5bad-4f1a-a0a6-8c24f1f84323 Apr 29 19:01:10 devstack sudo[89951]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 19:01:10 devstack sudo[89949]: pam_unix(sudo:session): session closed for user root Apr 29 19:01:10 devstack cinder-volume[84538]: DEBUG oslo_concurrency.processutils [None req-946fe2bd-1184-435d-b5d2-1b7494dda606 tempest-GroupsV314Test-669337307 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-bb883f83-2cb7-4bf9-979f-03d3f29cbd7a" returned: 0 in 0.784s {{(pid=84538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 19:01:10 devstack cinder-volume[84538]: DEBUG cinder.utils [None req-946fe2bd-1184-435d-b5d2-1b7494dda606 tempest-GroupsV314Test-669337307 None] Path /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-d6e91205-4536-431a-9b68-ae1d9393e89d not found in is_blk_device check {{(pid=84538) is_blk_device /opt/stack/cinder/cinder/utils.py:602}} Apr 29 19:01:10 devstack cinder-volume[84538]: DEBUG oslo_concurrency.processutils [None req-946fe2bd-1184-435d-b5d2-1b7494dda606 tempest-GroupsV314Test-669337307 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-bb883f83-2cb7-4bf9-979f-03d3f29cbd7a /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-d6e91205-4536-431a-9b68-ae1d9393e89d {{(pid=84538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 19:01:10 devstack sudo[89956]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-bb883f83-2cb7-4bf9-979f-03d3f29cbd7a /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-d6e91205-4536-431a-9b68-ae1d9393e89d Apr 29 19:01:10 devstack sudo[89956]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 19:01:11 devstack sudo[89951]: pam_unix(sudo:session): session closed for user root Apr 29 19:01:11 devstack cinder-volume[84538]: DEBUG oslo_concurrency.processutils [None req-c9b9d1e5-f4de-4abb-98d9-8d91506cafdf tempest-GroupSnapshotsTest-1835037466 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-80fda4c5-5bad-4f1a-a0a6-8c24f1f84323" returned: 0 in 0.769s {{(pid=84538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 19:01:11 devstack cinder-volume[84538]: DEBUG oslo_concurrency.processutils [None req-c9b9d1e5-f4de-4abb-98d9-8d91506cafdf tempest-GroupSnapshotsTest-1835037466 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-80fda4c5-5bad-4f1a-a0a6-8c24f1f84323 {{(pid=84538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 19:01:11 devstack sudo[89961]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-80fda4c5-5bad-4f1a-a0a6-8c24f1f84323 Apr 29 19:01:11 devstack sudo[89961]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 19:01:12 devstack sudo[89961]: pam_unix(sudo:session): session closed for user root Apr 29 19:01:12 devstack cinder-volume[84538]: DEBUG oslo_concurrency.processutils [None req-c9b9d1e5-f4de-4abb-98d9-8d91506cafdf tempest-GroupSnapshotsTest-1835037466 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-80fda4c5-5bad-4f1a-a0a6-8c24f1f84323" returned: 0 in 0.980s {{(pid=84538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 19:01:12 devstack cinder-volume[84538]: DEBUG cinder.coordination [None req-c9b9d1e5-f4de-4abb-98d9-8d91506cafdf tempest-GroupSnapshotsTest-1835037466 None] Lock "cinder-quobyte-80fda4c5-5bad-4f1a-a0a6-8c24f1f84323" released by "delete_volume" :: held 1.852s {{(pid=84538) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 19:01:12 devstack cinder-volume[84538]: DEBUG cinder.quota [None req-c9b9d1e5-f4de-4abb-98d9-8d91506cafdf tempest-GroupSnapshotsTest-1835037466 None] Created reservations ['2d587060-efb2-4e8f-96de-c95001bec15f'] {{(pid=84538) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 29 19:01:12 devstack cinder-volume[84538]: WARNING cinder.db.sqlalchemy.api [None req-c9b9d1e5-f4de-4abb-98d9-8d91506cafdf tempest-GroupSnapshotsTest-1835037466 None] Reservation would make usage less than 0 for the following resources, so on commit they will be limited to prevent going below 0: ['gigabytes', 'gigabytes_tempest-GroupSnapshotsTest-volume-type-454418730'] Apr 29 19:01:12 devstack cinder-volume[84538]: DEBUG cinder.quota [None req-c9b9d1e5-f4de-4abb-98d9-8d91506cafdf tempest-GroupSnapshotsTest-1835037466 None] Created reservations ['e6aecafd-dbf4-45a9-a162-485a3524dae0', '764e1280-cdad-400f-bf4b-239bc0c5b793', '5b85d256-2c8b-464f-9fc6-65361febf83f', '6cece2e7-61bc-4e51-991f-1b272a6d4726'] {{(pid=84538) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 29 19:01:12 devstack cinder-volume[84538]: DEBUG oslo_concurrency.lockutils [None req-c9b9d1e5-f4de-4abb-98d9-8d91506cafdf tempest-GroupSnapshotsTest-1835037466 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 19:01:12 devstack cinder-volume[84538]: DEBUG oslo_concurrency.lockutils [None req-c9b9d1e5-f4de-4abb-98d9-8d91506cafdf tempest-GroupSnapshotsTest-1835037466 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 19:01:12 devstack cinder-volume[84538]: DEBUG cinder.volume.drivers.quobyte [None req-c9b9d1e5-f4de-4abb-98d9-8d91506cafdf tempest-GroupSnapshotsTest-1835037466 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-34312b00-dd6d-45bb-af98-75855cea8e48': None} {{(pid=84538) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 19:01:12 devstack cinder-volume[84538]: DEBUG cinder.volume.drivers.quobyte [None req-c9b9d1e5-f4de-4abb-98d9-8d91506cafdf tempest-GroupSnapshotsTest-1835037466 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-34312b00-dd6d-45bb-af98-75855cea8e48'] {{(pid=84538) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 19:01:12 devstack cinder-volume[84538]: DEBUG oslo_concurrency.lockutils [None req-c9b9d1e5-f4de-4abb-98d9-8d91506cafdf tempest-GroupSnapshotsTest-1835037466 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=84538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 19:01:12 devstack cinder-volume[84538]: DEBUG oslo_concurrency.processutils [None req-c9b9d1e5-f4de-4abb-98d9-8d91506cafdf tempest-GroupSnapshotsTest-1835037466 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d {{(pid=84538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 19:01:12 devstack sudo[89975]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d Apr 29 19:01:12 devstack sudo[89975]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 19:01:13 devstack sudo[89975]: pam_unix(sudo:session): session closed for user root Apr 29 19:01:13 devstack cinder-volume[84538]: DEBUG oslo_concurrency.processutils [None req-c9b9d1e5-f4de-4abb-98d9-8d91506cafdf tempest-GroupSnapshotsTest-1835037466 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d" returned: 0 in 0.962s {{(pid=84538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 19:01:13 devstack cinder-volume[84538]: DEBUG cinder.manager [None req-c9b9d1e5-f4de-4abb-98d9-8d91506cafdf tempest-GroupSnapshotsTest-1835037466 None] Notifying Schedulers of capabilities ... {{(pid=84538) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 29 19:01:13 devstack cinder-volume[84538]: INFO cinder.volume.manager [None req-c9b9d1e5-f4de-4abb-98d9-8d91506cafdf tempest-GroupSnapshotsTest-1835037466 None] Delete group completed successfully. Apr 29 19:01:14 devstack cinder-volume[84538]: INFO cinder.volume.manager [None req-1c282daa-9460-4aa1-8ac1-5d784b5d8593 tempest-GroupSnapshotsTest-1835037466 None] Group tempest-GroupSnapshotsTest-Group-49288804: creating Apr 29 19:01:14 devstack cinder-volume[84538]: INFO cinder.volume.manager [None req-1c282daa-9460-4aa1-8ac1-5d784b5d8593 tempest-GroupSnapshotsTest-1835037466 None] Group tempest-GroupSnapshotsTest-Group-49288804: created successfully Apr 29 19:01:14 devstack cinder-volume[84538]: INFO cinder.volume.manager [None req-1c282daa-9460-4aa1-8ac1-5d784b5d8593 tempest-GroupSnapshotsTest-1835037466 None] Create group completed successfully. Apr 29 19:01:15 devstack sudo[89956]: pam_unix(sudo:session): session closed for user root Apr 29 19:01:15 devstack cinder-volume[84538]: DEBUG oslo_concurrency.processutils [None req-946fe2bd-1184-435d-b5d2-1b7494dda606 tempest-GroupsV314Test-669337307 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-bb883f83-2cb7-4bf9-979f-03d3f29cbd7a /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-d6e91205-4536-431a-9b68-ae1d9393e89d" returned: 0 in 5.097s {{(pid=84538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 19:01:15 devstack cinder-volume[84538]: DEBUG oslo.privsep.daemon [-] privsep: reply[7c5ccb4e-30b2-450c-9578-3f78b18eb41d]: (4, 'qcow2') {{(pid=85803) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 19:01:15 devstack cinder-volume[84538]: DEBUG oslo_concurrency.processutils [None req-946fe2bd-1184-435d-b5d2-1b7494dda606 tempest-GroupsV314Test-669337307 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-bb883f83-2cb7-4bf9-979f-03d3f29cbd7a {{(pid=84538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 19:01:15 devstack sudo[89978]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-bb883f83-2cb7-4bf9-979f-03d3f29cbd7a Apr 29 19:01:15 devstack sudo[89978]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 19:01:16 devstack cinder-volume[84538]: DEBUG cinder.volume.flows.manager.create_volume [None req-0421a4b5-c8c5-4f78-a66f-2bf07161c602 tempest-GroupSnapshotsTest-1835037466 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84538) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Apr 29 19:01:16 devstack cinder-volume[84538]: DEBUG cinder.volume.manager [None req-0421a4b5-c8c5-4f78-a66f-2bf07161c602 tempest-GroupSnapshotsTest-1835037466 None] Flow 'volume_create_manager' (e346d205-7bd9-4354-a1ba-8b0fc854ee4f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84538) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 19:01:16 devstack cinder-volume[84538]: DEBUG cinder.volume.manager [None req-0421a4b5-c8c5-4f78-a66f-2bf07161c602 tempest-GroupSnapshotsTest-1835037466 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8c6ee8cd-5bd4-4a63-b5bc-5290ea098f38) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 19:01:16 devstack cinder-volume[84538]: DEBUG cinder.volume.manager [None req-0421a4b5-c8c5-4f78-a66f-2bf07161c602 tempest-GroupSnapshotsTest-1835037466 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8c6ee8cd-5bd4-4a63-b5bc-5290ea098f38) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-29T17:01:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1627817600',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=dbf54acf-ba7e-4db8-8711-ba4d240c8365,host='devstack@QuobyteHD#QuobyteHD',id=ce170d29-c990-4cf6-85d1-20cfda253ab6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='14dd90144b0b4dcc8def965ebf4ada62',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T17:01:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T17:01:16Z,use_quota=True,user_id='616bcc255f9c4e89963a9ff70ca5ab6c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(90d05a75-d640-4694-8a0e-e914227d84e8),volume_type_id=90d05a75-d640-4694-8a0e-e914227d84e8)' {{(pid=84538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 19:01:16 devstack cinder-volume[84538]: DEBUG cinder.volume.manager [None req-0421a4b5-c8c5-4f78-a66f-2bf07161c602 tempest-GroupSnapshotsTest-1835037466 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cea1e94a-b8cd-4bf4-885a-0bec34d94b78) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 19:01:16 devstack cinder-volume[84538]: DEBUG cinder.volume.manager [None req-0421a4b5-c8c5-4f78-a66f-2bf07161c602 tempest-GroupSnapshotsTest-1835037466 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cea1e94a-b8cd-4bf4-885a-0bec34d94b78) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 19:01:16 devstack cinder-volume[84538]: DEBUG cinder.volume.manager [None req-0421a4b5-c8c5-4f78-a66f-2bf07161c602 tempest-GroupSnapshotsTest-1835037466 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (695485c1-75df-445e-a5fc-fa7c569f2d78) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 19:01:16 devstack cinder-volume[84538]: DEBUG cinder.volume.manager [None req-0421a4b5-c8c5-4f78-a66f-2bf07161c602 tempest-GroupSnapshotsTest-1835037466 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (695485c1-75df-445e-a5fc-fa7c569f2d78) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ce170d29-c990-4cf6-85d1-20cfda253ab6', 'volume_name': 'volume-ce170d29-c990-4cf6-85d1-20cfda253ab6', 'volume_size': 1}' {{(pid=84538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 19:01:16 devstack cinder-volume[84538]: DEBUG cinder.volume.manager [None req-0421a4b5-c8c5-4f78-a66f-2bf07161c602 tempest-GroupSnapshotsTest-1835037466 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c1f58810-6367-4b12-839a-1eacd9bb0945) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 19:01:16 devstack cinder-volume[84538]: DEBUG cinder.volume.manager [None req-0421a4b5-c8c5-4f78-a66f-2bf07161c602 tempest-GroupSnapshotsTest-1835037466 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c1f58810-6367-4b12-839a-1eacd9bb0945) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 19:01:16 devstack cinder-volume[84538]: DEBUG cinder.volume.manager [None req-0421a4b5-c8c5-4f78-a66f-2bf07161c602 tempest-GroupSnapshotsTest-1835037466 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (95e3d6d3-574b-4b01-805d-3ad2fb58ca79) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 19:01:16 devstack cinder-volume[84538]: INFO cinder.volume.flows.manager.create_volume [None req-0421a4b5-c8c5-4f78-a66f-2bf07161c602 tempest-GroupSnapshotsTest-1835037466 None] Volume ce170d29-c990-4cf6-85d1-20cfda253ab6: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ce170d29-c990-4cf6-85d1-20cfda253ab6', 'volume_size': 1} Apr 29 19:01:16 devstack cinder-volume[84538]: DEBUG oslo_concurrency.lockutils [None req-0421a4b5-c8c5-4f78-a66f-2bf07161c602 tempest-GroupSnapshotsTest-1835037466 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 19:01:16 devstack sudo[89978]: pam_unix(sudo:session): session closed for user root Apr 29 19:01:16 devstack cinder-volume[84538]: DEBUG oslo_concurrency.processutils [None req-946fe2bd-1184-435d-b5d2-1b7494dda606 tempest-GroupsV314Test-669337307 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-bb883f83-2cb7-4bf9-979f-03d3f29cbd7a" returned: 0 in 0.886s {{(pid=84538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 19:01:16 devstack cinder-volume[84538]: DEBUG cinder.image.image_utils [None req-946fe2bd-1184-435d-b5d2-1b7494dda606 tempest-GroupsV314Test-669337307 None] Image conversion details: src /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-bb883f83-2cb7-4bf9-979f-03d3f29cbd7a, size 1024.00 MB, duration 5.10 sec, destination /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-d6e91205-4536-431a-9b68-ae1d9393e89d {{(pid=84538) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}} Apr 29 19:01:16 devstack cinder-volume[84538]: INFO cinder.image.image_utils [None req-946fe2bd-1184-435d-b5d2-1b7494dda606 tempest-GroupsV314Test-669337307 None] Converted 1024.00 MB image at 200.86 MB/s Apr 29 19:01:16 devstack cinder-volume[84538]: WARNING cinder.volume.drivers.remotefs [None req-946fe2bd-1184-435d-b5d2-1b7494dda606 tempest-GroupsV314Test-669337307 None] /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-d6e91205-4536-431a-9b68-ae1d9393e89d is being set with open permissions: ugo+rw: NotImplementedError Apr 29 19:01:16 devstack cinder-volume[84538]: DEBUG oslo_concurrency.processutils [None req-946fe2bd-1184-435d-b5d2-1b7494dda606 tempest-GroupsV314Test-669337307 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-d6e91205-4536-431a-9b68-ae1d9393e89d {{(pid=84538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 19:01:16 devstack sudo[89983]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-d6e91205-4536-431a-9b68-ae1d9393e89d Apr 29 19:01:16 devstack sudo[89983]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 19:01:17 devstack sudo[89983]: pam_unix(sudo:session): session closed for user root Apr 29 19:01:17 devstack cinder-volume[84538]: DEBUG oslo_concurrency.processutils [None req-946fe2bd-1184-435d-b5d2-1b7494dda606 tempest-GroupsV314Test-669337307 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-d6e91205-4536-431a-9b68-ae1d9393e89d" returned: 0 in 0.591s {{(pid=84538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 19:01:17 devstack cinder-volume[84538]: DEBUG cinder.coordination [None req-946fe2bd-1184-435d-b5d2-1b7494dda606 tempest-GroupsV314Test-669337307 None] Lock "cinder-quobyte-d6e91205-4536-431a-9b68-ae1d9393e89d" released by "_copy_volume_from_snapshot" :: held 8.209s {{(pid=84538) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 19:01:17 devstack cinder-volume[84538]: DEBUG cinder.coordination [None req-946fe2bd-1184-435d-b5d2-1b7494dda606 tempest-GroupsV314Test-669337307 None] Acquiring lock "cinder-quobyte-e44ba06c-3216-4998-b8d8-ad782e6f0e4d" by "_delete_snapshot" {{(pid=84538) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 19:01:17 devstack cinder-volume[84538]: DEBUG cinder.coordination [None req-946fe2bd-1184-435d-b5d2-1b7494dda606 tempest-GroupsV314Test-669337307 None] Lock "cinder-quobyte-e44ba06c-3216-4998-b8d8-ad782e6f0e4d" acquired by "_delete_snapshot" :: waited 0.014s {{(pid=84538) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 19:01:17 devstack cinder-volume[84538]: DEBUG cinder.volume.drivers.remotefs [None req-946fe2bd-1184-435d-b5d2-1b7494dda606 tempest-GroupsV314Test-669337307 None] Deleting offline snapshot e44ba06c-3216-4998-b8d8-ad782e6f0e4d of volume bb883f83-2cb7-4bf9-979f-03d3f29cbd7a {{(pid=84538) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 29 19:01:17 devstack cinder-volume[84538]: DEBUG cinder.volume.drivers.remotefs [None req-946fe2bd-1184-435d-b5d2-1b7494dda606 tempest-GroupsV314Test-669337307 None] snapshot_file for this snap is: volume-bb883f83-2cb7-4bf9-979f-03d3f29cbd7a.e44ba06c-3216-4998-b8d8-ad782e6f0e4d {{(pid=84538) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 29 19:01:17 devstack cinder-volume[84538]: DEBUG oslo.privsep.daemon [-] privsep: reply[a8f1fc9c-e7cd-46aa-b988-c6c613f43bf0]: (4, 'qcow2') {{(pid=85803) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 19:01:17 devstack cinder-volume[84538]: DEBUG oslo_concurrency.processutils [None req-946fe2bd-1184-435d-b5d2-1b7494dda606 tempest-GroupsV314Test-669337307 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-bb883f83-2cb7-4bf9-979f-03d3f29cbd7a.e44ba06c-3216-4998-b8d8-ad782e6f0e4d {{(pid=84538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 19:01:17 devstack sudo[89986]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-bb883f83-2cb7-4bf9-979f-03d3f29cbd7a.e44ba06c-3216-4998-b8d8-ad782e6f0e4d Apr 29 19:01:17 devstack sudo[89986]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 19:01:18 devstack sudo[89986]: pam_unix(sudo:session): session closed for user root Apr 29 19:01:18 devstack cinder-volume[84538]: DEBUG oslo_concurrency.processutils [None req-946fe2bd-1184-435d-b5d2-1b7494dda606 tempest-GroupsV314Test-669337307 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-bb883f83-2cb7-4bf9-979f-03d3f29cbd7a.e44ba06c-3216-4998-b8d8-ad782e6f0e4d" returned: 0 in 0.687s {{(pid=84538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 19:01:18 devstack cinder-volume[84538]: DEBUG cinder.volume.drivers.remotefs [None req-946fe2bd-1184-435d-b5d2-1b7494dda606 tempest-GroupsV314Test-669337307 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-bb883f83-2cb7-4bf9-979f-03d3f29cbd7a(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=84538) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 29 19:01:18 devstack cinder-volume[84538]: DEBUG oslo.privsep.daemon [-] privsep: reply[3b1706d8-0c46-4e84-ac75-70f235a3fcef]: (4, 'qcow2') {{(pid=85803) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 19:01:18 devstack cinder-volume[84538]: DEBUG oslo_concurrency.processutils [None req-946fe2bd-1184-435d-b5d2-1b7494dda606 tempest-GroupsV314Test-669337307 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-bb883f83-2cb7-4bf9-979f-03d3f29cbd7a {{(pid=84538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 19:01:18 devstack sudo[89992]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-bb883f83-2cb7-4bf9-979f-03d3f29cbd7a Apr 29 19:01:18 devstack sudo[89992]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 19:01:18 devstack sudo[89992]: pam_unix(sudo:session): session closed for user root Apr 29 19:01:18 devstack cinder-volume[84538]: DEBUG oslo_concurrency.processutils [None req-946fe2bd-1184-435d-b5d2-1b7494dda606 tempest-GroupsV314Test-669337307 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-bb883f83-2cb7-4bf9-979f-03d3f29cbd7a" returned: 0 in 0.715s {{(pid=84538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 19:01:18 devstack cinder-volume[84538]: DEBUG oslo_concurrency.processutils [None req-946fe2bd-1184-435d-b5d2-1b7494dda606 tempest-GroupsV314Test-669337307 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-bb883f83-2cb7-4bf9-979f-03d3f29cbd7a.e44ba06c-3216-4998-b8d8-ad782e6f0e4d {{(pid=84538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 19:01:18 devstack sudo[89997]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-bb883f83-2cb7-4bf9-979f-03d3f29cbd7a.e44ba06c-3216-4998-b8d8-ad782e6f0e4d Apr 29 19:01:18 devstack sudo[89997]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 19:01:19 devstack sudo[89997]: pam_unix(sudo:session): session closed for user root Apr 29 19:01:19 devstack cinder-volume[84538]: DEBUG oslo_concurrency.processutils [None req-946fe2bd-1184-435d-b5d2-1b7494dda606 tempest-GroupsV314Test-669337307 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-bb883f83-2cb7-4bf9-979f-03d3f29cbd7a.e44ba06c-3216-4998-b8d8-ad782e6f0e4d" returned: 0 in 0.688s {{(pid=84538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 19:01:19 devstack cinder-volume[84538]: DEBUG oslo_concurrency.processutils [None req-946fe2bd-1184-435d-b5d2-1b7494dda606 tempest-GroupsV314Test-669337307 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-bb883f83-2cb7-4bf9-979f-03d3f29cbd7a.e44ba06c-3216-4998-b8d8-ad782e6f0e4d {{(pid=84538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 19:01:19 devstack sudo[90003]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-bb883f83-2cb7-4bf9-979f-03d3f29cbd7a.e44ba06c-3216-4998-b8d8-ad782e6f0e4d Apr 29 19:01:19 devstack sudo[90003]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 19:01:20 devstack sudo[90003]: pam_unix(sudo:session): session closed for user root Apr 29 19:01:20 devstack cinder-volume[84538]: DEBUG oslo_concurrency.processutils [None req-946fe2bd-1184-435d-b5d2-1b7494dda606 tempest-GroupsV314Test-669337307 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-bb883f83-2cb7-4bf9-979f-03d3f29cbd7a.e44ba06c-3216-4998-b8d8-ad782e6f0e4d" returned: 0 in 0.595s {{(pid=84538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 19:01:20 devstack cinder-volume[84538]: DEBUG cinder.coordination [None req-946fe2bd-1184-435d-b5d2-1b7494dda606 tempest-GroupsV314Test-669337307 None] Lock "cinder-quobyte-e44ba06c-3216-4998-b8d8-ad782e6f0e4d" released by "_delete_snapshot" :: held 2.776s {{(pid=84538) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 19:01:20 devstack cinder-volume[84538]: DEBUG oslo_concurrency.lockutils [None req-946fe2bd-1184-435d-b5d2-1b7494dda606 tempest-GroupsV314Test-669337307 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: held 15.346s {{(pid=84538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 19:01:20 devstack cinder-volume[84538]: DEBUG oslo_concurrency.lockutils [None req-d3fd9f6b-aa96-44a3-9f65-312889a61ea7 tempest-VolumesActionsTest-1687831653 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 17.932s {{(pid=84538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 19:01:20 devstack cinder-volume[84538]: DEBUG cinder.volume.drivers.quobyte [None req-d3fd9f6b-aa96-44a3-9f65-312889a61ea7 tempest-VolumesActionsTest-1687831653 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-29T17:01:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-401530977',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3990413b-cd16-4cfe-952d-9cccc4ee7f10,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a39f1f9e4e364982af869dd2b24dfe70',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T17:01:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T17:01:02Z,use_quota=True,user_id='0feaa082ee4740958e7eb31611d1e836',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(62b05900-93e3-4190-a88f-1d87324303d1),volume_type_id=62b05900-93e3-4190-a88f-1d87324303d1)}" {{(pid=84538) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 29 19:01:20 devstack cinder-volume[84538]: DEBUG cinder.volume.drivers.remotefs [None req-d3fd9f6b-aa96-44a3-9f65-312889a61ea7 tempest-VolumesActionsTest-1687831653 None] Creating volume 3990413b-cd16-4cfe-952d-9cccc4ee7f10 {{(pid=84538) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 29 19:01:20 devstack cinder-volume[84538]: DEBUG oslo_concurrency.lockutils [None req-d3fd9f6b-aa96-44a3-9f65-312889a61ea7 tempest-VolumesActionsTest-1687831653 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 19:01:20 devstack cinder-volume[84538]: DEBUG oslo_concurrency.lockutils [None req-d3fd9f6b-aa96-44a3-9f65-312889a61ea7 tempest-VolumesActionsTest-1687831653 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=84538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 19:01:20 devstack cinder-volume[84538]: DEBUG cinder.volume.drivers.quobyte [None req-d3fd9f6b-aa96-44a3-9f65-312889a61ea7 tempest-VolumesActionsTest-1687831653 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-34312b00-dd6d-45bb-af98-75855cea8e48': None} {{(pid=84538) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 19:01:20 devstack cinder-volume[84538]: DEBUG cinder.volume.drivers.quobyte [None req-d3fd9f6b-aa96-44a3-9f65-312889a61ea7 tempest-VolumesActionsTest-1687831653 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-34312b00-dd6d-45bb-af98-75855cea8e48'] {{(pid=84538) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 19:01:20 devstack cinder-volume[84538]: DEBUG oslo_concurrency.lockutils [None req-d3fd9f6b-aa96-44a3-9f65-312889a61ea7 tempest-VolumesActionsTest-1687831653 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=84538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 19:01:20 devstack cinder-volume[84538]: DEBUG cinder.volume.drivers.quobyte [None req-d3fd9f6b-aa96-44a3-9f65-312889a61ea7 tempest-VolumesActionsTest-1687831653 None] Selected osci02.corp.quobyte.com/cinder-vol-34312b00-dd6d-45bb-af98-75855cea8e48 as target Quobyte volume. {{(pid=84538) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 29 19:01:20 devstack cinder-volume[84538]: INFO cinder.volume.drivers.remotefs [None req-d3fd9f6b-aa96-44a3-9f65-312889a61ea7 tempest-VolumesActionsTest-1687831653 None] casted to osci02.corp.quobyte.com/cinder-vol-34312b00-dd6d-45bb-af98-75855cea8e48 Apr 29 19:01:20 devstack cinder-volume[84538]: DEBUG oslo_concurrency.processutils [None req-d3fd9f6b-aa96-44a3-9f65-312889a61ea7 tempest-VolumesActionsTest-1687831653 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-3990413b-cd16-4cfe-952d-9cccc4ee7f10 1073741824 {{(pid=84538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 19:01:20 devstack sudo[90006]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-3990413b-cd16-4cfe-952d-9cccc4ee7f10 1073741824 Apr 29 19:01:20 devstack sudo[90006]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 19:01:20 devstack cinder-volume[84538]: INFO cinder.volume.manager [None req-946fe2bd-1184-435d-b5d2-1b7494dda606 tempest-GroupsV314Test-669337307 None] Create group from source-group-49225968-4245-483a-93c1-4a147923e6c6 completed successfully. Apr 29 19:01:20 devstack sudo[90006]: pam_unix(sudo:session): session closed for user root Apr 29 19:01:20 devstack cinder-volume[84538]: DEBUG oslo_concurrency.processutils [None req-d3fd9f6b-aa96-44a3-9f65-312889a61ea7 tempest-VolumesActionsTest-1687831653 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-3990413b-cd16-4cfe-952d-9cccc4ee7f10 1073741824" returned: 0 in 0.831s {{(pid=84538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 19:01:21 devstack cinder-volume[84538]: DEBUG oslo_concurrency.processutils [None req-d3fd9f6b-aa96-44a3-9f65-312889a61ea7 tempest-VolumesActionsTest-1687831653 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-3990413b-cd16-4cfe-952d-9cccc4ee7f10 {{(pid=84538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 19:01:21 devstack sudo[90014]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-3990413b-cd16-4cfe-952d-9cccc4ee7f10 Apr 29 19:01:21 devstack sudo[90014]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 19:01:21 devstack cinder-volume[84538]: DEBUG cinder.coordination [None req-969f6195-b334-4484-9075-870b8429241f tempest-GroupsV314Test-669337307 None] Acquiring lock "cinder-quobyte-d6e91205-4536-431a-9b68-ae1d9393e89d" by "delete_volume" {{(pid=84538) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 19:01:21 devstack cinder-volume[84538]: DEBUG cinder.coordination [None req-969f6195-b334-4484-9075-870b8429241f tempest-GroupsV314Test-669337307 None] Lock "cinder-quobyte-d6e91205-4536-431a-9b68-ae1d9393e89d" acquired by "delete_volume" :: waited 0.016s {{(pid=84538) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 19:01:21 devstack cinder-volume[84538]: DEBUG oslo.privsep.daemon [-] privsep: reply[c64a4ea6-b401-426e-82ee-af0ff3b41202]: (4, 'qcow2') {{(pid=85803) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 19:01:21 devstack cinder-volume[84538]: DEBUG oslo_concurrency.processutils [None req-969f6195-b334-4484-9075-870b8429241f tempest-GroupsV314Test-669337307 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-d6e91205-4536-431a-9b68-ae1d9393e89d {{(pid=84538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 19:01:21 devstack sudo[90016]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-d6e91205-4536-431a-9b68-ae1d9393e89d Apr 29 19:01:21 devstack sudo[90016]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 19:01:21 devstack sudo[90014]: pam_unix(sudo:session): session closed for user root Apr 29 19:01:21 devstack cinder-volume[84538]: DEBUG oslo_concurrency.processutils [None req-d3fd9f6b-aa96-44a3-9f65-312889a61ea7 tempest-VolumesActionsTest-1687831653 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-3990413b-cd16-4cfe-952d-9cccc4ee7f10" returned: 0 in 0.638s {{(pid=84538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 19:01:21 devstack cinder-volume[84538]: DEBUG cinder.volume.drivers.quobyte [None req-d3fd9f6b-aa96-44a3-9f65-312889a61ea7 tempest-VolumesActionsTest-1687831653 None] <== create_volume: return (1509ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-34312b00-dd6d-45bb-af98-75855cea8e48'} {{(pid=84538) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 29 19:01:21 devstack cinder-volume[84538]: DEBUG oslo_concurrency.lockutils [None req-d3fd9f6b-aa96-44a3-9f65-312889a61ea7 tempest-VolumesActionsTest-1687831653 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.512s {{(pid=84538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 19:01:21 devstack cinder-volume[84538]: DEBUG oslo_concurrency.lockutils [None req-a3882886-3f19-405a-803d-866ec8f0568e tempest-SnapshotMetadataTestJSON-944613313 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 16.465s {{(pid=84538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 19:01:21 devstack cinder-volume[84538]: DEBUG cinder.volume.drivers.remotefs [None req-a3882886-3f19-405a-803d-866ec8f0568e tempest-SnapshotMetadataTestJSON-944613313 None] Creating offline snapshot 88462ace-755d-4e3d-b0d4-3ef52f2cfe81 of volume 6064853c-432e-401f-9fc0-7921731f1049 {{(pid=84538) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}} Apr 29 19:01:21 devstack cinder-volume[84538]: DEBUG cinder.volume.manager [None req-d3fd9f6b-aa96-44a3-9f65-312889a61ea7 tempest-VolumesActionsTest-1687831653 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c40dd33f-a15d-4a55-81be-e560d4706047) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3990413b-cd16-4cfe-952d-9cccc4ee7f10', 'volume_size': 1}' {{(pid=84538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 19:01:21 devstack cinder-volume[84538]: DEBUG cinder.volume.manager [None req-d3fd9f6b-aa96-44a3-9f65-312889a61ea7 tempest-VolumesActionsTest-1687831653 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b8df7ee4-f1d2-49ed-85f6-19e8ddaaf0a2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 19:01:21 devstack cinder-volume[84538]: DEBUG oslo.privsep.daemon [-] privsep: reply[babf185e-93e0-4edb-86a5-eefc8187ea3a]: (4, 'qcow2') {{(pid=85803) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 19:01:21 devstack cinder-volume[84538]: DEBUG oslo_concurrency.processutils [None req-a3882886-3f19-405a-803d-866ec8f0568e tempest-SnapshotMetadataTestJSON-944613313 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-6064853c-432e-401f-9fc0-7921731f1049 {{(pid=84538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 19:01:21 devstack cinder-volume[84538]: INFO cinder.volume.flows.manager.create_volume [None req-d3fd9f6b-aa96-44a3-9f65-312889a61ea7 tempest-VolumesActionsTest-1687831653 None] Volume volume-3990413b-cd16-4cfe-952d-9cccc4ee7f10 (3990413b-cd16-4cfe-952d-9cccc4ee7f10): created successfully Apr 29 19:01:21 devstack cinder-volume[84538]: DEBUG cinder.volume.manager [None req-d3fd9f6b-aa96-44a3-9f65-312889a61ea7 tempest-VolumesActionsTest-1687831653 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b8df7ee4-f1d2-49ed-85f6-19e8ddaaf0a2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 19:01:21 devstack cinder-volume[84538]: DEBUG cinder.volume.manager [None req-d3fd9f6b-aa96-44a3-9f65-312889a61ea7 tempest-VolumesActionsTest-1687831653 None] Flow 'volume_create_manager' (8bbf22ed-ee0f-4456-9135-d9788df7811a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84538) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 19:01:21 devstack cinder-volume[84538]: INFO cinder.volume.manager [None req-d3fd9f6b-aa96-44a3-9f65-312889a61ea7 tempest-VolumesActionsTest-1687831653 None] Created volume successfully. Apr 29 19:01:21 devstack sudo[90019]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-6064853c-432e-401f-9fc0-7921731f1049 Apr 29 19:01:21 devstack sudo[90019]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 19:01:21 devstack sudo[90016]: pam_unix(sudo:session): session closed for user root Apr 29 19:01:21 devstack cinder-volume[84538]: DEBUG oslo_concurrency.processutils [None req-969f6195-b334-4484-9075-870b8429241f tempest-GroupsV314Test-669337307 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-d6e91205-4536-431a-9b68-ae1d9393e89d" returned: 0 in 0.764s {{(pid=84538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 19:01:21 devstack cinder-volume[84538]: DEBUG oslo_concurrency.processutils [None req-969f6195-b334-4484-9075-870b8429241f tempest-GroupsV314Test-669337307 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-d6e91205-4536-431a-9b68-ae1d9393e89d {{(pid=84538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 19:01:21 devstack sudo[90025]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-d6e91205-4536-431a-9b68-ae1d9393e89d Apr 29 19:01:21 devstack sudo[90025]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 19:01:22 devstack sudo[90019]: pam_unix(sudo:session): session closed for user root Apr 29 19:01:22 devstack cinder-volume[84538]: DEBUG oslo_concurrency.processutils [None req-a3882886-3f19-405a-803d-866ec8f0568e tempest-SnapshotMetadataTestJSON-944613313 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-6064853c-432e-401f-9fc0-7921731f1049" returned: 0 in 0.699s {{(pid=84538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 19:01:22 devstack cinder-volume[84538]: DEBUG oslo_concurrency.processutils [None req-a3882886-3f19-405a-803d-866ec8f0568e tempest-SnapshotMetadataTestJSON-944613313 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-6064853c-432e-401f-9fc0-7921731f1049,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-6064853c-432e-401f-9fc0-7921731f1049.88462ace-755d-4e3d-b0d4-3ef52f2cfe81 1G {{(pid=84538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 19:01:22 devstack sudo[90031]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-6064853c-432e-401f-9fc0-7921731f1049,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-6064853c-432e-401f-9fc0-7921731f1049.88462ace-755d-4e3d-b0d4-3ef52f2cfe81 1G Apr 29 19:01:22 devstack sudo[90031]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 19:01:22 devstack sudo[90025]: pam_unix(sudo:session): session closed for user root Apr 29 19:01:22 devstack cinder-volume[84538]: DEBUG oslo_concurrency.processutils [None req-969f6195-b334-4484-9075-870b8429241f tempest-GroupsV314Test-669337307 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-d6e91205-4536-431a-9b68-ae1d9393e89d" returned: 0 in 0.620s {{(pid=84538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 19:01:22 devstack cinder-volume[84538]: DEBUG cinder.coordination [None req-969f6195-b334-4484-9075-870b8429241f tempest-GroupsV314Test-669337307 None] Lock "cinder-quobyte-d6e91205-4536-431a-9b68-ae1d9393e89d" released by "delete_volume" :: held 1.437s {{(pid=84538) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 19:01:22 devstack cinder-volume[84538]: DEBUG cinder.quota [None req-969f6195-b334-4484-9075-870b8429241f tempest-GroupsV314Test-669337307 None] Created reservations ['fed4624d-f7b9-4dd1-b15d-acc997f45178'] {{(pid=84538) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 29 19:01:22 devstack cinder-volume[84538]: WARNING cinder.quota [None req-969f6195-b334-4484-9075-870b8429241f tempest-GroupsV314Test-669337307 None] Deprecated: Default quota for resource: volumes_tempest-GroupsV314Test-volume-type-1059278001 is set by the default quota flag: quota_volumes_tempest-GroupsV314Test-volume-type-1059278001, it is now deprecated. Please use the default quota class for default quota. Apr 29 19:01:22 devstack cinder-volume[84538]: WARNING cinder.quota [None req-969f6195-b334-4484-9075-870b8429241f tempest-GroupsV314Test-669337307 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupsV314Test-volume-type-1059278001 is set by the default quota flag: quota_gigabytes_tempest-GroupsV314Test-volume-type-1059278001, it is now deprecated. Please use the default quota class for default quota. Apr 29 19:01:22 devstack cinder-volume[84538]: DEBUG cinder.quota [None req-969f6195-b334-4484-9075-870b8429241f tempest-GroupsV314Test-669337307 None] Created reservations ['2c1e5bb7-f750-47d6-8d12-e880802254ac', 'ab806527-ab83-4deb-9446-b1cd6c841a10', 'fe25e2c1-1eda-442a-a2fe-075f33be8918', '0ca9b63a-6bfb-4fdd-b3a0-3e5d5a6a1486'] {{(pid=84538) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 29 19:01:22 devstack cinder-volume[84538]: DEBUG oslo_concurrency.lockutils [None req-969f6195-b334-4484-9075-870b8429241f tempest-GroupsV314Test-669337307 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 19:01:22 devstack cinder-volume[84538]: DEBUG oslo_concurrency.lockutils [None req-969f6195-b334-4484-9075-870b8429241f tempest-GroupsV314Test-669337307 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 19:01:22 devstack cinder-volume[84538]: DEBUG cinder.volume.drivers.quobyte [None req-969f6195-b334-4484-9075-870b8429241f tempest-GroupsV314Test-669337307 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-34312b00-dd6d-45bb-af98-75855cea8e48': None} {{(pid=84538) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 19:01:22 devstack cinder-volume[84538]: DEBUG cinder.volume.drivers.quobyte [None req-969f6195-b334-4484-9075-870b8429241f tempest-GroupsV314Test-669337307 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-34312b00-dd6d-45bb-af98-75855cea8e48'] {{(pid=84538) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 19:01:22 devstack cinder-volume[84538]: DEBUG oslo_concurrency.lockutils [None req-969f6195-b334-4484-9075-870b8429241f tempest-GroupsV314Test-669337307 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=84538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 19:01:22 devstack cinder-volume[84538]: DEBUG oslo_concurrency.processutils [None req-969f6195-b334-4484-9075-870b8429241f tempest-GroupsV314Test-669337307 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d {{(pid=84538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 19:01:22 devstack sudo[90033]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d Apr 29 19:01:22 devstack sudo[90033]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 19:01:22 devstack cinder-volume[84538]: DEBUG cinder.coordination [None req-995ee156-529f-49ae-92f7-c23f45eae7cb tempest-VolumesActionsTest-927532498 None] Acquiring lock "cinder-3990413b-cd16-4cfe-952d-9cccc4ee7f10-delete_volume" by "delete_volume" {{(pid=84538) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 19:01:22 devstack cinder-volume[84538]: DEBUG cinder.coordination [None req-995ee156-529f-49ae-92f7-c23f45eae7cb tempest-VolumesActionsTest-927532498 None] Lock "cinder-3990413b-cd16-4cfe-952d-9cccc4ee7f10-delete_volume" acquired by "delete_volume" :: waited 0.035s {{(pid=84538) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 19:01:23 devstack cinder-volume[84538]: DEBUG cinder.coordination [None req-995ee156-529f-49ae-92f7-c23f45eae7cb tempest-VolumesActionsTest-927532498 None] Acquiring lock "cinder-quobyte-3990413b-cd16-4cfe-952d-9cccc4ee7f10" by "delete_volume" {{(pid=84538) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 19:01:23 devstack cinder-volume[84538]: DEBUG cinder.coordination [None req-995ee156-529f-49ae-92f7-c23f45eae7cb tempest-VolumesActionsTest-927532498 None] Lock "cinder-quobyte-3990413b-cd16-4cfe-952d-9cccc4ee7f10" acquired by "delete_volume" :: waited 0.017s {{(pid=84538) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 19:01:23 devstack cinder-volume[84538]: DEBUG oslo.privsep.daemon [-] privsep: reply[13c88943-9f33-47f5-8982-65fe1ad73428]: (4, 'qcow2') {{(pid=85803) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 19:01:23 devstack cinder-volume[84538]: DEBUG oslo_concurrency.processutils [None req-995ee156-529f-49ae-92f7-c23f45eae7cb tempest-VolumesActionsTest-927532498 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-3990413b-cd16-4cfe-952d-9cccc4ee7f10 {{(pid=84538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 19:01:23 devstack sudo[90038]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-3990413b-cd16-4cfe-952d-9cccc4ee7f10 Apr 29 19:01:23 devstack sudo[90038]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 19:01:23 devstack sudo[90031]: pam_unix(sudo:session): session closed for user root Apr 29 19:01:23 devstack cinder-volume[84538]: DEBUG oslo_concurrency.processutils [None req-a3882886-3f19-405a-803d-866ec8f0568e tempest-SnapshotMetadataTestJSON-944613313 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-6064853c-432e-401f-9fc0-7921731f1049,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-6064853c-432e-401f-9fc0-7921731f1049.88462ace-755d-4e3d-b0d4-3ef52f2cfe81 1G" returned: 0 in 0.851s {{(pid=84538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 19:01:23 devstack cinder-volume[84538]: DEBUG oslo_concurrency.processutils [None req-a3882886-3f19-405a-803d-866ec8f0568e tempest-SnapshotMetadataTestJSON-944613313 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6064853c-432e-401f-9fc0-7921731f1049 -F qcow2 /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-6064853c-432e-401f-9fc0-7921731f1049.88462ace-755d-4e3d-b0d4-3ef52f2cfe81 {{(pid=84538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 19:01:23 devstack sudo[90040]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6064853c-432e-401f-9fc0-7921731f1049 -F qcow2 /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-6064853c-432e-401f-9fc0-7921731f1049.88462ace-755d-4e3d-b0d4-3ef52f2cfe81 Apr 29 19:01:23 devstack sudo[90040]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 19:01:23 devstack sudo[90033]: pam_unix(sudo:session): session closed for user root Apr 29 19:01:23 devstack cinder-volume[84538]: DEBUG oslo_concurrency.processutils [None req-969f6195-b334-4484-9075-870b8429241f tempest-GroupsV314Test-669337307 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d" returned: 0 in 0.732s {{(pid=84538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 19:01:23 devstack cinder-volume[84538]: DEBUG cinder.manager [None req-969f6195-b334-4484-9075-870b8429241f tempest-GroupsV314Test-669337307 None] Notifying Schedulers of capabilities ... {{(pid=84538) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 29 19:01:23 devstack cinder-volume[84538]: INFO cinder.volume.manager [None req-969f6195-b334-4484-9075-870b8429241f tempest-GroupsV314Test-669337307 None] Delete group completed successfully. Apr 29 19:01:23 devstack cinder-volume[84538]: DEBUG cinder.coordination [None req-fd8d5c63-66aa-4e40-86b0-34c6b1f2f8d4 tempest-GroupsV314Test-669337307 None] Acquiring lock "cinder-quobyte-bb883f83-2cb7-4bf9-979f-03d3f29cbd7a" by "delete_volume" {{(pid=84538) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 19:01:23 devstack cinder-volume[84538]: DEBUG cinder.coordination [None req-fd8d5c63-66aa-4e40-86b0-34c6b1f2f8d4 tempest-GroupsV314Test-669337307 None] Lock "cinder-quobyte-bb883f83-2cb7-4bf9-979f-03d3f29cbd7a" acquired by "delete_volume" :: waited 0.019s {{(pid=84538) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 19:01:23 devstack cinder-volume[84538]: DEBUG oslo.privsep.daemon [-] privsep: reply[c5d48540-e7a1-4756-afbc-7ec263cafcfa]: (4, 'qcow2') {{(pid=85803) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 19:01:23 devstack cinder-volume[84538]: DEBUG oslo_concurrency.processutils [None req-fd8d5c63-66aa-4e40-86b0-34c6b1f2f8d4 tempest-GroupsV314Test-669337307 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-bb883f83-2cb7-4bf9-979f-03d3f29cbd7a {{(pid=84538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 19:01:23 devstack sudo[90043]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-bb883f83-2cb7-4bf9-979f-03d3f29cbd7a Apr 29 19:01:23 devstack sudo[90043]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 19:01:23 devstack sudo[90038]: pam_unix(sudo:session): session closed for user root Apr 29 19:01:23 devstack cinder-volume[84538]: DEBUG oslo_concurrency.processutils [None req-995ee156-529f-49ae-92f7-c23f45eae7cb tempest-VolumesActionsTest-927532498 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-3990413b-cd16-4cfe-952d-9cccc4ee7f10" returned: 0 in 0.793s {{(pid=84538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 19:01:23 devstack cinder-volume[84538]: DEBUG oslo_concurrency.processutils [None req-995ee156-529f-49ae-92f7-c23f45eae7cb tempest-VolumesActionsTest-927532498 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-3990413b-cd16-4cfe-952d-9cccc4ee7f10 {{(pid=84538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 19:01:23 devstack sudo[90051]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-3990413b-cd16-4cfe-952d-9cccc4ee7f10 Apr 29 19:01:23 devstack sudo[90051]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 19:01:23 devstack sudo[90040]: pam_unix(sudo:session): session closed for user root Apr 29 19:01:23 devstack cinder-volume[84538]: DEBUG oslo_concurrency.processutils [None req-a3882886-3f19-405a-803d-866ec8f0568e tempest-SnapshotMetadataTestJSON-944613313 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6064853c-432e-401f-9fc0-7921731f1049 -F qcow2 /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-6064853c-432e-401f-9fc0-7921731f1049.88462ace-755d-4e3d-b0d4-3ef52f2cfe81" returned: 0 in 0.709s {{(pid=84538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 19:01:23 devstack cinder-volume[84538]: WARNING cinder.volume.drivers.remotefs [None req-a3882886-3f19-405a-803d-866ec8f0568e tempest-SnapshotMetadataTestJSON-944613313 None] /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-6064853c-432e-401f-9fc0-7921731f1049.88462ace-755d-4e3d-b0d4-3ef52f2cfe81 is being set with open permissions: ugo+rw Apr 29 19:01:23 devstack cinder-volume[84538]: DEBUG oslo_concurrency.processutils [None req-a3882886-3f19-405a-803d-866ec8f0568e tempest-SnapshotMetadataTestJSON-944613313 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-6064853c-432e-401f-9fc0-7921731f1049.88462ace-755d-4e3d-b0d4-3ef52f2cfe81 {{(pid=84538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 19:01:24 devstack sudo[90053]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-6064853c-432e-401f-9fc0-7921731f1049.88462ace-755d-4e3d-b0d4-3ef52f2cfe81 Apr 29 19:01:24 devstack sudo[90053]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 19:01:24 devstack sudo[90043]: pam_unix(sudo:session): session closed for user root Apr 29 19:01:24 devstack cinder-volume[84538]: DEBUG oslo_concurrency.processutils [None req-fd8d5c63-66aa-4e40-86b0-34c6b1f2f8d4 tempest-GroupsV314Test-669337307 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-bb883f83-2cb7-4bf9-979f-03d3f29cbd7a" returned: 0 in 0.769s {{(pid=84538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 19:01:24 devstack cinder-volume[84538]: DEBUG oslo_concurrency.processutils [None req-fd8d5c63-66aa-4e40-86b0-34c6b1f2f8d4 tempest-GroupsV314Test-669337307 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-bb883f83-2cb7-4bf9-979f-03d3f29cbd7a {{(pid=84538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 19:01:24 devstack sudo[90058]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-bb883f83-2cb7-4bf9-979f-03d3f29cbd7a Apr 29 19:01:24 devstack sudo[90058]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 19:01:24 devstack sudo[90051]: pam_unix(sudo:session): session closed for user root Apr 29 19:01:24 devstack cinder-volume[84538]: DEBUG oslo_concurrency.processutils [None req-995ee156-529f-49ae-92f7-c23f45eae7cb tempest-VolumesActionsTest-927532498 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-3990413b-cd16-4cfe-952d-9cccc4ee7f10" returned: 0 in 0.666s {{(pid=84538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 19:01:24 devstack cinder-volume[84538]: DEBUG cinder.coordination [None req-995ee156-529f-49ae-92f7-c23f45eae7cb tempest-VolumesActionsTest-927532498 None] Lock "cinder-quobyte-3990413b-cd16-4cfe-952d-9cccc4ee7f10" released by "delete_volume" :: held 1.501s {{(pid=84538) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 19:01:24 devstack cinder-volume[84538]: DEBUG cinder.quota [None req-995ee156-529f-49ae-92f7-c23f45eae7cb tempest-VolumesActionsTest-927532498 None] Created reservations ['19f7b605-18f5-41c9-b5c9-871901ae47c4', '6eaa64bb-eb54-41f4-b233-8bda6a191362', 'cbf07f2d-4908-48a5-aff8-8113b8dcc7a8', '87107bf1-8d41-41c5-9718-8cd3381da147'] {{(pid=84538) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 29 19:01:24 devstack sudo[90053]: pam_unix(sudo:session): session closed for user root Apr 29 19:01:24 devstack cinder-volume[84538]: DEBUG oslo_concurrency.processutils [None req-a3882886-3f19-405a-803d-866ec8f0568e tempest-SnapshotMetadataTestJSON-944613313 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-6064853c-432e-401f-9fc0-7921731f1049.88462ace-755d-4e3d-b0d4-3ef52f2cfe81" returned: 0 in 0.621s {{(pid=84538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 19:01:24 devstack cinder-volume[84538]: DEBUG oslo_concurrency.processutils [None req-a3882886-3f19-405a-803d-866ec8f0568e tempest-SnapshotMetadataTestJSON-944613313 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-6064853c-432e-401f-9fc0-7921731f1049.info {{(pid=84538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 19:01:24 devstack sudo[90062]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-6064853c-432e-401f-9fc0-7921731f1049.info Apr 29 19:01:24 devstack sudo[90062]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 19:01:24 devstack cinder-volume[84538]: DEBUG oslo_concurrency.lockutils [None req-995ee156-529f-49ae-92f7-c23f45eae7cb tempest-VolumesActionsTest-927532498 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 19:01:24 devstack cinder-volume[84538]: DEBUG oslo_concurrency.lockutils [None req-995ee156-529f-49ae-92f7-c23f45eae7cb tempest-VolumesActionsTest-927532498 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=84538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 19:01:24 devstack cinder-volume[84538]: DEBUG cinder.volume.drivers.quobyte [None req-995ee156-529f-49ae-92f7-c23f45eae7cb tempest-VolumesActionsTest-927532498 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-34312b00-dd6d-45bb-af98-75855cea8e48': None} {{(pid=84538) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 19:01:24 devstack cinder-volume[84538]: DEBUG cinder.volume.drivers.quobyte [None req-995ee156-529f-49ae-92f7-c23f45eae7cb tempest-VolumesActionsTest-927532498 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-34312b00-dd6d-45bb-af98-75855cea8e48'] {{(pid=84538) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 19:01:24 devstack cinder-volume[84538]: DEBUG oslo_concurrency.lockutils [None req-995ee156-529f-49ae-92f7-c23f45eae7cb tempest-VolumesActionsTest-927532498 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=84538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 19:01:24 devstack cinder-volume[84538]: DEBUG oslo_concurrency.processutils [None req-995ee156-529f-49ae-92f7-c23f45eae7cb tempest-VolumesActionsTest-927532498 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d {{(pid=84538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 19:01:24 devstack sudo[90064]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d Apr 29 19:01:24 devstack sudo[90064]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 19:01:25 devstack sudo[90058]: pam_unix(sudo:session): session closed for user root Apr 29 19:01:25 devstack cinder-volume[84538]: DEBUG oslo_concurrency.processutils [None req-fd8d5c63-66aa-4e40-86b0-34c6b1f2f8d4 tempest-GroupsV314Test-669337307 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-bb883f83-2cb7-4bf9-979f-03d3f29cbd7a" returned: 0 in 0.637s {{(pid=84538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 19:01:25 devstack cinder-volume[84538]: DEBUG cinder.coordination [None req-fd8d5c63-66aa-4e40-86b0-34c6b1f2f8d4 tempest-GroupsV314Test-669337307 None] Lock "cinder-quobyte-bb883f83-2cb7-4bf9-979f-03d3f29cbd7a" released by "delete_volume" :: held 1.471s {{(pid=84538) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 19:01:25 devstack cinder-volume[84538]: DEBUG oslo_service.periodic_task [None req-a93183a6-1080-461c-84de-2fcb210d4f60 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=84538) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}} Apr 29 19:01:25 devstack cinder-volume[84538]: DEBUG oslo_concurrency.lockutils [None req-a93183a6-1080-461c-84de-2fcb210d4f60 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 19:01:25 devstack cinder-volume[84538]: DEBUG oslo_concurrency.lockutils [None req-a93183a6-1080-461c-84de-2fcb210d4f60 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=84538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 19:01:25 devstack cinder-volume[84538]: DEBUG cinder.volume.drivers.quobyte [None req-a93183a6-1080-461c-84de-2fcb210d4f60 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-34312b00-dd6d-45bb-af98-75855cea8e48': None} {{(pid=84538) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 19:01:25 devstack cinder-volume[84538]: DEBUG cinder.volume.drivers.quobyte [None req-a93183a6-1080-461c-84de-2fcb210d4f60 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-34312b00-dd6d-45bb-af98-75855cea8e48'] {{(pid=84538) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 19:01:25 devstack cinder-volume[84538]: DEBUG oslo_concurrency.lockutils [None req-a93183a6-1080-461c-84de-2fcb210d4f60 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=84538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 19:01:25 devstack cinder-volume[84538]: DEBUG oslo_concurrency.processutils [None req-a93183a6-1080-461c-84de-2fcb210d4f60 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d {{(pid=84538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 19:01:25 devstack cinder-volume[84538]: DEBUG cinder.quota [None req-fd8d5c63-66aa-4e40-86b0-34c6b1f2f8d4 tempest-GroupsV314Test-669337307 None] Created reservations ['a2d726c9-3fce-4b4c-8164-794a4771ee8d'] {{(pid=84538) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 29 19:01:25 devstack sudo[90067]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d Apr 29 19:01:25 devstack sudo[90067]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 19:01:25 devstack cinder-volume[84538]: DEBUG cinder.quota [None req-fd8d5c63-66aa-4e40-86b0-34c6b1f2f8d4 tempest-GroupsV314Test-669337307 None] Created reservations ['41b80e3c-6e33-41fb-9ae7-6625daf371fd', '9a8c7e30-fc37-4a28-aebb-07474deda889', '31c3ac27-9a64-48c4-a288-eb2a0f445395', 'd88fd832-6073-471b-8377-28cfc4ff511d'] {{(pid=84538) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 29 19:01:25 devstack cinder-volume[84538]: DEBUG oslo_concurrency.lockutils [None req-fd8d5c63-66aa-4e40-86b0-34c6b1f2f8d4 tempest-GroupsV314Test-669337307 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 19:01:25 devstack cinder-volume[84538]: DEBUG oslo_concurrency.lockutils [None req-fd8d5c63-66aa-4e40-86b0-34c6b1f2f8d4 tempest-GroupsV314Test-669337307 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 19:01:25 devstack cinder-volume[84538]: DEBUG cinder.volume.drivers.quobyte [None req-fd8d5c63-66aa-4e40-86b0-34c6b1f2f8d4 tempest-GroupsV314Test-669337307 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-34312b00-dd6d-45bb-af98-75855cea8e48': None} {{(pid=84538) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 19:01:25 devstack cinder-volume[84538]: DEBUG cinder.volume.drivers.quobyte [None req-fd8d5c63-66aa-4e40-86b0-34c6b1f2f8d4 tempest-GroupsV314Test-669337307 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-34312b00-dd6d-45bb-af98-75855cea8e48'] {{(pid=84538) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 19:01:25 devstack cinder-volume[84538]: DEBUG oslo_concurrency.lockutils [None req-fd8d5c63-66aa-4e40-86b0-34c6b1f2f8d4 tempest-GroupsV314Test-669337307 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=84538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 19:01:25 devstack cinder-volume[84538]: DEBUG oslo_concurrency.processutils [None req-fd8d5c63-66aa-4e40-86b0-34c6b1f2f8d4 tempest-GroupsV314Test-669337307 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d {{(pid=84538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 19:01:25 devstack sudo[90062]: pam_unix(sudo:session): session closed for user root Apr 29 19:01:25 devstack cinder-volume[84538]: DEBUG oslo_concurrency.processutils [None req-a3882886-3f19-405a-803d-866ec8f0568e tempest-SnapshotMetadataTestJSON-944613313 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-6064853c-432e-401f-9fc0-7921731f1049.info" returned: 0 in 0.759s {{(pid=84538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 19:01:25 devstack cinder-volume[84538]: WARNING cinder.volume.drivers.remotefs [None req-a3882886-3f19-405a-803d-866ec8f0568e tempest-SnapshotMetadataTestJSON-944613313 None] /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-6064853c-432e-401f-9fc0-7921731f1049.info is being set with open permissions: ugo+rw Apr 29 19:01:25 devstack cinder-volume[84538]: DEBUG oslo_concurrency.processutils [None req-a3882886-3f19-405a-803d-866ec8f0568e tempest-SnapshotMetadataTestJSON-944613313 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-6064853c-432e-401f-9fc0-7921731f1049.info {{(pid=84538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 19:01:25 devstack sudo[90064]: pam_unix(sudo:session): session closed for user root Apr 29 19:01:25 devstack sudo[90071]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d Apr 29 19:01:25 devstack sudo[90071]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 19:01:25 devstack cinder-volume[84538]: DEBUG oslo_concurrency.processutils [None req-995ee156-529f-49ae-92f7-c23f45eae7cb tempest-VolumesActionsTest-927532498 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d" returned: 0 in 0.725s {{(pid=84538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 19:01:25 devstack cinder-volume[84538]: DEBUG cinder.manager [None req-995ee156-529f-49ae-92f7-c23f45eae7cb tempest-VolumesActionsTest-927532498 None] Notifying Schedulers of capabilities ... {{(pid=84538) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 29 19:01:25 devstack cinder-volume[84538]: INFO cinder.volume.manager [None req-995ee156-529f-49ae-92f7-c23f45eae7cb tempest-VolumesActionsTest-927532498 None] Deleted volume successfully. Apr 29 19:01:25 devstack sudo[90072]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-6064853c-432e-401f-9fc0-7921731f1049.info Apr 29 19:01:25 devstack sudo[90072]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 19:01:25 devstack cinder-volume[84538]: DEBUG cinder.coordination [None req-995ee156-529f-49ae-92f7-c23f45eae7cb tempest-VolumesActionsTest-927532498 None] Lock "cinder-3990413b-cd16-4cfe-952d-9cccc4ee7f10-delete_volume" released by "delete_volume" :: held 2.512s {{(pid=84538) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 19:01:25 devstack cinder-volume[84538]: DEBUG cinder.volume.flows.manager.create_volume [None req-032fa0ae-c40e-4320-a902-769d11feb40e tempest-VolumesActionsTest-1687831653 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84538) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Apr 29 19:01:25 devstack cinder-volume[84538]: DEBUG cinder.volume.manager [None req-032fa0ae-c40e-4320-a902-769d11feb40e tempest-VolumesActionsTest-1687831653 None] Flow 'volume_create_manager' (f2525ded-4db2-4fb7-8b41-3cbf62d1f921) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84538) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 19:01:25 devstack cinder-volume[84538]: DEBUG cinder.volume.manager [None req-032fa0ae-c40e-4320-a902-769d11feb40e tempest-VolumesActionsTest-1687831653 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b1be091a-a52b-4ec4-adf6-08281ecf712c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 19:01:25 devstack cinder-volume[84538]: DEBUG cinder.volume.manager [None req-032fa0ae-c40e-4320-a902-769d11feb40e tempest-VolumesActionsTest-1687831653 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b1be091a-a52b-4ec4-adf6-08281ecf712c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-29T17:01:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-2115674412',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c8d3a270-1ee1-494a-97cd-74c697f277b4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a39f1f9e4e364982af869dd2b24dfe70',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T17:01:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T17:01:26Z,use_quota=True,user_id='0feaa082ee4740958e7eb31611d1e836',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(62b05900-93e3-4190-a88f-1d87324303d1),volume_type_id=62b05900-93e3-4190-a88f-1d87324303d1)' {{(pid=84538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 19:01:25 devstack cinder-volume[84538]: DEBUG cinder.volume.manager [None req-032fa0ae-c40e-4320-a902-769d11feb40e tempest-VolumesActionsTest-1687831653 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (25f3dc17-b323-414f-b7b7-a5278a702ea4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 19:01:25 devstack cinder-volume[84538]: DEBUG cinder.volume.manager [None req-032fa0ae-c40e-4320-a902-769d11feb40e tempest-VolumesActionsTest-1687831653 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (25f3dc17-b323-414f-b7b7-a5278a702ea4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 19:01:25 devstack cinder-volume[84538]: DEBUG cinder.volume.manager [None req-032fa0ae-c40e-4320-a902-769d11feb40e tempest-VolumesActionsTest-1687831653 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9ccfc57f-ffb4-4c8a-b508-0e4dcc5566e8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 19:01:25 devstack cinder-volume[84538]: DEBUG cinder.volume.manager [None req-032fa0ae-c40e-4320-a902-769d11feb40e tempest-VolumesActionsTest-1687831653 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9ccfc57f-ffb4-4c8a-b508-0e4dcc5566e8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c8d3a270-1ee1-494a-97cd-74c697f277b4', 'volume_name': 'volume-c8d3a270-1ee1-494a-97cd-74c697f277b4', 'volume_size': 1}' {{(pid=84538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 19:01:25 devstack cinder-volume[84538]: DEBUG cinder.volume.manager [None req-032fa0ae-c40e-4320-a902-769d11feb40e tempest-VolumesActionsTest-1687831653 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (03202d41-f05f-4914-9c06-02637e4dee07) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 19:01:25 devstack cinder-volume[84538]: DEBUG cinder.volume.manager [None req-032fa0ae-c40e-4320-a902-769d11feb40e tempest-VolumesActionsTest-1687831653 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (03202d41-f05f-4914-9c06-02637e4dee07) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 19:01:25 devstack cinder-volume[84538]: DEBUG cinder.volume.manager [None req-032fa0ae-c40e-4320-a902-769d11feb40e tempest-VolumesActionsTest-1687831653 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f9c10d82-1d6c-4ebd-ae94-7e253ed4f9cd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 19:01:25 devstack cinder-volume[84538]: INFO cinder.volume.flows.manager.create_volume [None req-032fa0ae-c40e-4320-a902-769d11feb40e tempest-VolumesActionsTest-1687831653 None] Volume c8d3a270-1ee1-494a-97cd-74c697f277b4: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c8d3a270-1ee1-494a-97cd-74c697f277b4', 'volume_size': 1} Apr 29 19:01:25 devstack cinder-volume[84538]: DEBUG oslo_concurrency.lockutils [None req-032fa0ae-c40e-4320-a902-769d11feb40e tempest-VolumesActionsTest-1687831653 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 19:01:26 devstack sudo[90067]: pam_unix(sudo:session): session closed for user root Apr 29 19:01:26 devstack cinder-volume[84538]: DEBUG oslo_concurrency.processutils [None req-a93183a6-1080-461c-84de-2fcb210d4f60 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d" returned: 0 in 0.971s {{(pid=84538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 19:01:26 devstack cinder-volume[84538]: DEBUG cinder.manager [None req-a93183a6-1080-461c-84de-2fcb210d4f60 None None] Notifying Schedulers of capabilities ... {{(pid=84538) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 29 19:01:26 devstack sudo[90071]: pam_unix(sudo:session): session closed for user root Apr 29 19:01:26 devstack cinder-volume[84538]: DEBUG oslo_concurrency.processutils [None req-fd8d5c63-66aa-4e40-86b0-34c6b1f2f8d4 tempest-GroupsV314Test-669337307 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d" returned: 0 in 0.822s {{(pid=84538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 19:01:26 devstack cinder-volume[84538]: DEBUG cinder.manager [None req-fd8d5c63-66aa-4e40-86b0-34c6b1f2f8d4 tempest-GroupsV314Test-669337307 None] Notifying Schedulers of capabilities ... {{(pid=84538) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 29 19:01:26 devstack cinder-volume[84538]: INFO cinder.volume.manager [None req-fd8d5c63-66aa-4e40-86b0-34c6b1f2f8d4 tempest-GroupsV314Test-669337307 None] Delete group completed successfully. Apr 29 19:01:26 devstack sudo[90072]: pam_unix(sudo:session): session closed for user root Apr 29 19:01:26 devstack cinder-volume[84538]: DEBUG oslo_concurrency.processutils [None req-a3882886-3f19-405a-803d-866ec8f0568e tempest-SnapshotMetadataTestJSON-944613313 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-6064853c-432e-401f-9fc0-7921731f1049.info" returned: 0 in 0.809s {{(pid=84538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 19:01:26 devstack cinder-volume[84538]: DEBUG oslo_concurrency.lockutils [None req-a3882886-3f19-405a-803d-866ec8f0568e tempest-SnapshotMetadataTestJSON-944613313 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.571s {{(pid=84538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 19:01:26 devstack cinder-volume[84538]: DEBUG oslo_concurrency.lockutils [None req-0421a4b5-c8c5-4f78-a66f-2bf07161c602 tempest-GroupSnapshotsTest-1835037466 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 9.953s {{(pid=84538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 19:01:26 devstack cinder-volume[84538]: DEBUG cinder.volume.drivers.quobyte [None req-0421a4b5-c8c5-4f78-a66f-2bf07161c602 tempest-GroupSnapshotsTest-1835037466 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=dbf54acf-ba7e-4db8-8711-ba4d240c8365,created_at=2026-04-29T17:01:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1627817600',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=dbf54acf-ba7e-4db8-8711-ba4d240c8365,host='devstack@QuobyteHD#QuobyteHD',id=ce170d29-c990-4cf6-85d1-20cfda253ab6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='14dd90144b0b4dcc8def965ebf4ada62',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T17:01:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T17:01:16Z,use_quota=True,user_id='616bcc255f9c4e89963a9ff70ca5ab6c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(90d05a75-d640-4694-8a0e-e914227d84e8),volume_type_id=90d05a75-d640-4694-8a0e-e914227d84e8)}" {{(pid=84538) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 29 19:01:26 devstack cinder-volume[84538]: DEBUG cinder.volume.drivers.remotefs [None req-0421a4b5-c8c5-4f78-a66f-2bf07161c602 tempest-GroupSnapshotsTest-1835037466 None] Creating volume ce170d29-c990-4cf6-85d1-20cfda253ab6 {{(pid=84538) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 29 19:01:26 devstack cinder-volume[84538]: DEBUG oslo_concurrency.lockutils [None req-0421a4b5-c8c5-4f78-a66f-2bf07161c602 tempest-GroupSnapshotsTest-1835037466 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 19:01:26 devstack cinder-volume[84538]: DEBUG oslo_concurrency.lockutils [None req-0421a4b5-c8c5-4f78-a66f-2bf07161c602 tempest-GroupSnapshotsTest-1835037466 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=84538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 19:01:26 devstack cinder-volume[84538]: DEBUG cinder.volume.drivers.quobyte [None req-0421a4b5-c8c5-4f78-a66f-2bf07161c602 tempest-GroupSnapshotsTest-1835037466 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-34312b00-dd6d-45bb-af98-75855cea8e48': None} {{(pid=84538) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 19:01:26 devstack cinder-volume[84538]: DEBUG cinder.volume.drivers.quobyte [None req-0421a4b5-c8c5-4f78-a66f-2bf07161c602 tempest-GroupSnapshotsTest-1835037466 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-34312b00-dd6d-45bb-af98-75855cea8e48'] {{(pid=84538) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 19:01:26 devstack cinder-volume[84538]: DEBUG oslo_concurrency.lockutils [None req-0421a4b5-c8c5-4f78-a66f-2bf07161c602 tempest-GroupSnapshotsTest-1835037466 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=84538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 19:01:26 devstack cinder-volume[84538]: DEBUG cinder.volume.drivers.quobyte [None req-0421a4b5-c8c5-4f78-a66f-2bf07161c602 tempest-GroupSnapshotsTest-1835037466 None] Selected osci02.corp.quobyte.com/cinder-vol-34312b00-dd6d-45bb-af98-75855cea8e48 as target Quobyte volume. {{(pid=84538) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 29 19:01:26 devstack cinder-volume[84538]: INFO cinder.volume.drivers.remotefs [None req-0421a4b5-c8c5-4f78-a66f-2bf07161c602 tempest-GroupSnapshotsTest-1835037466 None] casted to osci02.corp.quobyte.com/cinder-vol-34312b00-dd6d-45bb-af98-75855cea8e48 Apr 29 19:01:26 devstack cinder-volume[84538]: DEBUG oslo_concurrency.processutils [None req-0421a4b5-c8c5-4f78-a66f-2bf07161c602 tempest-GroupSnapshotsTest-1835037466 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-ce170d29-c990-4cf6-85d1-20cfda253ab6 1073741824 {{(pid=84538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 19:01:26 devstack sudo[90078]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-ce170d29-c990-4cf6-85d1-20cfda253ab6 1073741824 Apr 29 19:01:26 devstack sudo[90078]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 19:01:26 devstack cinder-volume[84538]: INFO cinder.volume.manager [None req-a3882886-3f19-405a-803d-866ec8f0568e tempest-SnapshotMetadataTestJSON-944613313 None] Create snapshot completed successfully Apr 29 19:01:27 devstack sudo[90078]: pam_unix(sudo:session): session closed for user root Apr 29 19:01:27 devstack cinder-volume[84538]: DEBUG oslo_concurrency.processutils [None req-0421a4b5-c8c5-4f78-a66f-2bf07161c602 tempest-GroupSnapshotsTest-1835037466 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-ce170d29-c990-4cf6-85d1-20cfda253ab6 1073741824" returned: 0 in 0.867s {{(pid=84538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 19:01:27 devstack cinder-volume[84538]: DEBUG oslo_concurrency.processutils [None req-0421a4b5-c8c5-4f78-a66f-2bf07161c602 tempest-GroupSnapshotsTest-1835037466 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-ce170d29-c990-4cf6-85d1-20cfda253ab6 {{(pid=84538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 19:01:27 devstack sudo[90083]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-ce170d29-c990-4cf6-85d1-20cfda253ab6 Apr 29 19:01:27 devstack sudo[90083]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 19:01:27 devstack sudo[90083]: pam_unix(sudo:session): session closed for user root Apr 29 19:01:27 devstack cinder-volume[84538]: DEBUG oslo_concurrency.processutils [None req-0421a4b5-c8c5-4f78-a66f-2bf07161c602 tempest-GroupSnapshotsTest-1835037466 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-ce170d29-c990-4cf6-85d1-20cfda253ab6" returned: 0 in 0.716s {{(pid=84538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 19:01:27 devstack cinder-volume[84538]: DEBUG cinder.volume.drivers.quobyte [None req-0421a4b5-c8c5-4f78-a66f-2bf07161c602 tempest-GroupSnapshotsTest-1835037466 None] <== create_volume: return (1653ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-34312b00-dd6d-45bb-af98-75855cea8e48'} {{(pid=84538) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 29 19:01:27 devstack cinder-volume[84538]: DEBUG oslo_concurrency.lockutils [None req-0421a4b5-c8c5-4f78-a66f-2bf07161c602 tempest-GroupSnapshotsTest-1835037466 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.656s {{(pid=84538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 19:01:27 devstack cinder-volume[84538]: DEBUG oslo_concurrency.lockutils [None req-032fa0ae-c40e-4320-a902-769d11feb40e tempest-VolumesActionsTest-1687831653 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.025s {{(pid=84538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 19:01:27 devstack cinder-volume[84538]: DEBUG cinder.volume.drivers.quobyte [None req-032fa0ae-c40e-4320-a902-769d11feb40e tempest-VolumesActionsTest-1687831653 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-29T17:01:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-2115674412',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c8d3a270-1ee1-494a-97cd-74c697f277b4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a39f1f9e4e364982af869dd2b24dfe70',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T17:01:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T17:01:26Z,use_quota=True,user_id='0feaa082ee4740958e7eb31611d1e836',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(62b05900-93e3-4190-a88f-1d87324303d1),volume_type_id=62b05900-93e3-4190-a88f-1d87324303d1)}" {{(pid=84538) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 29 19:01:27 devstack cinder-volume[84538]: DEBUG cinder.volume.drivers.remotefs [None req-032fa0ae-c40e-4320-a902-769d11feb40e tempest-VolumesActionsTest-1687831653 None] Creating volume c8d3a270-1ee1-494a-97cd-74c697f277b4 {{(pid=84538) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 29 19:01:27 devstack cinder-volume[84538]: DEBUG oslo_concurrency.lockutils [None req-032fa0ae-c40e-4320-a902-769d11feb40e tempest-VolumesActionsTest-1687831653 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 19:01:27 devstack cinder-volume[84538]: DEBUG oslo_concurrency.lockutils [None req-032fa0ae-c40e-4320-a902-769d11feb40e tempest-VolumesActionsTest-1687831653 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 19:01:27 devstack cinder-volume[84538]: DEBUG cinder.volume.drivers.quobyte [None req-032fa0ae-c40e-4320-a902-769d11feb40e tempest-VolumesActionsTest-1687831653 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-34312b00-dd6d-45bb-af98-75855cea8e48': None} {{(pid=84538) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 19:01:27 devstack cinder-volume[84538]: DEBUG cinder.volume.drivers.quobyte [None req-032fa0ae-c40e-4320-a902-769d11feb40e tempest-VolumesActionsTest-1687831653 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-34312b00-dd6d-45bb-af98-75855cea8e48'] {{(pid=84538) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 19:01:27 devstack cinder-volume[84538]: DEBUG oslo_concurrency.lockutils [None req-032fa0ae-c40e-4320-a902-769d11feb40e tempest-VolumesActionsTest-1687831653 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=84538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 19:01:27 devstack cinder-volume[84538]: DEBUG cinder.volume.drivers.quobyte [None req-032fa0ae-c40e-4320-a902-769d11feb40e tempest-VolumesActionsTest-1687831653 None] Selected osci02.corp.quobyte.com/cinder-vol-34312b00-dd6d-45bb-af98-75855cea8e48 as target Quobyte volume. {{(pid=84538) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 29 19:01:27 devstack cinder-volume[84538]: INFO cinder.volume.drivers.remotefs [None req-032fa0ae-c40e-4320-a902-769d11feb40e tempest-VolumesActionsTest-1687831653 None] casted to osci02.corp.quobyte.com/cinder-vol-34312b00-dd6d-45bb-af98-75855cea8e48 Apr 29 19:01:27 devstack cinder-volume[84538]: DEBUG oslo_concurrency.processutils [None req-032fa0ae-c40e-4320-a902-769d11feb40e tempest-VolumesActionsTest-1687831653 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-c8d3a270-1ee1-494a-97cd-74c697f277b4 1073741824 {{(pid=84538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 19:01:27 devstack cinder-volume[84538]: DEBUG cinder.coordination [None req-0c730a40-f759-4fab-859c-8a3033eabbd9 tempest-SnapshotMetadataTestJSON-944613313 None] Acquiring lock "cinder-88462ace-755d-4e3d-b0d4-3ef52f2cfe81-delete_snapshot" by "delete_snapshot" {{(pid=84538) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 19:01:27 devstack sudo[90086]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-c8d3a270-1ee1-494a-97cd-74c697f277b4 1073741824 Apr 29 19:01:27 devstack sudo[90086]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 19:01:27 devstack cinder-volume[84538]: DEBUG cinder.volume.manager [None req-0421a4b5-c8c5-4f78-a66f-2bf07161c602 tempest-GroupSnapshotsTest-1835037466 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (95e3d6d3-574b-4b01-805d-3ad2fb58ca79) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ce170d29-c990-4cf6-85d1-20cfda253ab6', 'volume_size': 1}' {{(pid=84538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 19:01:27 devstack cinder-volume[84538]: DEBUG cinder.volume.manager [None req-0421a4b5-c8c5-4f78-a66f-2bf07161c602 tempest-GroupSnapshotsTest-1835037466 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (559a42c7-9f6e-4377-818c-7a9abef176ca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 19:01:27 devstack cinder-volume[84538]: DEBUG cinder.coordination [None req-0c730a40-f759-4fab-859c-8a3033eabbd9 tempest-SnapshotMetadataTestJSON-944613313 None] Lock "cinder-88462ace-755d-4e3d-b0d4-3ef52f2cfe81-delete_snapshot" acquired by "delete_snapshot" :: waited 0.037s {{(pid=84538) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 19:01:27 devstack cinder-volume[84538]: DEBUG cinder.coordination [None req-0c730a40-f759-4fab-859c-8a3033eabbd9 tempest-SnapshotMetadataTestJSON-944613313 None] Acquiring lock "cinder-quobyte-6064853c-432e-401f-9fc0-7921731f1049" by "delete_snapshot" {{(pid=84538) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 19:01:27 devstack cinder-volume[84538]: INFO cinder.volume.flows.manager.create_volume [None req-0421a4b5-c8c5-4f78-a66f-2bf07161c602 tempest-GroupSnapshotsTest-1835037466 None] Volume volume-ce170d29-c990-4cf6-85d1-20cfda253ab6 (ce170d29-c990-4cf6-85d1-20cfda253ab6): created successfully Apr 29 19:01:27 devstack cinder-volume[84538]: DEBUG cinder.volume.manager [None req-0421a4b5-c8c5-4f78-a66f-2bf07161c602 tempest-GroupSnapshotsTest-1835037466 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (559a42c7-9f6e-4377-818c-7a9abef176ca) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 19:01:27 devstack cinder-volume[84538]: DEBUG cinder.volume.manager [None req-0421a4b5-c8c5-4f78-a66f-2bf07161c602 tempest-GroupSnapshotsTest-1835037466 None] Flow 'volume_create_manager' (e346d205-7bd9-4354-a1ba-8b0fc854ee4f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84538) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 19:01:28 devstack cinder-volume[84538]: DEBUG cinder.coordination [None req-0c730a40-f759-4fab-859c-8a3033eabbd9 tempest-SnapshotMetadataTestJSON-944613313 None] Lock "cinder-quobyte-6064853c-432e-401f-9fc0-7921731f1049" acquired by "delete_snapshot" :: waited 0.041s {{(pid=84538) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 19:01:28 devstack cinder-volume[84538]: DEBUG cinder.coordination [None req-0c730a40-f759-4fab-859c-8a3033eabbd9 tempest-SnapshotMetadataTestJSON-944613313 None] Acquiring lock "cinder-quobyte-88462ace-755d-4e3d-b0d4-3ef52f2cfe81" by "_delete_snapshot" {{(pid=84538) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 19:01:28 devstack cinder-volume[84538]: INFO cinder.volume.manager [None req-0421a4b5-c8c5-4f78-a66f-2bf07161c602 tempest-GroupSnapshotsTest-1835037466 None] Created volume successfully. Apr 29 19:01:28 devstack cinder-volume[84538]: DEBUG cinder.coordination [None req-0c730a40-f759-4fab-859c-8a3033eabbd9 tempest-SnapshotMetadataTestJSON-944613313 None] Lock "cinder-quobyte-88462ace-755d-4e3d-b0d4-3ef52f2cfe81" acquired by "_delete_snapshot" :: waited 0.027s {{(pid=84538) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 19:01:28 devstack cinder-volume[84538]: DEBUG cinder.volume.drivers.remotefs [None req-0c730a40-f759-4fab-859c-8a3033eabbd9 tempest-SnapshotMetadataTestJSON-944613313 None] Deleting offline snapshot 88462ace-755d-4e3d-b0d4-3ef52f2cfe81 of volume 6064853c-432e-401f-9fc0-7921731f1049 {{(pid=84538) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 29 19:01:28 devstack cinder-volume[84538]: DEBUG cinder.volume.drivers.remotefs [None req-0c730a40-f759-4fab-859c-8a3033eabbd9 tempest-SnapshotMetadataTestJSON-944613313 None] snapshot_file for this snap is: volume-6064853c-432e-401f-9fc0-7921731f1049.88462ace-755d-4e3d-b0d4-3ef52f2cfe81 {{(pid=84538) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 29 19:01:28 devstack cinder-volume[84538]: DEBUG oslo.privsep.daemon [-] privsep: reply[cb4caf72-35cc-4e56-a9cb-ac5a13e38558]: (4, 'qcow2') {{(pid=85803) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 19:01:28 devstack cinder-volume[84538]: DEBUG oslo_concurrency.processutils [None req-0c730a40-f759-4fab-859c-8a3033eabbd9 tempest-SnapshotMetadataTestJSON-944613313 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-6064853c-432e-401f-9fc0-7921731f1049.88462ace-755d-4e3d-b0d4-3ef52f2cfe81 {{(pid=84538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 19:01:28 devstack sudo[90089]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-6064853c-432e-401f-9fc0-7921731f1049.88462ace-755d-4e3d-b0d4-3ef52f2cfe81 Apr 29 19:01:28 devstack sudo[90089]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 19:01:28 devstack cinder-volume[84538]: DEBUG cinder.volume.flows.manager.create_volume [None req-511b342d-1bfa-47bc-b9a4-a407c851b0ac tempest-GroupSnapshotsTest-1835037466 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84538) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Apr 29 19:01:29 devstack sudo[90086]: pam_unix(sudo:session): session closed for user root Apr 29 19:01:29 devstack cinder-volume[84538]: DEBUG cinder.volume.manager [None req-511b342d-1bfa-47bc-b9a4-a407c851b0ac tempest-GroupSnapshotsTest-1835037466 None] Flow 'volume_create_manager' (8e63735d-dc78-466e-8074-9acd1fbae6f5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84538) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 19:01:29 devstack cinder-volume[84538]: DEBUG cinder.volume.manager [None req-511b342d-1bfa-47bc-b9a4-a407c851b0ac tempest-GroupSnapshotsTest-1835037466 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (25eb32d5-377a-4bcb-9393-946d1cb70ab9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 19:01:29 devstack cinder-volume[84538]: DEBUG oslo_concurrency.processutils [None req-032fa0ae-c40e-4320-a902-769d11feb40e tempest-VolumesActionsTest-1687831653 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-c8d3a270-1ee1-494a-97cd-74c697f277b4 1073741824" returned: 0 in 1.116s {{(pid=84538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 19:01:29 devstack cinder-volume[84538]: DEBUG cinder.volume.manager [None req-511b342d-1bfa-47bc-b9a4-a407c851b0ac tempest-GroupSnapshotsTest-1835037466 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (25eb32d5-377a-4bcb-9393-946d1cb70ab9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-29T17:01:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-2008001442',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=dbf54acf-ba7e-4db8-8711-ba4d240c8365,host='devstack@QuobyteHD#QuobyteHD',id=0210148a-07a3-4f2b-92dd-72ff91d5adb3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='14dd90144b0b4dcc8def965ebf4ada62',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T17:01:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T17:01:29Z,use_quota=True,user_id='616bcc255f9c4e89963a9ff70ca5ab6c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(90d05a75-d640-4694-8a0e-e914227d84e8),volume_type_id=90d05a75-d640-4694-8a0e-e914227d84e8)' {{(pid=84538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 19:01:29 devstack cinder-volume[84538]: DEBUG cinder.volume.manager [None req-511b342d-1bfa-47bc-b9a4-a407c851b0ac tempest-GroupSnapshotsTest-1835037466 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a953146b-eeaa-422d-8d72-ee4dea4f52d5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 19:01:29 devstack cinder-volume[84538]: DEBUG cinder.volume.manager [None req-511b342d-1bfa-47bc-b9a4-a407c851b0ac tempest-GroupSnapshotsTest-1835037466 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a953146b-eeaa-422d-8d72-ee4dea4f52d5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 19:01:29 devstack cinder-volume[84538]: DEBUG cinder.volume.manager [None req-511b342d-1bfa-47bc-b9a4-a407c851b0ac tempest-GroupSnapshotsTest-1835037466 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2572410a-06f6-4d2e-b28e-3aa3af264dce) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 19:01:29 devstack cinder-volume[84538]: DEBUG cinder.volume.manager [None req-511b342d-1bfa-47bc-b9a4-a407c851b0ac tempest-GroupSnapshotsTest-1835037466 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2572410a-06f6-4d2e-b28e-3aa3af264dce) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0210148a-07a3-4f2b-92dd-72ff91d5adb3', 'volume_name': 'volume-0210148a-07a3-4f2b-92dd-72ff91d5adb3', 'volume_size': 1}' {{(pid=84538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 19:01:29 devstack cinder-volume[84538]: DEBUG cinder.volume.manager [None req-511b342d-1bfa-47bc-b9a4-a407c851b0ac tempest-GroupSnapshotsTest-1835037466 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c3e180e8-3742-46b8-9928-ec6faa86e2b6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 19:01:29 devstack cinder-volume[84538]: DEBUG cinder.volume.manager [None req-511b342d-1bfa-47bc-b9a4-a407c851b0ac tempest-GroupSnapshotsTest-1835037466 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c3e180e8-3742-46b8-9928-ec6faa86e2b6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 19:01:29 devstack cinder-volume[84538]: DEBUG cinder.volume.manager [None req-511b342d-1bfa-47bc-b9a4-a407c851b0ac tempest-GroupSnapshotsTest-1835037466 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (daad1972-74f7-42c6-93e0-6183dbbe55e0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 19:01:29 devstack cinder-volume[84538]: INFO cinder.volume.flows.manager.create_volume [None req-511b342d-1bfa-47bc-b9a4-a407c851b0ac tempest-GroupSnapshotsTest-1835037466 None] Volume 0210148a-07a3-4f2b-92dd-72ff91d5adb3: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0210148a-07a3-4f2b-92dd-72ff91d5adb3', 'volume_size': 1} Apr 29 19:01:29 devstack cinder-volume[84538]: DEBUG oslo_concurrency.lockutils [None req-511b342d-1bfa-47bc-b9a4-a407c851b0ac tempest-GroupSnapshotsTest-1835037466 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 19:01:29 devstack sudo[90089]: pam_unix(sudo:session): session closed for user root Apr 29 19:01:29 devstack cinder-volume[84538]: DEBUG oslo_concurrency.processutils [None req-0c730a40-f759-4fab-859c-8a3033eabbd9 tempest-SnapshotMetadataTestJSON-944613313 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-6064853c-432e-401f-9fc0-7921731f1049.88462ace-755d-4e3d-b0d4-3ef52f2cfe81" returned: 0 in 1.013s {{(pid=84538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 19:01:29 devstack cinder-volume[84538]: DEBUG cinder.volume.drivers.remotefs [None req-0c730a40-f759-4fab-859c-8a3033eabbd9 tempest-SnapshotMetadataTestJSON-944613313 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-6064853c-432e-401f-9fc0-7921731f1049(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=84538) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 29 19:01:29 devstack cinder-volume[84538]: DEBUG oslo_concurrency.processutils [None req-032fa0ae-c40e-4320-a902-769d11feb40e tempest-VolumesActionsTest-1687831653 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-c8d3a270-1ee1-494a-97cd-74c697f277b4 {{(pid=84538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 19:01:29 devstack cinder-volume[84538]: DEBUG oslo.privsep.daemon [-] privsep: reply[6cff111e-c513-4a66-9b69-40997276643c]: (4, 'qcow2') {{(pid=85803) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 19:01:29 devstack cinder-volume[84538]: DEBUG oslo_concurrency.processutils [None req-0c730a40-f759-4fab-859c-8a3033eabbd9 tempest-SnapshotMetadataTestJSON-944613313 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-6064853c-432e-401f-9fc0-7921731f1049 {{(pid=84538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 19:01:29 devstack sudo[90098]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-c8d3a270-1ee1-494a-97cd-74c697f277b4 Apr 29 19:01:29 devstack sudo[90098]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 19:01:29 devstack sudo[90099]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-6064853c-432e-401f-9fc0-7921731f1049 Apr 29 19:01:29 devstack sudo[90099]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 19:01:29 devstack sudo[90098]: pam_unix(sudo:session): session closed for user root Apr 29 19:01:29 devstack cinder-volume[84538]: DEBUG oslo_concurrency.processutils [None req-032fa0ae-c40e-4320-a902-769d11feb40e tempest-VolumesActionsTest-1687831653 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-c8d3a270-1ee1-494a-97cd-74c697f277b4" returned: 0 in 0.642s {{(pid=84538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 19:01:29 devstack cinder-volume[84538]: DEBUG cinder.volume.drivers.quobyte [None req-032fa0ae-c40e-4320-a902-769d11feb40e tempest-VolumesActionsTest-1687831653 None] <== create_volume: return (1868ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-34312b00-dd6d-45bb-af98-75855cea8e48'} {{(pid=84538) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 29 19:01:29 devstack cinder-volume[84538]: DEBUG oslo_concurrency.lockutils [None req-032fa0ae-c40e-4320-a902-769d11feb40e tempest-VolumesActionsTest-1687831653 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.872s {{(pid=84538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 19:01:29 devstack cinder-volume[84538]: DEBUG oslo_concurrency.lockutils [None req-511b342d-1bfa-47bc-b9a4-a407c851b0ac tempest-GroupSnapshotsTest-1835037466 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.690s {{(pid=84538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 19:01:29 devstack cinder-volume[84538]: DEBUG cinder.volume.drivers.quobyte [None req-511b342d-1bfa-47bc-b9a4-a407c851b0ac tempest-GroupSnapshotsTest-1835037466 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=dbf54acf-ba7e-4db8-8711-ba4d240c8365,created_at=2026-04-29T17:01:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-2008001442',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=dbf54acf-ba7e-4db8-8711-ba4d240c8365,host='devstack@QuobyteHD#QuobyteHD',id=0210148a-07a3-4f2b-92dd-72ff91d5adb3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='14dd90144b0b4dcc8def965ebf4ada62',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T17:01:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T17:01:29Z,use_quota=True,user_id='616bcc255f9c4e89963a9ff70ca5ab6c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(90d05a75-d640-4694-8a0e-e914227d84e8),volume_type_id=90d05a75-d640-4694-8a0e-e914227d84e8)}" {{(pid=84538) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 29 19:01:29 devstack cinder-volume[84538]: DEBUG cinder.volume.drivers.remotefs [None req-511b342d-1bfa-47bc-b9a4-a407c851b0ac tempest-GroupSnapshotsTest-1835037466 None] Creating volume 0210148a-07a3-4f2b-92dd-72ff91d5adb3 {{(pid=84538) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 29 19:01:29 devstack cinder-volume[84538]: DEBUG oslo_concurrency.lockutils [None req-511b342d-1bfa-47bc-b9a4-a407c851b0ac tempest-GroupSnapshotsTest-1835037466 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 19:01:29 devstack cinder-volume[84538]: DEBUG oslo_concurrency.lockutils [None req-511b342d-1bfa-47bc-b9a4-a407c851b0ac tempest-GroupSnapshotsTest-1835037466 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 19:01:29 devstack cinder-volume[84538]: DEBUG cinder.volume.drivers.quobyte [None req-511b342d-1bfa-47bc-b9a4-a407c851b0ac tempest-GroupSnapshotsTest-1835037466 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-34312b00-dd6d-45bb-af98-75855cea8e48': None} {{(pid=84538) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 19:01:29 devstack cinder-volume[84538]: DEBUG cinder.volume.drivers.quobyte [None req-511b342d-1bfa-47bc-b9a4-a407c851b0ac tempest-GroupSnapshotsTest-1835037466 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-34312b00-dd6d-45bb-af98-75855cea8e48'] {{(pid=84538) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 19:01:29 devstack cinder-volume[84538]: DEBUG oslo_concurrency.lockutils [None req-511b342d-1bfa-47bc-b9a4-a407c851b0ac tempest-GroupSnapshotsTest-1835037466 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=84538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 19:01:29 devstack cinder-volume[84538]: DEBUG cinder.volume.drivers.quobyte [None req-511b342d-1bfa-47bc-b9a4-a407c851b0ac tempest-GroupSnapshotsTest-1835037466 None] Selected osci02.corp.quobyte.com/cinder-vol-34312b00-dd6d-45bb-af98-75855cea8e48 as target Quobyte volume. {{(pid=84538) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 29 19:01:29 devstack cinder-volume[84538]: INFO cinder.volume.drivers.remotefs [None req-511b342d-1bfa-47bc-b9a4-a407c851b0ac tempest-GroupSnapshotsTest-1835037466 None] casted to osci02.corp.quobyte.com/cinder-vol-34312b00-dd6d-45bb-af98-75855cea8e48 Apr 29 19:01:29 devstack cinder-volume[84538]: DEBUG oslo_concurrency.processutils [None req-511b342d-1bfa-47bc-b9a4-a407c851b0ac tempest-GroupSnapshotsTest-1835037466 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-0210148a-07a3-4f2b-92dd-72ff91d5adb3 1073741824 {{(pid=84538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 19:01:29 devstack cinder-volume[84538]: DEBUG cinder.volume.manager [None req-032fa0ae-c40e-4320-a902-769d11feb40e tempest-VolumesActionsTest-1687831653 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f9c10d82-1d6c-4ebd-ae94-7e253ed4f9cd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c8d3a270-1ee1-494a-97cd-74c697f277b4', 'volume_size': 1}' {{(pid=84538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 19:01:29 devstack sudo[90106]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-0210148a-07a3-4f2b-92dd-72ff91d5adb3 1073741824 Apr 29 19:01:29 devstack sudo[90106]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 19:01:29 devstack cinder-volume[84538]: DEBUG cinder.volume.manager [None req-032fa0ae-c40e-4320-a902-769d11feb40e tempest-VolumesActionsTest-1687831653 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6bd61d46-abc4-4790-a8dc-cea068e9ca09) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 19:01:29 devstack cinder-volume[84538]: INFO cinder.volume.flows.manager.create_volume [None req-032fa0ae-c40e-4320-a902-769d11feb40e tempest-VolumesActionsTest-1687831653 None] Volume volume-c8d3a270-1ee1-494a-97cd-74c697f277b4 (c8d3a270-1ee1-494a-97cd-74c697f277b4): created successfully Apr 29 19:01:29 devstack cinder-volume[84538]: DEBUG cinder.volume.manager [None req-032fa0ae-c40e-4320-a902-769d11feb40e tempest-VolumesActionsTest-1687831653 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6bd61d46-abc4-4790-a8dc-cea068e9ca09) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 19:01:29 devstack cinder-volume[84538]: DEBUG cinder.volume.manager [None req-032fa0ae-c40e-4320-a902-769d11feb40e tempest-VolumesActionsTest-1687831653 None] Flow 'volume_create_manager' (f2525ded-4db2-4fb7-8b41-3cbf62d1f921) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84538) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 19:01:29 devstack cinder-volume[84538]: INFO cinder.volume.manager [None req-032fa0ae-c40e-4320-a902-769d11feb40e tempest-VolumesActionsTest-1687831653 None] Created volume successfully. Apr 29 19:01:29 devstack sudo[90099]: pam_unix(sudo:session): session closed for user root Apr 29 19:01:29 devstack cinder-volume[84538]: DEBUG oslo_concurrency.processutils [None req-0c730a40-f759-4fab-859c-8a3033eabbd9 tempest-SnapshotMetadataTestJSON-944613313 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-6064853c-432e-401f-9fc0-7921731f1049" returned: 0 in 0.751s {{(pid=84538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 19:01:29 devstack cinder-volume[84538]: DEBUG oslo_concurrency.processutils [None req-0c730a40-f759-4fab-859c-8a3033eabbd9 tempest-SnapshotMetadataTestJSON-944613313 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-6064853c-432e-401f-9fc0-7921731f1049.88462ace-755d-4e3d-b0d4-3ef52f2cfe81 {{(pid=84538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 19:01:29 devstack sudo[90108]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-6064853c-432e-401f-9fc0-7921731f1049.88462ace-755d-4e3d-b0d4-3ef52f2cfe81 Apr 29 19:01:29 devstack sudo[90108]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 19:01:30 devstack cinder-volume[84538]: DEBUG cinder.coordination [None req-164544db-187d-4d8e-958d-2f9f442cac65 tempest-VolumesActionsTest-927532498 None] Acquiring lock "cinder-c8d3a270-1ee1-494a-97cd-74c697f277b4-delete_volume" by "delete_volume" {{(pid=84538) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 19:01:30 devstack cinder-volume[84538]: DEBUG cinder.coordination [None req-164544db-187d-4d8e-958d-2f9f442cac65 tempest-VolumesActionsTest-927532498 None] Lock "cinder-c8d3a270-1ee1-494a-97cd-74c697f277b4-delete_volume" acquired by "delete_volume" :: waited 0.035s {{(pid=84538) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 19:01:30 devstack cinder-volume[84538]: DEBUG cinder.coordination [None req-164544db-187d-4d8e-958d-2f9f442cac65 tempest-VolumesActionsTest-927532498 None] Acquiring lock "cinder-quobyte-c8d3a270-1ee1-494a-97cd-74c697f277b4" by "delete_volume" {{(pid=84538) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 19:01:30 devstack cinder-volume[84538]: DEBUG cinder.coordination [None req-164544db-187d-4d8e-958d-2f9f442cac65 tempest-VolumesActionsTest-927532498 None] Lock "cinder-quobyte-c8d3a270-1ee1-494a-97cd-74c697f277b4" acquired by "delete_volume" :: waited 0.028s {{(pid=84538) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 19:01:30 devstack cinder-volume[84538]: DEBUG oslo.privsep.daemon [-] privsep: reply[40f085d2-c2a8-4f95-a196-b02d40315dcb]: (4, 'qcow2') {{(pid=85803) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 19:01:30 devstack cinder-volume[84538]: DEBUG oslo_concurrency.processutils [None req-164544db-187d-4d8e-958d-2f9f442cac65 tempest-VolumesActionsTest-927532498 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-c8d3a270-1ee1-494a-97cd-74c697f277b4 {{(pid=84538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 19:01:30 devstack sudo[90112]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-c8d3a270-1ee1-494a-97cd-74c697f277b4 Apr 29 19:01:30 devstack sudo[90112]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 19:01:30 devstack sudo[90106]: pam_unix(sudo:session): session closed for user root Apr 29 19:01:30 devstack cinder-volume[84538]: DEBUG oslo_concurrency.processutils [None req-511b342d-1bfa-47bc-b9a4-a407c851b0ac tempest-GroupSnapshotsTest-1835037466 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-0210148a-07a3-4f2b-92dd-72ff91d5adb3 1073741824" returned: 0 in 0.997s {{(pid=84538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 19:01:30 devstack sudo[90108]: pam_unix(sudo:session): session closed for user root Apr 29 19:01:30 devstack cinder-volume[84538]: DEBUG oslo_concurrency.processutils [None req-0c730a40-f759-4fab-859c-8a3033eabbd9 tempest-SnapshotMetadataTestJSON-944613313 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-6064853c-432e-401f-9fc0-7921731f1049.88462ace-755d-4e3d-b0d4-3ef52f2cfe81" returned: 0 in 0.901s {{(pid=84538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 19:01:30 devstack cinder-volume[84538]: DEBUG oslo_concurrency.processutils [None req-0c730a40-f759-4fab-859c-8a3033eabbd9 tempest-SnapshotMetadataTestJSON-944613313 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-6064853c-432e-401f-9fc0-7921731f1049.88462ace-755d-4e3d-b0d4-3ef52f2cfe81 {{(pid=84538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 19:01:30 devstack sudo[90120]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-6064853c-432e-401f-9fc0-7921731f1049.88462ace-755d-4e3d-b0d4-3ef52f2cfe81 Apr 29 19:01:30 devstack sudo[90120]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 19:01:30 devstack cinder-volume[84538]: DEBUG oslo_concurrency.processutils [None req-511b342d-1bfa-47bc-b9a4-a407c851b0ac tempest-GroupSnapshotsTest-1835037466 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-0210148a-07a3-4f2b-92dd-72ff91d5adb3 {{(pid=84538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 19:01:30 devstack sudo[90122]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-0210148a-07a3-4f2b-92dd-72ff91d5adb3 Apr 29 19:01:30 devstack sudo[90122]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 19:01:31 devstack sudo[90112]: pam_unix(sudo:session): session closed for user root Apr 29 19:01:31 devstack cinder-volume[84538]: DEBUG oslo_concurrency.processutils [None req-164544db-187d-4d8e-958d-2f9f442cac65 tempest-VolumesActionsTest-927532498 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-c8d3a270-1ee1-494a-97cd-74c697f277b4" returned: 0 in 0.914s {{(pid=84538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 19:01:31 devstack cinder-volume[84538]: DEBUG oslo_concurrency.processutils [None req-164544db-187d-4d8e-958d-2f9f442cac65 tempest-VolumesActionsTest-927532498 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-c8d3a270-1ee1-494a-97cd-74c697f277b4 {{(pid=84538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 19:01:31 devstack sudo[90128]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-c8d3a270-1ee1-494a-97cd-74c697f277b4 Apr 29 19:01:31 devstack sudo[90128]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 19:01:31 devstack sudo[90120]: pam_unix(sudo:session): session closed for user root Apr 29 19:01:31 devstack cinder-volume[84538]: DEBUG oslo_concurrency.processutils [None req-0c730a40-f759-4fab-859c-8a3033eabbd9 tempest-SnapshotMetadataTestJSON-944613313 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-6064853c-432e-401f-9fc0-7921731f1049.88462ace-755d-4e3d-b0d4-3ef52f2cfe81" returned: 0 in 0.725s {{(pid=84538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 19:01:31 devstack sudo[90122]: pam_unix(sudo:session): session closed for user root Apr 29 19:01:31 devstack cinder-volume[84538]: DEBUG oslo_concurrency.processutils [None req-511b342d-1bfa-47bc-b9a4-a407c851b0ac tempest-GroupSnapshotsTest-1835037466 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-0210148a-07a3-4f2b-92dd-72ff91d5adb3" returned: 0 in 0.728s {{(pid=84538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 19:01:31 devstack cinder-volume[84538]: DEBUG cinder.volume.drivers.quobyte [None req-511b342d-1bfa-47bc-b9a4-a407c851b0ac tempest-GroupSnapshotsTest-1835037466 None] <== create_volume: return (1788ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-34312b00-dd6d-45bb-af98-75855cea8e48'} {{(pid=84538) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 29 19:01:31 devstack cinder-volume[84538]: DEBUG oslo_concurrency.lockutils [None req-511b342d-1bfa-47bc-b9a4-a407c851b0ac tempest-GroupSnapshotsTest-1835037466 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.790s {{(pid=84538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 19:01:31 devstack cinder-volume[84538]: DEBUG cinder.coordination [None req-0c730a40-f759-4fab-859c-8a3033eabbd9 tempest-SnapshotMetadataTestJSON-944613313 None] Lock "cinder-quobyte-88462ace-755d-4e3d-b0d4-3ef52f2cfe81" released by "_delete_snapshot" :: held 3.527s {{(pid=84538) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 19:01:31 devstack cinder-volume[84538]: DEBUG cinder.coordination [None req-0c730a40-f759-4fab-859c-8a3033eabbd9 tempest-SnapshotMetadataTestJSON-944613313 None] Lock "cinder-quobyte-6064853c-432e-401f-9fc0-7921731f1049" released by "delete_snapshot" :: held 3.565s {{(pid=84538) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 19:01:31 devstack cinder-volume[84538]: DEBUG cinder.volume.manager [None req-511b342d-1bfa-47bc-b9a4-a407c851b0ac tempest-GroupSnapshotsTest-1835037466 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (daad1972-74f7-42c6-93e0-6183dbbe55e0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0210148a-07a3-4f2b-92dd-72ff91d5adb3', 'volume_size': 1}' {{(pid=84538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 19:01:31 devstack cinder-volume[84538]: DEBUG cinder.volume.manager [None req-511b342d-1bfa-47bc-b9a4-a407c851b0ac tempest-GroupSnapshotsTest-1835037466 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ddb35ecf-85cf-4b31-9ce0-b32ad8ab30a6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 19:01:31 devstack cinder-volume[84538]: INFO cinder.volume.flows.manager.create_volume [None req-511b342d-1bfa-47bc-b9a4-a407c851b0ac tempest-GroupSnapshotsTest-1835037466 None] Volume volume-0210148a-07a3-4f2b-92dd-72ff91d5adb3 (0210148a-07a3-4f2b-92dd-72ff91d5adb3): created successfully Apr 29 19:01:31 devstack cinder-volume[84538]: DEBUG cinder.volume.manager [None req-511b342d-1bfa-47bc-b9a4-a407c851b0ac tempest-GroupSnapshotsTest-1835037466 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ddb35ecf-85cf-4b31-9ce0-b32ad8ab30a6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 19:01:31 devstack cinder-volume[84538]: DEBUG cinder.volume.manager [None req-511b342d-1bfa-47bc-b9a4-a407c851b0ac tempest-GroupSnapshotsTest-1835037466 None] Flow 'volume_create_manager' (8e63735d-dc78-466e-8074-9acd1fbae6f5) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84538) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 19:01:31 devstack cinder-volume[84538]: INFO cinder.volume.manager [None req-511b342d-1bfa-47bc-b9a4-a407c851b0ac tempest-GroupSnapshotsTest-1835037466 None] Created volume successfully. Apr 29 19:01:31 devstack cinder-volume[84538]: DEBUG cinder.quota [None req-0c730a40-f759-4fab-859c-8a3033eabbd9 tempest-SnapshotMetadataTestJSON-944613313 None] Created reservations ['d7056ef4-09b2-4ec4-a651-51315f054345', '7238c7d6-11d8-430b-9196-6a15b0314425', '47ca140c-952b-461a-a29c-f3ebae19cfcf', 'b1b07a4c-f592-4be3-8f42-de6625e69482'] {{(pid=84538) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 29 19:01:31 devstack cinder-volume[84538]: INFO cinder.volume.manager [None req-0c730a40-f759-4fab-859c-8a3033eabbd9 tempest-SnapshotMetadataTestJSON-944613313 None] Delete snapshot completed successfully. Apr 29 19:01:31 devstack cinder-volume[84538]: DEBUG cinder.coordination [None req-0c730a40-f759-4fab-859c-8a3033eabbd9 tempest-SnapshotMetadataTestJSON-944613313 None] Lock "cinder-88462ace-755d-4e3d-b0d4-3ef52f2cfe81-delete_snapshot" released by "delete_snapshot" :: held 3.772s {{(pid=84538) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 19:01:32 devstack sudo[90128]: pam_unix(sudo:session): session closed for user root Apr 29 19:01:32 devstack cinder-volume[84538]: DEBUG oslo_concurrency.processutils [None req-164544db-187d-4d8e-958d-2f9f442cac65 tempest-VolumesActionsTest-927532498 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-c8d3a270-1ee1-494a-97cd-74c697f277b4" returned: 0 in 0.719s {{(pid=84538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 19:01:32 devstack cinder-volume[84538]: DEBUG cinder.coordination [None req-164544db-187d-4d8e-958d-2f9f442cac65 tempest-VolumesActionsTest-927532498 None] Lock "cinder-quobyte-c8d3a270-1ee1-494a-97cd-74c697f277b4" released by "delete_volume" :: held 1.688s {{(pid=84538) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 19:01:32 devstack cinder-volume[84538]: DEBUG cinder.quota [None req-164544db-187d-4d8e-958d-2f9f442cac65 tempest-VolumesActionsTest-927532498 None] Created reservations ['2210d828-acf8-49eb-a7a0-97dbc14d1472', '8fcaf1f2-3796-497e-a016-14657ef037a7', '30875ce7-decd-4d7c-a961-23050bd91652', '5bcd24ef-b3ee-44e7-ab24-c30a79e94cda'] {{(pid=84538) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 29 19:01:32 devstack cinder-volume[84538]: DEBUG oslo_concurrency.lockutils [None req-164544db-187d-4d8e-958d-2f9f442cac65 tempest-VolumesActionsTest-927532498 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 19:01:32 devstack cinder-volume[84538]: DEBUG oslo_concurrency.lockutils [None req-164544db-187d-4d8e-958d-2f9f442cac65 tempest-VolumesActionsTest-927532498 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 19:01:32 devstack cinder-volume[84538]: DEBUG cinder.volume.drivers.quobyte [None req-164544db-187d-4d8e-958d-2f9f442cac65 tempest-VolumesActionsTest-927532498 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-34312b00-dd6d-45bb-af98-75855cea8e48': None} {{(pid=84538) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 19:01:32 devstack cinder-volume[84538]: DEBUG cinder.volume.drivers.quobyte [None req-164544db-187d-4d8e-958d-2f9f442cac65 tempest-VolumesActionsTest-927532498 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-34312b00-dd6d-45bb-af98-75855cea8e48'] {{(pid=84538) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 19:01:32 devstack cinder-volume[84538]: DEBUG oslo_concurrency.lockutils [None req-164544db-187d-4d8e-958d-2f9f442cac65 tempest-VolumesActionsTest-927532498 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=84538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 19:01:32 devstack cinder-volume[84538]: DEBUG oslo_concurrency.processutils [None req-164544db-187d-4d8e-958d-2f9f442cac65 tempest-VolumesActionsTest-927532498 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d {{(pid=84538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 19:01:32 devstack sudo[90133]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d Apr 29 19:01:32 devstack sudo[90133]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 19:01:32 devstack cinder-volume[84538]: DEBUG cinder.coordination [None req-233335e1-ef87-4b27-9de3-d801dab1c86a tempest-SnapshotMetadataTestJSON-944613313 None] Acquiring lock "cinder-6064853c-432e-401f-9fc0-7921731f1049-delete_volume" by "delete_volume" {{(pid=84538) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 19:01:32 devstack cinder-volume[84538]: DEBUG cinder.coordination [None req-233335e1-ef87-4b27-9de3-d801dab1c86a tempest-SnapshotMetadataTestJSON-944613313 None] Lock "cinder-6064853c-432e-401f-9fc0-7921731f1049-delete_volume" acquired by "delete_volume" :: waited 0.049s {{(pid=84538) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 19:01:32 devstack cinder-volume[84538]: DEBUG cinder.coordination [None req-233335e1-ef87-4b27-9de3-d801dab1c86a tempest-SnapshotMetadataTestJSON-944613313 None] Acquiring lock "cinder-quobyte-6064853c-432e-401f-9fc0-7921731f1049" by "delete_volume" {{(pid=84538) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 19:01:32 devstack cinder-volume[84538]: DEBUG cinder.coordination [None req-233335e1-ef87-4b27-9de3-d801dab1c86a tempest-SnapshotMetadataTestJSON-944613313 None] Lock "cinder-quobyte-6064853c-432e-401f-9fc0-7921731f1049" acquired by "delete_volume" :: waited 0.027s {{(pid=84538) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 19:01:32 devstack cinder-volume[84538]: INFO cinder.volume.manager [None req-1f21a422-ee1b-456a-92e0-1de8b52ce59e tempest-GroupSnapshotsTest-1835037466 None] Update group completed successfully. Apr 29 19:01:32 devstack cinder-volume[84538]: DEBUG oslo.privsep.daemon [-] privsep: reply[3dac9c3b-30c2-43d7-a070-6cabc5e9c0bf]: (4, 'qcow2') {{(pid=85803) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 19:01:32 devstack cinder-volume[84538]: DEBUG oslo_concurrency.processutils [None req-233335e1-ef87-4b27-9de3-d801dab1c86a tempest-SnapshotMetadataTestJSON-944613313 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-6064853c-432e-401f-9fc0-7921731f1049 {{(pid=84538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 19:01:32 devstack sudo[90135]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-6064853c-432e-401f-9fc0-7921731f1049 Apr 29 19:01:32 devstack sudo[90135]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 19:01:33 devstack sudo[90133]: pam_unix(sudo:session): session closed for user root Apr 29 19:01:33 devstack cinder-volume[84538]: DEBUG oslo_concurrency.processutils [None req-164544db-187d-4d8e-958d-2f9f442cac65 tempest-VolumesActionsTest-927532498 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d" returned: 0 in 0.834s {{(pid=84538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 19:01:33 devstack cinder-volume[84538]: DEBUG cinder.manager [None req-164544db-187d-4d8e-958d-2f9f442cac65 tempest-VolumesActionsTest-927532498 None] Notifying Schedulers of capabilities ... {{(pid=84538) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 29 19:01:33 devstack cinder-volume[84538]: INFO cinder.volume.manager [None req-164544db-187d-4d8e-958d-2f9f442cac65 tempest-VolumesActionsTest-927532498 None] Deleted volume successfully. Apr 29 19:01:33 devstack cinder-volume[84538]: DEBUG cinder.coordination [None req-164544db-187d-4d8e-958d-2f9f442cac65 tempest-VolumesActionsTest-927532498 None] Lock "cinder-c8d3a270-1ee1-494a-97cd-74c697f277b4-delete_volume" released by "delete_volume" :: held 2.765s {{(pid=84538) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 19:01:33 devstack cinder-volume[84538]: DEBUG cinder.volume.flows.manager.create_volume [None req-b0675271-14e3-4441-9ffe-75eaaf12b1f3 tempest-VolumesActionsTest-1687831653 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84538) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Apr 29 19:01:33 devstack cinder-volume[84538]: DEBUG cinder.volume.manager [None req-b0675271-14e3-4441-9ffe-75eaaf12b1f3 tempest-VolumesActionsTest-1687831653 None] Flow 'volume_create_manager' (ad8f78b6-d0f5-41e1-84b2-032ab128a538) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84538) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 19:01:33 devstack cinder-volume[84538]: DEBUG cinder.volume.manager [None req-b0675271-14e3-4441-9ffe-75eaaf12b1f3 tempest-VolumesActionsTest-1687831653 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a65e4fb6-abec-44fa-b620-57224ddfc0b4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 19:01:33 devstack cinder-volume[84538]: DEBUG cinder.volume.manager [None req-b0675271-14e3-4441-9ffe-75eaaf12b1f3 tempest-VolumesActionsTest-1687831653 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a65e4fb6-abec-44fa-b620-57224ddfc0b4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-29T17:01:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-2099731805',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9d71174d-80aa-474f-bae5-39c30f9044c8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a39f1f9e4e364982af869dd2b24dfe70',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T17:01:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T17:01:33Z,use_quota=True,user_id='0feaa082ee4740958e7eb31611d1e836',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(62b05900-93e3-4190-a88f-1d87324303d1),volume_type_id=62b05900-93e3-4190-a88f-1d87324303d1)' {{(pid=84538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 19:01:33 devstack cinder-volume[84538]: DEBUG cinder.volume.manager [None req-b0675271-14e3-4441-9ffe-75eaaf12b1f3 tempest-VolumesActionsTest-1687831653 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1f5fa807-a2a1-4a7e-89ed-113b43bfa73b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 19:01:33 devstack cinder-volume[84538]: DEBUG cinder.volume.manager [None req-b0675271-14e3-4441-9ffe-75eaaf12b1f3 tempest-VolumesActionsTest-1687831653 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1f5fa807-a2a1-4a7e-89ed-113b43bfa73b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 19:01:33 devstack cinder-volume[84538]: DEBUG cinder.volume.manager [None req-b0675271-14e3-4441-9ffe-75eaaf12b1f3 tempest-VolumesActionsTest-1687831653 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9cb0be5c-bf90-4a14-93fe-dff40d4bcb79) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 19:01:33 devstack cinder-volume[84538]: DEBUG cinder.volume.manager [None req-b0675271-14e3-4441-9ffe-75eaaf12b1f3 tempest-VolumesActionsTest-1687831653 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9cb0be5c-bf90-4a14-93fe-dff40d4bcb79) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9d71174d-80aa-474f-bae5-39c30f9044c8', 'volume_name': 'volume-9d71174d-80aa-474f-bae5-39c30f9044c8', 'volume_size': 1}' {{(pid=84538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 19:01:33 devstack cinder-volume[84538]: DEBUG cinder.volume.manager [None req-b0675271-14e3-4441-9ffe-75eaaf12b1f3 tempest-VolumesActionsTest-1687831653 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ccb10f13-7420-4bbf-a6f5-42be3c8cb1f7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 19:01:33 devstack cinder-volume[84538]: DEBUG cinder.volume.manager [None req-b0675271-14e3-4441-9ffe-75eaaf12b1f3 tempest-VolumesActionsTest-1687831653 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ccb10f13-7420-4bbf-a6f5-42be3c8cb1f7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 19:01:33 devstack cinder-volume[84538]: DEBUG cinder.volume.manager [None req-b0675271-14e3-4441-9ffe-75eaaf12b1f3 tempest-VolumesActionsTest-1687831653 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (dafd475c-9d9b-4023-8be2-956a0358a4db) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 19:01:33 devstack cinder-volume[84538]: INFO cinder.volume.flows.manager.create_volume [None req-b0675271-14e3-4441-9ffe-75eaaf12b1f3 tempest-VolumesActionsTest-1687831653 None] Volume 9d71174d-80aa-474f-bae5-39c30f9044c8: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9d71174d-80aa-474f-bae5-39c30f9044c8', 'volume_size': 1} Apr 29 19:01:33 devstack cinder-volume[84538]: DEBUG oslo_concurrency.lockutils [None req-b0675271-14e3-4441-9ffe-75eaaf12b1f3 tempest-VolumesActionsTest-1687831653 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 19:01:33 devstack cinder-volume[84538]: DEBUG oslo_concurrency.lockutils [None req-b0675271-14e3-4441-9ffe-75eaaf12b1f3 tempest-VolumesActionsTest-1687831653 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=84538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 19:01:33 devstack cinder-volume[84538]: DEBUG cinder.volume.drivers.quobyte [None req-b0675271-14e3-4441-9ffe-75eaaf12b1f3 tempest-VolumesActionsTest-1687831653 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-29T17:01:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-2099731805',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9d71174d-80aa-474f-bae5-39c30f9044c8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a39f1f9e4e364982af869dd2b24dfe70',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T17:01:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T17:01:33Z,use_quota=True,user_id='0feaa082ee4740958e7eb31611d1e836',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(62b05900-93e3-4190-a88f-1d87324303d1),volume_type_id=62b05900-93e3-4190-a88f-1d87324303d1)}" {{(pid=84538) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 29 19:01:33 devstack cinder-volume[84538]: DEBUG cinder.volume.drivers.remotefs [None req-b0675271-14e3-4441-9ffe-75eaaf12b1f3 tempest-VolumesActionsTest-1687831653 None] Creating volume 9d71174d-80aa-474f-bae5-39c30f9044c8 {{(pid=84538) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 29 19:01:33 devstack cinder-volume[84538]: DEBUG oslo_concurrency.lockutils [None req-b0675271-14e3-4441-9ffe-75eaaf12b1f3 tempest-VolumesActionsTest-1687831653 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 19:01:33 devstack cinder-volume[84538]: DEBUG oslo_concurrency.lockutils [None req-b0675271-14e3-4441-9ffe-75eaaf12b1f3 tempest-VolumesActionsTest-1687831653 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=84538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 19:01:33 devstack cinder-volume[84538]: DEBUG cinder.volume.drivers.quobyte [None req-b0675271-14e3-4441-9ffe-75eaaf12b1f3 tempest-VolumesActionsTest-1687831653 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-34312b00-dd6d-45bb-af98-75855cea8e48': None} {{(pid=84538) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 19:01:33 devstack cinder-volume[84538]: DEBUG cinder.volume.drivers.quobyte [None req-b0675271-14e3-4441-9ffe-75eaaf12b1f3 tempest-VolumesActionsTest-1687831653 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-34312b00-dd6d-45bb-af98-75855cea8e48'] {{(pid=84538) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 19:01:33 devstack cinder-volume[84538]: DEBUG oslo_concurrency.lockutils [None req-b0675271-14e3-4441-9ffe-75eaaf12b1f3 tempest-VolumesActionsTest-1687831653 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=84538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 19:01:33 devstack cinder-volume[84538]: DEBUG cinder.volume.drivers.quobyte [None req-b0675271-14e3-4441-9ffe-75eaaf12b1f3 tempest-VolumesActionsTest-1687831653 None] Selected osci02.corp.quobyte.com/cinder-vol-34312b00-dd6d-45bb-af98-75855cea8e48 as target Quobyte volume. {{(pid=84538) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 29 19:01:33 devstack cinder-volume[84538]: INFO cinder.volume.drivers.remotefs [None req-b0675271-14e3-4441-9ffe-75eaaf12b1f3 tempest-VolumesActionsTest-1687831653 None] casted to osci02.corp.quobyte.com/cinder-vol-34312b00-dd6d-45bb-af98-75855cea8e48 Apr 29 19:01:33 devstack cinder-volume[84538]: DEBUG oslo_concurrency.processutils [None req-b0675271-14e3-4441-9ffe-75eaaf12b1f3 tempest-VolumesActionsTest-1687831653 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-9d71174d-80aa-474f-bae5-39c30f9044c8 1073741824 {{(pid=84538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 19:01:33 devstack sudo[90138]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-9d71174d-80aa-474f-bae5-39c30f9044c8 1073741824 Apr 29 19:01:33 devstack sudo[90138]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 19:01:33 devstack sudo[90135]: pam_unix(sudo:session): session closed for user root Apr 29 19:01:33 devstack cinder-volume[84538]: DEBUG oslo_concurrency.processutils [None req-233335e1-ef87-4b27-9de3-d801dab1c86a tempest-SnapshotMetadataTestJSON-944613313 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-6064853c-432e-401f-9fc0-7921731f1049" returned: 0 in 0.961s {{(pid=84538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 19:01:33 devstack cinder-volume[84538]: DEBUG oslo_concurrency.processutils [None req-233335e1-ef87-4b27-9de3-d801dab1c86a tempest-SnapshotMetadataTestJSON-944613313 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-6064853c-432e-401f-9fc0-7921731f1049 {{(pid=84538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 19:01:33 devstack sudo[90144]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-6064853c-432e-401f-9fc0-7921731f1049 Apr 29 19:01:33 devstack sudo[90144]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 19:01:33 devstack cinder-volume[84538]: DEBUG dbcounter [-] [84538] Writing DB stats cinder:SELECT=150,cinder:INSERT=41,cinder:UPDATE=164,cinder:DELETE=9 {{(pid=84538) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Apr 29 19:01:33 devstack cinder-volume[84538]: DEBUG dbcounter [-] [84538] Writing DB stats cinder:SELECT=154,cinder:INSERT=47,cinder:UPDATE=162,cinder:DELETE=9 {{(pid=84538) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Apr 29 19:01:33 devstack cinder-volume[84538]: INFO cinder.volume.manager [None req-a56e58ff-96b8-45f0-8fc1-baddc86eea32 tempest-GroupSnapshotsTest-1835037466 None] Update group completed successfully. Apr 29 19:01:34 devstack sudo[90138]: pam_unix(sudo:session): session closed for user root Apr 29 19:01:34 devstack cinder-volume[84538]: DEBUG oslo_concurrency.processutils [None req-b0675271-14e3-4441-9ffe-75eaaf12b1f3 tempest-VolumesActionsTest-1687831653 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-9d71174d-80aa-474f-bae5-39c30f9044c8 1073741824" returned: 0 in 0.982s {{(pid=84538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 19:01:34 devstack cinder-volume[84538]: DEBUG oslo_concurrency.processutils [None req-b0675271-14e3-4441-9ffe-75eaaf12b1f3 tempest-VolumesActionsTest-1687831653 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-9d71174d-80aa-474f-bae5-39c30f9044c8 {{(pid=84538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 19:01:34 devstack sudo[90144]: pam_unix(sudo:session): session closed for user root Apr 29 19:01:34 devstack cinder-volume[84538]: DEBUG oslo_concurrency.processutils [None req-233335e1-ef87-4b27-9de3-d801dab1c86a tempest-SnapshotMetadataTestJSON-944613313 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-6064853c-432e-401f-9fc0-7921731f1049" returned: 0 in 0.751s {{(pid=84538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 19:01:34 devstack sudo[90151]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-9d71174d-80aa-474f-bae5-39c30f9044c8 Apr 29 19:01:34 devstack sudo[90151]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 19:01:34 devstack cinder-volume[84538]: DEBUG cinder.coordination [None req-233335e1-ef87-4b27-9de3-d801dab1c86a tempest-SnapshotMetadataTestJSON-944613313 None] Lock "cinder-quobyte-6064853c-432e-401f-9fc0-7921731f1049" released by "delete_volume" :: held 1.808s {{(pid=84538) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 19:01:34 devstack cinder-volume[84538]: DEBUG cinder.quota [None req-233335e1-ef87-4b27-9de3-d801dab1c86a tempest-SnapshotMetadataTestJSON-944613313 None] Created reservations ['25b86a04-a2f9-4739-a107-7e62638bdf12', 'dcec8fd1-5724-4167-b085-36f82708927d', '03e56e90-b16c-4538-acf1-0ae743522515', '1745c231-4640-41cb-8117-f6019b9fcd1e'] {{(pid=84538) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 29 19:01:34 devstack cinder-volume[84538]: DEBUG oslo_concurrency.lockutils [None req-233335e1-ef87-4b27-9de3-d801dab1c86a tempest-SnapshotMetadataTestJSON-944613313 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 19:01:34 devstack cinder-volume[84538]: DEBUG oslo_concurrency.lockutils [None req-233335e1-ef87-4b27-9de3-d801dab1c86a tempest-SnapshotMetadataTestJSON-944613313 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 19:01:34 devstack cinder-volume[84538]: DEBUG cinder.volume.drivers.quobyte [None req-233335e1-ef87-4b27-9de3-d801dab1c86a tempest-SnapshotMetadataTestJSON-944613313 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-34312b00-dd6d-45bb-af98-75855cea8e48': None} {{(pid=84538) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 19:01:34 devstack cinder-volume[84538]: DEBUG cinder.volume.drivers.quobyte [None req-233335e1-ef87-4b27-9de3-d801dab1c86a tempest-SnapshotMetadataTestJSON-944613313 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-34312b00-dd6d-45bb-af98-75855cea8e48'] {{(pid=84538) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 19:01:34 devstack cinder-volume[84538]: DEBUG oslo_concurrency.lockutils [None req-233335e1-ef87-4b27-9de3-d801dab1c86a tempest-SnapshotMetadataTestJSON-944613313 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=84538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 19:01:34 devstack cinder-volume[84538]: DEBUG oslo_concurrency.processutils [None req-233335e1-ef87-4b27-9de3-d801dab1c86a tempest-SnapshotMetadataTestJSON-944613313 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d {{(pid=84538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 19:01:34 devstack sudo[90153]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d Apr 29 19:01:34 devstack sudo[90153]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 19:01:34 devstack sudo[90151]: pam_unix(sudo:session): session closed for user root Apr 29 19:01:34 devstack cinder-volume[84538]: DEBUG oslo_concurrency.processutils [None req-b0675271-14e3-4441-9ffe-75eaaf12b1f3 tempest-VolumesActionsTest-1687831653 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-9d71174d-80aa-474f-bae5-39c30f9044c8" returned: 0 in 0.714s {{(pid=84538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 19:01:34 devstack cinder-volume[84538]: DEBUG cinder.volume.drivers.quobyte [None req-b0675271-14e3-4441-9ffe-75eaaf12b1f3 tempest-VolumesActionsTest-1687831653 None] <== create_volume: return (1748ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-34312b00-dd6d-45bb-af98-75855cea8e48'} {{(pid=84538) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 29 19:01:34 devstack cinder-volume[84538]: DEBUG oslo_concurrency.lockutils [None req-b0675271-14e3-4441-9ffe-75eaaf12b1f3 tempest-VolumesActionsTest-1687831653 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.750s {{(pid=84538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 19:01:34 devstack cinder-volume[84538]: DEBUG cinder.volume.manager [None req-b0675271-14e3-4441-9ffe-75eaaf12b1f3 tempest-VolumesActionsTest-1687831653 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (dafd475c-9d9b-4023-8be2-956a0358a4db) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9d71174d-80aa-474f-bae5-39c30f9044c8', 'volume_size': 1}' {{(pid=84538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 19:01:34 devstack cinder-volume[84538]: DEBUG cinder.volume.manager [None req-b0675271-14e3-4441-9ffe-75eaaf12b1f3 tempest-VolumesActionsTest-1687831653 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (acea1f19-c9e6-4e8e-989d-7cd128a5f20c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 19:01:35 devstack cinder-volume[84538]: INFO cinder.volume.flows.manager.create_volume [None req-b0675271-14e3-4441-9ffe-75eaaf12b1f3 tempest-VolumesActionsTest-1687831653 None] Volume volume-9d71174d-80aa-474f-bae5-39c30f9044c8 (9d71174d-80aa-474f-bae5-39c30f9044c8): created successfully Apr 29 19:01:35 devstack cinder-volume[84538]: DEBUG cinder.volume.manager [None req-b0675271-14e3-4441-9ffe-75eaaf12b1f3 tempest-VolumesActionsTest-1687831653 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (acea1f19-c9e6-4e8e-989d-7cd128a5f20c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 19:01:35 devstack cinder-volume[84538]: DEBUG cinder.volume.manager [None req-b0675271-14e3-4441-9ffe-75eaaf12b1f3 tempest-VolumesActionsTest-1687831653 None] Flow 'volume_create_manager' (ad8f78b6-d0f5-41e1-84b2-032ab128a538) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84538) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 19:01:35 devstack cinder-volume[84538]: INFO cinder.volume.manager [None req-583a075d-b1a1-4b80-b2f0-2eac97470934 tempest-GroupSnapshotsTest-1835037466 None] Update group completed successfully. Apr 29 19:01:35 devstack cinder-volume[84538]: INFO cinder.volume.manager [None req-b0675271-14e3-4441-9ffe-75eaaf12b1f3 tempest-VolumesActionsTest-1687831653 None] Created volume successfully. Apr 29 19:01:35 devstack sudo[90153]: pam_unix(sudo:session): session closed for user root Apr 29 19:01:35 devstack cinder-volume[84538]: DEBUG oslo_concurrency.processutils [None req-233335e1-ef87-4b27-9de3-d801dab1c86a tempest-SnapshotMetadataTestJSON-944613313 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d" returned: 0 in 0.778s {{(pid=84538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 19:01:35 devstack cinder-volume[84538]: DEBUG cinder.manager [None req-233335e1-ef87-4b27-9de3-d801dab1c86a tempest-SnapshotMetadataTestJSON-944613313 None] Notifying Schedulers of capabilities ... {{(pid=84538) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 29 19:01:35 devstack cinder-volume[84538]: INFO cinder.volume.manager [None req-233335e1-ef87-4b27-9de3-d801dab1c86a tempest-SnapshotMetadataTestJSON-944613313 None] Deleted volume successfully. Apr 29 19:01:35 devstack cinder-volume[84538]: DEBUG cinder.coordination [None req-233335e1-ef87-4b27-9de3-d801dab1c86a tempest-SnapshotMetadataTestJSON-944613313 None] Lock "cinder-6064853c-432e-401f-9fc0-7921731f1049-delete_volume" released by "delete_volume" :: held 2.889s {{(pid=84538) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 19:01:35 devstack cinder-volume[84538]: DEBUG cinder.coordination [None req-572df1e3-9ed7-44d7-9334-8ae1e0d6ae76 tempest-VolumesActionsTest-927532498 None] Acquiring lock "cinder-9d71174d-80aa-474f-bae5-39c30f9044c8-delete_volume" by "delete_volume" {{(pid=84538) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 19:01:35 devstack cinder-volume[84538]: DEBUG cinder.coordination [None req-572df1e3-9ed7-44d7-9334-8ae1e0d6ae76 tempest-VolumesActionsTest-927532498 None] Lock "cinder-9d71174d-80aa-474f-bae5-39c30f9044c8-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=84538) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 19:01:35 devstack cinder-volume[84538]: DEBUG cinder.coordination [None req-572df1e3-9ed7-44d7-9334-8ae1e0d6ae76 tempest-VolumesActionsTest-927532498 None] Acquiring lock "cinder-quobyte-9d71174d-80aa-474f-bae5-39c30f9044c8" by "delete_volume" {{(pid=84538) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 19:01:35 devstack cinder-volume[84538]: DEBUG cinder.coordination [None req-572df1e3-9ed7-44d7-9334-8ae1e0d6ae76 tempest-VolumesActionsTest-927532498 None] Lock "cinder-quobyte-9d71174d-80aa-474f-bae5-39c30f9044c8" acquired by "delete_volume" :: waited 0.031s {{(pid=84538) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 19:01:35 devstack cinder-volume[84538]: DEBUG oslo.privsep.daemon [-] privsep: reply[34af9c84-aadc-4fb1-8d9e-0cee0188dcd2]: (4, 'qcow2') {{(pid=85803) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 19:01:35 devstack cinder-volume[84538]: DEBUG oslo_concurrency.processutils [None req-572df1e3-9ed7-44d7-9334-8ae1e0d6ae76 tempest-VolumesActionsTest-927532498 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-9d71174d-80aa-474f-bae5-39c30f9044c8 {{(pid=84538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 19:01:35 devstack sudo[90157]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-9d71174d-80aa-474f-bae5-39c30f9044c8 Apr 29 19:01:35 devstack sudo[90157]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 19:01:36 devstack cinder-volume[84538]: INFO cinder.volume.manager [None req-83d0faaa-ee02-40fc-bb67-0d92d6823250 tempest-GroupSnapshotsTest-1835037466 None] Update group completed successfully. Apr 29 19:01:36 devstack sudo[90157]: pam_unix(sudo:session): session closed for user root Apr 29 19:01:36 devstack cinder-volume[84538]: DEBUG oslo_concurrency.processutils [None req-572df1e3-9ed7-44d7-9334-8ae1e0d6ae76 tempest-VolumesActionsTest-927532498 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-9d71174d-80aa-474f-bae5-39c30f9044c8" returned: 0 in 0.922s {{(pid=84538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 19:01:36 devstack cinder-volume[84538]: DEBUG oslo_concurrency.processutils [None req-572df1e3-9ed7-44d7-9334-8ae1e0d6ae76 tempest-VolumesActionsTest-927532498 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-9d71174d-80aa-474f-bae5-39c30f9044c8 {{(pid=84538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 19:01:36 devstack sudo[90162]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-9d71174d-80aa-474f-bae5-39c30f9044c8 Apr 29 19:01:36 devstack sudo[90162]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 19:01:37 devstack sudo[90162]: pam_unix(sudo:session): session closed for user root Apr 29 19:01:37 devstack cinder-volume[84538]: DEBUG oslo_concurrency.processutils [None req-572df1e3-9ed7-44d7-9334-8ae1e0d6ae76 tempest-VolumesActionsTest-927532498 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-9d71174d-80aa-474f-bae5-39c30f9044c8" returned: 0 in 0.648s {{(pid=84538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 19:01:37 devstack cinder-volume[84538]: DEBUG cinder.coordination [None req-572df1e3-9ed7-44d7-9334-8ae1e0d6ae76 tempest-VolumesActionsTest-927532498 None] Lock "cinder-quobyte-9d71174d-80aa-474f-bae5-39c30f9044c8" released by "delete_volume" :: held 1.618s {{(pid=84538) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 19:01:37 devstack cinder-volume[84538]: DEBUG cinder.quota [None req-572df1e3-9ed7-44d7-9334-8ae1e0d6ae76 tempest-VolumesActionsTest-927532498 None] Created reservations ['a5f13e99-dd9d-4713-8420-9ef349e1d643', 'c965eafd-b531-47b3-9cd3-e53d3b02273b', 'edf50144-54d0-4078-98df-89e489228376', '56e0fa26-3472-411c-8e95-fa38f0b293b3'] {{(pid=84538) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 29 19:01:37 devstack cinder-volume[84538]: DEBUG oslo_concurrency.lockutils [None req-572df1e3-9ed7-44d7-9334-8ae1e0d6ae76 tempest-VolumesActionsTest-927532498 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 19:01:37 devstack cinder-volume[84538]: DEBUG oslo_concurrency.lockutils [None req-572df1e3-9ed7-44d7-9334-8ae1e0d6ae76 tempest-VolumesActionsTest-927532498 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 19:01:37 devstack cinder-volume[84538]: DEBUG cinder.volume.drivers.quobyte [None req-572df1e3-9ed7-44d7-9334-8ae1e0d6ae76 tempest-VolumesActionsTest-927532498 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-34312b00-dd6d-45bb-af98-75855cea8e48': None} {{(pid=84538) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 19:01:37 devstack cinder-volume[84538]: DEBUG cinder.volume.drivers.quobyte [None req-572df1e3-9ed7-44d7-9334-8ae1e0d6ae76 tempest-VolumesActionsTest-927532498 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-34312b00-dd6d-45bb-af98-75855cea8e48'] {{(pid=84538) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 19:01:37 devstack cinder-volume[84538]: DEBUG oslo_concurrency.lockutils [None req-572df1e3-9ed7-44d7-9334-8ae1e0d6ae76 tempest-VolumesActionsTest-927532498 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=84538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 19:01:37 devstack cinder-volume[84538]: DEBUG oslo_concurrency.processutils [None req-572df1e3-9ed7-44d7-9334-8ae1e0d6ae76 tempest-VolumesActionsTest-927532498 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d {{(pid=84538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 19:01:37 devstack sudo[90165]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d Apr 29 19:01:37 devstack sudo[90165]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 19:01:37 devstack sudo[90165]: pam_unix(sudo:session): session closed for user root Apr 29 19:01:37 devstack cinder-volume[84538]: DEBUG oslo_concurrency.processutils [None req-572df1e3-9ed7-44d7-9334-8ae1e0d6ae76 tempest-VolumesActionsTest-927532498 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d" returned: 0 in 0.665s {{(pid=84538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 19:01:37 devstack cinder-volume[84538]: DEBUG cinder.manager [None req-572df1e3-9ed7-44d7-9334-8ae1e0d6ae76 tempest-VolumesActionsTest-927532498 None] Notifying Schedulers of capabilities ... {{(pid=84538) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 29 19:01:37 devstack cinder-volume[84538]: INFO cinder.volume.manager [None req-572df1e3-9ed7-44d7-9334-8ae1e0d6ae76 tempest-VolumesActionsTest-927532498 None] Deleted volume successfully. Apr 29 19:01:37 devstack cinder-volume[84538]: DEBUG cinder.coordination [None req-572df1e3-9ed7-44d7-9334-8ae1e0d6ae76 tempest-VolumesActionsTest-927532498 None] Lock "cinder-9d71174d-80aa-474f-bae5-39c30f9044c8-delete_volume" released by "delete_volume" :: held 2.543s {{(pid=84538) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 19:01:38 devstack cinder-volume[84538]: DEBUG cinder.volume.flows.manager.create_volume [None req-0dd04c71-4bd4-4bc2-a448-7da060ab6d77 tempest-VolumesDeleteCascade-1314225595 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84538) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Apr 29 19:01:38 devstack cinder-volume[84538]: DEBUG cinder.volume.manager [None req-0dd04c71-4bd4-4bc2-a448-7da060ab6d77 tempest-VolumesDeleteCascade-1314225595 None] Flow 'volume_create_manager' (87965d13-33f7-45d3-bf90-3dda280845de) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84538) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 19:01:38 devstack cinder-volume[84538]: DEBUG cinder.volume.manager [None req-0dd04c71-4bd4-4bc2-a448-7da060ab6d77 tempest-VolumesDeleteCascade-1314225595 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0559564e-2f57-4636-ac5b-ca4939b7b0fb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 19:01:38 devstack cinder-volume[84538]: DEBUG cinder.volume.manager [None req-0dd04c71-4bd4-4bc2-a448-7da060ab6d77 tempest-VolumesDeleteCascade-1314225595 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0559564e-2f57-4636-ac5b-ca4939b7b0fb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-29T17:01:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-1447122524',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=363b2b67-b40a-4aea-a61a-58750417ef9c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='26acfb1208254d3ca0d297f4abbc3144',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T17:01:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T17:01:38Z,use_quota=True,user_id='5c5deee661434855ad8181b5b72c64da',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(62b05900-93e3-4190-a88f-1d87324303d1),volume_type_id=62b05900-93e3-4190-a88f-1d87324303d1)' {{(pid=84538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 19:01:38 devstack cinder-volume[84538]: DEBUG cinder.volume.manager [None req-0dd04c71-4bd4-4bc2-a448-7da060ab6d77 tempest-VolumesDeleteCascade-1314225595 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (04816e04-6fd5-4926-818a-7344c7171697) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 19:01:38 devstack cinder-volume[84538]: DEBUG cinder.volume.manager [None req-0dd04c71-4bd4-4bc2-a448-7da060ab6d77 tempest-VolumesDeleteCascade-1314225595 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (04816e04-6fd5-4926-818a-7344c7171697) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 19:01:38 devstack cinder-volume[84538]: DEBUG cinder.volume.manager [None req-0dd04c71-4bd4-4bc2-a448-7da060ab6d77 tempest-VolumesDeleteCascade-1314225595 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (525f4b4f-6139-4f54-91e3-94cb0fae71d1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 19:01:38 devstack cinder-volume[84538]: DEBUG cinder.volume.manager [None req-0dd04c71-4bd4-4bc2-a448-7da060ab6d77 tempest-VolumesDeleteCascade-1314225595 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (525f4b4f-6139-4f54-91e3-94cb0fae71d1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '363b2b67-b40a-4aea-a61a-58750417ef9c', 'volume_name': 'volume-363b2b67-b40a-4aea-a61a-58750417ef9c', 'volume_size': 1}' {{(pid=84538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 19:01:38 devstack cinder-volume[84538]: DEBUG cinder.volume.manager [None req-0dd04c71-4bd4-4bc2-a448-7da060ab6d77 tempest-VolumesDeleteCascade-1314225595 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6368833e-a88d-4107-891c-27658306cbbb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 19:01:38 devstack cinder-volume[84538]: DEBUG cinder.volume.manager [None req-0dd04c71-4bd4-4bc2-a448-7da060ab6d77 tempest-VolumesDeleteCascade-1314225595 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6368833e-a88d-4107-891c-27658306cbbb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 19:01:38 devstack cinder-volume[84538]: DEBUG cinder.volume.manager [None req-0dd04c71-4bd4-4bc2-a448-7da060ab6d77 tempest-VolumesDeleteCascade-1314225595 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bfd83c87-882b-45dd-80ac-5ba4257ffc89) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 19:01:38 devstack cinder-volume[84538]: INFO cinder.volume.flows.manager.create_volume [None req-0dd04c71-4bd4-4bc2-a448-7da060ab6d77 tempest-VolumesDeleteCascade-1314225595 None] Volume 363b2b67-b40a-4aea-a61a-58750417ef9c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-363b2b67-b40a-4aea-a61a-58750417ef9c', 'volume_size': 1} Apr 29 19:01:38 devstack cinder-volume[84538]: DEBUG oslo_concurrency.lockutils [None req-0dd04c71-4bd4-4bc2-a448-7da060ab6d77 tempest-VolumesDeleteCascade-1314225595 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 19:01:38 devstack cinder-volume[84538]: DEBUG oslo_concurrency.lockutils [None req-0dd04c71-4bd4-4bc2-a448-7da060ab6d77 tempest-VolumesDeleteCascade-1314225595 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=84538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 19:01:38 devstack cinder-volume[84538]: DEBUG cinder.volume.drivers.quobyte [None req-0dd04c71-4bd4-4bc2-a448-7da060ab6d77 tempest-VolumesDeleteCascade-1314225595 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-29T17:01:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-1447122524',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=363b2b67-b40a-4aea-a61a-58750417ef9c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='26acfb1208254d3ca0d297f4abbc3144',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T17:01:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T17:01:38Z,use_quota=True,user_id='5c5deee661434855ad8181b5b72c64da',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(62b05900-93e3-4190-a88f-1d87324303d1),volume_type_id=62b05900-93e3-4190-a88f-1d87324303d1)}" {{(pid=84538) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 29 19:01:38 devstack cinder-volume[84538]: DEBUG cinder.volume.drivers.remotefs [None req-0dd04c71-4bd4-4bc2-a448-7da060ab6d77 tempest-VolumesDeleteCascade-1314225595 None] Creating volume 363b2b67-b40a-4aea-a61a-58750417ef9c {{(pid=84538) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 29 19:01:38 devstack cinder-volume[84538]: DEBUG oslo_concurrency.lockutils [None req-0dd04c71-4bd4-4bc2-a448-7da060ab6d77 tempest-VolumesDeleteCascade-1314225595 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 19:01:38 devstack cinder-volume[84538]: DEBUG oslo_concurrency.lockutils [None req-0dd04c71-4bd4-4bc2-a448-7da060ab6d77 tempest-VolumesDeleteCascade-1314225595 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=84538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 19:01:38 devstack cinder-volume[84538]: DEBUG cinder.volume.drivers.quobyte [None req-0dd04c71-4bd4-4bc2-a448-7da060ab6d77 tempest-VolumesDeleteCascade-1314225595 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-34312b00-dd6d-45bb-af98-75855cea8e48': None} {{(pid=84538) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 19:01:38 devstack cinder-volume[84538]: DEBUG cinder.volume.drivers.quobyte [None req-0dd04c71-4bd4-4bc2-a448-7da060ab6d77 tempest-VolumesDeleteCascade-1314225595 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-34312b00-dd6d-45bb-af98-75855cea8e48'] {{(pid=84538) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 19:01:38 devstack cinder-volume[84538]: DEBUG oslo_concurrency.lockutils [None req-0dd04c71-4bd4-4bc2-a448-7da060ab6d77 tempest-VolumesDeleteCascade-1314225595 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=84538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 19:01:38 devstack cinder-volume[84538]: DEBUG cinder.volume.drivers.quobyte [None req-0dd04c71-4bd4-4bc2-a448-7da060ab6d77 tempest-VolumesDeleteCascade-1314225595 None] Selected osci02.corp.quobyte.com/cinder-vol-34312b00-dd6d-45bb-af98-75855cea8e48 as target Quobyte volume. {{(pid=84538) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 29 19:01:38 devstack cinder-volume[84538]: INFO cinder.volume.drivers.remotefs [None req-0dd04c71-4bd4-4bc2-a448-7da060ab6d77 tempest-VolumesDeleteCascade-1314225595 None] casted to osci02.corp.quobyte.com/cinder-vol-34312b00-dd6d-45bb-af98-75855cea8e48 Apr 29 19:01:38 devstack cinder-volume[84538]: DEBUG oslo_concurrency.processutils [None req-0dd04c71-4bd4-4bc2-a448-7da060ab6d77 tempest-VolumesDeleteCascade-1314225595 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-363b2b67-b40a-4aea-a61a-58750417ef9c 1073741824 {{(pid=84538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 19:01:38 devstack cinder-volume[84538]: INFO cinder.volume.manager [None req-a1566296-9712-4cd0-adfa-5b9d52981e31 tempest-GroupSnapshotsTest-1835037466 None] GroupSnapshot d08068b9-c31a-49a2-9f9e-a74ca4ab45fc: creating. Apr 29 19:01:38 devstack sudo[90171]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-363b2b67-b40a-4aea-a61a-58750417ef9c 1073741824 Apr 29 19:01:38 devstack sudo[90171]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 19:01:38 devstack cinder-volume[84538]: DEBUG cinder.volume.manager [None req-a1566296-9712-4cd0-adfa-5b9d52981e31 tempest-GroupSnapshotsTest-1835037466 None] Group snapshot d08068b9-c31a-49a2-9f9e-a74ca4ab45fc: creating. {{(pid=84538) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4175}} Apr 29 19:01:38 devstack cinder-volume[84538]: DEBUG oslo_concurrency.lockutils [None req-a1566296-9712-4cd0-adfa-5b9d52981e31 tempest-GroupSnapshotsTest-1835037466 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=84538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 19:01:38 devstack cinder-volume[84538]: DEBUG cinder.volume.flows.manager.create_volume [None req-74b1314d-77ca-40b3-8e7a-eef70185b447 tempest-VolumesActionsTest-1687831653 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84538) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Apr 29 19:01:38 devstack cinder-volume[84538]: DEBUG cinder.volume.manager [None req-74b1314d-77ca-40b3-8e7a-eef70185b447 tempest-VolumesActionsTest-1687831653 None] Flow 'volume_create_manager' (96bbc2aa-8cef-4a95-aea2-a98eb9c468e1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84538) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 19:01:38 devstack cinder-volume[84538]: DEBUG cinder.volume.manager [None req-74b1314d-77ca-40b3-8e7a-eef70185b447 tempest-VolumesActionsTest-1687831653 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6ab4be82-da20-4070-b15a-7f5825cbc1a5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 19:01:38 devstack cinder-volume[84538]: DEBUG cinder.volume.manager [None req-74b1314d-77ca-40b3-8e7a-eef70185b447 tempest-VolumesActionsTest-1687831653 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6ab4be82-da20-4070-b15a-7f5825cbc1a5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-29T17:01:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-779822383',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f18c72e5-6b3c-4fa9-ba3d-e4f1013c78e6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a39f1f9e4e364982af869dd2b24dfe70',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T17:01:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T17:01:39Z,use_quota=True,user_id='0feaa082ee4740958e7eb31611d1e836',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(62b05900-93e3-4190-a88f-1d87324303d1),volume_type_id=62b05900-93e3-4190-a88f-1d87324303d1)' {{(pid=84538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 19:01:38 devstack cinder-volume[84538]: DEBUG cinder.volume.manager [None req-74b1314d-77ca-40b3-8e7a-eef70185b447 tempest-VolumesActionsTest-1687831653 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ea791dc0-ca23-4f5f-a982-035a2942d14d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 19:01:38 devstack cinder-volume[84538]: DEBUG cinder.volume.manager [None req-74b1314d-77ca-40b3-8e7a-eef70185b447 tempest-VolumesActionsTest-1687831653 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ea791dc0-ca23-4f5f-a982-035a2942d14d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 19:01:38 devstack cinder-volume[84538]: DEBUG cinder.volume.manager [None req-74b1314d-77ca-40b3-8e7a-eef70185b447 tempest-VolumesActionsTest-1687831653 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ab1775e3-1fc2-445c-a0c9-bcf051447ed9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 19:01:38 devstack cinder-volume[84538]: DEBUG cinder.volume.manager [None req-74b1314d-77ca-40b3-8e7a-eef70185b447 tempest-VolumesActionsTest-1687831653 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ab1775e3-1fc2-445c-a0c9-bcf051447ed9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f18c72e5-6b3c-4fa9-ba3d-e4f1013c78e6', 'volume_name': 'volume-f18c72e5-6b3c-4fa9-ba3d-e4f1013c78e6', 'volume_size': 1}' {{(pid=84538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 19:01:38 devstack cinder-volume[84538]: DEBUG cinder.volume.manager [None req-74b1314d-77ca-40b3-8e7a-eef70185b447 tempest-VolumesActionsTest-1687831653 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6fae1e28-0d09-4521-8988-c66e7ea68e4f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 19:01:38 devstack cinder-volume[84538]: DEBUG cinder.volume.manager [None req-74b1314d-77ca-40b3-8e7a-eef70185b447 tempest-VolumesActionsTest-1687831653 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6fae1e28-0d09-4521-8988-c66e7ea68e4f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 19:01:38 devstack cinder-volume[84538]: DEBUG cinder.volume.manager [None req-74b1314d-77ca-40b3-8e7a-eef70185b447 tempest-VolumesActionsTest-1687831653 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2edcea77-d3f9-4e04-bd9b-77af3f5cbbba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 19:01:38 devstack cinder-volume[84538]: INFO cinder.volume.flows.manager.create_volume [None req-74b1314d-77ca-40b3-8e7a-eef70185b447 tempest-VolumesActionsTest-1687831653 None] Volume f18c72e5-6b3c-4fa9-ba3d-e4f1013c78e6: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f18c72e5-6b3c-4fa9-ba3d-e4f1013c78e6', 'volume_size': 1} Apr 29 19:01:38 devstack cinder-volume[84538]: DEBUG oslo_concurrency.lockutils [None req-74b1314d-77ca-40b3-8e7a-eef70185b447 tempest-VolumesActionsTest-1687831653 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 19:01:39 devstack sudo[90171]: pam_unix(sudo:session): session closed for user root Apr 29 19:01:39 devstack cinder-volume[84538]: DEBUG oslo_concurrency.processutils [None req-0dd04c71-4bd4-4bc2-a448-7da060ab6d77 tempest-VolumesDeleteCascade-1314225595 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-363b2b67-b40a-4aea-a61a-58750417ef9c 1073741824" returned: 0 in 0.931s {{(pid=84538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 19:01:39 devstack cinder-volume[84538]: DEBUG oslo_concurrency.processutils [None req-0dd04c71-4bd4-4bc2-a448-7da060ab6d77 tempest-VolumesDeleteCascade-1314225595 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-363b2b67-b40a-4aea-a61a-58750417ef9c {{(pid=84538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 19:01:39 devstack sudo[90176]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-363b2b67-b40a-4aea-a61a-58750417ef9c Apr 29 19:01:39 devstack sudo[90176]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 19:01:39 devstack sudo[90176]: pam_unix(sudo:session): session closed for user root Apr 29 19:01:39 devstack cinder-volume[84538]: DEBUG oslo_concurrency.processutils [None req-0dd04c71-4bd4-4bc2-a448-7da060ab6d77 tempest-VolumesDeleteCascade-1314225595 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-363b2b67-b40a-4aea-a61a-58750417ef9c" returned: 0 in 0.675s {{(pid=84538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 19:01:39 devstack cinder-volume[84538]: DEBUG cinder.volume.drivers.quobyte [None req-0dd04c71-4bd4-4bc2-a448-7da060ab6d77 tempest-VolumesDeleteCascade-1314225595 None] <== create_volume: return (1644ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-34312b00-dd6d-45bb-af98-75855cea8e48'} {{(pid=84538) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 29 19:01:39 devstack cinder-volume[84538]: DEBUG oslo_concurrency.lockutils [None req-0dd04c71-4bd4-4bc2-a448-7da060ab6d77 tempest-VolumesDeleteCascade-1314225595 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.647s {{(pid=84538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 19:01:39 devstack cinder-volume[84538]: DEBUG oslo_concurrency.lockutils [None req-a1566296-9712-4cd0-adfa-5b9d52981e31 tempest-GroupSnapshotsTest-1835037466 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 1.582s {{(pid=84538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 19:01:39 devstack cinder-volume[84538]: DEBUG cinder.volume.manager [None req-0dd04c71-4bd4-4bc2-a448-7da060ab6d77 tempest-VolumesDeleteCascade-1314225595 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bfd83c87-882b-45dd-80ac-5ba4257ffc89) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-363b2b67-b40a-4aea-a61a-58750417ef9c', 'volume_size': 1}' {{(pid=84538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 19:01:39 devstack cinder-volume[84538]: DEBUG cinder.volume.manager [None req-0dd04c71-4bd4-4bc2-a448-7da060ab6d77 tempest-VolumesDeleteCascade-1314225595 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0d3e8137-2e7e-4f73-a6c5-95d4b5a33090) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 19:01:39 devstack cinder-volume[84538]: DEBUG cinder.volume.drivers.remotefs [None req-a1566296-9712-4cd0-adfa-5b9d52981e31 tempest-GroupSnapshotsTest-1835037466 None] Creating offline snapshot e4e71198-07c3-4361-bf3c-981d8dfed4c3 of volume 0210148a-07a3-4f2b-92dd-72ff91d5adb3 {{(pid=84538) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}} Apr 29 19:01:39 devstack cinder-volume[84538]: INFO cinder.volume.flows.manager.create_volume [None req-0dd04c71-4bd4-4bc2-a448-7da060ab6d77 tempest-VolumesDeleteCascade-1314225595 None] Volume volume-363b2b67-b40a-4aea-a61a-58750417ef9c (363b2b67-b40a-4aea-a61a-58750417ef9c): created successfully Apr 29 19:01:39 devstack cinder-volume[84538]: DEBUG cinder.volume.manager [None req-0dd04c71-4bd4-4bc2-a448-7da060ab6d77 tempest-VolumesDeleteCascade-1314225595 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0d3e8137-2e7e-4f73-a6c5-95d4b5a33090) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 19:01:39 devstack cinder-volume[84538]: DEBUG cinder.volume.manager [None req-0dd04c71-4bd4-4bc2-a448-7da060ab6d77 tempest-VolumesDeleteCascade-1314225595 None] Flow 'volume_create_manager' (87965d13-33f7-45d3-bf90-3dda280845de) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84538) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 19:01:39 devstack cinder-volume[84538]: DEBUG oslo.privsep.daemon [-] privsep: reply[66073a3d-eccf-4d38-b38c-029421c7fbe9]: (4, 'qcow2') {{(pid=85803) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 19:01:39 devstack cinder-volume[84538]: DEBUG oslo_concurrency.processutils [None req-a1566296-9712-4cd0-adfa-5b9d52981e31 tempest-GroupSnapshotsTest-1835037466 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-0210148a-07a3-4f2b-92dd-72ff91d5adb3 {{(pid=84538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 19:01:39 devstack cinder-volume[84538]: INFO cinder.volume.manager [None req-0dd04c71-4bd4-4bc2-a448-7da060ab6d77 tempest-VolumesDeleteCascade-1314225595 None] Created volume successfully. Apr 29 19:01:40 devstack sudo[90179]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-0210148a-07a3-4f2b-92dd-72ff91d5adb3 Apr 29 19:01:40 devstack sudo[90179]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 19:01:40 devstack cinder-volume[84538]: DEBUG oslo_concurrency.lockutils [None req-3a287ec3-2f23-446c-9d05-4d7f9ae27365 tempest-VolumesDeleteCascade-1314225595 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=84538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 19:01:40 devstack sudo[90179]: pam_unix(sudo:session): session closed for user root Apr 29 19:01:40 devstack cinder-volume[84538]: DEBUG oslo_concurrency.processutils [None req-a1566296-9712-4cd0-adfa-5b9d52981e31 tempest-GroupSnapshotsTest-1835037466 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-0210148a-07a3-4f2b-92dd-72ff91d5adb3" returned: 0 in 0.807s {{(pid=84538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 19:01:40 devstack cinder-volume[84538]: DEBUG oslo_concurrency.processutils [None req-a1566296-9712-4cd0-adfa-5b9d52981e31 tempest-GroupSnapshotsTest-1835037466 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-0210148a-07a3-4f2b-92dd-72ff91d5adb3,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-0210148a-07a3-4f2b-92dd-72ff91d5adb3.e4e71198-07c3-4361-bf3c-981d8dfed4c3 1G {{(pid=84538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 19:01:40 devstack sudo[90184]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-0210148a-07a3-4f2b-92dd-72ff91d5adb3,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-0210148a-07a3-4f2b-92dd-72ff91d5adb3.e4e71198-07c3-4361-bf3c-981d8dfed4c3 1G Apr 29 19:01:40 devstack sudo[90184]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 19:01:41 devstack sudo[90184]: pam_unix(sudo:session): session closed for user root Apr 29 19:01:41 devstack cinder-volume[84538]: DEBUG oslo_concurrency.processutils [None req-a1566296-9712-4cd0-adfa-5b9d52981e31 tempest-GroupSnapshotsTest-1835037466 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-0210148a-07a3-4f2b-92dd-72ff91d5adb3,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-0210148a-07a3-4f2b-92dd-72ff91d5adb3.e4e71198-07c3-4361-bf3c-981d8dfed4c3 1G" returned: 0 in 0.804s {{(pid=84538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 19:01:41 devstack cinder-volume[84538]: DEBUG oslo_concurrency.processutils [None req-a1566296-9712-4cd0-adfa-5b9d52981e31 tempest-GroupSnapshotsTest-1835037466 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-0210148a-07a3-4f2b-92dd-72ff91d5adb3 -F qcow2 /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-0210148a-07a3-4f2b-92dd-72ff91d5adb3.e4e71198-07c3-4361-bf3c-981d8dfed4c3 {{(pid=84538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 19:01:41 devstack sudo[90191]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-0210148a-07a3-4f2b-92dd-72ff91d5adb3 -F qcow2 /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-0210148a-07a3-4f2b-92dd-72ff91d5adb3.e4e71198-07c3-4361-bf3c-981d8dfed4c3 Apr 29 19:01:41 devstack sudo[90191]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 19:01:42 devstack sudo[90191]: pam_unix(sudo:session): session closed for user root Apr 29 19:01:42 devstack cinder-volume[84538]: DEBUG oslo_concurrency.processutils [None req-a1566296-9712-4cd0-adfa-5b9d52981e31 tempest-GroupSnapshotsTest-1835037466 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-0210148a-07a3-4f2b-92dd-72ff91d5adb3 -F qcow2 /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-0210148a-07a3-4f2b-92dd-72ff91d5adb3.e4e71198-07c3-4361-bf3c-981d8dfed4c3" returned: 0 in 0.681s {{(pid=84538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 19:01:42 devstack cinder-volume[84538]: WARNING cinder.volume.drivers.remotefs [None req-a1566296-9712-4cd0-adfa-5b9d52981e31 tempest-GroupSnapshotsTest-1835037466 None] /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-0210148a-07a3-4f2b-92dd-72ff91d5adb3.e4e71198-07c3-4361-bf3c-981d8dfed4c3 is being set with open permissions: ugo+rw: NotImplementedError Apr 29 19:01:42 devstack cinder-volume[84538]: DEBUG oslo_concurrency.processutils [None req-a1566296-9712-4cd0-adfa-5b9d52981e31 tempest-GroupSnapshotsTest-1835037466 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-0210148a-07a3-4f2b-92dd-72ff91d5adb3.e4e71198-07c3-4361-bf3c-981d8dfed4c3 {{(pid=84538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 19:01:42 devstack sudo[90196]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-0210148a-07a3-4f2b-92dd-72ff91d5adb3.e4e71198-07c3-4361-bf3c-981d8dfed4c3 Apr 29 19:01:42 devstack sudo[90196]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 19:01:42 devstack sudo[90196]: pam_unix(sudo:session): session closed for user root Apr 29 19:01:42 devstack cinder-volume[84538]: DEBUG oslo_concurrency.processutils [None req-a1566296-9712-4cd0-adfa-5b9d52981e31 tempest-GroupSnapshotsTest-1835037466 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-0210148a-07a3-4f2b-92dd-72ff91d5adb3.e4e71198-07c3-4361-bf3c-981d8dfed4c3" returned: 0 in 0.602s {{(pid=84538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 19:01:42 devstack cinder-volume[84538]: DEBUG oslo_concurrency.processutils [None req-a1566296-9712-4cd0-adfa-5b9d52981e31 tempest-GroupSnapshotsTest-1835037466 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-0210148a-07a3-4f2b-92dd-72ff91d5adb3.info {{(pid=84538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 19:01:42 devstack sudo[90201]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-0210148a-07a3-4f2b-92dd-72ff91d5adb3.info Apr 29 19:01:42 devstack sudo[90201]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 19:01:43 devstack cinder-volume[84538]: DEBUG cinder.volume.flows.manager.create_volume [None req-681829ee-98fe-4844-9646-a7cd4db0bad9 tempest-VolumeQuotasNegativeTestJSON-1422550780 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84538) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Apr 29 19:01:43 devstack cinder-volume[84538]: DEBUG cinder.volume.manager [None req-681829ee-98fe-4844-9646-a7cd4db0bad9 tempest-VolumeQuotasNegativeTestJSON-1422550780 None] Flow 'volume_create_manager' (bed89682-026f-4f31-8328-9f4d44f750e8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84538) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 19:01:43 devstack cinder-volume[84538]: DEBUG cinder.volume.manager [None req-681829ee-98fe-4844-9646-a7cd4db0bad9 tempest-VolumeQuotasNegativeTestJSON-1422550780 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c233c3b5-bf4b-4763-b6ec-da825615ebbd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 19:01:43 devstack cinder-volume[84538]: DEBUG cinder.volume.manager [None req-681829ee-98fe-4844-9646-a7cd4db0bad9 tempest-VolumeQuotasNegativeTestJSON-1422550780 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c233c3b5-bf4b-4763-b6ec-da825615ebbd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-29T17:01:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasNegativeTestJSON-Volume-704889784',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=782e6e28-03ff-456c-84aa-283c91f3c9bb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f5b960e4908546c8b38a41249d52265a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T17:01:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T17:01:43Z,use_quota=True,user_id='761e91d91297462598409c3a8d28c584',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(62b05900-93e3-4190-a88f-1d87324303d1),volume_type_id=62b05900-93e3-4190-a88f-1d87324303d1)' {{(pid=84538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 19:01:43 devstack cinder-volume[84538]: DEBUG cinder.volume.manager [None req-681829ee-98fe-4844-9646-a7cd4db0bad9 tempest-VolumeQuotasNegativeTestJSON-1422550780 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fb02514a-66c7-44dd-88e3-5d7730730e4b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 19:01:43 devstack cinder-volume[84538]: DEBUG cinder.volume.manager [None req-681829ee-98fe-4844-9646-a7cd4db0bad9 tempest-VolumeQuotasNegativeTestJSON-1422550780 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fb02514a-66c7-44dd-88e3-5d7730730e4b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 19:01:43 devstack cinder-volume[84538]: DEBUG cinder.volume.manager [None req-681829ee-98fe-4844-9646-a7cd4db0bad9 tempest-VolumeQuotasNegativeTestJSON-1422550780 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5e765b6a-4969-49cd-a784-937cbb9359cb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 19:01:43 devstack cinder-volume[84538]: DEBUG cinder.volume.manager [None req-681829ee-98fe-4844-9646-a7cd4db0bad9 tempest-VolumeQuotasNegativeTestJSON-1422550780 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5e765b6a-4969-49cd-a784-937cbb9359cb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '782e6e28-03ff-456c-84aa-283c91f3c9bb', 'volume_name': 'volume-782e6e28-03ff-456c-84aa-283c91f3c9bb', 'volume_size': 1}' {{(pid=84538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 19:01:43 devstack cinder-volume[84538]: DEBUG cinder.volume.manager [None req-681829ee-98fe-4844-9646-a7cd4db0bad9 tempest-VolumeQuotasNegativeTestJSON-1422550780 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9e20bf44-f959-4052-9936-d1a1494f0412) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 19:01:43 devstack cinder-volume[84538]: DEBUG cinder.volume.manager [None req-681829ee-98fe-4844-9646-a7cd4db0bad9 tempest-VolumeQuotasNegativeTestJSON-1422550780 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9e20bf44-f959-4052-9936-d1a1494f0412) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 19:01:43 devstack cinder-volume[84538]: DEBUG cinder.volume.manager [None req-681829ee-98fe-4844-9646-a7cd4db0bad9 tempest-VolumeQuotasNegativeTestJSON-1422550780 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (90a0192b-b1f7-4055-a098-83f01539f33a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 19:01:43 devstack cinder-volume[84538]: INFO cinder.volume.flows.manager.create_volume [None req-681829ee-98fe-4844-9646-a7cd4db0bad9 tempest-VolumeQuotasNegativeTestJSON-1422550780 None] Volume 782e6e28-03ff-456c-84aa-283c91f3c9bb: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-782e6e28-03ff-456c-84aa-283c91f3c9bb', 'volume_size': 1} Apr 29 19:01:43 devstack cinder-volume[84538]: DEBUG oslo_concurrency.lockutils [None req-681829ee-98fe-4844-9646-a7cd4db0bad9 tempest-VolumeQuotasNegativeTestJSON-1422550780 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 19:01:43 devstack sudo[90201]: pam_unix(sudo:session): session closed for user root Apr 29 19:01:43 devstack cinder-volume[84538]: DEBUG oslo_concurrency.processutils [None req-a1566296-9712-4cd0-adfa-5b9d52981e31 tempest-GroupSnapshotsTest-1835037466 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-0210148a-07a3-4f2b-92dd-72ff91d5adb3.info" returned: 0 in 0.618s {{(pid=84538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 19:01:43 devstack cinder-volume[84538]: WARNING cinder.volume.drivers.remotefs [None req-a1566296-9712-4cd0-adfa-5b9d52981e31 tempest-GroupSnapshotsTest-1835037466 None] /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-0210148a-07a3-4f2b-92dd-72ff91d5adb3.info is being set with open permissions: ugo+rw: NotImplementedError Apr 29 19:01:43 devstack cinder-volume[84538]: DEBUG oslo_concurrency.processutils [None req-a1566296-9712-4cd0-adfa-5b9d52981e31 tempest-GroupSnapshotsTest-1835037466 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-0210148a-07a3-4f2b-92dd-72ff91d5adb3.info {{(pid=84538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 19:01:43 devstack sudo[90240]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-0210148a-07a3-4f2b-92dd-72ff91d5adb3.info Apr 29 19:01:43 devstack sudo[90240]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 19:01:44 devstack sudo[90240]: pam_unix(sudo:session): session closed for user root Apr 29 19:01:44 devstack cinder-volume[84538]: DEBUG oslo_concurrency.processutils [None req-a1566296-9712-4cd0-adfa-5b9d52981e31 tempest-GroupSnapshotsTest-1835037466 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-0210148a-07a3-4f2b-92dd-72ff91d5adb3.info" returned: 0 in 0.608s {{(pid=84538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 19:01:44 devstack cinder-volume[84538]: DEBUG oslo_concurrency.lockutils [None req-a1566296-9712-4cd0-adfa-5b9d52981e31 tempest-GroupSnapshotsTest-1835037466 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.230s {{(pid=84538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 19:01:44 devstack cinder-volume[84538]: DEBUG oslo_concurrency.lockutils [None req-a1566296-9712-4cd0-adfa-5b9d52981e31 tempest-GroupSnapshotsTest-1835037466 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=84538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 19:01:44 devstack cinder-volume[84538]: DEBUG oslo_concurrency.lockutils [None req-a1566296-9712-4cd0-adfa-5b9d52981e31 tempest-GroupSnapshotsTest-1835037466 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.000s {{(pid=84538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 19:01:44 devstack cinder-volume[84538]: DEBUG cinder.volume.drivers.remotefs [None req-a1566296-9712-4cd0-adfa-5b9d52981e31 tempest-GroupSnapshotsTest-1835037466 None] Creating offline snapshot f3f276a9-9d8e-4f4b-af67-125b718fe290 of volume ce170d29-c990-4cf6-85d1-20cfda253ab6 {{(pid=84538) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}} Apr 29 19:01:44 devstack cinder-volume[84538]: DEBUG oslo.privsep.daemon [-] privsep: reply[6a708593-bb39-4a66-b852-c20a10c81b92]: (4, 'qcow2') {{(pid=85803) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 19:01:44 devstack cinder-volume[84538]: DEBUG oslo_concurrency.processutils [None req-a1566296-9712-4cd0-adfa-5b9d52981e31 tempest-GroupSnapshotsTest-1835037466 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-ce170d29-c990-4cf6-85d1-20cfda253ab6 {{(pid=84538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 19:01:44 devstack sudo[90243]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-ce170d29-c990-4cf6-85d1-20cfda253ab6 Apr 29 19:01:44 devstack sudo[90243]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 19:01:44 devstack sudo[90243]: pam_unix(sudo:session): session closed for user root Apr 29 19:01:44 devstack cinder-volume[84538]: DEBUG oslo_concurrency.processutils [None req-a1566296-9712-4cd0-adfa-5b9d52981e31 tempest-GroupSnapshotsTest-1835037466 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-ce170d29-c990-4cf6-85d1-20cfda253ab6" returned: 0 in 0.685s {{(pid=84538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 19:01:44 devstack cinder-volume[84538]: DEBUG oslo_concurrency.processutils [None req-a1566296-9712-4cd0-adfa-5b9d52981e31 tempest-GroupSnapshotsTest-1835037466 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-ce170d29-c990-4cf6-85d1-20cfda253ab6,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-ce170d29-c990-4cf6-85d1-20cfda253ab6.f3f276a9-9d8e-4f4b-af67-125b718fe290 1G {{(pid=84538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 19:01:44 devstack sudo[90248]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-ce170d29-c990-4cf6-85d1-20cfda253ab6,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-ce170d29-c990-4cf6-85d1-20cfda253ab6.f3f276a9-9d8e-4f4b-af67-125b718fe290 1G Apr 29 19:01:44 devstack sudo[90248]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 19:01:45 devstack sudo[90248]: pam_unix(sudo:session): session closed for user root Apr 29 19:01:45 devstack cinder-volume[84538]: DEBUG oslo_concurrency.processutils [None req-a1566296-9712-4cd0-adfa-5b9d52981e31 tempest-GroupSnapshotsTest-1835037466 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-ce170d29-c990-4cf6-85d1-20cfda253ab6,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-ce170d29-c990-4cf6-85d1-20cfda253ab6.f3f276a9-9d8e-4f4b-af67-125b718fe290 1G" returned: 0 in 0.729s {{(pid=84538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 19:01:45 devstack cinder-volume[84538]: DEBUG oslo_concurrency.processutils [None req-a1566296-9712-4cd0-adfa-5b9d52981e31 tempest-GroupSnapshotsTest-1835037466 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ce170d29-c990-4cf6-85d1-20cfda253ab6 -F qcow2 /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-ce170d29-c990-4cf6-85d1-20cfda253ab6.f3f276a9-9d8e-4f4b-af67-125b718fe290 {{(pid=84538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 19:01:45 devstack sudo[90253]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ce170d29-c990-4cf6-85d1-20cfda253ab6 -F qcow2 /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-ce170d29-c990-4cf6-85d1-20cfda253ab6.f3f276a9-9d8e-4f4b-af67-125b718fe290 Apr 29 19:01:45 devstack sudo[90253]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 19:01:46 devstack sudo[90253]: pam_unix(sudo:session): session closed for user root Apr 29 19:01:46 devstack cinder-volume[84538]: DEBUG oslo_concurrency.processutils [None req-a1566296-9712-4cd0-adfa-5b9d52981e31 tempest-GroupSnapshotsTest-1835037466 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ce170d29-c990-4cf6-85d1-20cfda253ab6 -F qcow2 /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-ce170d29-c990-4cf6-85d1-20cfda253ab6.f3f276a9-9d8e-4f4b-af67-125b718fe290" returned: 0 in 0.618s {{(pid=84538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 19:01:46 devstack cinder-volume[84538]: WARNING cinder.volume.drivers.remotefs [None req-a1566296-9712-4cd0-adfa-5b9d52981e31 tempest-GroupSnapshotsTest-1835037466 None] /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-ce170d29-c990-4cf6-85d1-20cfda253ab6.f3f276a9-9d8e-4f4b-af67-125b718fe290 is being set with open permissions: ugo+rw: NotImplementedError Apr 29 19:01:46 devstack cinder-volume[84538]: DEBUG oslo_concurrency.processutils [None req-a1566296-9712-4cd0-adfa-5b9d52981e31 tempest-GroupSnapshotsTest-1835037466 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-ce170d29-c990-4cf6-85d1-20cfda253ab6.f3f276a9-9d8e-4f4b-af67-125b718fe290 {{(pid=84538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 19:01:46 devstack sudo[90258]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-ce170d29-c990-4cf6-85d1-20cfda253ab6.f3f276a9-9d8e-4f4b-af67-125b718fe290 Apr 29 19:01:46 devstack sudo[90258]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 19:01:46 devstack sudo[90258]: pam_unix(sudo:session): session closed for user root Apr 29 19:01:46 devstack cinder-volume[84538]: DEBUG oslo_concurrency.processutils [None req-a1566296-9712-4cd0-adfa-5b9d52981e31 tempest-GroupSnapshotsTest-1835037466 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-ce170d29-c990-4cf6-85d1-20cfda253ab6.f3f276a9-9d8e-4f4b-af67-125b718fe290" returned: 0 in 0.581s {{(pid=84538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 19:01:46 devstack cinder-volume[84538]: DEBUG oslo_concurrency.processutils [None req-a1566296-9712-4cd0-adfa-5b9d52981e31 tempest-GroupSnapshotsTest-1835037466 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-ce170d29-c990-4cf6-85d1-20cfda253ab6.info {{(pid=84538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 19:01:46 devstack sudo[90261]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-ce170d29-c990-4cf6-85d1-20cfda253ab6.info Apr 29 19:01:46 devstack sudo[90261]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 19:01:47 devstack sudo[90261]: pam_unix(sudo:session): session closed for user root Apr 29 19:01:47 devstack cinder-volume[84538]: DEBUG oslo_concurrency.processutils [None req-a1566296-9712-4cd0-adfa-5b9d52981e31 tempest-GroupSnapshotsTest-1835037466 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-ce170d29-c990-4cf6-85d1-20cfda253ab6.info" returned: 0 in 0.580s {{(pid=84538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 19:01:47 devstack cinder-volume[84538]: WARNING cinder.volume.drivers.remotefs [None req-a1566296-9712-4cd0-adfa-5b9d52981e31 tempest-GroupSnapshotsTest-1835037466 None] /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-ce170d29-c990-4cf6-85d1-20cfda253ab6.info is being set with open permissions: ugo+rw: NotImplementedError Apr 29 19:01:47 devstack cinder-volume[84538]: DEBUG oslo_concurrency.processutils [None req-a1566296-9712-4cd0-adfa-5b9d52981e31 tempest-GroupSnapshotsTest-1835037466 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-ce170d29-c990-4cf6-85d1-20cfda253ab6.info {{(pid=84538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 19:01:47 devstack sudo[90264]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-ce170d29-c990-4cf6-85d1-20cfda253ab6.info Apr 29 19:01:47 devstack sudo[90264]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 19:01:47 devstack sudo[90264]: pam_unix(sudo:session): session closed for user root Apr 29 19:01:47 devstack cinder-volume[84538]: DEBUG oslo_concurrency.processutils [None req-a1566296-9712-4cd0-adfa-5b9d52981e31 tempest-GroupSnapshotsTest-1835037466 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-ce170d29-c990-4cf6-85d1-20cfda253ab6.info" returned: 0 in 0.575s {{(pid=84538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 19:01:47 devstack cinder-volume[84538]: DEBUG oslo_concurrency.lockutils [None req-a1566296-9712-4cd0-adfa-5b9d52981e31 tempest-GroupSnapshotsTest-1835037466 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.841s {{(pid=84538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 19:01:47 devstack cinder-volume[84538]: DEBUG oslo_concurrency.lockutils [None req-3a287ec3-2f23-446c-9d05-4d7f9ae27365 tempest-VolumesDeleteCascade-1314225595 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 7.486s {{(pid=84538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 19:01:47 devstack cinder-volume[84538]: DEBUG cinder.volume.drivers.remotefs [None req-3a287ec3-2f23-446c-9d05-4d7f9ae27365 tempest-VolumesDeleteCascade-1314225595 None] Creating offline snapshot 7296ba8c-4293-4139-a2e3-7f97420395c7 of volume 363b2b67-b40a-4aea-a61a-58750417ef9c {{(pid=84538) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}} Apr 29 19:01:47 devstack cinder-volume[84538]: DEBUG oslo.privsep.daemon [-] privsep: reply[43380728-d782-4eb3-bdfc-0987e1c8f3a9]: (4, 'qcow2') {{(pid=85803) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 19:01:47 devstack cinder-volume[84538]: DEBUG oslo_concurrency.processutils [None req-3a287ec3-2f23-446c-9d05-4d7f9ae27365 tempest-VolumesDeleteCascade-1314225595 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-363b2b67-b40a-4aea-a61a-58750417ef9c {{(pid=84538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 19:01:48 devstack sudo[90267]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-363b2b67-b40a-4aea-a61a-58750417ef9c Apr 29 19:01:48 devstack sudo[90267]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 19:01:48 devstack cinder-volume[84538]: INFO cinder.volume.manager [None req-a1566296-9712-4cd0-adfa-5b9d52981e31 tempest-GroupSnapshotsTest-1835037466 None] group_snapshot d08068b9-c31a-49a2-9f9e-a74ca4ab45fc: created successfully Apr 29 19:01:48 devstack sudo[90267]: pam_unix(sudo:session): session closed for user root Apr 29 19:01:48 devstack cinder-volume[84538]: DEBUG oslo_concurrency.processutils [None req-3a287ec3-2f23-446c-9d05-4d7f9ae27365 tempest-VolumesDeleteCascade-1314225595 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-363b2b67-b40a-4aea-a61a-58750417ef9c" returned: 0 in 0.716s {{(pid=84538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 19:01:48 devstack cinder-volume[84538]: DEBUG oslo_concurrency.processutils [None req-3a287ec3-2f23-446c-9d05-4d7f9ae27365 tempest-VolumesDeleteCascade-1314225595 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-363b2b67-b40a-4aea-a61a-58750417ef9c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-363b2b67-b40a-4aea-a61a-58750417ef9c.7296ba8c-4293-4139-a2e3-7f97420395c7 1G {{(pid=84538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 19:01:48 devstack sudo[90273]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-363b2b67-b40a-4aea-a61a-58750417ef9c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-363b2b67-b40a-4aea-a61a-58750417ef9c.7296ba8c-4293-4139-a2e3-7f97420395c7 1G Apr 29 19:01:48 devstack sudo[90273]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 19:01:48 devstack cinder-volume[84538]: INFO cinder.volume.manager [None req-d7fb5be1-e7c5-4caf-a394-d598db506d5e tempest-GroupSnapshotsTest-1835037466 None] group_snapshot d08068b9-c31a-49a2-9f9e-a74ca4ab45fc: deleting Apr 29 19:01:48 devstack cinder-volume[84538]: DEBUG cinder.volume.manager [None req-d7fb5be1-e7c5-4caf-a394-d598db506d5e tempest-GroupSnapshotsTest-1835037466 None] group_snapshot d08068b9-c31a-49a2-9f9e-a74ca4ab45fc: deleting {{(pid=84538) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4350}} Apr 29 19:01:48 devstack cinder-volume[84538]: DEBUG cinder.coordination [None req-d7fb5be1-e7c5-4caf-a394-d598db506d5e tempest-GroupSnapshotsTest-1835037466 None] Acquiring lock "cinder-quobyte-0210148a-07a3-4f2b-92dd-72ff91d5adb3" by "delete_snapshot" {{(pid=84538) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 19:01:48 devstack cinder-volume[84538]: DEBUG cinder.coordination [None req-d7fb5be1-e7c5-4caf-a394-d598db506d5e tempest-GroupSnapshotsTest-1835037466 None] Lock "cinder-quobyte-0210148a-07a3-4f2b-92dd-72ff91d5adb3" acquired by "delete_snapshot" :: waited 0.015s {{(pid=84538) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 19:01:48 devstack cinder-volume[84538]: DEBUG cinder.coordination [None req-d7fb5be1-e7c5-4caf-a394-d598db506d5e tempest-GroupSnapshotsTest-1835037466 None] Acquiring lock "cinder-quobyte-e4e71198-07c3-4361-bf3c-981d8dfed4c3" by "_delete_snapshot" {{(pid=84538) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 19:01:48 devstack cinder-volume[84538]: DEBUG cinder.coordination [None req-d7fb5be1-e7c5-4caf-a394-d598db506d5e tempest-GroupSnapshotsTest-1835037466 None] Lock "cinder-quobyte-e4e71198-07c3-4361-bf3c-981d8dfed4c3" acquired by "_delete_snapshot" :: waited 0.028s {{(pid=84538) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 19:01:48 devstack cinder-volume[84538]: DEBUG cinder.volume.drivers.remotefs [None req-d7fb5be1-e7c5-4caf-a394-d598db506d5e tempest-GroupSnapshotsTest-1835037466 None] Deleting offline snapshot e4e71198-07c3-4361-bf3c-981d8dfed4c3 of volume 0210148a-07a3-4f2b-92dd-72ff91d5adb3 {{(pid=84538) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 29 19:01:48 devstack cinder-volume[84538]: DEBUG cinder.volume.drivers.remotefs [None req-d7fb5be1-e7c5-4caf-a394-d598db506d5e tempest-GroupSnapshotsTest-1835037466 None] snapshot_file for this snap is: volume-0210148a-07a3-4f2b-92dd-72ff91d5adb3.e4e71198-07c3-4361-bf3c-981d8dfed4c3 {{(pid=84538) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 29 19:01:48 devstack cinder-volume[84538]: DEBUG oslo.privsep.daemon [-] privsep: reply[4a350b19-0920-4ab6-bfb7-bd6bfcdbd7c3]: (4, 'qcow2') {{(pid=85803) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 19:01:48 devstack cinder-volume[84538]: DEBUG oslo_concurrency.processutils [None req-d7fb5be1-e7c5-4caf-a394-d598db506d5e tempest-GroupSnapshotsTest-1835037466 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-0210148a-07a3-4f2b-92dd-72ff91d5adb3.e4e71198-07c3-4361-bf3c-981d8dfed4c3 {{(pid=84538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 19:01:49 devstack sudo[90275]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-0210148a-07a3-4f2b-92dd-72ff91d5adb3.e4e71198-07c3-4361-bf3c-981d8dfed4c3 Apr 29 19:01:49 devstack sudo[90275]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 19:01:49 devstack sudo[90273]: pam_unix(sudo:session): session closed for user root Apr 29 19:01:49 devstack cinder-volume[84538]: DEBUG oslo_concurrency.processutils [None req-3a287ec3-2f23-446c-9d05-4d7f9ae27365 tempest-VolumesDeleteCascade-1314225595 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-363b2b67-b40a-4aea-a61a-58750417ef9c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-363b2b67-b40a-4aea-a61a-58750417ef9c.7296ba8c-4293-4139-a2e3-7f97420395c7 1G" returned: 0 in 0.786s {{(pid=84538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 19:01:49 devstack cinder-volume[84538]: DEBUG oslo_concurrency.processutils [None req-3a287ec3-2f23-446c-9d05-4d7f9ae27365 tempest-VolumesDeleteCascade-1314225595 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-363b2b67-b40a-4aea-a61a-58750417ef9c -F qcow2 /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-363b2b67-b40a-4aea-a61a-58750417ef9c.7296ba8c-4293-4139-a2e3-7f97420395c7 {{(pid=84538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 19:01:49 devstack sudo[90280]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-363b2b67-b40a-4aea-a61a-58750417ef9c -F qcow2 /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-363b2b67-b40a-4aea-a61a-58750417ef9c.7296ba8c-4293-4139-a2e3-7f97420395c7 Apr 29 19:01:49 devstack sudo[90280]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 19:01:49 devstack sudo[90275]: pam_unix(sudo:session): session closed for user root Apr 29 19:01:49 devstack cinder-volume[84538]: DEBUG oslo_concurrency.processutils [None req-d7fb5be1-e7c5-4caf-a394-d598db506d5e tempest-GroupSnapshotsTest-1835037466 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-0210148a-07a3-4f2b-92dd-72ff91d5adb3.e4e71198-07c3-4361-bf3c-981d8dfed4c3" returned: 0 in 0.776s {{(pid=84538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 19:01:49 devstack cinder-volume[84538]: DEBUG cinder.volume.drivers.remotefs [None req-d7fb5be1-e7c5-4caf-a394-d598db506d5e tempest-GroupSnapshotsTest-1835037466 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-0210148a-07a3-4f2b-92dd-72ff91d5adb3(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=84538) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 29 19:01:49 devstack cinder-volume[84538]: DEBUG oslo.privsep.daemon [-] privsep: reply[473ca1d7-fb82-4a91-891c-4355db800f31]: (4, 'qcow2') {{(pid=85803) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 19:01:49 devstack cinder-volume[84538]: DEBUG oslo_concurrency.processutils [None req-d7fb5be1-e7c5-4caf-a394-d598db506d5e tempest-GroupSnapshotsTest-1835037466 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-0210148a-07a3-4f2b-92dd-72ff91d5adb3 {{(pid=84538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 19:01:49 devstack sudo[90285]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-0210148a-07a3-4f2b-92dd-72ff91d5adb3 Apr 29 19:01:49 devstack sudo[90285]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 19:01:50 devstack sudo[90280]: pam_unix(sudo:session): session closed for user root Apr 29 19:01:50 devstack cinder-volume[84538]: DEBUG oslo_concurrency.processutils [None req-3a287ec3-2f23-446c-9d05-4d7f9ae27365 tempest-VolumesDeleteCascade-1314225595 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-363b2b67-b40a-4aea-a61a-58750417ef9c -F qcow2 /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-363b2b67-b40a-4aea-a61a-58750417ef9c.7296ba8c-4293-4139-a2e3-7f97420395c7" returned: 0 in 0.664s {{(pid=84538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 19:01:50 devstack cinder-volume[84538]: WARNING cinder.volume.drivers.remotefs [None req-3a287ec3-2f23-446c-9d05-4d7f9ae27365 tempest-VolumesDeleteCascade-1314225595 None] /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-363b2b67-b40a-4aea-a61a-58750417ef9c.7296ba8c-4293-4139-a2e3-7f97420395c7 is being set with open permissions: ugo+rw Apr 29 19:01:50 devstack cinder-volume[84538]: DEBUG oslo_concurrency.processutils [None req-3a287ec3-2f23-446c-9d05-4d7f9ae27365 tempest-VolumesDeleteCascade-1314225595 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-363b2b67-b40a-4aea-a61a-58750417ef9c.7296ba8c-4293-4139-a2e3-7f97420395c7 {{(pid=84538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 19:01:50 devstack sudo[90290]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-363b2b67-b40a-4aea-a61a-58750417ef9c.7296ba8c-4293-4139-a2e3-7f97420395c7 Apr 29 19:01:50 devstack sudo[90290]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 19:01:50 devstack sudo[90285]: pam_unix(sudo:session): session closed for user root Apr 29 19:01:50 devstack cinder-volume[84538]: DEBUG oslo_concurrency.processutils [None req-d7fb5be1-e7c5-4caf-a394-d598db506d5e tempest-GroupSnapshotsTest-1835037466 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-0210148a-07a3-4f2b-92dd-72ff91d5adb3" returned: 0 in 0.769s {{(pid=84538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 19:01:50 devstack cinder-volume[84538]: DEBUG oslo_concurrency.processutils [None req-d7fb5be1-e7c5-4caf-a394-d598db506d5e tempest-GroupSnapshotsTest-1835037466 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-0210148a-07a3-4f2b-92dd-72ff91d5adb3.e4e71198-07c3-4361-bf3c-981d8dfed4c3 {{(pid=84538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 19:01:50 devstack sudo[90295]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-0210148a-07a3-4f2b-92dd-72ff91d5adb3.e4e71198-07c3-4361-bf3c-981d8dfed4c3 Apr 29 19:01:50 devstack sudo[90295]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 19:01:50 devstack sudo[90290]: pam_unix(sudo:session): session closed for user root Apr 29 19:01:50 devstack cinder-volume[84538]: DEBUG oslo_concurrency.processutils [None req-3a287ec3-2f23-446c-9d05-4d7f9ae27365 tempest-VolumesDeleteCascade-1314225595 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-363b2b67-b40a-4aea-a61a-58750417ef9c.7296ba8c-4293-4139-a2e3-7f97420395c7" returned: 0 in 0.643s {{(pid=84538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 19:01:50 devstack cinder-volume[84538]: DEBUG oslo_concurrency.processutils [None req-3a287ec3-2f23-446c-9d05-4d7f9ae27365 tempest-VolumesDeleteCascade-1314225595 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-363b2b67-b40a-4aea-a61a-58750417ef9c.info {{(pid=84538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 19:01:50 devstack sudo[90298]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-363b2b67-b40a-4aea-a61a-58750417ef9c.info Apr 29 19:01:50 devstack sudo[90298]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 19:01:51 devstack sudo[90295]: pam_unix(sudo:session): session closed for user root Apr 29 19:01:51 devstack cinder-volume[84538]: DEBUG oslo_concurrency.processutils [None req-d7fb5be1-e7c5-4caf-a394-d598db506d5e tempest-GroupSnapshotsTest-1835037466 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-0210148a-07a3-4f2b-92dd-72ff91d5adb3.e4e71198-07c3-4361-bf3c-981d8dfed4c3" returned: 0 in 0.733s {{(pid=84538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 19:01:51 devstack cinder-volume[84538]: DEBUG oslo_concurrency.processutils [None req-d7fb5be1-e7c5-4caf-a394-d598db506d5e tempest-GroupSnapshotsTest-1835037466 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-0210148a-07a3-4f2b-92dd-72ff91d5adb3.e4e71198-07c3-4361-bf3c-981d8dfed4c3 {{(pid=84538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 19:01:51 devstack sudo[90303]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-0210148a-07a3-4f2b-92dd-72ff91d5adb3.e4e71198-07c3-4361-bf3c-981d8dfed4c3 Apr 29 19:01:51 devstack sudo[90303]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 19:01:51 devstack sudo[90298]: pam_unix(sudo:session): session closed for user root Apr 29 19:01:51 devstack cinder-volume[84538]: DEBUG oslo_concurrency.processutils [None req-3a287ec3-2f23-446c-9d05-4d7f9ae27365 tempest-VolumesDeleteCascade-1314225595 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-363b2b67-b40a-4aea-a61a-58750417ef9c.info" returned: 0 in 0.633s {{(pid=84538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 19:01:51 devstack cinder-volume[84538]: WARNING cinder.volume.drivers.remotefs [None req-3a287ec3-2f23-446c-9d05-4d7f9ae27365 tempest-VolumesDeleteCascade-1314225595 None] /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-363b2b67-b40a-4aea-a61a-58750417ef9c.info is being set with open permissions: ugo+rw Apr 29 19:01:51 devstack cinder-volume[84538]: DEBUG oslo_concurrency.processutils [None req-3a287ec3-2f23-446c-9d05-4d7f9ae27365 tempest-VolumesDeleteCascade-1314225595 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-363b2b67-b40a-4aea-a61a-58750417ef9c.info {{(pid=84538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 19:01:51 devstack sudo[90306]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-363b2b67-b40a-4aea-a61a-58750417ef9c.info Apr 29 19:01:51 devstack sudo[90306]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 19:01:51 devstack sudo[90303]: pam_unix(sudo:session): session closed for user root Apr 29 19:01:51 devstack cinder-volume[84538]: DEBUG oslo_concurrency.processutils [None req-d7fb5be1-e7c5-4caf-a394-d598db506d5e tempest-GroupSnapshotsTest-1835037466 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-0210148a-07a3-4f2b-92dd-72ff91d5adb3.e4e71198-07c3-4361-bf3c-981d8dfed4c3" returned: 0 in 0.607s {{(pid=84538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 19:01:51 devstack cinder-volume[84538]: DEBUG cinder.coordination [None req-d7fb5be1-e7c5-4caf-a394-d598db506d5e tempest-GroupSnapshotsTest-1835037466 None] Lock "cinder-quobyte-e4e71198-07c3-4361-bf3c-981d8dfed4c3" released by "_delete_snapshot" :: held 2.985s {{(pid=84538) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 19:01:51 devstack cinder-volume[84538]: DEBUG cinder.coordination [None req-d7fb5be1-e7c5-4caf-a394-d598db506d5e tempest-GroupSnapshotsTest-1835037466 None] Lock "cinder-quobyte-0210148a-07a3-4f2b-92dd-72ff91d5adb3" released by "delete_snapshot" :: held 3.023s {{(pid=84538) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 19:01:51 devstack cinder-volume[84538]: DEBUG cinder.coordination [None req-d7fb5be1-e7c5-4caf-a394-d598db506d5e tempest-GroupSnapshotsTest-1835037466 None] Acquiring lock "cinder-quobyte-ce170d29-c990-4cf6-85d1-20cfda253ab6" by "delete_snapshot" {{(pid=84538) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 19:01:51 devstack cinder-volume[84538]: DEBUG cinder.coordination [None req-d7fb5be1-e7c5-4caf-a394-d598db506d5e tempest-GroupSnapshotsTest-1835037466 None] Lock "cinder-quobyte-ce170d29-c990-4cf6-85d1-20cfda253ab6" acquired by "delete_snapshot" :: waited 0.015s {{(pid=84538) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 19:01:51 devstack cinder-volume[84538]: DEBUG cinder.coordination [None req-d7fb5be1-e7c5-4caf-a394-d598db506d5e tempest-GroupSnapshotsTest-1835037466 None] Acquiring lock "cinder-quobyte-f3f276a9-9d8e-4f4b-af67-125b718fe290" by "_delete_snapshot" {{(pid=84538) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 19:01:51 devstack cinder-volume[84538]: DEBUG cinder.coordination [None req-d7fb5be1-e7c5-4caf-a394-d598db506d5e tempest-GroupSnapshotsTest-1835037466 None] Lock "cinder-quobyte-f3f276a9-9d8e-4f4b-af67-125b718fe290" acquired by "_delete_snapshot" :: waited 0.016s {{(pid=84538) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 19:01:51 devstack cinder-volume[84538]: DEBUG cinder.volume.drivers.remotefs [None req-d7fb5be1-e7c5-4caf-a394-d598db506d5e tempest-GroupSnapshotsTest-1835037466 None] Deleting offline snapshot f3f276a9-9d8e-4f4b-af67-125b718fe290 of volume ce170d29-c990-4cf6-85d1-20cfda253ab6 {{(pid=84538) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 29 19:01:51 devstack cinder-volume[84538]: DEBUG cinder.volume.drivers.remotefs [None req-d7fb5be1-e7c5-4caf-a394-d598db506d5e tempest-GroupSnapshotsTest-1835037466 None] snapshot_file for this snap is: volume-ce170d29-c990-4cf6-85d1-20cfda253ab6.f3f276a9-9d8e-4f4b-af67-125b718fe290 {{(pid=84538) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 29 19:01:51 devstack cinder-volume[84538]: DEBUG oslo.privsep.daemon [-] privsep: reply[8e3c8faa-a434-47b6-8875-01921fa5fdd7]: (4, 'qcow2') {{(pid=85803) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 19:01:51 devstack cinder-volume[84538]: DEBUG oslo_concurrency.processutils [None req-d7fb5be1-e7c5-4caf-a394-d598db506d5e tempest-GroupSnapshotsTest-1835037466 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-ce170d29-c990-4cf6-85d1-20cfda253ab6.f3f276a9-9d8e-4f4b-af67-125b718fe290 {{(pid=84538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 19:01:52 devstack sudo[90309]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-ce170d29-c990-4cf6-85d1-20cfda253ab6.f3f276a9-9d8e-4f4b-af67-125b718fe290 Apr 29 19:01:52 devstack sudo[90309]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 19:01:52 devstack sudo[90306]: pam_unix(sudo:session): session closed for user root Apr 29 19:01:52 devstack cinder-volume[84538]: DEBUG oslo_concurrency.processutils [None req-3a287ec3-2f23-446c-9d05-4d7f9ae27365 tempest-VolumesDeleteCascade-1314225595 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-363b2b67-b40a-4aea-a61a-58750417ef9c.info" returned: 0 in 0.644s {{(pid=84538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 19:01:52 devstack cinder-volume[84538]: DEBUG oslo_concurrency.lockutils [None req-3a287ec3-2f23-446c-9d05-4d7f9ae27365 tempest-VolumesDeleteCascade-1314225595 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.179s {{(pid=84538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 19:01:52 devstack cinder-volume[84538]: DEBUG oslo_concurrency.lockutils [None req-681829ee-98fe-4844-9646-a7cd4db0bad9 tempest-VolumeQuotasNegativeTestJSON-1422550780 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 8.951s {{(pid=84538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 19:01:52 devstack cinder-volume[84538]: DEBUG cinder.volume.drivers.quobyte [None req-681829ee-98fe-4844-9646-a7cd4db0bad9 tempest-VolumeQuotasNegativeTestJSON-1422550780 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-29T17:01:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasNegativeTestJSON-Volume-704889784',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=782e6e28-03ff-456c-84aa-283c91f3c9bb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f5b960e4908546c8b38a41249d52265a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T17:01:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T17:01:43Z,use_quota=True,user_id='761e91d91297462598409c3a8d28c584',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(62b05900-93e3-4190-a88f-1d87324303d1),volume_type_id=62b05900-93e3-4190-a88f-1d87324303d1)}" {{(pid=84538) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 29 19:01:52 devstack cinder-volume[84538]: DEBUG cinder.volume.drivers.remotefs [None req-681829ee-98fe-4844-9646-a7cd4db0bad9 tempest-VolumeQuotasNegativeTestJSON-1422550780 None] Creating volume 782e6e28-03ff-456c-84aa-283c91f3c9bb {{(pid=84538) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 29 19:01:52 devstack cinder-volume[84538]: DEBUG oslo_concurrency.lockutils [None req-681829ee-98fe-4844-9646-a7cd4db0bad9 tempest-VolumeQuotasNegativeTestJSON-1422550780 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 19:01:52 devstack cinder-volume[84538]: DEBUG oslo_concurrency.lockutils [None req-681829ee-98fe-4844-9646-a7cd4db0bad9 tempest-VolumeQuotasNegativeTestJSON-1422550780 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=84538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 19:01:52 devstack cinder-volume[84538]: DEBUG cinder.volume.drivers.quobyte [None req-681829ee-98fe-4844-9646-a7cd4db0bad9 tempest-VolumeQuotasNegativeTestJSON-1422550780 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-34312b00-dd6d-45bb-af98-75855cea8e48': None} {{(pid=84538) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 19:01:52 devstack cinder-volume[84538]: DEBUG cinder.volume.drivers.quobyte [None req-681829ee-98fe-4844-9646-a7cd4db0bad9 tempest-VolumeQuotasNegativeTestJSON-1422550780 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-34312b00-dd6d-45bb-af98-75855cea8e48'] {{(pid=84538) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 19:01:52 devstack cinder-volume[84538]: DEBUG oslo_concurrency.lockutils [None req-681829ee-98fe-4844-9646-a7cd4db0bad9 tempest-VolumeQuotasNegativeTestJSON-1422550780 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=84538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 19:01:52 devstack cinder-volume[84538]: DEBUG cinder.volume.drivers.quobyte [None req-681829ee-98fe-4844-9646-a7cd4db0bad9 tempest-VolumeQuotasNegativeTestJSON-1422550780 None] Selected osci02.corp.quobyte.com/cinder-vol-34312b00-dd6d-45bb-af98-75855cea8e48 as target Quobyte volume. {{(pid=84538) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 29 19:01:52 devstack cinder-volume[84538]: INFO cinder.volume.drivers.remotefs [None req-681829ee-98fe-4844-9646-a7cd4db0bad9 tempest-VolumeQuotasNegativeTestJSON-1422550780 None] casted to osci02.corp.quobyte.com/cinder-vol-34312b00-dd6d-45bb-af98-75855cea8e48 Apr 29 19:01:52 devstack cinder-volume[84538]: DEBUG oslo_concurrency.processutils [None req-681829ee-98fe-4844-9646-a7cd4db0bad9 tempest-VolumeQuotasNegativeTestJSON-1422550780 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-782e6e28-03ff-456c-84aa-283c91f3c9bb 1073741824 {{(pid=84538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 19:01:52 devstack sudo[90312]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-782e6e28-03ff-456c-84aa-283c91f3c9bb 1073741824 Apr 29 19:01:52 devstack sudo[90312]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 19:01:52 devstack cinder-volume[84538]: INFO cinder.volume.manager [None req-3a287ec3-2f23-446c-9d05-4d7f9ae27365 tempest-VolumesDeleteCascade-1314225595 None] Create snapshot completed successfully Apr 29 19:01:52 devstack sudo[90309]: pam_unix(sudo:session): session closed for user root Apr 29 19:01:52 devstack cinder-volume[84538]: DEBUG oslo_concurrency.processutils [None req-d7fb5be1-e7c5-4caf-a394-d598db506d5e tempest-GroupSnapshotsTest-1835037466 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-ce170d29-c990-4cf6-85d1-20cfda253ab6.f3f276a9-9d8e-4f4b-af67-125b718fe290" returned: 0 in 0.764s {{(pid=84538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 19:01:52 devstack cinder-volume[84538]: DEBUG cinder.volume.drivers.remotefs [None req-d7fb5be1-e7c5-4caf-a394-d598db506d5e tempest-GroupSnapshotsTest-1835037466 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-ce170d29-c990-4cf6-85d1-20cfda253ab6(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=84538) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 29 19:01:52 devstack cinder-volume[84538]: DEBUG oslo.privsep.daemon [-] privsep: reply[a91bf5b6-5a80-4066-9b4c-02b1de55578f]: (4, 'qcow2') {{(pid=85803) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 19:01:52 devstack cinder-volume[84538]: DEBUG oslo_concurrency.processutils [None req-d7fb5be1-e7c5-4caf-a394-d598db506d5e tempest-GroupSnapshotsTest-1835037466 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-ce170d29-c990-4cf6-85d1-20cfda253ab6 {{(pid=84538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 19:01:52 devstack sudo[90320]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-ce170d29-c990-4cf6-85d1-20cfda253ab6 Apr 29 19:01:52 devstack sudo[90320]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 19:01:52 devstack sudo[90312]: pam_unix(sudo:session): session closed for user root Apr 29 19:01:52 devstack cinder-volume[84538]: DEBUG oslo_concurrency.processutils [None req-681829ee-98fe-4844-9646-a7cd4db0bad9 tempest-VolumeQuotasNegativeTestJSON-1422550780 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-782e6e28-03ff-456c-84aa-283c91f3c9bb 1073741824" returned: 0 in 0.807s {{(pid=84538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 19:01:53 devstack cinder-volume[84538]: DEBUG oslo_concurrency.processutils [None req-681829ee-98fe-4844-9646-a7cd4db0bad9 tempest-VolumeQuotasNegativeTestJSON-1422550780 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-782e6e28-03ff-456c-84aa-283c91f3c9bb {{(pid=84538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 19:01:53 devstack sudo[90322]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-782e6e28-03ff-456c-84aa-283c91f3c9bb Apr 29 19:01:53 devstack sudo[90322]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 19:01:53 devstack cinder-volume[84538]: DEBUG oslo_concurrency.lockutils [None req-b6aed4ac-33f3-4a55-98e5-56e9a2146ac8 tempest-VolumesDeleteCascade-1314225595 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=84538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 19:01:53 devstack sudo[90320]: pam_unix(sudo:session): session closed for user root Apr 29 19:01:53 devstack cinder-volume[84538]: DEBUG oslo_concurrency.processutils [None req-d7fb5be1-e7c5-4caf-a394-d598db506d5e tempest-GroupSnapshotsTest-1835037466 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-ce170d29-c990-4cf6-85d1-20cfda253ab6" returned: 0 in 0.764s {{(pid=84538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 19:01:53 devstack cinder-volume[84538]: DEBUG oslo_concurrency.processutils [None req-d7fb5be1-e7c5-4caf-a394-d598db506d5e tempest-GroupSnapshotsTest-1835037466 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-ce170d29-c990-4cf6-85d1-20cfda253ab6.f3f276a9-9d8e-4f4b-af67-125b718fe290 {{(pid=84538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 19:01:53 devstack sudo[90327]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-ce170d29-c990-4cf6-85d1-20cfda253ab6.f3f276a9-9d8e-4f4b-af67-125b718fe290 Apr 29 19:01:53 devstack sudo[90327]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 19:01:53 devstack sudo[90322]: pam_unix(sudo:session): session closed for user root Apr 29 19:01:53 devstack cinder-volume[84538]: DEBUG oslo_concurrency.processutils [None req-681829ee-98fe-4844-9646-a7cd4db0bad9 tempest-VolumeQuotasNegativeTestJSON-1422550780 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-782e6e28-03ff-456c-84aa-283c91f3c9bb" returned: 0 in 0.658s {{(pid=84538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 19:01:53 devstack cinder-volume[84538]: DEBUG cinder.volume.drivers.quobyte [None req-681829ee-98fe-4844-9646-a7cd4db0bad9 tempest-VolumeQuotasNegativeTestJSON-1422550780 None] <== create_volume: return (1520ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-34312b00-dd6d-45bb-af98-75855cea8e48'} {{(pid=84538) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 29 19:01:53 devstack cinder-volume[84538]: DEBUG oslo_concurrency.lockutils [None req-681829ee-98fe-4844-9646-a7cd4db0bad9 tempest-VolumeQuotasNegativeTestJSON-1422550780 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.526s {{(pid=84538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 19:01:53 devstack cinder-volume[84538]: DEBUG oslo_concurrency.lockutils [None req-74b1314d-77ca-40b3-8e7a-eef70185b447 tempest-VolumesActionsTest-1687831653 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 14.984s {{(pid=84538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 19:01:53 devstack cinder-volume[84538]: DEBUG cinder.volume.drivers.quobyte [None req-74b1314d-77ca-40b3-8e7a-eef70185b447 tempest-VolumesActionsTest-1687831653 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-29T17:01:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-779822383',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f18c72e5-6b3c-4fa9-ba3d-e4f1013c78e6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a39f1f9e4e364982af869dd2b24dfe70',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T17:01:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T17:01:39Z,use_quota=True,user_id='0feaa082ee4740958e7eb31611d1e836',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(62b05900-93e3-4190-a88f-1d87324303d1),volume_type_id=62b05900-93e3-4190-a88f-1d87324303d1)}" {{(pid=84538) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 29 19:01:53 devstack cinder-volume[84538]: DEBUG cinder.volume.drivers.remotefs [None req-74b1314d-77ca-40b3-8e7a-eef70185b447 tempest-VolumesActionsTest-1687831653 None] Creating volume f18c72e5-6b3c-4fa9-ba3d-e4f1013c78e6 {{(pid=84538) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 29 19:01:53 devstack cinder-volume[84538]: DEBUG oslo_concurrency.lockutils [None req-74b1314d-77ca-40b3-8e7a-eef70185b447 tempest-VolumesActionsTest-1687831653 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 19:01:53 devstack cinder-volume[84538]: DEBUG oslo_concurrency.lockutils [None req-74b1314d-77ca-40b3-8e7a-eef70185b447 tempest-VolumesActionsTest-1687831653 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 19:01:53 devstack cinder-volume[84538]: DEBUG cinder.volume.drivers.quobyte [None req-74b1314d-77ca-40b3-8e7a-eef70185b447 tempest-VolumesActionsTest-1687831653 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-34312b00-dd6d-45bb-af98-75855cea8e48': None} {{(pid=84538) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 19:01:53 devstack cinder-volume[84538]: DEBUG cinder.volume.drivers.quobyte [None req-74b1314d-77ca-40b3-8e7a-eef70185b447 tempest-VolumesActionsTest-1687831653 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-34312b00-dd6d-45bb-af98-75855cea8e48'] {{(pid=84538) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 19:01:53 devstack cinder-volume[84538]: DEBUG oslo_concurrency.lockutils [None req-74b1314d-77ca-40b3-8e7a-eef70185b447 tempest-VolumesActionsTest-1687831653 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=84538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 19:01:53 devstack cinder-volume[84538]: DEBUG cinder.volume.drivers.quobyte [None req-74b1314d-77ca-40b3-8e7a-eef70185b447 tempest-VolumesActionsTest-1687831653 None] Selected osci02.corp.quobyte.com/cinder-vol-34312b00-dd6d-45bb-af98-75855cea8e48 as target Quobyte volume. {{(pid=84538) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 29 19:01:53 devstack cinder-volume[84538]: INFO cinder.volume.drivers.remotefs [None req-74b1314d-77ca-40b3-8e7a-eef70185b447 tempest-VolumesActionsTest-1687831653 None] casted to osci02.corp.quobyte.com/cinder-vol-34312b00-dd6d-45bb-af98-75855cea8e48 Apr 29 19:01:53 devstack cinder-volume[84538]: DEBUG oslo_concurrency.processutils [None req-74b1314d-77ca-40b3-8e7a-eef70185b447 tempest-VolumesActionsTest-1687831653 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-f18c72e5-6b3c-4fa9-ba3d-e4f1013c78e6 1073741824 {{(pid=84538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 19:01:53 devstack cinder-volume[84538]: DEBUG cinder.volume.manager [None req-681829ee-98fe-4844-9646-a7cd4db0bad9 tempest-VolumeQuotasNegativeTestJSON-1422550780 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (90a0192b-b1f7-4055-a098-83f01539f33a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-782e6e28-03ff-456c-84aa-283c91f3c9bb', 'volume_size': 1}' {{(pid=84538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 19:01:53 devstack sudo[90330]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-f18c72e5-6b3c-4fa9-ba3d-e4f1013c78e6 1073741824 Apr 29 19:01:53 devstack sudo[90330]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 19:01:53 devstack cinder-volume[84538]: DEBUG cinder.volume.manager [None req-681829ee-98fe-4844-9646-a7cd4db0bad9 tempest-VolumeQuotasNegativeTestJSON-1422550780 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (56f70d20-259b-490b-a313-262db426577c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 19:01:53 devstack cinder-volume[84538]: INFO cinder.volume.flows.manager.create_volume [None req-681829ee-98fe-4844-9646-a7cd4db0bad9 tempest-VolumeQuotasNegativeTestJSON-1422550780 None] Volume volume-782e6e28-03ff-456c-84aa-283c91f3c9bb (782e6e28-03ff-456c-84aa-283c91f3c9bb): created successfully Apr 29 19:01:53 devstack cinder-volume[84538]: DEBUG cinder.volume.manager [None req-681829ee-98fe-4844-9646-a7cd4db0bad9 tempest-VolumeQuotasNegativeTestJSON-1422550780 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (56f70d20-259b-490b-a313-262db426577c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 19:01:53 devstack cinder-volume[84538]: DEBUG cinder.volume.manager [None req-681829ee-98fe-4844-9646-a7cd4db0bad9 tempest-VolumeQuotasNegativeTestJSON-1422550780 None] Flow 'volume_create_manager' (bed89682-026f-4f31-8328-9f4d44f750e8) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84538) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 19:01:53 devstack cinder-volume[84538]: INFO cinder.volume.manager [None req-681829ee-98fe-4844-9646-a7cd4db0bad9 tempest-VolumeQuotasNegativeTestJSON-1422550780 None] Created volume successfully. Apr 29 19:01:54 devstack sudo[90327]: pam_unix(sudo:session): session closed for user root Apr 29 19:01:54 devstack cinder-volume[84538]: DEBUG oslo_concurrency.processutils [None req-d7fb5be1-e7c5-4caf-a394-d598db506d5e tempest-GroupSnapshotsTest-1835037466 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-ce170d29-c990-4cf6-85d1-20cfda253ab6.f3f276a9-9d8e-4f4b-af67-125b718fe290" returned: 0 in 0.792s {{(pid=84538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 19:01:54 devstack cinder-volume[84538]: DEBUG oslo_concurrency.processutils [None req-d7fb5be1-e7c5-4caf-a394-d598db506d5e tempest-GroupSnapshotsTest-1835037466 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-ce170d29-c990-4cf6-85d1-20cfda253ab6.f3f276a9-9d8e-4f4b-af67-125b718fe290 {{(pid=84538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 19:01:54 devstack sudo[90344]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-ce170d29-c990-4cf6-85d1-20cfda253ab6.f3f276a9-9d8e-4f4b-af67-125b718fe290 Apr 29 19:01:54 devstack sudo[90344]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 19:01:54 devstack sudo[90330]: pam_unix(sudo:session): session closed for user root Apr 29 19:01:54 devstack cinder-volume[84538]: DEBUG oslo_concurrency.processutils [None req-74b1314d-77ca-40b3-8e7a-eef70185b447 tempest-VolumesActionsTest-1687831653 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-f18c72e5-6b3c-4fa9-ba3d-e4f1013c78e6 1073741824" returned: 0 in 0.920s {{(pid=84538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 19:01:54 devstack cinder-volume[84538]: DEBUG oslo_concurrency.processutils [None req-74b1314d-77ca-40b3-8e7a-eef70185b447 tempest-VolumesActionsTest-1687831653 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-f18c72e5-6b3c-4fa9-ba3d-e4f1013c78e6 {{(pid=84538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 19:01:54 devstack sudo[90347]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-f18c72e5-6b3c-4fa9-ba3d-e4f1013c78e6 Apr 29 19:01:54 devstack sudo[90347]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 19:01:54 devstack sudo[90344]: pam_unix(sudo:session): session closed for user root Apr 29 19:01:54 devstack cinder-volume[84538]: DEBUG oslo_concurrency.processutils [None req-d7fb5be1-e7c5-4caf-a394-d598db506d5e tempest-GroupSnapshotsTest-1835037466 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-ce170d29-c990-4cf6-85d1-20cfda253ab6.f3f276a9-9d8e-4f4b-af67-125b718fe290" returned: 0 in 0.654s {{(pid=84538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 19:01:54 devstack cinder-volume[84538]: DEBUG cinder.coordination [None req-d7fb5be1-e7c5-4caf-a394-d598db506d5e tempest-GroupSnapshotsTest-1835037466 None] Lock "cinder-quobyte-f3f276a9-9d8e-4f4b-af67-125b718fe290" released by "_delete_snapshot" :: held 3.076s {{(pid=84538) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 19:01:54 devstack cinder-volume[84538]: DEBUG cinder.coordination [None req-d7fb5be1-e7c5-4caf-a394-d598db506d5e tempest-GroupSnapshotsTest-1835037466 None] Lock "cinder-quobyte-ce170d29-c990-4cf6-85d1-20cfda253ab6" released by "delete_snapshot" :: held 3.103s {{(pid=84538) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 19:01:55 devstack cinder-volume[84538]: DEBUG cinder.coordination [None req-005b8f4a-a1b4-42f8-8226-4aefcf7515bf tempest-VolumeQuotasNegativeTestJSON-1422550780 None] Acquiring lock "cinder-782e6e28-03ff-456c-84aa-283c91f3c9bb-delete_volume" by "delete_volume" {{(pid=84538) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 19:01:55 devstack cinder-volume[84538]: DEBUG cinder.coordination [None req-005b8f4a-a1b4-42f8-8226-4aefcf7515bf tempest-VolumeQuotasNegativeTestJSON-1422550780 None] Lock "cinder-782e6e28-03ff-456c-84aa-283c91f3c9bb-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=84538) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 19:01:55 devstack cinder-volume[84538]: WARNING cinder.quota [None req-d7fb5be1-e7c5-4caf-a394-d598db506d5e tempest-GroupSnapshotsTest-1835037466 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsTest-volume-type-1864509393 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsTest-volume-type-1864509393, it is now deprecated. Please use the default quota class for default quota. Apr 29 19:01:55 devstack cinder-volume[84538]: WARNING cinder.quota [None req-d7fb5be1-e7c5-4caf-a394-d598db506d5e tempest-GroupSnapshotsTest-1835037466 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsTest-volume-type-1864509393 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsTest-volume-type-1864509393, it is now deprecated. Please use the default quota class for default quota. Apr 29 19:01:55 devstack cinder-volume[84538]: DEBUG cinder.coordination [None req-005b8f4a-a1b4-42f8-8226-4aefcf7515bf tempest-VolumeQuotasNegativeTestJSON-1422550780 None] Acquiring lock "cinder-quobyte-782e6e28-03ff-456c-84aa-283c91f3c9bb" by "delete_volume" {{(pid=84538) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 19:01:55 devstack cinder-volume[84538]: DEBUG cinder.quota [None req-d7fb5be1-e7c5-4caf-a394-d598db506d5e tempest-GroupSnapshotsTest-1835037466 None] Created reservations ['ce492973-031f-4f4a-a768-edf8b0563088', 'fd4bf08c-9c61-434a-ab1a-8c7bd36b19e8', '17b53b74-f37f-464f-a380-fbfa020ea092', '42abd21d-f40c-421f-932b-fbe78c196844'] {{(pid=84538) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 29 19:01:55 devstack cinder-volume[84538]: DEBUG cinder.coordination [None req-005b8f4a-a1b4-42f8-8226-4aefcf7515bf tempest-VolumeQuotasNegativeTestJSON-1422550780 None] Lock "cinder-quobyte-782e6e28-03ff-456c-84aa-283c91f3c9bb" acquired by "delete_volume" :: waited 0.035s {{(pid=84538) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 19:01:55 devstack cinder-volume[84538]: DEBUG oslo.privsep.daemon [-] privsep: reply[360f4be3-70ef-4c3a-8010-9802fc7cbc9f]: (4, 'qcow2') {{(pid=85803) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 19:01:55 devstack cinder-volume[84538]: DEBUG oslo_concurrency.processutils [None req-005b8f4a-a1b4-42f8-8226-4aefcf7515bf tempest-VolumeQuotasNegativeTestJSON-1422550780 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-782e6e28-03ff-456c-84aa-283c91f3c9bb {{(pid=84538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 19:01:55 devstack sudo[90351]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-782e6e28-03ff-456c-84aa-283c91f3c9bb Apr 29 19:01:55 devstack sudo[90351]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 19:01:55 devstack cinder-volume[84538]: DEBUG cinder.quota [None req-d7fb5be1-e7c5-4caf-a394-d598db506d5e tempest-GroupSnapshotsTest-1835037466 None] Created reservations ['9fa20edf-dffc-469f-a973-7f70b1f5e22a', '7fda9568-c013-46fe-94c9-7a15aff0c014', 'caad64cc-044d-423b-a179-dc2d58f72aae', 'db61e65f-d879-43ae-bc43-c7535dc0a09b'] {{(pid=84538) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 29 19:01:55 devstack sudo[90347]: pam_unix(sudo:session): session closed for user root Apr 29 19:01:55 devstack cinder-volume[84538]: DEBUG oslo_concurrency.processutils [None req-74b1314d-77ca-40b3-8e7a-eef70185b447 tempest-VolumesActionsTest-1687831653 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-f18c72e5-6b3c-4fa9-ba3d-e4f1013c78e6" returned: 0 in 0.690s {{(pid=84538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 19:01:55 devstack cinder-volume[84538]: DEBUG cinder.volume.drivers.quobyte [None req-74b1314d-77ca-40b3-8e7a-eef70185b447 tempest-VolumesActionsTest-1687831653 None] <== create_volume: return (1658ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-34312b00-dd6d-45bb-af98-75855cea8e48'} {{(pid=84538) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 29 19:01:55 devstack cinder-volume[84538]: DEBUG oslo_concurrency.lockutils [None req-74b1314d-77ca-40b3-8e7a-eef70185b447 tempest-VolumesActionsTest-1687831653 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.662s {{(pid=84538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 19:01:55 devstack cinder-volume[84538]: DEBUG oslo_concurrency.lockutils [None req-b6aed4ac-33f3-4a55-98e5-56e9a2146ac8 tempest-VolumesDeleteCascade-1314225595 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 2.229s {{(pid=84538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 19:01:55 devstack cinder-volume[84538]: DEBUG cinder.volume.manager [None req-74b1314d-77ca-40b3-8e7a-eef70185b447 tempest-VolumesActionsTest-1687831653 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2edcea77-d3f9-4e04-bd9b-77af3f5cbbba) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f18c72e5-6b3c-4fa9-ba3d-e4f1013c78e6', 'volume_size': 1}' {{(pid=84538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 19:01:55 devstack cinder-volume[84538]: DEBUG cinder.volume.manager [None req-74b1314d-77ca-40b3-8e7a-eef70185b447 tempest-VolumesActionsTest-1687831653 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (72d232af-8a86-4a8a-b84a-8c52df41a45a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 19:01:55 devstack cinder-volume[84538]: DEBUG cinder.volume.drivers.remotefs [None req-b6aed4ac-33f3-4a55-98e5-56e9a2146ac8 tempest-VolumesDeleteCascade-1314225595 None] Creating offline snapshot 7559f91c-a60b-4b95-8383-d4a8022ad997 of volume 363b2b67-b40a-4aea-a61a-58750417ef9c {{(pid=84538) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}} Apr 29 19:01:55 devstack cinder-volume[84538]: INFO cinder.volume.flows.manager.create_volume [None req-74b1314d-77ca-40b3-8e7a-eef70185b447 tempest-VolumesActionsTest-1687831653 None] Volume volume-f18c72e5-6b3c-4fa9-ba3d-e4f1013c78e6 (f18c72e5-6b3c-4fa9-ba3d-e4f1013c78e6): created successfully Apr 29 19:01:55 devstack cinder-volume[84538]: DEBUG cinder.volume.manager [None req-74b1314d-77ca-40b3-8e7a-eef70185b447 tempest-VolumesActionsTest-1687831653 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (72d232af-8a86-4a8a-b84a-8c52df41a45a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 19:01:55 devstack cinder-volume[84538]: DEBUG cinder.volume.manager [None req-74b1314d-77ca-40b3-8e7a-eef70185b447 tempest-VolumesActionsTest-1687831653 None] Flow 'volume_create_manager' (96bbc2aa-8cef-4a95-aea2-a98eb9c468e1) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84538) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 19:01:55 devstack cinder-volume[84538]: DEBUG oslo.privsep.daemon [-] privsep: reply[437c1695-ecb5-4472-986f-0b9484f13263]: (4, 'qcow2') {{(pid=85803) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 19:01:55 devstack cinder-volume[84538]: DEBUG oslo_concurrency.processutils [None req-b6aed4ac-33f3-4a55-98e5-56e9a2146ac8 tempest-VolumesDeleteCascade-1314225595 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-363b2b67-b40a-4aea-a61a-58750417ef9c.7296ba8c-4293-4139-a2e3-7f97420395c7 {{(pid=84538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 19:01:55 devstack cinder-volume[84538]: INFO cinder.volume.manager [None req-74b1314d-77ca-40b3-8e7a-eef70185b447 tempest-VolumesActionsTest-1687831653 None] Created volume successfully. Apr 29 19:01:55 devstack cinder-volume[84538]: INFO cinder.volume.manager [None req-d7fb5be1-e7c5-4caf-a394-d598db506d5e tempest-GroupSnapshotsTest-1835037466 None] group_snapshot d08068b9-c31a-49a2-9f9e-a74ca4ab45fc: deleted successfully Apr 29 19:01:55 devstack sudo[90354]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-363b2b67-b40a-4aea-a61a-58750417ef9c.7296ba8c-4293-4139-a2e3-7f97420395c7 Apr 29 19:01:55 devstack sudo[90354]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 19:01:55 devstack cinder-volume[84538]: DEBUG cinder.coordination [None req-905a4b47-0258-427f-9ae2-720aa98fe3c4 tempest-VolumesActionsTest-927532498 None] Acquiring lock "cinder-f18c72e5-6b3c-4fa9-ba3d-e4f1013c78e6-delete_volume" by "delete_volume" {{(pid=84538) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 19:01:55 devstack cinder-volume[84538]: DEBUG cinder.coordination [None req-905a4b47-0258-427f-9ae2-720aa98fe3c4 tempest-VolumesActionsTest-927532498 None] Lock "cinder-f18c72e5-6b3c-4fa9-ba3d-e4f1013c78e6-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=84538) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 19:01:55 devstack cinder-volume[84538]: DEBUG cinder.coordination [None req-905a4b47-0258-427f-9ae2-720aa98fe3c4 tempest-VolumesActionsTest-927532498 None] Acquiring lock "cinder-quobyte-f18c72e5-6b3c-4fa9-ba3d-e4f1013c78e6" by "delete_volume" {{(pid=84538) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 19:01:55 devstack cinder-volume[84538]: DEBUG cinder.coordination [None req-905a4b47-0258-427f-9ae2-720aa98fe3c4 tempest-VolumesActionsTest-927532498 None] Lock "cinder-quobyte-f18c72e5-6b3c-4fa9-ba3d-e4f1013c78e6" acquired by "delete_volume" :: waited 0.025s {{(pid=84538) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 19:01:55 devstack cinder-volume[84538]: DEBUG oslo.privsep.daemon [-] privsep: reply[c4eaed35-dd80-40f8-bf5c-9665bef7f2a3]: (4, 'qcow2') {{(pid=85803) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 19:01:55 devstack cinder-volume[84538]: DEBUG oslo_concurrency.processutils [None req-905a4b47-0258-427f-9ae2-720aa98fe3c4 tempest-VolumesActionsTest-927532498 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-f18c72e5-6b3c-4fa9-ba3d-e4f1013c78e6 {{(pid=84538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 19:01:55 devstack sudo[90351]: pam_unix(sudo:session): session closed for user root Apr 29 19:01:56 devstack cinder-volume[84538]: DEBUG oslo_concurrency.processutils [None req-005b8f4a-a1b4-42f8-8226-4aefcf7515bf tempest-VolumeQuotasNegativeTestJSON-1422550780 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-782e6e28-03ff-456c-84aa-283c91f3c9bb" returned: 0 in 0.803s {{(pid=84538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 19:01:56 devstack cinder-volume[84538]: DEBUG oslo_concurrency.processutils [None req-005b8f4a-a1b4-42f8-8226-4aefcf7515bf tempest-VolumeQuotasNegativeTestJSON-1422550780 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-782e6e28-03ff-456c-84aa-283c91f3c9bb {{(pid=84538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 19:01:56 devstack sudo[90359]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-f18c72e5-6b3c-4fa9-ba3d-e4f1013c78e6 Apr 29 19:01:56 devstack sudo[90359]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 19:01:56 devstack sudo[90361]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-782e6e28-03ff-456c-84aa-283c91f3c9bb Apr 29 19:01:56 devstack sudo[90361]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 19:01:56 devstack sudo[90354]: pam_unix(sudo:session): session closed for user root Apr 29 19:01:56 devstack cinder-volume[84538]: DEBUG oslo_concurrency.processutils [None req-b6aed4ac-33f3-4a55-98e5-56e9a2146ac8 tempest-VolumesDeleteCascade-1314225595 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-363b2b67-b40a-4aea-a61a-58750417ef9c.7296ba8c-4293-4139-a2e3-7f97420395c7" returned: 0 in 0.870s {{(pid=84538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 19:01:56 devstack cinder-volume[84538]: DEBUG cinder.volume.drivers.remotefs [None req-b6aed4ac-33f3-4a55-98e5-56e9a2146ac8 tempest-VolumesDeleteCascade-1314225595 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-363b2b67-b40a-4aea-a61a-58750417ef9c(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=84538) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 29 19:01:56 devstack cinder-volume[84538]: DEBUG oslo_concurrency.processutils [None req-b6aed4ac-33f3-4a55-98e5-56e9a2146ac8 tempest-VolumesDeleteCascade-1314225595 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-363b2b67-b40a-4aea-a61a-58750417ef9c.7296ba8c-4293-4139-a2e3-7f97420395c7,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-363b2b67-b40a-4aea-a61a-58750417ef9c.7559f91c-a60b-4b95-8383-d4a8022ad997 1G {{(pid=84538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 19:01:56 devstack sudo[90366]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-363b2b67-b40a-4aea-a61a-58750417ef9c.7296ba8c-4293-4139-a2e3-7f97420395c7,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-363b2b67-b40a-4aea-a61a-58750417ef9c.7559f91c-a60b-4b95-8383-d4a8022ad997 1G Apr 29 19:01:56 devstack sudo[90366]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 19:01:56 devstack cinder-volume[84538]: DEBUG cinder.coordination [None req-368b9352-2e75-4e13-9c29-b5156ec2ce16 tempest-GroupSnapshotsTest-1835037466 None] Acquiring lock "cinder-quobyte-0210148a-07a3-4f2b-92dd-72ff91d5adb3" by "delete_volume" {{(pid=84538) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 19:01:56 devstack cinder-volume[84538]: DEBUG cinder.coordination [None req-368b9352-2e75-4e13-9c29-b5156ec2ce16 tempest-GroupSnapshotsTest-1835037466 None] Lock "cinder-quobyte-0210148a-07a3-4f2b-92dd-72ff91d5adb3" acquired by "delete_volume" :: waited 0.025s {{(pid=84538) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 19:01:56 devstack sudo[90359]: pam_unix(sudo:session): session closed for user root Apr 29 19:01:56 devstack cinder-volume[84538]: DEBUG oslo_concurrency.processutils [None req-905a4b47-0258-427f-9ae2-720aa98fe3c4 tempest-VolumesActionsTest-927532498 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-f18c72e5-6b3c-4fa9-ba3d-e4f1013c78e6" returned: 0 in 0.809s {{(pid=84538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 19:01:56 devstack cinder-volume[84538]: DEBUG oslo_concurrency.processutils [None req-905a4b47-0258-427f-9ae2-720aa98fe3c4 tempest-VolumesActionsTest-927532498 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-f18c72e5-6b3c-4fa9-ba3d-e4f1013c78e6 {{(pid=84538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 19:01:56 devstack cinder-volume[84538]: DEBUG oslo.privsep.daemon [-] privsep: reply[92e72368-568e-4b13-87b9-d266517557b5]: (4, 'qcow2') {{(pid=85803) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 19:01:56 devstack cinder-volume[84538]: DEBUG oslo_concurrency.processutils [None req-368b9352-2e75-4e13-9c29-b5156ec2ce16 tempest-GroupSnapshotsTest-1835037466 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-0210148a-07a3-4f2b-92dd-72ff91d5adb3 {{(pid=84538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 19:01:56 devstack sudo[90361]: pam_unix(sudo:session): session closed for user root Apr 29 19:01:56 devstack sudo[90373]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-f18c72e5-6b3c-4fa9-ba3d-e4f1013c78e6 Apr 29 19:01:56 devstack sudo[90373]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 19:01:56 devstack cinder-volume[84538]: DEBUG oslo_concurrency.processutils [None req-005b8f4a-a1b4-42f8-8226-4aefcf7515bf tempest-VolumeQuotasNegativeTestJSON-1422550780 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-782e6e28-03ff-456c-84aa-283c91f3c9bb" returned: 0 in 0.740s {{(pid=84538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 19:01:56 devstack cinder-volume[84538]: DEBUG cinder.coordination [None req-005b8f4a-a1b4-42f8-8226-4aefcf7515bf tempest-VolumeQuotasNegativeTestJSON-1422550780 None] Lock "cinder-quobyte-782e6e28-03ff-456c-84aa-283c91f3c9bb" released by "delete_volume" :: held 1.605s {{(pid=84538) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 19:01:56 devstack cinder-volume[84538]: DEBUG cinder.quota [None req-005b8f4a-a1b4-42f8-8226-4aefcf7515bf tempest-VolumeQuotasNegativeTestJSON-1422550780 None] Created reservations ['07868ad6-e8ec-4edb-a005-acc9f27e91ea', '25057503-3a35-45d1-b95f-b4ed81cf477e', 'c6749ce3-66dd-4826-b5d8-d2c34f210bbf', 'd1177b32-0821-4b0e-935c-989843537a3e'] {{(pid=84538) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 29 19:01:56 devstack sudo[90374]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-0210148a-07a3-4f2b-92dd-72ff91d5adb3 Apr 29 19:01:56 devstack sudo[90374]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 19:01:56 devstack cinder-volume[84538]: DEBUG oslo_concurrency.lockutils [None req-005b8f4a-a1b4-42f8-8226-4aefcf7515bf tempest-VolumeQuotasNegativeTestJSON-1422550780 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 19:01:56 devstack cinder-volume[84538]: DEBUG oslo_concurrency.lockutils [None req-005b8f4a-a1b4-42f8-8226-4aefcf7515bf tempest-VolumeQuotasNegativeTestJSON-1422550780 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 19:01:56 devstack cinder-volume[84538]: DEBUG cinder.volume.drivers.quobyte [None req-005b8f4a-a1b4-42f8-8226-4aefcf7515bf tempest-VolumeQuotasNegativeTestJSON-1422550780 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-34312b00-dd6d-45bb-af98-75855cea8e48': None} {{(pid=84538) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 19:01:56 devstack cinder-volume[84538]: DEBUG cinder.volume.drivers.quobyte [None req-005b8f4a-a1b4-42f8-8226-4aefcf7515bf tempest-VolumeQuotasNegativeTestJSON-1422550780 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-34312b00-dd6d-45bb-af98-75855cea8e48'] {{(pid=84538) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 19:01:56 devstack cinder-volume[84538]: DEBUG oslo_concurrency.lockutils [None req-005b8f4a-a1b4-42f8-8226-4aefcf7515bf tempest-VolumeQuotasNegativeTestJSON-1422550780 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=84538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 19:01:56 devstack cinder-volume[84538]: DEBUG oslo_concurrency.processutils [None req-005b8f4a-a1b4-42f8-8226-4aefcf7515bf tempest-VolumeQuotasNegativeTestJSON-1422550780 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d {{(pid=84538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 19:01:56 devstack sudo[90377]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d Apr 29 19:01:56 devstack sudo[90377]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 19:01:57 devstack sudo[90366]: pam_unix(sudo:session): session closed for user root Apr 29 19:01:57 devstack cinder-volume[84538]: DEBUG oslo_concurrency.processutils [None req-b6aed4ac-33f3-4a55-98e5-56e9a2146ac8 tempest-VolumesDeleteCascade-1314225595 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-363b2b67-b40a-4aea-a61a-58750417ef9c.7296ba8c-4293-4139-a2e3-7f97420395c7,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-363b2b67-b40a-4aea-a61a-58750417ef9c.7559f91c-a60b-4b95-8383-d4a8022ad997 1G" returned: 0 in 0.947s {{(pid=84538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 19:01:57 devstack cinder-volume[84538]: DEBUG oslo_concurrency.processutils [None req-b6aed4ac-33f3-4a55-98e5-56e9a2146ac8 tempest-VolumesDeleteCascade-1314225595 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-363b2b67-b40a-4aea-a61a-58750417ef9c.7296ba8c-4293-4139-a2e3-7f97420395c7 -F qcow2 /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-363b2b67-b40a-4aea-a61a-58750417ef9c.7559f91c-a60b-4b95-8383-d4a8022ad997 {{(pid=84538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 19:01:57 devstack sudo[90383]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-363b2b67-b40a-4aea-a61a-58750417ef9c.7296ba8c-4293-4139-a2e3-7f97420395c7 -F qcow2 /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-363b2b67-b40a-4aea-a61a-58750417ef9c.7559f91c-a60b-4b95-8383-d4a8022ad997 Apr 29 19:01:57 devstack sudo[90383]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 19:01:57 devstack sudo[90373]: pam_unix(sudo:session): session closed for user root Apr 29 19:01:57 devstack cinder-volume[84538]: DEBUG oslo_concurrency.processutils [None req-905a4b47-0258-427f-9ae2-720aa98fe3c4 tempest-VolumesActionsTest-927532498 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-f18c72e5-6b3c-4fa9-ba3d-e4f1013c78e6" returned: 0 in 0.778s {{(pid=84538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 19:01:57 devstack cinder-volume[84538]: DEBUG cinder.coordination [None req-905a4b47-0258-427f-9ae2-720aa98fe3c4 tempest-VolumesActionsTest-927532498 None] Lock "cinder-quobyte-f18c72e5-6b3c-4fa9-ba3d-e4f1013c78e6" released by "delete_volume" :: held 1.643s {{(pid=84538) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 19:01:57 devstack cinder-volume[84538]: DEBUG cinder.quota [None req-905a4b47-0258-427f-9ae2-720aa98fe3c4 tempest-VolumesActionsTest-927532498 None] Created reservations ['cd8fcef3-da75-4666-9709-8aeec5865142', 'dfc8f455-d0ed-46dd-a0a1-bb4d6cc592d5', '4bc5decd-b604-4e6a-a4f1-4553c0ea222a', '1ebdff41-1cfe-4e49-bfc3-3f6ef57a9151'] {{(pid=84538) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 29 19:01:57 devstack cinder-volume[84538]: DEBUG oslo_concurrency.lockutils [None req-905a4b47-0258-427f-9ae2-720aa98fe3c4 tempest-VolumesActionsTest-927532498 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 19:01:57 devstack cinder-volume[84538]: DEBUG oslo_concurrency.lockutils [None req-905a4b47-0258-427f-9ae2-720aa98fe3c4 tempest-VolumesActionsTest-927532498 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 19:01:57 devstack cinder-volume[84538]: DEBUG cinder.volume.drivers.quobyte [None req-905a4b47-0258-427f-9ae2-720aa98fe3c4 tempest-VolumesActionsTest-927532498 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-34312b00-dd6d-45bb-af98-75855cea8e48': None} {{(pid=84538) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 19:01:57 devstack cinder-volume[84538]: DEBUG cinder.volume.drivers.quobyte [None req-905a4b47-0258-427f-9ae2-720aa98fe3c4 tempest-VolumesActionsTest-927532498 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-34312b00-dd6d-45bb-af98-75855cea8e48'] {{(pid=84538) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 19:01:57 devstack cinder-volume[84538]: DEBUG oslo_concurrency.lockutils [None req-905a4b47-0258-427f-9ae2-720aa98fe3c4 tempest-VolumesActionsTest-927532498 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=84538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 19:01:57 devstack cinder-volume[84538]: DEBUG oslo_concurrency.processutils [None req-905a4b47-0258-427f-9ae2-720aa98fe3c4 tempest-VolumesActionsTest-927532498 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d {{(pid=84538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 19:01:57 devstack sudo[90374]: pam_unix(sudo:session): session closed for user root Apr 29 19:01:57 devstack cinder-volume[84538]: DEBUG oslo_concurrency.processutils [None req-368b9352-2e75-4e13-9c29-b5156ec2ce16 tempest-GroupSnapshotsTest-1835037466 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-0210148a-07a3-4f2b-92dd-72ff91d5adb3" returned: 0 in 0.972s {{(pid=84538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 19:01:57 devstack cinder-volume[84538]: DEBUG oslo_concurrency.processutils [None req-368b9352-2e75-4e13-9c29-b5156ec2ce16 tempest-GroupSnapshotsTest-1835037466 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-0210148a-07a3-4f2b-92dd-72ff91d5adb3 {{(pid=84538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 19:01:57 devstack sudo[90389]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d Apr 29 19:01:57 devstack sudo[90389]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 19:01:57 devstack sudo[90391]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-0210148a-07a3-4f2b-92dd-72ff91d5adb3 Apr 29 19:01:57 devstack sudo[90391]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 19:01:57 devstack sudo[90377]: pam_unix(sudo:session): session closed for user root Apr 29 19:01:57 devstack cinder-volume[84538]: DEBUG oslo_concurrency.processutils [None req-005b8f4a-a1b4-42f8-8226-4aefcf7515bf tempest-VolumeQuotasNegativeTestJSON-1422550780 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d" returned: 0 in 0.963s {{(pid=84538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 19:01:57 devstack cinder-volume[84538]: DEBUG cinder.manager [None req-005b8f4a-a1b4-42f8-8226-4aefcf7515bf tempest-VolumeQuotasNegativeTestJSON-1422550780 None] Notifying Schedulers of capabilities ... {{(pid=84538) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 29 19:01:57 devstack cinder-volume[84538]: INFO cinder.volume.manager [None req-005b8f4a-a1b4-42f8-8226-4aefcf7515bf tempest-VolumeQuotasNegativeTestJSON-1422550780 None] Deleted volume successfully. Apr 29 19:01:57 devstack cinder-volume[84538]: DEBUG cinder.coordination [None req-005b8f4a-a1b4-42f8-8226-4aefcf7515bf tempest-VolumeQuotasNegativeTestJSON-1422550780 None] Lock "cinder-782e6e28-03ff-456c-84aa-283c91f3c9bb-delete_volume" released by "delete_volume" :: held 2.828s {{(pid=84538) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 19:01:58 devstack sudo[90383]: pam_unix(sudo:session): session closed for user root Apr 29 19:01:58 devstack cinder-volume[84538]: DEBUG oslo_concurrency.processutils [None req-b6aed4ac-33f3-4a55-98e5-56e9a2146ac8 tempest-VolumesDeleteCascade-1314225595 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-363b2b67-b40a-4aea-a61a-58750417ef9c.7296ba8c-4293-4139-a2e3-7f97420395c7 -F qcow2 /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-363b2b67-b40a-4aea-a61a-58750417ef9c.7559f91c-a60b-4b95-8383-d4a8022ad997" returned: 0 in 0.977s {{(pid=84538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 19:01:58 devstack cinder-volume[84538]: WARNING cinder.volume.drivers.remotefs [None req-b6aed4ac-33f3-4a55-98e5-56e9a2146ac8 tempest-VolumesDeleteCascade-1314225595 None] /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-363b2b67-b40a-4aea-a61a-58750417ef9c.7559f91c-a60b-4b95-8383-d4a8022ad997 is being set with open permissions: ugo+rw Apr 29 19:01:58 devstack cinder-volume[84538]: DEBUG oslo_concurrency.processutils [None req-b6aed4ac-33f3-4a55-98e5-56e9a2146ac8 tempest-VolumesDeleteCascade-1314225595 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-363b2b67-b40a-4aea-a61a-58750417ef9c.7559f91c-a60b-4b95-8383-d4a8022ad997 {{(pid=84538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 19:01:58 devstack sudo[90400]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-363b2b67-b40a-4aea-a61a-58750417ef9c.7559f91c-a60b-4b95-8383-d4a8022ad997 Apr 29 19:01:58 devstack sudo[90400]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 19:01:58 devstack sudo[90389]: pam_unix(sudo:session): session closed for user root Apr 29 19:01:58 devstack cinder-volume[84538]: DEBUG oslo_concurrency.processutils [None req-905a4b47-0258-427f-9ae2-720aa98fe3c4 tempest-VolumesActionsTest-927532498 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d" returned: 0 in 0.725s {{(pid=84538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 19:01:58 devstack cinder-volume[84538]: DEBUG cinder.manager [None req-905a4b47-0258-427f-9ae2-720aa98fe3c4 tempest-VolumesActionsTest-927532498 None] Notifying Schedulers of capabilities ... {{(pid=84538) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 29 19:01:58 devstack cinder-volume[84538]: INFO cinder.volume.manager [None req-905a4b47-0258-427f-9ae2-720aa98fe3c4 tempest-VolumesActionsTest-927532498 None] Deleted volume successfully. Apr 29 19:01:58 devstack cinder-volume[84538]: DEBUG cinder.coordination [None req-905a4b47-0258-427f-9ae2-720aa98fe3c4 tempest-VolumesActionsTest-927532498 None] Lock "cinder-f18c72e5-6b3c-4fa9-ba3d-e4f1013c78e6-delete_volume" released by "delete_volume" :: held 2.658s {{(pid=84538) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 19:01:58 devstack sudo[90391]: pam_unix(sudo:session): session closed for user root Apr 29 19:01:58 devstack cinder-volume[84538]: DEBUG oslo_concurrency.processutils [None req-368b9352-2e75-4e13-9c29-b5156ec2ce16 tempest-GroupSnapshotsTest-1835037466 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-0210148a-07a3-4f2b-92dd-72ff91d5adb3" returned: 0 in 0.909s {{(pid=84538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 19:01:58 devstack cinder-volume[84538]: DEBUG cinder.coordination [None req-368b9352-2e75-4e13-9c29-b5156ec2ce16 tempest-GroupSnapshotsTest-1835037466 None] Lock "cinder-quobyte-0210148a-07a3-4f2b-92dd-72ff91d5adb3" released by "delete_volume" :: held 1.991s {{(pid=84538) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 19:01:58 devstack cinder-volume[84538]: DEBUG cinder.coordination [None req-368b9352-2e75-4e13-9c29-b5156ec2ce16 tempest-GroupSnapshotsTest-1835037466 None] Acquiring lock "cinder-quobyte-ce170d29-c990-4cf6-85d1-20cfda253ab6" by "delete_volume" {{(pid=84538) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 19:01:58 devstack cinder-volume[84538]: DEBUG cinder.coordination [None req-368b9352-2e75-4e13-9c29-b5156ec2ce16 tempest-GroupSnapshotsTest-1835037466 None] Lock "cinder-quobyte-ce170d29-c990-4cf6-85d1-20cfda253ab6" acquired by "delete_volume" :: waited 0.016s {{(pid=84538) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 19:01:58 devstack cinder-volume[84538]: DEBUG oslo.privsep.daemon [-] privsep: reply[d877e2c3-2c6a-4865-b6bf-5a52bd6e8906]: (4, 'qcow2') {{(pid=85803) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 19:01:58 devstack cinder-volume[84538]: DEBUG oslo_concurrency.processutils [None req-368b9352-2e75-4e13-9c29-b5156ec2ce16 tempest-GroupSnapshotsTest-1835037466 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-ce170d29-c990-4cf6-85d1-20cfda253ab6 {{(pid=84538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 19:01:58 devstack cinder-volume[84538]: DEBUG cinder.volume.flows.manager.create_volume [None req-d2796022-2cb5-4528-9d41-61713dc0ae53 tempest-VolumesActionsTest-1687831653 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84538) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Apr 29 19:01:58 devstack cinder-volume[84538]: DEBUG cinder.volume.manager [None req-d2796022-2cb5-4528-9d41-61713dc0ae53 tempest-VolumesActionsTest-1687831653 None] Flow 'volume_create_manager' (02527f32-034f-46d0-8932-5103e1b03287) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84538) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 19:01:58 devstack cinder-volume[84538]: DEBUG cinder.volume.manager [None req-d2796022-2cb5-4528-9d41-61713dc0ae53 tempest-VolumesActionsTest-1687831653 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a9b7b7f4-459c-45c6-bbb4-b63083ecfb72) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 19:01:58 devstack cinder-volume[84538]: DEBUG cinder.volume.manager [None req-d2796022-2cb5-4528-9d41-61713dc0ae53 tempest-VolumesActionsTest-1687831653 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a9b7b7f4-459c-45c6-bbb4-b63083ecfb72) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-29T17:01:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1553586414',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b83d5df6-eee2-4790-b562-41a753d16e1c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a39f1f9e4e364982af869dd2b24dfe70',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T17:01:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T17:01:59Z,use_quota=True,user_id='0feaa082ee4740958e7eb31611d1e836',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(62b05900-93e3-4190-a88f-1d87324303d1),volume_type_id=62b05900-93e3-4190-a88f-1d87324303d1)' {{(pid=84538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 19:01:58 devstack sudo[90403]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-ce170d29-c990-4cf6-85d1-20cfda253ab6 Apr 29 19:01:58 devstack sudo[90403]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 19:01:58 devstack cinder-volume[84538]: DEBUG cinder.volume.manager [None req-d2796022-2cb5-4528-9d41-61713dc0ae53 tempest-VolumesActionsTest-1687831653 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (77b61f0b-c63e-4b05-97c2-5a0a8e137e19) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 19:01:58 devstack cinder-volume[84538]: DEBUG cinder.volume.manager [None req-d2796022-2cb5-4528-9d41-61713dc0ae53 tempest-VolumesActionsTest-1687831653 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (77b61f0b-c63e-4b05-97c2-5a0a8e137e19) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 19:01:58 devstack cinder-volume[84538]: DEBUG cinder.volume.manager [None req-d2796022-2cb5-4528-9d41-61713dc0ae53 tempest-VolumesActionsTest-1687831653 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a17b9de1-0f65-4ecc-8010-0f4818778fcb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 19:01:58 devstack cinder-volume[84538]: DEBUG cinder.volume.manager [None req-d2796022-2cb5-4528-9d41-61713dc0ae53 tempest-VolumesActionsTest-1687831653 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a17b9de1-0f65-4ecc-8010-0f4818778fcb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b83d5df6-eee2-4790-b562-41a753d16e1c', 'volume_name': 'volume-b83d5df6-eee2-4790-b562-41a753d16e1c', 'volume_size': 1}' {{(pid=84538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 19:01:58 devstack cinder-volume[84538]: DEBUG cinder.volume.manager [None req-d2796022-2cb5-4528-9d41-61713dc0ae53 tempest-VolumesActionsTest-1687831653 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2edd72f6-ab25-45f7-887a-10d01a53929b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 19:01:58 devstack cinder-volume[84538]: DEBUG cinder.volume.manager [None req-d2796022-2cb5-4528-9d41-61713dc0ae53 tempest-VolumesActionsTest-1687831653 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2edd72f6-ab25-45f7-887a-10d01a53929b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 19:01:58 devstack cinder-volume[84538]: DEBUG cinder.volume.manager [None req-d2796022-2cb5-4528-9d41-61713dc0ae53 tempest-VolumesActionsTest-1687831653 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (651c1d80-3bfa-4772-ba44-a0b4047de85f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 19:01:58 devstack cinder-volume[84538]: INFO cinder.volume.flows.manager.create_volume [None req-d2796022-2cb5-4528-9d41-61713dc0ae53 tempest-VolumesActionsTest-1687831653 None] Volume b83d5df6-eee2-4790-b562-41a753d16e1c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b83d5df6-eee2-4790-b562-41a753d16e1c', 'volume_size': 1} Apr 29 19:01:58 devstack cinder-volume[84538]: DEBUG oslo_concurrency.lockutils [None req-d2796022-2cb5-4528-9d41-61713dc0ae53 tempest-VolumesActionsTest-1687831653 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 19:01:59 devstack sudo[90400]: pam_unix(sudo:session): session closed for user root Apr 29 19:01:59 devstack cinder-volume[84538]: DEBUG oslo_concurrency.processutils [None req-b6aed4ac-33f3-4a55-98e5-56e9a2146ac8 tempest-VolumesDeleteCascade-1314225595 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-363b2b67-b40a-4aea-a61a-58750417ef9c.7559f91c-a60b-4b95-8383-d4a8022ad997" returned: 0 in 0.820s {{(pid=84538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 19:01:59 devstack cinder-volume[84538]: DEBUG oslo_concurrency.lockutils [None req-b6aed4ac-33f3-4a55-98e5-56e9a2146ac8 tempest-VolumesDeleteCascade-1314225595 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.749s {{(pid=84538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 19:01:59 devstack cinder-volume[84538]: DEBUG oslo_concurrency.lockutils [None req-d2796022-2cb5-4528-9d41-61713dc0ae53 tempest-VolumesActionsTest-1687831653 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.158s {{(pid=84538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 19:01:59 devstack cinder-volume[84538]: DEBUG cinder.volume.drivers.quobyte [None req-d2796022-2cb5-4528-9d41-61713dc0ae53 tempest-VolumesActionsTest-1687831653 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-29T17:01:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1553586414',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b83d5df6-eee2-4790-b562-41a753d16e1c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a39f1f9e4e364982af869dd2b24dfe70',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T17:01:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T17:01:59Z,use_quota=True,user_id='0feaa082ee4740958e7eb31611d1e836',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(62b05900-93e3-4190-a88f-1d87324303d1),volume_type_id=62b05900-93e3-4190-a88f-1d87324303d1)}" {{(pid=84538) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 29 19:01:59 devstack cinder-volume[84538]: DEBUG cinder.volume.drivers.remotefs [None req-d2796022-2cb5-4528-9d41-61713dc0ae53 tempest-VolumesActionsTest-1687831653 None] Creating volume b83d5df6-eee2-4790-b562-41a753d16e1c {{(pid=84538) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 29 19:01:59 devstack cinder-volume[84538]: DEBUG oslo_concurrency.lockutils [None req-d2796022-2cb5-4528-9d41-61713dc0ae53 tempest-VolumesActionsTest-1687831653 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 19:01:59 devstack cinder-volume[84538]: DEBUG oslo_concurrency.lockutils [None req-d2796022-2cb5-4528-9d41-61713dc0ae53 tempest-VolumesActionsTest-1687831653 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=84538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 19:01:59 devstack cinder-volume[84538]: DEBUG cinder.volume.drivers.quobyte [None req-d2796022-2cb5-4528-9d41-61713dc0ae53 tempest-VolumesActionsTest-1687831653 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-34312b00-dd6d-45bb-af98-75855cea8e48': None} {{(pid=84538) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 19:01:59 devstack cinder-volume[84538]: DEBUG cinder.volume.drivers.quobyte [None req-d2796022-2cb5-4528-9d41-61713dc0ae53 tempest-VolumesActionsTest-1687831653 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-34312b00-dd6d-45bb-af98-75855cea8e48'] {{(pid=84538) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 19:01:59 devstack cinder-volume[84538]: DEBUG oslo_concurrency.lockutils [None req-d2796022-2cb5-4528-9d41-61713dc0ae53 tempest-VolumesActionsTest-1687831653 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=84538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 19:01:59 devstack cinder-volume[84538]: DEBUG cinder.volume.drivers.quobyte [None req-d2796022-2cb5-4528-9d41-61713dc0ae53 tempest-VolumesActionsTest-1687831653 None] Selected osci02.corp.quobyte.com/cinder-vol-34312b00-dd6d-45bb-af98-75855cea8e48 as target Quobyte volume. {{(pid=84538) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 29 19:01:59 devstack cinder-volume[84538]: INFO cinder.volume.drivers.remotefs [None req-d2796022-2cb5-4528-9d41-61713dc0ae53 tempest-VolumesActionsTest-1687831653 None] casted to osci02.corp.quobyte.com/cinder-vol-34312b00-dd6d-45bb-af98-75855cea8e48 Apr 29 19:01:59 devstack cinder-volume[84538]: DEBUG oslo_concurrency.processutils [None req-d2796022-2cb5-4528-9d41-61713dc0ae53 tempest-VolumesActionsTest-1687831653 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-b83d5df6-eee2-4790-b562-41a753d16e1c 1073741824 {{(pid=84538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 19:01:59 devstack sudo[90406]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-b83d5df6-eee2-4790-b562-41a753d16e1c 1073741824 Apr 29 19:01:59 devstack sudo[90406]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 19:01:59 devstack cinder-volume[84538]: INFO cinder.volume.manager [None req-b6aed4ac-33f3-4a55-98e5-56e9a2146ac8 tempest-VolumesDeleteCascade-1314225595 None] Create snapshot completed successfully Apr 29 19:01:59 devstack cinder-volume[84538]: DEBUG cinder.coordination [None req-ed99f4d5-1b4f-479e-825b-0838b6a61223 tempest-VolumesDeleteCascade-1314225595 None] Acquiring lock "cinder-363b2b67-b40a-4aea-a61a-58750417ef9c-delete_volume" by "delete_volume" {{(pid=84538) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 19:01:59 devstack cinder-volume[84538]: DEBUG cinder.coordination [None req-ed99f4d5-1b4f-479e-825b-0838b6a61223 tempest-VolumesDeleteCascade-1314225595 None] Lock "cinder-363b2b67-b40a-4aea-a61a-58750417ef9c-delete_volume" acquired by "delete_volume" :: waited 0.038s {{(pid=84538) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 19:01:59 devstack cinder-volume[84538]: DEBUG cinder.volume.manager [None req-ed99f4d5-1b4f-479e-825b-0838b6a61223 tempest-VolumesDeleteCascade-1314225595 None] Performing cascade delete. {{(pid=84538) delete_volume /opt/stack/cinder/cinder/volume/manager.py:995}} Apr 29 19:01:59 devstack cinder-volume[84538]: DEBUG cinder.coordination [None req-ed99f4d5-1b4f-479e-825b-0838b6a61223 tempest-VolumesDeleteCascade-1314225595 None] Acquiring lock "cinder-7296ba8c-4293-4139-a2e3-7f97420395c7-delete_snapshot" by "delete_snapshot" {{(pid=84538) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 19:01:59 devstack cinder-volume[84538]: DEBUG cinder.coordination [None req-ed99f4d5-1b4f-479e-825b-0838b6a61223 tempest-VolumesDeleteCascade-1314225595 None] Lock "cinder-7296ba8c-4293-4139-a2e3-7f97420395c7-delete_snapshot" acquired by "delete_snapshot" :: waited 0.030s {{(pid=84538) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 19:01:59 devstack cinder-volume[84538]: DEBUG cinder.coordination [None req-ed99f4d5-1b4f-479e-825b-0838b6a61223 tempest-VolumesDeleteCascade-1314225595 None] Acquiring lock "cinder-quobyte-363b2b67-b40a-4aea-a61a-58750417ef9c" by "delete_snapshot" {{(pid=84538) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 19:01:59 devstack cinder-volume[84538]: DEBUG cinder.coordination [None req-ed99f4d5-1b4f-479e-825b-0838b6a61223 tempest-VolumesDeleteCascade-1314225595 None] Lock "cinder-quobyte-363b2b67-b40a-4aea-a61a-58750417ef9c" acquired by "delete_snapshot" :: waited 0.023s {{(pid=84538) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 19:01:59 devstack cinder-volume[84538]: DEBUG cinder.coordination [None req-ed99f4d5-1b4f-479e-825b-0838b6a61223 tempest-VolumesDeleteCascade-1314225595 None] Acquiring lock "cinder-quobyte-7296ba8c-4293-4139-a2e3-7f97420395c7" by "_delete_snapshot" {{(pid=84538) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 19:01:59 devstack cinder-volume[84538]: DEBUG cinder.coordination [None req-ed99f4d5-1b4f-479e-825b-0838b6a61223 tempest-VolumesDeleteCascade-1314225595 None] Lock "cinder-quobyte-7296ba8c-4293-4139-a2e3-7f97420395c7" acquired by "_delete_snapshot" :: waited 0.037s {{(pid=84538) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 19:01:59 devstack cinder-volume[84538]: DEBUG cinder.volume.drivers.remotefs [None req-ed99f4d5-1b4f-479e-825b-0838b6a61223 tempest-VolumesDeleteCascade-1314225595 None] Deleting offline snapshot 7296ba8c-4293-4139-a2e3-7f97420395c7 of volume 363b2b67-b40a-4aea-a61a-58750417ef9c {{(pid=84538) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 29 19:01:59 devstack sudo[90403]: pam_unix(sudo:session): session closed for user root Apr 29 19:01:59 devstack cinder-volume[84538]: DEBUG cinder.volume.drivers.remotefs [None req-ed99f4d5-1b4f-479e-825b-0838b6a61223 tempest-VolumesDeleteCascade-1314225595 None] snapshot_file for this snap is: volume-363b2b67-b40a-4aea-a61a-58750417ef9c.7296ba8c-4293-4139-a2e3-7f97420395c7 {{(pid=84538) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 29 19:01:59 devstack cinder-volume[84538]: DEBUG oslo_concurrency.processutils [None req-368b9352-2e75-4e13-9c29-b5156ec2ce16 tempest-GroupSnapshotsTest-1835037466 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-ce170d29-c990-4cf6-85d1-20cfda253ab6" returned: 0 in 1.039s {{(pid=84538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 19:01:59 devstack cinder-volume[84538]: DEBUG oslo_concurrency.processutils [None req-368b9352-2e75-4e13-9c29-b5156ec2ce16 tempest-GroupSnapshotsTest-1835037466 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-ce170d29-c990-4cf6-85d1-20cfda253ab6 {{(pid=84538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 19:01:59 devstack cinder-volume[84538]: DEBUG oslo.privsep.daemon [-] privsep: reply[44afb092-c021-4b5f-9d44-281ad8a2ea9f]: (4, 'qcow2') {{(pid=85803) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 19:01:59 devstack cinder-volume[84538]: DEBUG oslo_concurrency.processutils [None req-ed99f4d5-1b4f-479e-825b-0838b6a61223 tempest-VolumesDeleteCascade-1314225595 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-363b2b67-b40a-4aea-a61a-58750417ef9c.7296ba8c-4293-4139-a2e3-7f97420395c7 {{(pid=84538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 19:01:59 devstack sudo[90414]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-ce170d29-c990-4cf6-85d1-20cfda253ab6 Apr 29 19:01:59 devstack sudo[90414]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 19:01:59 devstack sudo[90416]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-363b2b67-b40a-4aea-a61a-58750417ef9c.7296ba8c-4293-4139-a2e3-7f97420395c7 Apr 29 19:01:59 devstack sudo[90416]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 19:02:00 devstack sudo[90406]: pam_unix(sudo:session): session closed for user root Apr 29 19:02:00 devstack cinder-volume[84538]: DEBUG oslo_concurrency.processutils [None req-d2796022-2cb5-4528-9d41-61713dc0ae53 tempest-VolumesActionsTest-1687831653 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-b83d5df6-eee2-4790-b562-41a753d16e1c 1073741824" returned: 0 in 1.084s {{(pid=84538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 19:02:00 devstack cinder-volume[84538]: DEBUG oslo_concurrency.processutils [None req-d2796022-2cb5-4528-9d41-61713dc0ae53 tempest-VolumesActionsTest-1687831653 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-b83d5df6-eee2-4790-b562-41a753d16e1c {{(pid=84538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 19:02:00 devstack sudo[90421]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-b83d5df6-eee2-4790-b562-41a753d16e1c Apr 29 19:02:00 devstack sudo[90421]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 19:02:00 devstack sudo[90414]: pam_unix(sudo:session): session closed for user root Apr 29 19:02:00 devstack cinder-volume[84538]: DEBUG oslo_concurrency.processutils [None req-368b9352-2e75-4e13-9c29-b5156ec2ce16 tempest-GroupSnapshotsTest-1835037466 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-ce170d29-c990-4cf6-85d1-20cfda253ab6" returned: 0 in 0.791s {{(pid=84538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 19:02:00 devstack cinder-volume[84538]: DEBUG cinder.coordination [None req-368b9352-2e75-4e13-9c29-b5156ec2ce16 tempest-GroupSnapshotsTest-1835037466 None] Lock "cinder-quobyte-ce170d29-c990-4cf6-85d1-20cfda253ab6" released by "delete_volume" :: held 1.928s {{(pid=84538) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 19:02:00 devstack sudo[90416]: pam_unix(sudo:session): session closed for user root Apr 29 19:02:00 devstack cinder-volume[84538]: DEBUG oslo_concurrency.processutils [None req-ed99f4d5-1b4f-479e-825b-0838b6a61223 tempest-VolumesDeleteCascade-1314225595 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-363b2b67-b40a-4aea-a61a-58750417ef9c.7296ba8c-4293-4139-a2e3-7f97420395c7" returned: 0 in 0.895s {{(pid=84538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 19:02:00 devstack cinder-volume[84538]: DEBUG cinder.volume.drivers.remotefs [None req-ed99f4d5-1b4f-479e-825b-0838b6a61223 tempest-VolumesDeleteCascade-1314225595 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-363b2b67-b40a-4aea-a61a-58750417ef9c(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=84538) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 29 19:02:00 devstack cinder-volume[84538]: DEBUG oslo.privsep.daemon [-] privsep: reply[98829eaa-6262-4c68-a066-3e811afc85cc]: (4, 'qcow2') {{(pid=85803) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 19:02:00 devstack cinder-volume[84538]: DEBUG oslo_concurrency.processutils [None req-ed99f4d5-1b4f-479e-825b-0838b6a61223 tempest-VolumesDeleteCascade-1314225595 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-363b2b67-b40a-4aea-a61a-58750417ef9c {{(pid=84538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 19:02:00 devstack cinder-volume[84538]: DEBUG cinder.quota [None req-368b9352-2e75-4e13-9c29-b5156ec2ce16 tempest-GroupSnapshotsTest-1835037466 None] Created reservations ['6281c81a-f207-44e2-8c0b-3a74387fead4'] {{(pid=84538) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 29 19:02:00 devstack cinder-volume[84538]: WARNING cinder.quota [None req-368b9352-2e75-4e13-9c29-b5156ec2ce16 tempest-GroupSnapshotsTest-1835037466 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsTest-volume-type-1864509393 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsTest-volume-type-1864509393, it is now deprecated. Please use the default quota class for default quota. Apr 29 19:02:00 devstack cinder-volume[84538]: DEBUG cinder.quota [None req-368b9352-2e75-4e13-9c29-b5156ec2ce16 tempest-GroupSnapshotsTest-1835037466 None] Created reservations ['a33c2eb3-2bbe-4d71-af82-c7cebfbb4c32', '37a76fcc-ad68-4098-b0cd-55f623e8d177', 'e0be56ed-0934-4e99-9916-4c2e2eaa4e6a', 'e32f20d7-8c67-410b-b9b5-c6d98880ccf9'] {{(pid=84538) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 29 19:02:00 devstack sudo[90428]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-363b2b67-b40a-4aea-a61a-58750417ef9c Apr 29 19:02:00 devstack sudo[90428]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 19:02:00 devstack cinder-volume[84538]: DEBUG cinder.quota [None req-368b9352-2e75-4e13-9c29-b5156ec2ce16 tempest-GroupSnapshotsTest-1835037466 None] Created reservations ['4db46059-9335-4d47-949d-393f7fdd1356', 'b0d2a1d0-d818-4d01-bd8d-cff74457bb8f', '22fee260-05ce-4622-858b-964348051d12', '165e236b-66c8-462e-aeb7-29246b1b40b9'] {{(pid=84538) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 29 19:02:01 devstack sudo[90421]: pam_unix(sudo:session): session closed for user root Apr 29 19:02:01 devstack cinder-volume[84538]: DEBUG oslo_concurrency.processutils [None req-d2796022-2cb5-4528-9d41-61713dc0ae53 tempest-VolumesActionsTest-1687831653 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-b83d5df6-eee2-4790-b562-41a753d16e1c" returned: 0 in 0.800s {{(pid=84538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 19:02:01 devstack cinder-volume[84538]: DEBUG cinder.volume.drivers.quobyte [None req-d2796022-2cb5-4528-9d41-61713dc0ae53 tempest-VolumesActionsTest-1687831653 None] <== create_volume: return (1951ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-34312b00-dd6d-45bb-af98-75855cea8e48'} {{(pid=84538) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 29 19:02:01 devstack cinder-volume[84538]: DEBUG oslo_concurrency.lockutils [None req-d2796022-2cb5-4528-9d41-61713dc0ae53 tempest-VolumesActionsTest-1687831653 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.954s {{(pid=84538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 19:02:01 devstack cinder-volume[84538]: DEBUG cinder.volume.manager [None req-d2796022-2cb5-4528-9d41-61713dc0ae53 tempest-VolumesActionsTest-1687831653 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (651c1d80-3bfa-4772-ba44-a0b4047de85f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b83d5df6-eee2-4790-b562-41a753d16e1c', 'volume_size': 1}' {{(pid=84538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 19:02:01 devstack cinder-volume[84538]: DEBUG cinder.volume.manager [None req-d2796022-2cb5-4528-9d41-61713dc0ae53 tempest-VolumesActionsTest-1687831653 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0cb29121-21fc-4f02-8468-8c513df400dc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 19:02:01 devstack cinder-volume[84538]: INFO cinder.volume.flows.manager.create_volume [None req-d2796022-2cb5-4528-9d41-61713dc0ae53 tempest-VolumesActionsTest-1687831653 None] Volume volume-b83d5df6-eee2-4790-b562-41a753d16e1c (b83d5df6-eee2-4790-b562-41a753d16e1c): created successfully Apr 29 19:02:01 devstack cinder-volume[84538]: DEBUG cinder.volume.manager [None req-d2796022-2cb5-4528-9d41-61713dc0ae53 tempest-VolumesActionsTest-1687831653 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0cb29121-21fc-4f02-8468-8c513df400dc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 19:02:01 devstack cinder-volume[84538]: DEBUG cinder.volume.manager [None req-d2796022-2cb5-4528-9d41-61713dc0ae53 tempest-VolumesActionsTest-1687831653 None] Flow 'volume_create_manager' (02527f32-034f-46d0-8932-5103e1b03287) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84538) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 19:02:01 devstack cinder-volume[84538]: INFO cinder.volume.manager [None req-d2796022-2cb5-4528-9d41-61713dc0ae53 tempest-VolumesActionsTest-1687831653 None] Created volume successfully. Apr 29 19:02:01 devstack cinder-volume[84538]: DEBUG oslo_concurrency.lockutils [None req-368b9352-2e75-4e13-9c29-b5156ec2ce16 tempest-GroupSnapshotsTest-1835037466 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 19:02:01 devstack cinder-volume[84538]: DEBUG oslo_concurrency.lockutils [None req-368b9352-2e75-4e13-9c29-b5156ec2ce16 tempest-GroupSnapshotsTest-1835037466 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 19:02:01 devstack cinder-volume[84538]: DEBUG cinder.volume.drivers.quobyte [None req-368b9352-2e75-4e13-9c29-b5156ec2ce16 tempest-GroupSnapshotsTest-1835037466 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-34312b00-dd6d-45bb-af98-75855cea8e48': None} {{(pid=84538) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 19:02:01 devstack cinder-volume[84538]: DEBUG cinder.volume.drivers.quobyte [None req-368b9352-2e75-4e13-9c29-b5156ec2ce16 tempest-GroupSnapshotsTest-1835037466 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-34312b00-dd6d-45bb-af98-75855cea8e48'] {{(pid=84538) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 19:02:01 devstack cinder-volume[84538]: DEBUG oslo_concurrency.lockutils [None req-368b9352-2e75-4e13-9c29-b5156ec2ce16 tempest-GroupSnapshotsTest-1835037466 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=84538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 19:02:01 devstack cinder-volume[84538]: DEBUG oslo_concurrency.processutils [None req-368b9352-2e75-4e13-9c29-b5156ec2ce16 tempest-GroupSnapshotsTest-1835037466 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d {{(pid=84538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 19:02:01 devstack sudo[90431]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d Apr 29 19:02:01 devstack sudo[90431]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 19:02:01 devstack sudo[90428]: pam_unix(sudo:session): session closed for user root Apr 29 19:02:01 devstack cinder-volume[84538]: DEBUG oslo_concurrency.processutils [None req-ed99f4d5-1b4f-479e-825b-0838b6a61223 tempest-VolumesDeleteCascade-1314225595 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-363b2b67-b40a-4aea-a61a-58750417ef9c" returned: 0 in 0.892s {{(pid=84538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 19:02:01 devstack cinder-volume[84538]: DEBUG oslo.privsep.daemon [-] privsep: reply[f725a7d7-0395-4bf5-9372-29418fa3e7e8]: (4, 'qcow2') {{(pid=85803) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 19:02:01 devstack cinder-volume[84538]: DEBUG oslo_concurrency.processutils [None req-ed99f4d5-1b4f-479e-825b-0838b6a61223 tempest-VolumesDeleteCascade-1314225595 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-363b2b67-b40a-4aea-a61a-58750417ef9c.7559f91c-a60b-4b95-8383-d4a8022ad997 {{(pid=84538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 19:02:01 devstack cinder-volume[84538]: INFO cinder.volume.manager [None req-1cbe7e3d-f1ab-44e2-8c60-b81412520430 tempest-GroupSnapshotsTest-1835037466 None] Group tempest-GroupSnapshotsTest-Group-2098746401: creating Apr 29 19:02:01 devstack cinder-volume[84538]: INFO cinder.volume.manager [None req-1cbe7e3d-f1ab-44e2-8c60-b81412520430 tempest-GroupSnapshotsTest-1835037466 None] Group tempest-GroupSnapshotsTest-Group-2098746401: created successfully Apr 29 19:02:01 devstack cinder-volume[84538]: INFO cinder.volume.manager [None req-1cbe7e3d-f1ab-44e2-8c60-b81412520430 tempest-GroupSnapshotsTest-1835037466 None] Create group completed successfully. Apr 29 19:02:01 devstack sudo[90437]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-363b2b67-b40a-4aea-a61a-58750417ef9c.7559f91c-a60b-4b95-8383-d4a8022ad997 Apr 29 19:02:01 devstack sudo[90437]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 19:02:01 devstack sudo[90431]: pam_unix(sudo:session): session closed for user root Apr 29 19:02:01 devstack cinder-volume[84538]: DEBUG oslo_concurrency.processutils [None req-368b9352-2e75-4e13-9c29-b5156ec2ce16 tempest-GroupSnapshotsTest-1835037466 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d" returned: 0 in 0.719s {{(pid=84538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 19:02:01 devstack cinder-volume[84538]: DEBUG cinder.manager [None req-368b9352-2e75-4e13-9c29-b5156ec2ce16 tempest-GroupSnapshotsTest-1835037466 None] Notifying Schedulers of capabilities ... {{(pid=84538) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 29 19:02:01 devstack cinder-volume[84538]: INFO cinder.volume.manager [None req-368b9352-2e75-4e13-9c29-b5156ec2ce16 tempest-GroupSnapshotsTest-1835037466 None] Delete group completed successfully. Apr 29 19:02:02 devstack sudo[90437]: pam_unix(sudo:session): session closed for user root Apr 29 19:02:02 devstack cinder-volume[84538]: DEBUG oslo_concurrency.processutils [None req-ed99f4d5-1b4f-479e-825b-0838b6a61223 tempest-VolumesDeleteCascade-1314225595 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-363b2b67-b40a-4aea-a61a-58750417ef9c.7559f91c-a60b-4b95-8383-d4a8022ad997" returned: 0 in 0.801s {{(pid=84538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 19:02:02 devstack cinder-volume[84538]: DEBUG cinder.volume.drivers.remotefs [None req-ed99f4d5-1b4f-479e-825b-0838b6a61223 tempest-VolumesDeleteCascade-1314225595 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-363b2b67-b40a-4aea-a61a-58750417ef9c(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=84538) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 29 19:02:02 devstack cinder-volume[84538]: DEBUG oslo.privsep.daemon [-] privsep: reply[00f88e1c-26fc-4647-990c-94ceda5eece3]: (4, 'qcow2') {{(pid=85803) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 19:02:02 devstack cinder-volume[84538]: DEBUG oslo_concurrency.processutils [None req-ed99f4d5-1b4f-479e-825b-0838b6a61223 tempest-VolumesDeleteCascade-1314225595 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-363b2b67-b40a-4aea-a61a-58750417ef9c.7296ba8c-4293-4139-a2e3-7f97420395c7 {{(pid=84538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 19:02:02 devstack sudo[90443]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-363b2b67-b40a-4aea-a61a-58750417ef9c.7296ba8c-4293-4139-a2e3-7f97420395c7 Apr 29 19:02:02 devstack sudo[90443]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 19:02:02 devstack cinder-volume[84538]: DEBUG cinder.coordination [None req-51b84617-9203-480c-94b2-c7ba63934726 tempest-VolumesActionsTest-1687831653 None] Acquiring lock "cinder-b83d5df6-eee2-4790-b562-41a753d16e1c-delete_volume" by "delete_volume" {{(pid=84538) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 19:02:02 devstack cinder-volume[84538]: DEBUG cinder.coordination [None req-51b84617-9203-480c-94b2-c7ba63934726 tempest-VolumesActionsTest-1687831653 None] Lock "cinder-b83d5df6-eee2-4790-b562-41a753d16e1c-delete_volume" acquired by "delete_volume" :: waited 0.032s {{(pid=84538) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 19:02:02 devstack cinder-volume[84538]: DEBUG cinder.coordination [None req-51b84617-9203-480c-94b2-c7ba63934726 tempest-VolumesActionsTest-1687831653 None] Acquiring lock "cinder-quobyte-b83d5df6-eee2-4790-b562-41a753d16e1c" by "delete_volume" {{(pid=84538) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 19:02:02 devstack cinder-volume[84538]: DEBUG cinder.coordination [None req-51b84617-9203-480c-94b2-c7ba63934726 tempest-VolumesActionsTest-1687831653 None] Lock "cinder-quobyte-b83d5df6-eee2-4790-b562-41a753d16e1c" acquired by "delete_volume" :: waited 0.023s {{(pid=84538) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 19:02:02 devstack cinder-volume[84538]: DEBUG oslo.privsep.daemon [-] privsep: reply[96b7861d-0f21-4426-9bab-7222adf452e9]: (4, 'qcow2') {{(pid=85803) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 19:02:02 devstack cinder-volume[84538]: DEBUG oslo_concurrency.processutils [None req-51b84617-9203-480c-94b2-c7ba63934726 tempest-VolumesActionsTest-1687831653 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-b83d5df6-eee2-4790-b562-41a753d16e1c {{(pid=84538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 19:02:02 devstack sudo[90445]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-b83d5df6-eee2-4790-b562-41a753d16e1c Apr 29 19:02:02 devstack sudo[90445]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 19:02:03 devstack cinder-volume[84538]: DEBUG cinder.volume.flows.manager.create_volume [None req-dfbb60a8-b8fb-4d70-986c-cadf98d3c25a tempest-GroupSnapshotsTest-1835037466 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84538) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Apr 29 19:02:03 devstack cinder-volume[84538]: DEBUG cinder.volume.manager [None req-dfbb60a8-b8fb-4d70-986c-cadf98d3c25a tempest-GroupSnapshotsTest-1835037466 None] Flow 'volume_create_manager' (4178966f-1829-480c-83d7-f89605974005) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84538) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 19:02:03 devstack cinder-volume[84538]: DEBUG cinder.volume.manager [None req-dfbb60a8-b8fb-4d70-986c-cadf98d3c25a tempest-GroupSnapshotsTest-1835037466 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cbdf805b-3ac6-4c37-bc9d-2bbe5f1b2e69) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 19:02:03 devstack sudo[90443]: pam_unix(sudo:session): session closed for user root Apr 29 19:02:03 devstack cinder-volume[84538]: DEBUG oslo_concurrency.processutils [None req-ed99f4d5-1b4f-479e-825b-0838b6a61223 tempest-VolumesDeleteCascade-1314225595 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-363b2b67-b40a-4aea-a61a-58750417ef9c.7296ba8c-4293-4139-a2e3-7f97420395c7" returned: 0 in 0.896s {{(pid=84538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 19:02:03 devstack cinder-volume[84538]: DEBUG cinder.volume.drivers.remotefs [None req-ed99f4d5-1b4f-479e-825b-0838b6a61223 tempest-VolumesDeleteCascade-1314225595 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-363b2b67-b40a-4aea-a61a-58750417ef9c(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=84538) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 29 19:02:03 devstack cinder-volume[84538]: DEBUG cinder.volume.manager [None req-dfbb60a8-b8fb-4d70-986c-cadf98d3c25a tempest-GroupSnapshotsTest-1835037466 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cbdf805b-3ac6-4c37-bc9d-2bbe5f1b2e69) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-29T17:02:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-821865946',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=082a9742-6543-460b-8b6d-db32658a2ca2,host='devstack@QuobyteHD#QuobyteHD',id=2e29ba0d-aed9-4682-8da4-ade2b8e26470,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='14dd90144b0b4dcc8def965ebf4ada62',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T17:02:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T17:02:03Z,use_quota=True,user_id='616bcc255f9c4e89963a9ff70ca5ab6c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1cd58a33-cb7b-4bdd-adc4-5668c2c022b0),volume_type_id=1cd58a33-cb7b-4bdd-adc4-5668c2c022b0)' {{(pid=84538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 19:02:03 devstack cinder-volume[84538]: DEBUG cinder.volume.manager [None req-dfbb60a8-b8fb-4d70-986c-cadf98d3c25a tempest-GroupSnapshotsTest-1835037466 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f8267fab-d175-45a1-9438-60d67cb6f0b7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 19:02:03 devstack cinder-volume[84538]: DEBUG cinder.volume.manager [None req-dfbb60a8-b8fb-4d70-986c-cadf98d3c25a tempest-GroupSnapshotsTest-1835037466 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f8267fab-d175-45a1-9438-60d67cb6f0b7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 19:02:03 devstack cinder-volume[84538]: DEBUG cinder.volume.manager [None req-dfbb60a8-b8fb-4d70-986c-cadf98d3c25a tempest-GroupSnapshotsTest-1835037466 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (48653d33-1a0e-419c-9aa1-d5e0ae03a8cd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 19:02:03 devstack cinder-volume[84538]: DEBUG cinder.volume.manager [None req-dfbb60a8-b8fb-4d70-986c-cadf98d3c25a tempest-GroupSnapshotsTest-1835037466 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (48653d33-1a0e-419c-9aa1-d5e0ae03a8cd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2e29ba0d-aed9-4682-8da4-ade2b8e26470', 'volume_name': 'volume-2e29ba0d-aed9-4682-8da4-ade2b8e26470', 'volume_size': 1}' {{(pid=84538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 19:02:03 devstack cinder-volume[84538]: DEBUG cinder.volume.manager [None req-dfbb60a8-b8fb-4d70-986c-cadf98d3c25a tempest-GroupSnapshotsTest-1835037466 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (09f3bcd8-b251-46ea-a25f-8ed9a69221ad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 19:02:03 devstack cinder-volume[84538]: DEBUG cinder.volume.manager [None req-dfbb60a8-b8fb-4d70-986c-cadf98d3c25a tempest-GroupSnapshotsTest-1835037466 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (09f3bcd8-b251-46ea-a25f-8ed9a69221ad) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 19:02:03 devstack cinder-volume[84538]: DEBUG cinder.volume.manager [None req-dfbb60a8-b8fb-4d70-986c-cadf98d3c25a tempest-GroupSnapshotsTest-1835037466 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ad00ebd1-7d9d-46e3-bcc2-db71722e05ad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 19:02:03 devstack cinder-volume[84538]: INFO cinder.volume.flows.manager.create_volume [None req-dfbb60a8-b8fb-4d70-986c-cadf98d3c25a tempest-GroupSnapshotsTest-1835037466 None] Volume 2e29ba0d-aed9-4682-8da4-ade2b8e26470: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2e29ba0d-aed9-4682-8da4-ade2b8e26470', 'volume_size': 1} Apr 29 19:02:03 devstack cinder-volume[84538]: DEBUG oslo_concurrency.lockutils [None req-dfbb60a8-b8fb-4d70-986c-cadf98d3c25a tempest-GroupSnapshotsTest-1835037466 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 19:02:03 devstack cinder-volume[84538]: DEBUG oslo_concurrency.lockutils [None req-dfbb60a8-b8fb-4d70-986c-cadf98d3c25a tempest-GroupSnapshotsTest-1835037466 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=84538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 19:02:03 devstack cinder-volume[84538]: DEBUG cinder.volume.drivers.quobyte [None req-dfbb60a8-b8fb-4d70-986c-cadf98d3c25a tempest-GroupSnapshotsTest-1835037466 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=082a9742-6543-460b-8b6d-db32658a2ca2,created_at=2026-04-29T17:02:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-821865946',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=082a9742-6543-460b-8b6d-db32658a2ca2,host='devstack@QuobyteHD#QuobyteHD',id=2e29ba0d-aed9-4682-8da4-ade2b8e26470,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='14dd90144b0b4dcc8def965ebf4ada62',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T17:02:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T17:02:03Z,use_quota=True,user_id='616bcc255f9c4e89963a9ff70ca5ab6c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1cd58a33-cb7b-4bdd-adc4-5668c2c022b0),volume_type_id=1cd58a33-cb7b-4bdd-adc4-5668c2c022b0)}" {{(pid=84538) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 29 19:02:03 devstack cinder-volume[84538]: DEBUG cinder.volume.drivers.remotefs [None req-dfbb60a8-b8fb-4d70-986c-cadf98d3c25a tempest-GroupSnapshotsTest-1835037466 None] Creating volume 2e29ba0d-aed9-4682-8da4-ade2b8e26470 {{(pid=84538) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 29 19:02:03 devstack cinder-volume[84538]: DEBUG oslo_concurrency.lockutils [None req-dfbb60a8-b8fb-4d70-986c-cadf98d3c25a tempest-GroupSnapshotsTest-1835037466 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 19:02:03 devstack cinder-volume[84538]: DEBUG oslo_concurrency.lockutils [None req-dfbb60a8-b8fb-4d70-986c-cadf98d3c25a tempest-GroupSnapshotsTest-1835037466 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=84538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 19:02:03 devstack cinder-volume[84538]: DEBUG cinder.volume.drivers.quobyte [None req-dfbb60a8-b8fb-4d70-986c-cadf98d3c25a tempest-GroupSnapshotsTest-1835037466 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-34312b00-dd6d-45bb-af98-75855cea8e48': None} {{(pid=84538) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 19:02:03 devstack cinder-volume[84538]: DEBUG cinder.volume.drivers.quobyte [None req-dfbb60a8-b8fb-4d70-986c-cadf98d3c25a tempest-GroupSnapshotsTest-1835037466 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-34312b00-dd6d-45bb-af98-75855cea8e48'] {{(pid=84538) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 19:02:03 devstack cinder-volume[84538]: DEBUG oslo_concurrency.lockutils [None req-dfbb60a8-b8fb-4d70-986c-cadf98d3c25a tempest-GroupSnapshotsTest-1835037466 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=84538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 19:02:03 devstack cinder-volume[84538]: DEBUG cinder.volume.drivers.quobyte [None req-dfbb60a8-b8fb-4d70-986c-cadf98d3c25a tempest-GroupSnapshotsTest-1835037466 None] Selected osci02.corp.quobyte.com/cinder-vol-34312b00-dd6d-45bb-af98-75855cea8e48 as target Quobyte volume. {{(pid=84538) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 29 19:02:03 devstack cinder-volume[84538]: INFO cinder.volume.drivers.remotefs [None req-dfbb60a8-b8fb-4d70-986c-cadf98d3c25a tempest-GroupSnapshotsTest-1835037466 None] casted to osci02.corp.quobyte.com/cinder-vol-34312b00-dd6d-45bb-af98-75855cea8e48 Apr 29 19:02:03 devstack cinder-volume[84538]: DEBUG oslo_concurrency.processutils [None req-dfbb60a8-b8fb-4d70-986c-cadf98d3c25a tempest-GroupSnapshotsTest-1835037466 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-2e29ba0d-aed9-4682-8da4-ade2b8e26470 1073741824 {{(pid=84538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 19:02:03 devstack cinder-volume[84538]: DEBUG oslo.privsep.daemon [-] privsep: reply[7cd68107-41af-4042-a3c9-bb0df44d40aa]: (4, 'qcow2') {{(pid=85803) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 19:02:03 devstack cinder-volume[84538]: DEBUG oslo_concurrency.processutils [None req-ed99f4d5-1b4f-479e-825b-0838b6a61223 tempest-VolumesDeleteCascade-1314225595 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-363b2b67-b40a-4aea-a61a-58750417ef9c {{(pid=84538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 19:02:03 devstack sudo[90450]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-2e29ba0d-aed9-4682-8da4-ade2b8e26470 1073741824 Apr 29 19:02:03 devstack sudo[90450]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 19:02:03 devstack sudo[90451]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-363b2b67-b40a-4aea-a61a-58750417ef9c Apr 29 19:02:03 devstack sudo[90451]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 19:02:03 devstack sudo[90445]: pam_unix(sudo:session): session closed for user root Apr 29 19:02:03 devstack cinder-volume[84538]: DEBUG oslo_concurrency.processutils [None req-51b84617-9203-480c-94b2-c7ba63934726 tempest-VolumesActionsTest-1687831653 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-b83d5df6-eee2-4790-b562-41a753d16e1c" returned: 0 in 0.877s {{(pid=84538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 19:02:03 devstack cinder-volume[84538]: DEBUG oslo_concurrency.processutils [None req-51b84617-9203-480c-94b2-c7ba63934726 tempest-VolumesActionsTest-1687831653 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-b83d5df6-eee2-4790-b562-41a753d16e1c {{(pid=84538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 19:02:03 devstack sudo[90457]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-b83d5df6-eee2-4790-b562-41a753d16e1c Apr 29 19:02:03 devstack sudo[90457]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 19:02:04 devstack sudo[90451]: pam_unix(sudo:session): session closed for user root Apr 29 19:02:04 devstack cinder-volume[84538]: DEBUG oslo_concurrency.processutils [None req-ed99f4d5-1b4f-479e-825b-0838b6a61223 tempest-VolumesDeleteCascade-1314225595 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-363b2b67-b40a-4aea-a61a-58750417ef9c" returned: 0 in 0.843s {{(pid=84538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 19:02:04 devstack cinder-volume[84538]: DEBUG oslo_concurrency.processutils [None req-ed99f4d5-1b4f-479e-825b-0838b6a61223 tempest-VolumesDeleteCascade-1314225595 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-363b2b67-b40a-4aea-a61a-58750417ef9c.7296ba8c-4293-4139-a2e3-7f97420395c7 {{(pid=84538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 19:02:04 devstack sudo[90467]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-363b2b67-b40a-4aea-a61a-58750417ef9c.7296ba8c-4293-4139-a2e3-7f97420395c7 Apr 29 19:02:04 devstack sudo[90467]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 19:02:04 devstack sudo[90457]: pam_unix(sudo:session): session closed for user root Apr 29 19:02:04 devstack cinder-volume[84538]: DEBUG oslo_concurrency.processutils [None req-51b84617-9203-480c-94b2-c7ba63934726 tempest-VolumesActionsTest-1687831653 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-b83d5df6-eee2-4790-b562-41a753d16e1c" returned: 0 in 0.768s {{(pid=84538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 19:02:04 devstack cinder-volume[84538]: DEBUG cinder.coordination [None req-51b84617-9203-480c-94b2-c7ba63934726 tempest-VolumesActionsTest-1687831653 None] Lock "cinder-quobyte-b83d5df6-eee2-4790-b562-41a753d16e1c" released by "delete_volume" :: held 1.706s {{(pid=84538) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 19:02:04 devstack sudo[90450]: pam_unix(sudo:session): session closed for user root Apr 29 19:02:04 devstack cinder-volume[84538]: DEBUG oslo_concurrency.processutils [None req-dfbb60a8-b8fb-4d70-986c-cadf98d3c25a tempest-GroupSnapshotsTest-1835037466 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-2e29ba0d-aed9-4682-8da4-ade2b8e26470 1073741824" returned: 0 in 1.004s {{(pid=84538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 19:02:04 devstack cinder-volume[84538]: DEBUG oslo_concurrency.processutils [None req-dfbb60a8-b8fb-4d70-986c-cadf98d3c25a tempest-GroupSnapshotsTest-1835037466 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-2e29ba0d-aed9-4682-8da4-ade2b8e26470 {{(pid=84538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 19:02:04 devstack sudo[90469]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-2e29ba0d-aed9-4682-8da4-ade2b8e26470 Apr 29 19:02:04 devstack sudo[90469]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 19:02:04 devstack cinder-volume[84538]: DEBUG cinder.quota [None req-51b84617-9203-480c-94b2-c7ba63934726 tempest-VolumesActionsTest-1687831653 None] Created reservations ['9e3c4965-f14a-4ee2-9340-a22c069e8924', '92f74965-7a6c-40f1-a814-6257dc1c9cc7', 'ea8cf09a-80e2-4f31-8a24-60942e6593d1', 'adff4021-41ea-475b-b236-f0770e47b7e1'] {{(pid=84538) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 29 19:02:04 devstack cinder-volume[84538]: DEBUG oslo_concurrency.lockutils [None req-51b84617-9203-480c-94b2-c7ba63934726 tempest-VolumesActionsTest-1687831653 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 19:02:04 devstack cinder-volume[84538]: DEBUG oslo_concurrency.lockutils [None req-51b84617-9203-480c-94b2-c7ba63934726 tempest-VolumesActionsTest-1687831653 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 19:02:04 devstack cinder-volume[84538]: DEBUG cinder.volume.drivers.quobyte [None req-51b84617-9203-480c-94b2-c7ba63934726 tempest-VolumesActionsTest-1687831653 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-34312b00-dd6d-45bb-af98-75855cea8e48': None} {{(pid=84538) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 19:02:04 devstack cinder-volume[84538]: DEBUG cinder.volume.drivers.quobyte [None req-51b84617-9203-480c-94b2-c7ba63934726 tempest-VolumesActionsTest-1687831653 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-34312b00-dd6d-45bb-af98-75855cea8e48'] {{(pid=84538) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 19:02:04 devstack cinder-volume[84538]: DEBUG oslo_concurrency.lockutils [None req-51b84617-9203-480c-94b2-c7ba63934726 tempest-VolumesActionsTest-1687831653 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=84538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 19:02:04 devstack cinder-volume[84538]: DEBUG oslo_concurrency.processutils [None req-51b84617-9203-480c-94b2-c7ba63934726 tempest-VolumesActionsTest-1687831653 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d {{(pid=84538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 19:02:04 devstack sudo[90471]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d Apr 29 19:02:04 devstack sudo[90471]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 19:02:05 devstack sudo[90467]: pam_unix(sudo:session): session closed for user root Apr 29 19:02:05 devstack cinder-volume[84538]: DEBUG oslo_concurrency.processutils [None req-ed99f4d5-1b4f-479e-825b-0838b6a61223 tempest-VolumesDeleteCascade-1314225595 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-363b2b67-b40a-4aea-a61a-58750417ef9c.7296ba8c-4293-4139-a2e3-7f97420395c7" returned: 0 in 0.999s {{(pid=84538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 19:02:05 devstack cinder-volume[84538]: DEBUG oslo_concurrency.processutils [None req-ed99f4d5-1b4f-479e-825b-0838b6a61223 tempest-VolumesDeleteCascade-1314225595 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-363b2b67-b40a-4aea-a61a-58750417ef9c.7296ba8c-4293-4139-a2e3-7f97420395c7 {{(pid=84538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 19:02:05 devstack sudo[90480]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-363b2b67-b40a-4aea-a61a-58750417ef9c.7296ba8c-4293-4139-a2e3-7f97420395c7 Apr 29 19:02:05 devstack sudo[90480]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 19:02:05 devstack sudo[90469]: pam_unix(sudo:session): session closed for user root Apr 29 19:02:05 devstack cinder-volume[84538]: DEBUG oslo_concurrency.processutils [None req-dfbb60a8-b8fb-4d70-986c-cadf98d3c25a tempest-GroupSnapshotsTest-1835037466 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-2e29ba0d-aed9-4682-8da4-ade2b8e26470" returned: 0 in 0.870s {{(pid=84538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 19:02:05 devstack cinder-volume[84538]: DEBUG cinder.volume.drivers.quobyte [None req-dfbb60a8-b8fb-4d70-986c-cadf98d3c25a tempest-GroupSnapshotsTest-1835037466 None] <== create_volume: return (1925ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-34312b00-dd6d-45bb-af98-75855cea8e48'} {{(pid=84538) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 29 19:02:05 devstack cinder-volume[84538]: DEBUG oslo_concurrency.lockutils [None req-dfbb60a8-b8fb-4d70-986c-cadf98d3c25a tempest-GroupSnapshotsTest-1835037466 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.927s {{(pid=84538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 19:02:05 devstack cinder-volume[84538]: DEBUG cinder.volume.manager [None req-dfbb60a8-b8fb-4d70-986c-cadf98d3c25a tempest-GroupSnapshotsTest-1835037466 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ad00ebd1-7d9d-46e3-bcc2-db71722e05ad) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2e29ba0d-aed9-4682-8da4-ade2b8e26470', 'volume_size': 1}' {{(pid=84538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 19:02:05 devstack cinder-volume[84538]: DEBUG cinder.volume.manager [None req-dfbb60a8-b8fb-4d70-986c-cadf98d3c25a tempest-GroupSnapshotsTest-1835037466 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0d4616e6-d186-4567-9161-5ff5682c79c1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 19:02:05 devstack cinder-volume[84538]: INFO cinder.volume.flows.manager.create_volume [None req-dfbb60a8-b8fb-4d70-986c-cadf98d3c25a tempest-GroupSnapshotsTest-1835037466 None] Volume volume-2e29ba0d-aed9-4682-8da4-ade2b8e26470 (2e29ba0d-aed9-4682-8da4-ade2b8e26470): created successfully Apr 29 19:02:05 devstack cinder-volume[84538]: DEBUG cinder.volume.manager [None req-dfbb60a8-b8fb-4d70-986c-cadf98d3c25a tempest-GroupSnapshotsTest-1835037466 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0d4616e6-d186-4567-9161-5ff5682c79c1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 19:02:05 devstack cinder-volume[84538]: DEBUG cinder.volume.manager [None req-dfbb60a8-b8fb-4d70-986c-cadf98d3c25a tempest-GroupSnapshotsTest-1835037466 None] Flow 'volume_create_manager' (4178966f-1829-480c-83d7-f89605974005) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84538) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 19:02:05 devstack cinder-volume[84538]: INFO cinder.volume.manager [None req-dfbb60a8-b8fb-4d70-986c-cadf98d3c25a tempest-GroupSnapshotsTest-1835037466 None] Created volume successfully. Apr 29 19:02:05 devstack sudo[90471]: pam_unix(sudo:session): session closed for user root Apr 29 19:02:05 devstack cinder-volume[84538]: DEBUG oslo_concurrency.processutils [None req-51b84617-9203-480c-94b2-c7ba63934726 tempest-VolumesActionsTest-1687831653 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d" returned: 0 in 0.828s {{(pid=84538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 19:02:05 devstack cinder-volume[84538]: DEBUG cinder.manager [None req-51b84617-9203-480c-94b2-c7ba63934726 tempest-VolumesActionsTest-1687831653 None] Notifying Schedulers of capabilities ... {{(pid=84538) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 29 19:02:05 devstack cinder-volume[84538]: INFO cinder.volume.manager [None req-51b84617-9203-480c-94b2-c7ba63934726 tempest-VolumesActionsTest-1687831653 None] Deleted volume successfully. Apr 29 19:02:05 devstack cinder-volume[84538]: DEBUG cinder.coordination [None req-51b84617-9203-480c-94b2-c7ba63934726 tempest-VolumesActionsTest-1687831653 None] Lock "cinder-b83d5df6-eee2-4790-b562-41a753d16e1c-delete_volume" released by "delete_volume" :: held 2.831s {{(pid=84538) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 19:02:05 devstack cinder-volume[84538]: INFO cinder.volume.manager [None req-ed23fde7-dd1b-4409-85b1-9eaed4a8fa6a tempest-GroupSnapshotsTest-1835037466 None] GroupSnapshot e5261cd2-ef5d-4929-8724-d6be5c53406d: creating. Apr 29 19:02:05 devstack cinder-volume[84538]: DEBUG cinder.volume.manager [None req-ed23fde7-dd1b-4409-85b1-9eaed4a8fa6a tempest-GroupSnapshotsTest-1835037466 None] Group snapshot e5261cd2-ef5d-4929-8724-d6be5c53406d: creating. {{(pid=84538) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4175}} Apr 29 19:02:05 devstack cinder-volume[84538]: DEBUG oslo_concurrency.lockutils [None req-ed23fde7-dd1b-4409-85b1-9eaed4a8fa6a tempest-GroupSnapshotsTest-1835037466 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=84538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 19:02:05 devstack cinder-volume[84538]: DEBUG oslo_concurrency.lockutils [None req-ed23fde7-dd1b-4409-85b1-9eaed4a8fa6a tempest-GroupSnapshotsTest-1835037466 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=84538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 19:02:06 devstack cinder-volume[84538]: DEBUG cinder.volume.drivers.remotefs [None req-ed23fde7-dd1b-4409-85b1-9eaed4a8fa6a tempest-GroupSnapshotsTest-1835037466 None] Creating offline snapshot 24e2d28b-4a78-4a18-920d-20bac9441361 of volume 2e29ba0d-aed9-4682-8da4-ade2b8e26470 {{(pid=84538) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}} Apr 29 19:02:06 devstack cinder-volume[84538]: DEBUG oslo.privsep.daemon [-] privsep: reply[d4dd19ef-9c28-4c60-87da-7666280823bb]: (4, 'qcow2') {{(pid=85803) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 19:02:06 devstack cinder-volume[84538]: DEBUG oslo_concurrency.processutils [None req-ed23fde7-dd1b-4409-85b1-9eaed4a8fa6a tempest-GroupSnapshotsTest-1835037466 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-2e29ba0d-aed9-4682-8da4-ade2b8e26470 {{(pid=84538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 19:02:06 devstack sudo[90480]: pam_unix(sudo:session): session closed for user root Apr 29 19:02:06 devstack cinder-volume[84538]: DEBUG oslo_concurrency.processutils [None req-ed99f4d5-1b4f-479e-825b-0838b6a61223 tempest-VolumesDeleteCascade-1314225595 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-363b2b67-b40a-4aea-a61a-58750417ef9c.7296ba8c-4293-4139-a2e3-7f97420395c7" returned: 0 in 0.821s {{(pid=84538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 19:02:06 devstack cinder-volume[84538]: DEBUG oslo_concurrency.processutils [None req-ed99f4d5-1b4f-479e-825b-0838b6a61223 tempest-VolumesDeleteCascade-1314225595 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-363b2b67-b40a-4aea-a61a-58750417ef9c /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-363b2b67-b40a-4aea-a61a-58750417ef9c.7559f91c-a60b-4b95-8383-d4a8022ad997 -F qcow2 {{(pid=84538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 19:02:06 devstack sudo[90483]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-2e29ba0d-aed9-4682-8da4-ade2b8e26470 Apr 29 19:02:06 devstack sudo[90484]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-363b2b67-b40a-4aea-a61a-58750417ef9c /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-363b2b67-b40a-4aea-a61a-58750417ef9c.7559f91c-a60b-4b95-8383-d4a8022ad997 -F qcow2 Apr 29 19:02:06 devstack sudo[90483]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 19:02:06 devstack sudo[90484]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 19:02:06 devstack cinder-volume[84538]: DEBUG oslo_concurrency.processutils [None req-ed99f4d5-1b4f-479e-825b-0838b6a61223 tempest-VolumesDeleteCascade-1314225595 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-363b2b67-b40a-4aea-a61a-58750417ef9c /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-363b2b67-b40a-4aea-a61a-58750417ef9c.7559f91c-a60b-4b95-8383-d4a8022ad997 -F qcow2" returned: 0 in 0.759s {{(pid=84538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 19:02:06 devstack sudo[90484]: pam_unix(sudo:session): session closed for user root Apr 29 19:02:06 devstack sudo[90483]: pam_unix(sudo:session): session closed for user root Apr 29 19:02:06 devstack cinder-volume[84538]: DEBUG cinder.coordination [None req-ed99f4d5-1b4f-479e-825b-0838b6a61223 tempest-VolumesDeleteCascade-1314225595 None] Lock "cinder-quobyte-7296ba8c-4293-4139-a2e3-7f97420395c7" released by "_delete_snapshot" :: held 7.235s {{(pid=84538) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 19:02:06 devstack cinder-volume[84538]: DEBUG oslo_concurrency.processutils [None req-ed23fde7-dd1b-4409-85b1-9eaed4a8fa6a tempest-GroupSnapshotsTest-1835037466 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-2e29ba0d-aed9-4682-8da4-ade2b8e26470" returned: 0 in 0.928s {{(pid=84538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 19:02:06 devstack cinder-volume[84538]: DEBUG oslo_concurrency.processutils [None req-ed23fde7-dd1b-4409-85b1-9eaed4a8fa6a tempest-GroupSnapshotsTest-1835037466 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-2e29ba0d-aed9-4682-8da4-ade2b8e26470,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-2e29ba0d-aed9-4682-8da4-ade2b8e26470.24e2d28b-4a78-4a18-920d-20bac9441361 1G {{(pid=84538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 19:02:06 devstack cinder-volume[84538]: DEBUG cinder.coordination [None req-ed99f4d5-1b4f-479e-825b-0838b6a61223 tempest-VolumesDeleteCascade-1314225595 None] Lock "cinder-quobyte-363b2b67-b40a-4aea-a61a-58750417ef9c" released by "delete_snapshot" :: held 7.297s {{(pid=84538) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 19:02:07 devstack sudo[90494]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-2e29ba0d-aed9-4682-8da4-ade2b8e26470,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-2e29ba0d-aed9-4682-8da4-ade2b8e26470.24e2d28b-4a78-4a18-920d-20bac9441361 1G Apr 29 19:02:07 devstack sudo[90494]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 19:02:07 devstack cinder-volume[84538]: DEBUG cinder.quota [None req-ed99f4d5-1b4f-479e-825b-0838b6a61223 tempest-VolumesDeleteCascade-1314225595 None] Created reservations ['06d2d5a9-03bf-4b20-af00-e6a1b4152d4b', 'd628ec6b-05fa-4f5f-90d6-c6515c08286c', '37c46c73-86b1-4d0a-862d-9a4bc01f60e7', 'b83d5653-c9a2-44e6-b942-e64b4fbcfd30'] {{(pid=84538) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 29 19:02:07 devstack cinder-volume[84538]: INFO cinder.volume.manager [None req-ed99f4d5-1b4f-479e-825b-0838b6a61223 tempest-VolumesDeleteCascade-1314225595 None] Delete snapshot completed successfully. Apr 29 19:02:07 devstack cinder-volume[84538]: DEBUG cinder.coordination [None req-ed99f4d5-1b4f-479e-825b-0838b6a61223 tempest-VolumesDeleteCascade-1314225595 None] Lock "cinder-7296ba8c-4293-4139-a2e3-7f97420395c7-delete_snapshot" released by "delete_snapshot" :: held 7.498s {{(pid=84538) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 19:02:07 devstack cinder-volume[84538]: DEBUG cinder.coordination [None req-ed99f4d5-1b4f-479e-825b-0838b6a61223 tempest-VolumesDeleteCascade-1314225595 None] Acquiring lock "cinder-7559f91c-a60b-4b95-8383-d4a8022ad997-delete_snapshot" by "delete_snapshot" {{(pid=84538) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 19:02:07 devstack cinder-volume[84538]: DEBUG cinder.coordination [None req-ed99f4d5-1b4f-479e-825b-0838b6a61223 tempest-VolumesDeleteCascade-1314225595 None] Lock "cinder-7559f91c-a60b-4b95-8383-d4a8022ad997-delete_snapshot" acquired by "delete_snapshot" :: waited 0.021s {{(pid=84538) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 19:02:07 devstack cinder-volume[84538]: DEBUG cinder.coordination [None req-ed99f4d5-1b4f-479e-825b-0838b6a61223 tempest-VolumesDeleteCascade-1314225595 None] Acquiring lock "cinder-quobyte-363b2b67-b40a-4aea-a61a-58750417ef9c" by "delete_snapshot" {{(pid=84538) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 19:02:07 devstack cinder-volume[84538]: DEBUG cinder.coordination [None req-ed99f4d5-1b4f-479e-825b-0838b6a61223 tempest-VolumesDeleteCascade-1314225595 None] Lock "cinder-quobyte-363b2b67-b40a-4aea-a61a-58750417ef9c" acquired by "delete_snapshot" :: waited 0.030s {{(pid=84538) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 19:02:07 devstack cinder-volume[84538]: DEBUG cinder.coordination [None req-ed99f4d5-1b4f-479e-825b-0838b6a61223 tempest-VolumesDeleteCascade-1314225595 None] Acquiring lock "cinder-quobyte-7559f91c-a60b-4b95-8383-d4a8022ad997" by "_delete_snapshot" {{(pid=84538) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 19:02:07 devstack cinder-volume[84538]: DEBUG cinder.coordination [None req-ed99f4d5-1b4f-479e-825b-0838b6a61223 tempest-VolumesDeleteCascade-1314225595 None] Lock "cinder-quobyte-7559f91c-a60b-4b95-8383-d4a8022ad997" acquired by "_delete_snapshot" :: waited 0.021s {{(pid=84538) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 19:02:07 devstack cinder-volume[84538]: DEBUG cinder.volume.drivers.remotefs [None req-ed99f4d5-1b4f-479e-825b-0838b6a61223 tempest-VolumesDeleteCascade-1314225595 None] Deleting offline snapshot 7559f91c-a60b-4b95-8383-d4a8022ad997 of volume 363b2b67-b40a-4aea-a61a-58750417ef9c {{(pid=84538) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 29 19:02:07 devstack cinder-volume[84538]: DEBUG cinder.volume.drivers.remotefs [None req-ed99f4d5-1b4f-479e-825b-0838b6a61223 tempest-VolumesDeleteCascade-1314225595 None] snapshot_file for this snap is: volume-363b2b67-b40a-4aea-a61a-58750417ef9c.7559f91c-a60b-4b95-8383-d4a8022ad997 {{(pid=84538) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 29 19:02:07 devstack cinder-volume[84538]: DEBUG oslo.privsep.daemon [-] privsep: reply[60260755-4266-4437-a65c-fc604bd12bbb]: (4, 'qcow2') {{(pid=85803) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 19:02:07 devstack cinder-volume[84538]: DEBUG oslo_concurrency.processutils [None req-ed99f4d5-1b4f-479e-825b-0838b6a61223 tempest-VolumesDeleteCascade-1314225595 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-363b2b67-b40a-4aea-a61a-58750417ef9c.7559f91c-a60b-4b95-8383-d4a8022ad997 {{(pid=84538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 19:02:07 devstack sudo[90496]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-363b2b67-b40a-4aea-a61a-58750417ef9c.7559f91c-a60b-4b95-8383-d4a8022ad997 Apr 29 19:02:07 devstack sudo[90496]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 19:02:07 devstack sudo[90494]: pam_unix(sudo:session): session closed for user root Apr 29 19:02:07 devstack cinder-volume[84538]: DEBUG oslo_concurrency.processutils [None req-ed23fde7-dd1b-4409-85b1-9eaed4a8fa6a tempest-GroupSnapshotsTest-1835037466 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-2e29ba0d-aed9-4682-8da4-ade2b8e26470,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-2e29ba0d-aed9-4682-8da4-ade2b8e26470.24e2d28b-4a78-4a18-920d-20bac9441361 1G" returned: 0 in 1.018s {{(pid=84538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 19:02:07 devstack cinder-volume[84538]: DEBUG oslo_concurrency.processutils [None req-ed23fde7-dd1b-4409-85b1-9eaed4a8fa6a tempest-GroupSnapshotsTest-1835037466 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-2e29ba0d-aed9-4682-8da4-ade2b8e26470 -F qcow2 /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-2e29ba0d-aed9-4682-8da4-ade2b8e26470.24e2d28b-4a78-4a18-920d-20bac9441361 {{(pid=84538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 19:02:08 devstack sudo[90506]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-2e29ba0d-aed9-4682-8da4-ade2b8e26470 -F qcow2 /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-2e29ba0d-aed9-4682-8da4-ade2b8e26470.24e2d28b-4a78-4a18-920d-20bac9441361 Apr 29 19:02:08 devstack sudo[90506]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 19:02:08 devstack sudo[90496]: pam_unix(sudo:session): session closed for user root Apr 29 19:02:08 devstack cinder-volume[84538]: DEBUG oslo_concurrency.processutils [None req-ed99f4d5-1b4f-479e-825b-0838b6a61223 tempest-VolumesDeleteCascade-1314225595 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-363b2b67-b40a-4aea-a61a-58750417ef9c.7559f91c-a60b-4b95-8383-d4a8022ad997" returned: 0 in 0.849s {{(pid=84538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 19:02:08 devstack cinder-volume[84538]: DEBUG cinder.volume.drivers.remotefs [None req-ed99f4d5-1b4f-479e-825b-0838b6a61223 tempest-VolumesDeleteCascade-1314225595 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-363b2b67-b40a-4aea-a61a-58750417ef9c(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=84538) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 29 19:02:08 devstack cinder-volume[84538]: DEBUG oslo.privsep.daemon [-] privsep: reply[b6e6dbb6-29c6-40aa-bca0-c028772577fb]: (4, 'qcow2') {{(pid=85803) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 19:02:08 devstack cinder-volume[84538]: DEBUG oslo_concurrency.processutils [None req-ed99f4d5-1b4f-479e-825b-0838b6a61223 tempest-VolumesDeleteCascade-1314225595 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-363b2b67-b40a-4aea-a61a-58750417ef9c {{(pid=84538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 19:02:08 devstack sudo[90509]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-363b2b67-b40a-4aea-a61a-58750417ef9c Apr 29 19:02:08 devstack sudo[90509]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 19:02:08 devstack sudo[90506]: pam_unix(sudo:session): session closed for user root Apr 29 19:02:08 devstack cinder-volume[84538]: DEBUG oslo_concurrency.processutils [None req-ed23fde7-dd1b-4409-85b1-9eaed4a8fa6a tempest-GroupSnapshotsTest-1835037466 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-2e29ba0d-aed9-4682-8da4-ade2b8e26470 -F qcow2 /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-2e29ba0d-aed9-4682-8da4-ade2b8e26470.24e2d28b-4a78-4a18-920d-20bac9441361" returned: 0 in 0.953s {{(pid=84538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 19:02:08 devstack cinder-volume[84538]: WARNING cinder.volume.drivers.remotefs [None req-ed23fde7-dd1b-4409-85b1-9eaed4a8fa6a tempest-GroupSnapshotsTest-1835037466 None] /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-2e29ba0d-aed9-4682-8da4-ade2b8e26470.24e2d28b-4a78-4a18-920d-20bac9441361 is being set with open permissions: ugo+rw: NotImplementedError Apr 29 19:02:08 devstack cinder-volume[84538]: DEBUG oslo_concurrency.processutils [None req-ed23fde7-dd1b-4409-85b1-9eaed4a8fa6a tempest-GroupSnapshotsTest-1835037466 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-2e29ba0d-aed9-4682-8da4-ade2b8e26470.24e2d28b-4a78-4a18-920d-20bac9441361 {{(pid=84538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 19:02:08 devstack sudo[90519]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-2e29ba0d-aed9-4682-8da4-ade2b8e26470.24e2d28b-4a78-4a18-920d-20bac9441361 Apr 29 19:02:08 devstack sudo[90519]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 19:02:09 devstack sudo[90509]: pam_unix(sudo:session): session closed for user root Apr 29 19:02:09 devstack cinder-volume[84538]: DEBUG oslo_concurrency.processutils [None req-ed99f4d5-1b4f-479e-825b-0838b6a61223 tempest-VolumesDeleteCascade-1314225595 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-363b2b67-b40a-4aea-a61a-58750417ef9c" returned: 0 in 0.860s {{(pid=84538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 19:02:09 devstack cinder-volume[84538]: DEBUG oslo_concurrency.processutils [None req-ed99f4d5-1b4f-479e-825b-0838b6a61223 tempest-VolumesDeleteCascade-1314225595 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-363b2b67-b40a-4aea-a61a-58750417ef9c.7559f91c-a60b-4b95-8383-d4a8022ad997 {{(pid=84538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 19:02:09 devstack sudo[90521]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-363b2b67-b40a-4aea-a61a-58750417ef9c.7559f91c-a60b-4b95-8383-d4a8022ad997 Apr 29 19:02:09 devstack sudo[90521]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 19:02:09 devstack sudo[90519]: pam_unix(sudo:session): session closed for user root Apr 29 19:02:09 devstack cinder-volume[84538]: DEBUG oslo_concurrency.processutils [None req-ed23fde7-dd1b-4409-85b1-9eaed4a8fa6a tempest-GroupSnapshotsTest-1835037466 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-2e29ba0d-aed9-4682-8da4-ade2b8e26470.24e2d28b-4a78-4a18-920d-20bac9441361" returned: 0 in 0.868s {{(pid=84538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 19:02:09 devstack cinder-volume[84538]: DEBUG oslo_concurrency.processutils [None req-ed23fde7-dd1b-4409-85b1-9eaed4a8fa6a tempest-GroupSnapshotsTest-1835037466 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-2e29ba0d-aed9-4682-8da4-ade2b8e26470.info {{(pid=84538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 19:02:09 devstack sudo[90528]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-2e29ba0d-aed9-4682-8da4-ade2b8e26470.info Apr 29 19:02:09 devstack sudo[90528]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 19:02:09 devstack sudo[90521]: pam_unix(sudo:session): session closed for user root Apr 29 19:02:09 devstack cinder-volume[84538]: DEBUG oslo_concurrency.processutils [None req-ed99f4d5-1b4f-479e-825b-0838b6a61223 tempest-VolumesDeleteCascade-1314225595 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-363b2b67-b40a-4aea-a61a-58750417ef9c.7559f91c-a60b-4b95-8383-d4a8022ad997" returned: 0 in 0.882s {{(pid=84538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 19:02:09 devstack cinder-volume[84538]: DEBUG oslo_concurrency.processutils [None req-ed99f4d5-1b4f-479e-825b-0838b6a61223 tempest-VolumesDeleteCascade-1314225595 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-363b2b67-b40a-4aea-a61a-58750417ef9c.7559f91c-a60b-4b95-8383-d4a8022ad997 {{(pid=84538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 19:02:09 devstack sudo[90530]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-363b2b67-b40a-4aea-a61a-58750417ef9c.7559f91c-a60b-4b95-8383-d4a8022ad997 Apr 29 19:02:09 devstack sudo[90530]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 19:02:10 devstack sudo[90528]: pam_unix(sudo:session): session closed for user root Apr 29 19:02:10 devstack cinder-volume[84538]: DEBUG oslo_concurrency.processutils [None req-ed23fde7-dd1b-4409-85b1-9eaed4a8fa6a tempest-GroupSnapshotsTest-1835037466 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-2e29ba0d-aed9-4682-8da4-ade2b8e26470.info" returned: 0 in 0.789s {{(pid=84538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 19:02:10 devstack cinder-volume[84538]: WARNING cinder.volume.drivers.remotefs [None req-ed23fde7-dd1b-4409-85b1-9eaed4a8fa6a tempest-GroupSnapshotsTest-1835037466 None] /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-2e29ba0d-aed9-4682-8da4-ade2b8e26470.info is being set with open permissions: ugo+rw: NotImplementedError Apr 29 19:02:10 devstack sudo[90530]: pam_unix(sudo:session): session closed for user root Apr 29 19:02:10 devstack cinder-volume[84538]: DEBUG oslo_concurrency.processutils [None req-ed23fde7-dd1b-4409-85b1-9eaed4a8fa6a tempest-GroupSnapshotsTest-1835037466 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-2e29ba0d-aed9-4682-8da4-ade2b8e26470.info {{(pid=84538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 19:02:10 devstack cinder-volume[84538]: DEBUG oslo_concurrency.processutils [None req-ed99f4d5-1b4f-479e-825b-0838b6a61223 tempest-VolumesDeleteCascade-1314225595 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-363b2b67-b40a-4aea-a61a-58750417ef9c.7559f91c-a60b-4b95-8383-d4a8022ad997" returned: 0 in 0.753s {{(pid=84538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 19:02:10 devstack sudo[90534]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-2e29ba0d-aed9-4682-8da4-ade2b8e26470.info Apr 29 19:02:10 devstack sudo[90534]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 19:02:10 devstack cinder-volume[84538]: DEBUG cinder.coordination [None req-ed99f4d5-1b4f-479e-825b-0838b6a61223 tempest-VolumesDeleteCascade-1314225595 None] Lock "cinder-quobyte-7559f91c-a60b-4b95-8383-d4a8022ad997" released by "_delete_snapshot" :: held 3.478s {{(pid=84538) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 19:02:10 devstack cinder-volume[84538]: DEBUG cinder.coordination [None req-ed99f4d5-1b4f-479e-825b-0838b6a61223 tempest-VolumesDeleteCascade-1314225595 None] Lock "cinder-quobyte-363b2b67-b40a-4aea-a61a-58750417ef9c" released by "delete_snapshot" :: held 3.514s {{(pid=84538) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 19:02:10 devstack cinder-volume[84538]: DEBUG cinder.quota [None req-ed99f4d5-1b4f-479e-825b-0838b6a61223 tempest-VolumesDeleteCascade-1314225595 None] Created reservations ['ca1c86f3-9a6b-42c1-96e0-923f6f318cb9', '52c0931a-6b2e-4445-ac47-2f4ad935712f', '52209bf8-6869-469a-b6b1-ad7cacda1abf', '8e0a9783-7dd1-455a-b698-78736a4c5bf6'] {{(pid=84538) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 29 19:02:10 devstack cinder-volume[84538]: INFO cinder.volume.manager [None req-ed99f4d5-1b4f-479e-825b-0838b6a61223 tempest-VolumesDeleteCascade-1314225595 None] Delete snapshot completed successfully. Apr 29 19:02:10 devstack cinder-volume[84538]: DEBUG cinder.coordination [None req-ed99f4d5-1b4f-479e-825b-0838b6a61223 tempest-VolumesDeleteCascade-1314225595 None] Lock "cinder-7559f91c-a60b-4b95-8383-d4a8022ad997-delete_snapshot" released by "delete_snapshot" :: held 3.694s {{(pid=84538) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 19:02:10 devstack cinder-volume[84538]: DEBUG cinder.volume.manager [None req-ed99f4d5-1b4f-479e-825b-0838b6a61223 tempest-VolumesDeleteCascade-1314225595 None] Snapshots deleted, issuing volume delete {{(pid=84538) delete_volume /opt/stack/cinder/cinder/volume/manager.py:1010}} Apr 29 19:02:10 devstack cinder-volume[84538]: DEBUG cinder.coordination [None req-ed99f4d5-1b4f-479e-825b-0838b6a61223 tempest-VolumesDeleteCascade-1314225595 None] Acquiring lock "cinder-quobyte-363b2b67-b40a-4aea-a61a-58750417ef9c" by "delete_volume" {{(pid=84538) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 19:02:10 devstack cinder-volume[84538]: DEBUG cinder.coordination [None req-ed99f4d5-1b4f-479e-825b-0838b6a61223 tempest-VolumesDeleteCascade-1314225595 None] Lock "cinder-quobyte-363b2b67-b40a-4aea-a61a-58750417ef9c" acquired by "delete_volume" :: waited 0.021s {{(pid=84538) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 19:02:10 devstack cinder-volume[84538]: DEBUG oslo.privsep.daemon [-] privsep: reply[6543a3e7-5808-4a59-a32f-79a26d3c5179]: (4, 'qcow2') {{(pid=85803) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 19:02:10 devstack cinder-volume[84538]: DEBUG oslo_concurrency.processutils [None req-ed99f4d5-1b4f-479e-825b-0838b6a61223 tempest-VolumesDeleteCascade-1314225595 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-363b2b67-b40a-4aea-a61a-58750417ef9c {{(pid=84538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 19:02:11 devstack sudo[90536]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-363b2b67-b40a-4aea-a61a-58750417ef9c Apr 29 19:02:11 devstack sudo[90536]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 19:02:11 devstack sudo[90534]: pam_unix(sudo:session): session closed for user root Apr 29 19:02:11 devstack cinder-volume[84538]: DEBUG oslo_concurrency.processutils [None req-ed23fde7-dd1b-4409-85b1-9eaed4a8fa6a tempest-GroupSnapshotsTest-1835037466 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-2e29ba0d-aed9-4682-8da4-ade2b8e26470.info" returned: 0 in 0.768s {{(pid=84538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 19:02:11 devstack cinder-volume[84538]: DEBUG oslo_concurrency.lockutils [None req-ed23fde7-dd1b-4409-85b1-9eaed4a8fa6a tempest-GroupSnapshotsTest-1835037466 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 5.434s {{(pid=84538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 19:02:11 devstack cinder-volume[84538]: INFO cinder.volume.manager [None req-ed23fde7-dd1b-4409-85b1-9eaed4a8fa6a tempest-GroupSnapshotsTest-1835037466 None] group_snapshot e5261cd2-ef5d-4929-8724-d6be5c53406d: created successfully Apr 29 19:02:11 devstack sudo[90536]: pam_unix(sudo:session): session closed for user root Apr 29 19:02:11 devstack cinder-volume[84538]: DEBUG oslo_concurrency.processutils [None req-ed99f4d5-1b4f-479e-825b-0838b6a61223 tempest-VolumesDeleteCascade-1314225595 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-363b2b67-b40a-4aea-a61a-58750417ef9c" returned: 0 in 0.964s {{(pid=84538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 19:02:11 devstack cinder-volume[84538]: DEBUG oslo_concurrency.processutils [None req-ed99f4d5-1b4f-479e-825b-0838b6a61223 tempest-VolumesDeleteCascade-1314225595 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-363b2b67-b40a-4aea-a61a-58750417ef9c {{(pid=84538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 19:02:11 devstack sudo[90543]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-363b2b67-b40a-4aea-a61a-58750417ef9c Apr 29 19:02:11 devstack sudo[90543]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 19:02:12 devstack sudo[90543]: pam_unix(sudo:session): session closed for user root Apr 29 19:02:12 devstack cinder-volume[84538]: DEBUG oslo_concurrency.processutils [None req-ed99f4d5-1b4f-479e-825b-0838b6a61223 tempest-VolumesDeleteCascade-1314225595 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-363b2b67-b40a-4aea-a61a-58750417ef9c" returned: 0 in 0.631s {{(pid=84538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 19:02:12 devstack cinder-volume[84538]: DEBUG cinder.coordination [None req-ed99f4d5-1b4f-479e-825b-0838b6a61223 tempest-VolumesDeleteCascade-1314225595 None] Lock "cinder-quobyte-363b2b67-b40a-4aea-a61a-58750417ef9c" released by "delete_volume" :: held 1.699s {{(pid=84538) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 19:02:12 devstack cinder-volume[84538]: INFO cinder.volume.manager [None req-6478d918-bf54-482f-bdc6-a2d0f7d01ad1 tempest-GroupSnapshotsTest-1835037466 None] group_snapshot e5261cd2-ef5d-4929-8724-d6be5c53406d: deleting Apr 29 19:02:12 devstack cinder-volume[84538]: DEBUG cinder.quota [None req-ed99f4d5-1b4f-479e-825b-0838b6a61223 tempest-VolumesDeleteCascade-1314225595 None] Created reservations ['49961d5e-37f1-42ee-8d05-2a3c00c7249a', '265faef2-8fa5-49d2-809f-9a614994bc56', '2ef1f325-473f-4207-b862-a8c24bd1d312', '4455c020-db51-4d6d-810a-994613bd406a'] {{(pid=84538) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 29 19:02:12 devstack cinder-volume[84538]: DEBUG cinder.volume.manager [None req-6478d918-bf54-482f-bdc6-a2d0f7d01ad1 tempest-GroupSnapshotsTest-1835037466 None] group_snapshot e5261cd2-ef5d-4929-8724-d6be5c53406d: deleting {{(pid=84538) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4350}} Apr 29 19:02:12 devstack cinder-volume[84538]: DEBUG cinder.coordination [None req-6478d918-bf54-482f-bdc6-a2d0f7d01ad1 tempest-GroupSnapshotsTest-1835037466 None] Acquiring lock "cinder-quobyte-2e29ba0d-aed9-4682-8da4-ade2b8e26470" by "delete_snapshot" {{(pid=84538) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 19:02:12 devstack cinder-volume[84538]: DEBUG cinder.coordination [None req-6478d918-bf54-482f-bdc6-a2d0f7d01ad1 tempest-GroupSnapshotsTest-1835037466 None] Lock "cinder-quobyte-2e29ba0d-aed9-4682-8da4-ade2b8e26470" acquired by "delete_snapshot" :: waited 0.036s {{(pid=84538) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 19:02:12 devstack cinder-volume[84538]: DEBUG cinder.coordination [None req-6478d918-bf54-482f-bdc6-a2d0f7d01ad1 tempest-GroupSnapshotsTest-1835037466 None] Acquiring lock "cinder-quobyte-24e2d28b-4a78-4a18-920d-20bac9441361" by "_delete_snapshot" {{(pid=84538) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 19:02:12 devstack cinder-volume[84538]: DEBUG cinder.coordination [None req-6478d918-bf54-482f-bdc6-a2d0f7d01ad1 tempest-GroupSnapshotsTest-1835037466 None] Lock "cinder-quobyte-24e2d28b-4a78-4a18-920d-20bac9441361" acquired by "_delete_snapshot" :: waited 0.034s {{(pid=84538) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 19:02:12 devstack cinder-volume[84538]: DEBUG cinder.volume.drivers.remotefs [None req-6478d918-bf54-482f-bdc6-a2d0f7d01ad1 tempest-GroupSnapshotsTest-1835037466 None] Deleting offline snapshot 24e2d28b-4a78-4a18-920d-20bac9441361 of volume 2e29ba0d-aed9-4682-8da4-ade2b8e26470 {{(pid=84538) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 29 19:02:12 devstack cinder-volume[84538]: DEBUG cinder.volume.drivers.remotefs [None req-6478d918-bf54-482f-bdc6-a2d0f7d01ad1 tempest-GroupSnapshotsTest-1835037466 None] snapshot_file for this snap is: volume-2e29ba0d-aed9-4682-8da4-ade2b8e26470.24e2d28b-4a78-4a18-920d-20bac9441361 {{(pid=84538) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 29 19:02:12 devstack cinder-volume[84538]: DEBUG oslo_concurrency.lockutils [None req-ed99f4d5-1b4f-479e-825b-0838b6a61223 tempest-VolumesDeleteCascade-1314225595 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 19:02:12 devstack cinder-volume[84538]: DEBUG oslo_concurrency.lockutils [None req-ed99f4d5-1b4f-479e-825b-0838b6a61223 tempest-VolumesDeleteCascade-1314225595 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 19:02:12 devstack cinder-volume[84538]: DEBUG cinder.volume.drivers.quobyte [None req-ed99f4d5-1b4f-479e-825b-0838b6a61223 tempest-VolumesDeleteCascade-1314225595 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-34312b00-dd6d-45bb-af98-75855cea8e48': None} {{(pid=84538) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 19:02:12 devstack cinder-volume[84538]: DEBUG cinder.volume.drivers.quobyte [None req-ed99f4d5-1b4f-479e-825b-0838b6a61223 tempest-VolumesDeleteCascade-1314225595 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-34312b00-dd6d-45bb-af98-75855cea8e48'] {{(pid=84538) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 19:02:12 devstack cinder-volume[84538]: DEBUG oslo_concurrency.lockutils [None req-ed99f4d5-1b4f-479e-825b-0838b6a61223 tempest-VolumesDeleteCascade-1314225595 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=84538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 19:02:12 devstack cinder-volume[84538]: DEBUG oslo_concurrency.processutils [None req-ed99f4d5-1b4f-479e-825b-0838b6a61223 tempest-VolumesDeleteCascade-1314225595 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d {{(pid=84538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 19:02:12 devstack cinder-volume[84538]: DEBUG oslo.privsep.daemon [-] privsep: reply[69fd2cb1-9845-4cea-903d-79727e152dda]: (4, 'qcow2') {{(pid=85803) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 19:02:12 devstack cinder-volume[84538]: DEBUG oslo_concurrency.processutils [None req-6478d918-bf54-482f-bdc6-a2d0f7d01ad1 tempest-GroupSnapshotsTest-1835037466 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-2e29ba0d-aed9-4682-8da4-ade2b8e26470.24e2d28b-4a78-4a18-920d-20bac9441361 {{(pid=84538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 19:02:12 devstack sudo[90546]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d Apr 29 19:02:12 devstack sudo[90546]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 19:02:13 devstack sudo[90547]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-2e29ba0d-aed9-4682-8da4-ade2b8e26470.24e2d28b-4a78-4a18-920d-20bac9441361 Apr 29 19:02:13 devstack sudo[90547]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 19:02:13 devstack cinder-volume[84538]: DEBUG cinder.volume.flows.manager.create_volume [None req-1758fb14-b5ad-4286-8a34-73813a48bce4 tempest-VolumesDeleteCascade-1314225595 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84538) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Apr 29 19:02:13 devstack cinder-volume[84538]: DEBUG cinder.volume.manager [None req-1758fb14-b5ad-4286-8a34-73813a48bce4 tempest-VolumesDeleteCascade-1314225595 None] Flow 'volume_create_manager' (ce3fd068-91af-44ab-a6d4-4ce7aae725e4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84538) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 19:02:13 devstack cinder-volume[84538]: DEBUG cinder.volume.manager [None req-1758fb14-b5ad-4286-8a34-73813a48bce4 tempest-VolumesDeleteCascade-1314225595 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (be33d835-1c03-43b4-b3c7-8f3955ee6766) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 19:02:13 devstack cinder-volume[84538]: DEBUG cinder.volume.manager [None req-1758fb14-b5ad-4286-8a34-73813a48bce4 tempest-VolumesDeleteCascade-1314225595 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (be33d835-1c03-43b4-b3c7-8f3955ee6766) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-29T17:02:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-910106979',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6d573221-9dab-4f46-b8d6-92bad7a9a295,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='26acfb1208254d3ca0d297f4abbc3144',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T17:02:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T17:02:14Z,use_quota=True,user_id='5c5deee661434855ad8181b5b72c64da',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(62b05900-93e3-4190-a88f-1d87324303d1),volume_type_id=62b05900-93e3-4190-a88f-1d87324303d1)' {{(pid=84538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 19:02:13 devstack cinder-volume[84538]: DEBUG cinder.volume.manager [None req-1758fb14-b5ad-4286-8a34-73813a48bce4 tempest-VolumesDeleteCascade-1314225595 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a4e56a7f-4eb7-422f-a24e-02d93ec45ba7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 19:02:13 devstack cinder-volume[84538]: DEBUG cinder.volume.manager [None req-1758fb14-b5ad-4286-8a34-73813a48bce4 tempest-VolumesDeleteCascade-1314225595 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a4e56a7f-4eb7-422f-a24e-02d93ec45ba7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 19:02:13 devstack cinder-volume[84538]: DEBUG cinder.volume.manager [None req-1758fb14-b5ad-4286-8a34-73813a48bce4 tempest-VolumesDeleteCascade-1314225595 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2b979cdf-1ab8-4e60-a084-7834f638fa19) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 19:02:13 devstack cinder-volume[84538]: DEBUG cinder.volume.manager [None req-1758fb14-b5ad-4286-8a34-73813a48bce4 tempest-VolumesDeleteCascade-1314225595 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2b979cdf-1ab8-4e60-a084-7834f638fa19) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6d573221-9dab-4f46-b8d6-92bad7a9a295', 'volume_name': 'volume-6d573221-9dab-4f46-b8d6-92bad7a9a295', 'volume_size': 1}' {{(pid=84538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 19:02:13 devstack cinder-volume[84538]: DEBUG cinder.volume.manager [None req-1758fb14-b5ad-4286-8a34-73813a48bce4 tempest-VolumesDeleteCascade-1314225595 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0c570827-addc-405a-91ec-3693708f01e3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 19:02:13 devstack cinder-volume[84538]: DEBUG cinder.volume.manager [None req-1758fb14-b5ad-4286-8a34-73813a48bce4 tempest-VolumesDeleteCascade-1314225595 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0c570827-addc-405a-91ec-3693708f01e3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 19:02:13 devstack cinder-volume[84538]: DEBUG cinder.volume.manager [None req-1758fb14-b5ad-4286-8a34-73813a48bce4 tempest-VolumesDeleteCascade-1314225595 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6b436dc8-7a00-4105-9f02-5070a4df77fa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 19:02:13 devstack cinder-volume[84538]: INFO cinder.volume.flows.manager.create_volume [None req-1758fb14-b5ad-4286-8a34-73813a48bce4 tempest-VolumesDeleteCascade-1314225595 None] Volume 6d573221-9dab-4f46-b8d6-92bad7a9a295: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6d573221-9dab-4f46-b8d6-92bad7a9a295', 'volume_size': 1} Apr 29 19:02:13 devstack cinder-volume[84538]: DEBUG oslo_concurrency.lockutils [None req-1758fb14-b5ad-4286-8a34-73813a48bce4 tempest-VolumesDeleteCascade-1314225595 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 19:02:13 devstack cinder-volume[84538]: DEBUG oslo_concurrency.lockutils [None req-1758fb14-b5ad-4286-8a34-73813a48bce4 tempest-VolumesDeleteCascade-1314225595 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=84538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 19:02:13 devstack cinder-volume[84538]: DEBUG cinder.volume.drivers.quobyte [None req-1758fb14-b5ad-4286-8a34-73813a48bce4 tempest-VolumesDeleteCascade-1314225595 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-29T17:02:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-910106979',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6d573221-9dab-4f46-b8d6-92bad7a9a295,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='26acfb1208254d3ca0d297f4abbc3144',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T17:02:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T17:02:14Z,use_quota=True,user_id='5c5deee661434855ad8181b5b72c64da',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(62b05900-93e3-4190-a88f-1d87324303d1),volume_type_id=62b05900-93e3-4190-a88f-1d87324303d1)}" {{(pid=84538) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 29 19:02:13 devstack cinder-volume[84538]: DEBUG cinder.volume.drivers.remotefs [None req-1758fb14-b5ad-4286-8a34-73813a48bce4 tempest-VolumesDeleteCascade-1314225595 None] Creating volume 6d573221-9dab-4f46-b8d6-92bad7a9a295 {{(pid=84538) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 29 19:02:13 devstack cinder-volume[84538]: DEBUG oslo_concurrency.lockutils [None req-1758fb14-b5ad-4286-8a34-73813a48bce4 tempest-VolumesDeleteCascade-1314225595 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 19:02:13 devstack cinder-volume[84538]: DEBUG oslo_concurrency.lockutils [None req-1758fb14-b5ad-4286-8a34-73813a48bce4 tempest-VolumesDeleteCascade-1314225595 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=84538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 19:02:13 devstack cinder-volume[84538]: DEBUG cinder.volume.drivers.quobyte [None req-1758fb14-b5ad-4286-8a34-73813a48bce4 tempest-VolumesDeleteCascade-1314225595 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-34312b00-dd6d-45bb-af98-75855cea8e48': None} {{(pid=84538) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 19:02:13 devstack cinder-volume[84538]: DEBUG cinder.volume.drivers.quobyte [None req-1758fb14-b5ad-4286-8a34-73813a48bce4 tempest-VolumesDeleteCascade-1314225595 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-34312b00-dd6d-45bb-af98-75855cea8e48'] {{(pid=84538) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 19:02:13 devstack cinder-volume[84538]: DEBUG oslo_concurrency.lockutils [None req-1758fb14-b5ad-4286-8a34-73813a48bce4 tempest-VolumesDeleteCascade-1314225595 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=84538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 19:02:13 devstack cinder-volume[84538]: DEBUG cinder.volume.drivers.quobyte [None req-1758fb14-b5ad-4286-8a34-73813a48bce4 tempest-VolumesDeleteCascade-1314225595 None] Selected osci02.corp.quobyte.com/cinder-vol-34312b00-dd6d-45bb-af98-75855cea8e48 as target Quobyte volume. {{(pid=84538) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 29 19:02:13 devstack cinder-volume[84538]: INFO cinder.volume.drivers.remotefs [None req-1758fb14-b5ad-4286-8a34-73813a48bce4 tempest-VolumesDeleteCascade-1314225595 None] casted to osci02.corp.quobyte.com/cinder-vol-34312b00-dd6d-45bb-af98-75855cea8e48 Apr 29 19:02:13 devstack cinder-volume[84538]: DEBUG oslo_concurrency.processutils [None req-1758fb14-b5ad-4286-8a34-73813a48bce4 tempest-VolumesDeleteCascade-1314225595 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-6d573221-9dab-4f46-b8d6-92bad7a9a295 1073741824 {{(pid=84538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 19:02:13 devstack sudo[90554]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-6d573221-9dab-4f46-b8d6-92bad7a9a295 1073741824 Apr 29 19:02:13 devstack sudo[90554]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 19:02:13 devstack sudo[90547]: pam_unix(sudo:session): session closed for user root Apr 29 19:02:13 devstack cinder-volume[84538]: DEBUG oslo_concurrency.processutils [None req-6478d918-bf54-482f-bdc6-a2d0f7d01ad1 tempest-GroupSnapshotsTest-1835037466 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-2e29ba0d-aed9-4682-8da4-ade2b8e26470.24e2d28b-4a78-4a18-920d-20bac9441361" returned: 0 in 1.097s {{(pid=84538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 19:02:13 devstack cinder-volume[84538]: DEBUG cinder.volume.drivers.remotefs [None req-6478d918-bf54-482f-bdc6-a2d0f7d01ad1 tempest-GroupSnapshotsTest-1835037466 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-2e29ba0d-aed9-4682-8da4-ade2b8e26470(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=84538) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 29 19:02:14 devstack cinder-volume[84538]: DEBUG oslo.privsep.daemon [-] privsep: reply[5af60127-cdcd-4a44-89c1-e75885817fd5]: (4, 'qcow2') {{(pid=85803) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 19:02:14 devstack cinder-volume[84538]: DEBUG oslo_concurrency.processutils [None req-6478d918-bf54-482f-bdc6-a2d0f7d01ad1 tempest-GroupSnapshotsTest-1835037466 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-2e29ba0d-aed9-4682-8da4-ade2b8e26470 {{(pid=84538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 19:02:14 devstack sudo[90546]: pam_unix(sudo:session): session closed for user root Apr 29 19:02:14 devstack cinder-volume[84538]: DEBUG oslo_concurrency.processutils [None req-ed99f4d5-1b4f-479e-825b-0838b6a61223 tempest-VolumesDeleteCascade-1314225595 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d" returned: 0 in 1.205s {{(pid=84538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 19:02:14 devstack cinder-volume[84538]: DEBUG cinder.manager [None req-ed99f4d5-1b4f-479e-825b-0838b6a61223 tempest-VolumesDeleteCascade-1314225595 None] Notifying Schedulers of capabilities ... {{(pid=84538) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 29 19:02:14 devstack cinder-volume[84538]: INFO cinder.volume.manager [None req-ed99f4d5-1b4f-479e-825b-0838b6a61223 tempest-VolumesDeleteCascade-1314225595 None] Deleted volume successfully. Apr 29 19:02:14 devstack cinder-volume[84538]: DEBUG cinder.coordination [None req-ed99f4d5-1b4f-479e-825b-0838b6a61223 tempest-VolumesDeleteCascade-1314225595 None] Lock "cinder-363b2b67-b40a-4aea-a61a-58750417ef9c-delete_volume" released by "delete_volume" :: held 14.606s {{(pid=84538) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 19:02:14 devstack sudo[90556]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-2e29ba0d-aed9-4682-8da4-ade2b8e26470 Apr 29 19:02:14 devstack sudo[90556]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 19:02:14 devstack sudo[90554]: pam_unix(sudo:session): session closed for user root Apr 29 19:02:14 devstack cinder-volume[84538]: DEBUG oslo_concurrency.processutils [None req-1758fb14-b5ad-4286-8a34-73813a48bce4 tempest-VolumesDeleteCascade-1314225595 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-6d573221-9dab-4f46-b8d6-92bad7a9a295 1073741824" returned: 0 in 1.027s {{(pid=84538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 19:02:14 devstack cinder-volume[84538]: DEBUG oslo_concurrency.processutils [None req-1758fb14-b5ad-4286-8a34-73813a48bce4 tempest-VolumesDeleteCascade-1314225595 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-6d573221-9dab-4f46-b8d6-92bad7a9a295 {{(pid=84538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 19:02:14 devstack sudo[90556]: pam_unix(sudo:session): session closed for user root Apr 29 19:02:15 devstack cinder-volume[84538]: DEBUG oslo_concurrency.processutils [None req-6478d918-bf54-482f-bdc6-a2d0f7d01ad1 tempest-GroupSnapshotsTest-1835037466 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-2e29ba0d-aed9-4682-8da4-ade2b8e26470" returned: 0 in 0.951s {{(pid=84538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 19:02:15 devstack cinder-volume[84538]: DEBUG oslo_concurrency.processutils [None req-6478d918-bf54-482f-bdc6-a2d0f7d01ad1 tempest-GroupSnapshotsTest-1835037466 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-2e29ba0d-aed9-4682-8da4-ade2b8e26470.24e2d28b-4a78-4a18-920d-20bac9441361 {{(pid=84538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 19:02:15 devstack sudo[90567]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-6d573221-9dab-4f46-b8d6-92bad7a9a295 Apr 29 19:02:15 devstack sudo[90567]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 19:02:15 devstack sudo[90569]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-2e29ba0d-aed9-4682-8da4-ade2b8e26470.24e2d28b-4a78-4a18-920d-20bac9441361 Apr 29 19:02:15 devstack sudo[90569]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 19:02:15 devstack sudo[90567]: pam_unix(sudo:session): session closed for user root Apr 29 19:02:15 devstack cinder-volume[84538]: DEBUG oslo_concurrency.processutils [None req-1758fb14-b5ad-4286-8a34-73813a48bce4 tempest-VolumesDeleteCascade-1314225595 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-6d573221-9dab-4f46-b8d6-92bad7a9a295" returned: 0 in 0.675s {{(pid=84538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 19:02:15 devstack cinder-volume[84538]: DEBUG cinder.volume.drivers.quobyte [None req-1758fb14-b5ad-4286-8a34-73813a48bce4 tempest-VolumesDeleteCascade-1314225595 None] <== create_volume: return (1787ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-34312b00-dd6d-45bb-af98-75855cea8e48'} {{(pid=84538) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 29 19:02:15 devstack cinder-volume[84538]: DEBUG oslo_concurrency.lockutils [None req-1758fb14-b5ad-4286-8a34-73813a48bce4 tempest-VolumesDeleteCascade-1314225595 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.792s {{(pid=84538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 19:02:15 devstack cinder-volume[84538]: DEBUG cinder.volume.manager [None req-1758fb14-b5ad-4286-8a34-73813a48bce4 tempest-VolumesDeleteCascade-1314225595 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6b436dc8-7a00-4105-9f02-5070a4df77fa) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6d573221-9dab-4f46-b8d6-92bad7a9a295', 'volume_size': 1}' {{(pid=84538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 19:02:15 devstack cinder-volume[84538]: DEBUG cinder.volume.manager [None req-1758fb14-b5ad-4286-8a34-73813a48bce4 tempest-VolumesDeleteCascade-1314225595 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2ba0b536-6b06-41ea-bace-65363dee16aa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 19:02:15 devstack cinder-volume[84538]: INFO cinder.volume.flows.manager.create_volume [None req-1758fb14-b5ad-4286-8a34-73813a48bce4 tempest-VolumesDeleteCascade-1314225595 None] Volume volume-6d573221-9dab-4f46-b8d6-92bad7a9a295 (6d573221-9dab-4f46-b8d6-92bad7a9a295): created successfully Apr 29 19:02:15 devstack cinder-volume[84538]: DEBUG cinder.volume.manager [None req-1758fb14-b5ad-4286-8a34-73813a48bce4 tempest-VolumesDeleteCascade-1314225595 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2ba0b536-6b06-41ea-bace-65363dee16aa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 19:02:15 devstack cinder-volume[84538]: DEBUG cinder.volume.manager [None req-1758fb14-b5ad-4286-8a34-73813a48bce4 tempest-VolumesDeleteCascade-1314225595 None] Flow 'volume_create_manager' (ce3fd068-91af-44ab-a6d4-4ce7aae725e4) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84538) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 19:02:15 devstack cinder-volume[84538]: INFO cinder.volume.manager [None req-1758fb14-b5ad-4286-8a34-73813a48bce4 tempest-VolumesDeleteCascade-1314225595 None] Created volume successfully. Apr 29 19:02:15 devstack sudo[90569]: pam_unix(sudo:session): session closed for user root Apr 29 19:02:15 devstack cinder-volume[84538]: DEBUG oslo_concurrency.processutils [None req-6478d918-bf54-482f-bdc6-a2d0f7d01ad1 tempest-GroupSnapshotsTest-1835037466 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-2e29ba0d-aed9-4682-8da4-ade2b8e26470.24e2d28b-4a78-4a18-920d-20bac9441361" returned: 0 in 0.981s {{(pid=84538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 19:02:15 devstack cinder-volume[84538]: DEBUG oslo_concurrency.processutils [None req-6478d918-bf54-482f-bdc6-a2d0f7d01ad1 tempest-GroupSnapshotsTest-1835037466 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-2e29ba0d-aed9-4682-8da4-ade2b8e26470.24e2d28b-4a78-4a18-920d-20bac9441361 {{(pid=84538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 19:02:16 devstack sudo[90576]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-2e29ba0d-aed9-4682-8da4-ade2b8e26470.24e2d28b-4a78-4a18-920d-20bac9441361 Apr 29 19:02:16 devstack sudo[90576]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 19:02:16 devstack cinder-volume[84538]: DEBUG oslo_concurrency.lockutils [None req-81d608dc-2bc4-4661-8605-851cb46e6d83 tempest-VolumesDeleteCascade-1314225595 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=84538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 19:02:16 devstack cinder-volume[84538]: DEBUG oslo_concurrency.lockutils [None req-81d608dc-2bc4-4661-8605-851cb46e6d83 tempest-VolumesDeleteCascade-1314225595 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=84538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 19:02:16 devstack cinder-volume[84538]: DEBUG cinder.volume.drivers.remotefs [None req-81d608dc-2bc4-4661-8605-851cb46e6d83 tempest-VolumesDeleteCascade-1314225595 None] Creating offline snapshot a6f70eaf-8289-42b0-8ac0-7f1c5c105985 of volume 6d573221-9dab-4f46-b8d6-92bad7a9a295 {{(pid=84538) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}} Apr 29 19:02:16 devstack cinder-volume[84538]: DEBUG oslo.privsep.daemon [-] privsep: reply[0d95da54-1ae4-4b79-aefa-c6ac0701deae]: (4, 'qcow2') {{(pid=85803) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 19:02:16 devstack cinder-volume[84538]: DEBUG oslo_concurrency.processutils [None req-81d608dc-2bc4-4661-8605-851cb46e6d83 tempest-VolumesDeleteCascade-1314225595 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-6d573221-9dab-4f46-b8d6-92bad7a9a295 {{(pid=84538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 19:02:16 devstack sudo[90578]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-6d573221-9dab-4f46-b8d6-92bad7a9a295 Apr 29 19:02:16 devstack sudo[90578]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 19:02:16 devstack sudo[90576]: pam_unix(sudo:session): session closed for user root Apr 29 19:02:16 devstack cinder-volume[84538]: DEBUG oslo_concurrency.processutils [None req-6478d918-bf54-482f-bdc6-a2d0f7d01ad1 tempest-GroupSnapshotsTest-1835037466 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-2e29ba0d-aed9-4682-8da4-ade2b8e26470.24e2d28b-4a78-4a18-920d-20bac9441361" returned: 0 in 0.722s {{(pid=84538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 19:02:16 devstack cinder-volume[84538]: DEBUG cinder.coordination [None req-6478d918-bf54-482f-bdc6-a2d0f7d01ad1 tempest-GroupSnapshotsTest-1835037466 None] Lock "cinder-quobyte-24e2d28b-4a78-4a18-920d-20bac9441361" released by "_delete_snapshot" :: held 3.938s {{(pid=84538) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 19:02:16 devstack cinder-volume[84538]: DEBUG cinder.coordination [None req-6478d918-bf54-482f-bdc6-a2d0f7d01ad1 tempest-GroupSnapshotsTest-1835037466 None] Lock "cinder-quobyte-2e29ba0d-aed9-4682-8da4-ade2b8e26470" released by "delete_snapshot" :: held 3.986s {{(pid=84538) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 19:02:16 devstack cinder-volume[84538]: WARNING cinder.quota [None req-6478d918-bf54-482f-bdc6-a2d0f7d01ad1 tempest-GroupSnapshotsTest-1835037466 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsTest-volume-type-1269596194 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsTest-volume-type-1269596194, it is now deprecated. Please use the default quota class for default quota. Apr 29 19:02:16 devstack cinder-volume[84538]: WARNING cinder.quota [None req-6478d918-bf54-482f-bdc6-a2d0f7d01ad1 tempest-GroupSnapshotsTest-1835037466 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsTest-volume-type-1269596194 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsTest-volume-type-1269596194, it is now deprecated. Please use the default quota class for default quota. Apr 29 19:02:16 devstack cinder-volume[84538]: DEBUG cinder.quota [None req-6478d918-bf54-482f-bdc6-a2d0f7d01ad1 tempest-GroupSnapshotsTest-1835037466 None] Created reservations ['fc9e129d-aa40-41f8-847e-691d9568fb8c', 'da1fa0ec-c3f4-4a30-8a55-e061dd6b8094', 'e7f1d2bc-dabb-49a2-965b-06a4531c450a', 'e8cd2a28-f875-4973-83b1-d003c3623572'] {{(pid=84538) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 29 19:02:16 devstack cinder-volume[84538]: INFO cinder.volume.manager [None req-6478d918-bf54-482f-bdc6-a2d0f7d01ad1 tempest-GroupSnapshotsTest-1835037466 None] group_snapshot e5261cd2-ef5d-4929-8724-d6be5c53406d: deleted successfully Apr 29 19:02:17 devstack sudo[90578]: pam_unix(sudo:session): session closed for user root Apr 29 19:02:17 devstack cinder-volume[84538]: DEBUG oslo_concurrency.processutils [None req-81d608dc-2bc4-4661-8605-851cb46e6d83 tempest-VolumesDeleteCascade-1314225595 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-6d573221-9dab-4f46-b8d6-92bad7a9a295" returned: 0 in 0.916s {{(pid=84538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 19:02:17 devstack cinder-volume[84538]: DEBUG oslo_concurrency.processutils [None req-81d608dc-2bc4-4661-8605-851cb46e6d83 tempest-VolumesDeleteCascade-1314225595 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-6d573221-9dab-4f46-b8d6-92bad7a9a295,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-6d573221-9dab-4f46-b8d6-92bad7a9a295.a6f70eaf-8289-42b0-8ac0-7f1c5c105985 1G {{(pid=84538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 19:02:17 devstack sudo[90584]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-6d573221-9dab-4f46-b8d6-92bad7a9a295,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-6d573221-9dab-4f46-b8d6-92bad7a9a295.a6f70eaf-8289-42b0-8ac0-7f1c5c105985 1G Apr 29 19:02:17 devstack sudo[90584]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 19:02:17 devstack cinder-volume[84538]: DEBUG cinder.coordination [None req-cd6a2f52-09a8-41b2-9f5f-48411f84d07b tempest-GroupSnapshotsTest-1835037466 None] Acquiring lock "cinder-quobyte-2e29ba0d-aed9-4682-8da4-ade2b8e26470" by "delete_volume" {{(pid=84538) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 19:02:17 devstack cinder-volume[84538]: DEBUG cinder.coordination [None req-cd6a2f52-09a8-41b2-9f5f-48411f84d07b tempest-GroupSnapshotsTest-1835037466 None] Lock "cinder-quobyte-2e29ba0d-aed9-4682-8da4-ade2b8e26470" acquired by "delete_volume" :: waited 0.024s {{(pid=84538) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 19:02:17 devstack cinder-volume[84538]: DEBUG oslo.privsep.daemon [-] privsep: reply[8abed9e9-af1b-4318-9d4a-eccf13907e7c]: (4, 'qcow2') {{(pid=85803) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 19:02:17 devstack cinder-volume[84538]: DEBUG oslo_concurrency.processutils [None req-cd6a2f52-09a8-41b2-9f5f-48411f84d07b tempest-GroupSnapshotsTest-1835037466 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-2e29ba0d-aed9-4682-8da4-ade2b8e26470 {{(pid=84538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 19:02:17 devstack sudo[90586]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-2e29ba0d-aed9-4682-8da4-ade2b8e26470 Apr 29 19:02:17 devstack sudo[90586]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 19:02:18 devstack sudo[90584]: pam_unix(sudo:session): session closed for user root Apr 29 19:02:18 devstack cinder-volume[84538]: DEBUG oslo_concurrency.processutils [None req-81d608dc-2bc4-4661-8605-851cb46e6d83 tempest-VolumesDeleteCascade-1314225595 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-6d573221-9dab-4f46-b8d6-92bad7a9a295,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-6d573221-9dab-4f46-b8d6-92bad7a9a295.a6f70eaf-8289-42b0-8ac0-7f1c5c105985 1G" returned: 0 in 1.033s {{(pid=84538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 19:02:18 devstack cinder-volume[84538]: DEBUG oslo_concurrency.processutils [None req-81d608dc-2bc4-4661-8605-851cb46e6d83 tempest-VolumesDeleteCascade-1314225595 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6d573221-9dab-4f46-b8d6-92bad7a9a295 -F qcow2 /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-6d573221-9dab-4f46-b8d6-92bad7a9a295.a6f70eaf-8289-42b0-8ac0-7f1c5c105985 {{(pid=84538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 19:02:18 devstack sudo[90595]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6d573221-9dab-4f46-b8d6-92bad7a9a295 -F qcow2 /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-6d573221-9dab-4f46-b8d6-92bad7a9a295.a6f70eaf-8289-42b0-8ac0-7f1c5c105985 Apr 29 19:02:18 devstack sudo[90595]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 19:02:18 devstack sudo[90586]: pam_unix(sudo:session): session closed for user root Apr 29 19:02:18 devstack cinder-volume[84538]: DEBUG oslo_concurrency.processutils [None req-cd6a2f52-09a8-41b2-9f5f-48411f84d07b tempest-GroupSnapshotsTest-1835037466 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-2e29ba0d-aed9-4682-8da4-ade2b8e26470" returned: 0 in 0.903s {{(pid=84538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 19:02:18 devstack cinder-volume[84538]: DEBUG oslo_concurrency.processutils [None req-cd6a2f52-09a8-41b2-9f5f-48411f84d07b tempest-GroupSnapshotsTest-1835037466 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-2e29ba0d-aed9-4682-8da4-ade2b8e26470 {{(pid=84538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 19:02:18 devstack sudo[90599]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-2e29ba0d-aed9-4682-8da4-ade2b8e26470 Apr 29 19:02:18 devstack sudo[90599]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 19:02:18 devstack sudo[90595]: pam_unix(sudo:session): session closed for user root Apr 29 19:02:18 devstack cinder-volume[84538]: DEBUG oslo_concurrency.processutils [None req-81d608dc-2bc4-4661-8605-851cb46e6d83 tempest-VolumesDeleteCascade-1314225595 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6d573221-9dab-4f46-b8d6-92bad7a9a295 -F qcow2 /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-6d573221-9dab-4f46-b8d6-92bad7a9a295.a6f70eaf-8289-42b0-8ac0-7f1c5c105985" returned: 0 in 0.732s {{(pid=84538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 19:02:18 devstack cinder-volume[84538]: WARNING cinder.volume.drivers.remotefs [None req-81d608dc-2bc4-4661-8605-851cb46e6d83 tempest-VolumesDeleteCascade-1314225595 None] /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-6d573221-9dab-4f46-b8d6-92bad7a9a295.a6f70eaf-8289-42b0-8ac0-7f1c5c105985 is being set with open permissions: ugo+rw Apr 29 19:02:18 devstack cinder-volume[84538]: DEBUG oslo_concurrency.processutils [None req-81d608dc-2bc4-4661-8605-851cb46e6d83 tempest-VolumesDeleteCascade-1314225595 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-6d573221-9dab-4f46-b8d6-92bad7a9a295.a6f70eaf-8289-42b0-8ac0-7f1c5c105985 {{(pid=84538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 19:02:18 devstack sudo[90604]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-6d573221-9dab-4f46-b8d6-92bad7a9a295.a6f70eaf-8289-42b0-8ac0-7f1c5c105985 Apr 29 19:02:18 devstack sudo[90604]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 19:02:19 devstack sudo[90599]: pam_unix(sudo:session): session closed for user root Apr 29 19:02:19 devstack cinder-volume[84538]: DEBUG oslo_concurrency.processutils [None req-cd6a2f52-09a8-41b2-9f5f-48411f84d07b tempest-GroupSnapshotsTest-1835037466 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-2e29ba0d-aed9-4682-8da4-ade2b8e26470" returned: 0 in 0.722s {{(pid=84538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 19:02:19 devstack cinder-volume[84538]: DEBUG cinder.coordination [None req-cd6a2f52-09a8-41b2-9f5f-48411f84d07b tempest-GroupSnapshotsTest-1835037466 None] Lock "cinder-quobyte-2e29ba0d-aed9-4682-8da4-ade2b8e26470" released by "delete_volume" :: held 1.711s {{(pid=84538) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 19:02:19 devstack cinder-volume[84538]: DEBUG cinder.quota [None req-cd6a2f52-09a8-41b2-9f5f-48411f84d07b tempest-GroupSnapshotsTest-1835037466 None] Created reservations ['0814a78a-5db0-4b31-bf18-6aa7b3a7b479'] {{(pid=84538) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 29 19:02:19 devstack cinder-volume[84538]: WARNING cinder.quota [None req-cd6a2f52-09a8-41b2-9f5f-48411f84d07b tempest-GroupSnapshotsTest-1835037466 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsTest-volume-type-1269596194 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsTest-volume-type-1269596194, it is now deprecated. Please use the default quota class for default quota. Apr 29 19:02:19 devstack cinder-volume[84538]: DEBUG cinder.quota [None req-cd6a2f52-09a8-41b2-9f5f-48411f84d07b tempest-GroupSnapshotsTest-1835037466 None] Created reservations ['526bb18a-3446-4f06-97b1-e9f292c7c20a', '08b8ba3c-36fb-4b5d-8953-6a40504c6ee2', 'a26a776f-c8bb-4413-9243-f00922c8ad85', 'f47505c0-257d-4fee-9308-5205ead0fbb3'] {{(pid=84538) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 29 19:02:19 devstack cinder-volume[84538]: DEBUG oslo_concurrency.lockutils [None req-cd6a2f52-09a8-41b2-9f5f-48411f84d07b tempest-GroupSnapshotsTest-1835037466 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 19:02:19 devstack cinder-volume[84538]: DEBUG oslo_concurrency.lockutils [None req-cd6a2f52-09a8-41b2-9f5f-48411f84d07b tempest-GroupSnapshotsTest-1835037466 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 19:02:19 devstack cinder-volume[84538]: DEBUG cinder.volume.drivers.quobyte [None req-cd6a2f52-09a8-41b2-9f5f-48411f84d07b tempest-GroupSnapshotsTest-1835037466 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-34312b00-dd6d-45bb-af98-75855cea8e48': None} {{(pid=84538) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 19:02:19 devstack cinder-volume[84538]: DEBUG cinder.volume.drivers.quobyte [None req-cd6a2f52-09a8-41b2-9f5f-48411f84d07b tempest-GroupSnapshotsTest-1835037466 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-34312b00-dd6d-45bb-af98-75855cea8e48'] {{(pid=84538) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 19:02:19 devstack cinder-volume[84538]: DEBUG oslo_concurrency.lockutils [None req-cd6a2f52-09a8-41b2-9f5f-48411f84d07b tempest-GroupSnapshotsTest-1835037466 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=84538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 19:02:19 devstack cinder-volume[84538]: DEBUG oslo_concurrency.processutils [None req-cd6a2f52-09a8-41b2-9f5f-48411f84d07b tempest-GroupSnapshotsTest-1835037466 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d {{(pid=84538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 19:02:19 devstack sudo[90607]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d Apr 29 19:02:19 devstack sudo[90607]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 19:02:19 devstack sudo[90604]: pam_unix(sudo:session): session closed for user root Apr 29 19:02:19 devstack cinder-volume[84538]: DEBUG oslo_concurrency.processutils [None req-81d608dc-2bc4-4661-8605-851cb46e6d83 tempest-VolumesDeleteCascade-1314225595 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-6d573221-9dab-4f46-b8d6-92bad7a9a295.a6f70eaf-8289-42b0-8ac0-7f1c5c105985" returned: 0 in 0.852s {{(pid=84538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 19:02:19 devstack cinder-volume[84538]: DEBUG oslo_concurrency.processutils [None req-81d608dc-2bc4-4661-8605-851cb46e6d83 tempest-VolumesDeleteCascade-1314225595 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-6d573221-9dab-4f46-b8d6-92bad7a9a295.info {{(pid=84538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 19:02:19 devstack sudo[90610]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-6d573221-9dab-4f46-b8d6-92bad7a9a295.info Apr 29 19:02:19 devstack sudo[90610]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 19:02:19 devstack cinder-volume[84538]: DEBUG cinder.volume.flows.manager.create_volume [None req-4ddffdc7-fcd2-4d00-997d-31746739a32c tempest-VolumesListAdminTestJSON-1330364154 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84538) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Apr 29 19:02:19 devstack cinder-volume[84538]: DEBUG cinder.volume.manager [None req-4ddffdc7-fcd2-4d00-997d-31746739a32c tempest-VolumesListAdminTestJSON-1330364154 None] Flow 'volume_create_manager' (7288c6d3-d32e-4f83-a735-a4f5ac41eb4e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84538) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 19:02:19 devstack cinder-volume[84538]: DEBUG cinder.volume.manager [None req-4ddffdc7-fcd2-4d00-997d-31746739a32c tempest-VolumesListAdminTestJSON-1330364154 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2577f24c-8cb9-4f0f-8cc0-23009f4b2113) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 19:02:19 devstack cinder-volume[84538]: DEBUG cinder.volume.manager [None req-4ddffdc7-fcd2-4d00-997d-31746739a32c tempest-VolumesListAdminTestJSON-1330364154 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2577f24c-8cb9-4f0f-8cc0-23009f4b2113) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-29T17:02:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-1522869219',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ff7a0714-5788-45e5-810b-2fbdc9dd8132,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e7d888ac4b1a4a90a3d7723e60bd9f36',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T17:02:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T17:02:20Z,use_quota=True,user_id='ff657a7ce8464cd9b8b73cc3a7213188',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(62b05900-93e3-4190-a88f-1d87324303d1),volume_type_id=62b05900-93e3-4190-a88f-1d87324303d1)' {{(pid=84538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 19:02:20 devstack cinder-volume[84538]: DEBUG cinder.volume.manager [None req-4ddffdc7-fcd2-4d00-997d-31746739a32c tempest-VolumesListAdminTestJSON-1330364154 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a21a0c2b-0cc7-4d95-a1a5-2ac84b1f699d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 19:02:20 devstack cinder-volume[84538]: DEBUG cinder.volume.manager [None req-4ddffdc7-fcd2-4d00-997d-31746739a32c tempest-VolumesListAdminTestJSON-1330364154 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a21a0c2b-0cc7-4d95-a1a5-2ac84b1f699d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 19:02:20 devstack cinder-volume[84538]: DEBUG cinder.volume.manager [None req-4ddffdc7-fcd2-4d00-997d-31746739a32c tempest-VolumesListAdminTestJSON-1330364154 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bf8fd7ba-2424-4002-8cf2-4bd9b4283954) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 19:02:20 devstack cinder-volume[84538]: DEBUG cinder.volume.manager [None req-4ddffdc7-fcd2-4d00-997d-31746739a32c tempest-VolumesListAdminTestJSON-1330364154 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bf8fd7ba-2424-4002-8cf2-4bd9b4283954) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ff7a0714-5788-45e5-810b-2fbdc9dd8132', 'volume_name': 'volume-ff7a0714-5788-45e5-810b-2fbdc9dd8132', 'volume_size': 1}' {{(pid=84538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 19:02:20 devstack cinder-volume[84538]: DEBUG cinder.volume.manager [None req-4ddffdc7-fcd2-4d00-997d-31746739a32c tempest-VolumesListAdminTestJSON-1330364154 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6f898f54-63d8-43a9-a6f1-1855713f0e0d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 19:02:20 devstack cinder-volume[84538]: DEBUG cinder.volume.manager [None req-4ddffdc7-fcd2-4d00-997d-31746739a32c tempest-VolumesListAdminTestJSON-1330364154 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6f898f54-63d8-43a9-a6f1-1855713f0e0d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 19:02:20 devstack cinder-volume[84538]: DEBUG cinder.volume.manager [None req-4ddffdc7-fcd2-4d00-997d-31746739a32c tempest-VolumesListAdminTestJSON-1330364154 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (496c280c-ae1b-49aa-b4e3-746c8258c3e8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 19:02:20 devstack cinder-volume[84538]: INFO cinder.volume.flows.manager.create_volume [None req-4ddffdc7-fcd2-4d00-997d-31746739a32c tempest-VolumesListAdminTestJSON-1330364154 None] Volume ff7a0714-5788-45e5-810b-2fbdc9dd8132: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ff7a0714-5788-45e5-810b-2fbdc9dd8132', 'volume_size': 1} Apr 29 19:02:20 devstack cinder-volume[84538]: DEBUG oslo_concurrency.lockutils [None req-4ddffdc7-fcd2-4d00-997d-31746739a32c tempest-VolumesListAdminTestJSON-1330364154 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 19:02:20 devstack sudo[90607]: pam_unix(sudo:session): session closed for user root Apr 29 19:02:20 devstack cinder-volume[84538]: DEBUG oslo_concurrency.processutils [None req-cd6a2f52-09a8-41b2-9f5f-48411f84d07b tempest-GroupSnapshotsTest-1835037466 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d" returned: 0 in 0.864s {{(pid=84538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 19:02:20 devstack cinder-volume[84538]: DEBUG cinder.manager [None req-cd6a2f52-09a8-41b2-9f5f-48411f84d07b tempest-GroupSnapshotsTest-1835037466 None] Notifying Schedulers of capabilities ... {{(pid=84538) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 29 19:02:20 devstack cinder-volume[84538]: INFO cinder.volume.manager [None req-cd6a2f52-09a8-41b2-9f5f-48411f84d07b tempest-GroupSnapshotsTest-1835037466 None] Delete group completed successfully. Apr 29 19:02:20 devstack sudo[90610]: pam_unix(sudo:session): session closed for user root Apr 29 19:02:20 devstack cinder-volume[84538]: DEBUG oslo_concurrency.processutils [None req-81d608dc-2bc4-4661-8605-851cb46e6d83 tempest-VolumesDeleteCascade-1314225595 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-6d573221-9dab-4f46-b8d6-92bad7a9a295.info" returned: 0 in 0.814s {{(pid=84538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 19:02:20 devstack cinder-volume[84538]: WARNING cinder.volume.drivers.remotefs [None req-81d608dc-2bc4-4661-8605-851cb46e6d83 tempest-VolumesDeleteCascade-1314225595 None] /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-6d573221-9dab-4f46-b8d6-92bad7a9a295.info is being set with open permissions: ugo+rw Apr 29 19:02:20 devstack cinder-volume[84538]: DEBUG oslo_concurrency.processutils [None req-81d608dc-2bc4-4661-8605-851cb46e6d83 tempest-VolumesDeleteCascade-1314225595 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-6d573221-9dab-4f46-b8d6-92bad7a9a295.info {{(pid=84538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 19:02:20 devstack sudo[90614]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-6d573221-9dab-4f46-b8d6-92bad7a9a295.info Apr 29 19:02:20 devstack sudo[90614]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 19:02:21 devstack sudo[90614]: pam_unix(sudo:session): session closed for user root Apr 29 19:02:21 devstack cinder-volume[84538]: DEBUG oslo_concurrency.processutils [None req-81d608dc-2bc4-4661-8605-851cb46e6d83 tempest-VolumesDeleteCascade-1314225595 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-6d573221-9dab-4f46-b8d6-92bad7a9a295.info" returned: 0 in 0.745s {{(pid=84538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 19:02:21 devstack cinder-volume[84538]: DEBUG oslo_concurrency.lockutils [None req-81d608dc-2bc4-4661-8605-851cb46e6d83 tempest-VolumesDeleteCascade-1314225595 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 5.226s {{(pid=84538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 19:02:21 devstack cinder-volume[84538]: DEBUG oslo_concurrency.lockutils [None req-4ddffdc7-fcd2-4d00-997d-31746739a32c tempest-VolumesListAdminTestJSON-1330364154 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.388s {{(pid=84538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 19:02:21 devstack cinder-volume[84538]: DEBUG cinder.volume.drivers.quobyte [None req-4ddffdc7-fcd2-4d00-997d-31746739a32c tempest-VolumesListAdminTestJSON-1330364154 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-29T17:02:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-1522869219',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ff7a0714-5788-45e5-810b-2fbdc9dd8132,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e7d888ac4b1a4a90a3d7723e60bd9f36',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T17:02:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T17:02:20Z,use_quota=True,user_id='ff657a7ce8464cd9b8b73cc3a7213188',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(62b05900-93e3-4190-a88f-1d87324303d1),volume_type_id=62b05900-93e3-4190-a88f-1d87324303d1)}" {{(pid=84538) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 29 19:02:21 devstack cinder-volume[84538]: DEBUG cinder.volume.drivers.remotefs [None req-4ddffdc7-fcd2-4d00-997d-31746739a32c tempest-VolumesListAdminTestJSON-1330364154 None] Creating volume ff7a0714-5788-45e5-810b-2fbdc9dd8132 {{(pid=84538) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 29 19:02:21 devstack cinder-volume[84538]: DEBUG oslo_concurrency.lockutils [None req-4ddffdc7-fcd2-4d00-997d-31746739a32c tempest-VolumesListAdminTestJSON-1330364154 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 19:02:21 devstack cinder-volume[84538]: DEBUG oslo_concurrency.lockutils [None req-4ddffdc7-fcd2-4d00-997d-31746739a32c tempest-VolumesListAdminTestJSON-1330364154 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 19:02:21 devstack cinder-volume[84538]: DEBUG cinder.volume.drivers.quobyte [None req-4ddffdc7-fcd2-4d00-997d-31746739a32c tempest-VolumesListAdminTestJSON-1330364154 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-34312b00-dd6d-45bb-af98-75855cea8e48': None} {{(pid=84538) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 19:02:21 devstack cinder-volume[84538]: DEBUG cinder.volume.drivers.quobyte [None req-4ddffdc7-fcd2-4d00-997d-31746739a32c tempest-VolumesListAdminTestJSON-1330364154 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-34312b00-dd6d-45bb-af98-75855cea8e48'] {{(pid=84538) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 19:02:21 devstack cinder-volume[84538]: DEBUG oslo_concurrency.lockutils [None req-4ddffdc7-fcd2-4d00-997d-31746739a32c tempest-VolumesListAdminTestJSON-1330364154 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=84538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 19:02:21 devstack cinder-volume[84538]: DEBUG cinder.volume.drivers.quobyte [None req-4ddffdc7-fcd2-4d00-997d-31746739a32c tempest-VolumesListAdminTestJSON-1330364154 None] Selected osci02.corp.quobyte.com/cinder-vol-34312b00-dd6d-45bb-af98-75855cea8e48 as target Quobyte volume. {{(pid=84538) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 29 19:02:21 devstack cinder-volume[84538]: INFO cinder.volume.drivers.remotefs [None req-4ddffdc7-fcd2-4d00-997d-31746739a32c tempest-VolumesListAdminTestJSON-1330364154 None] casted to osci02.corp.quobyte.com/cinder-vol-34312b00-dd6d-45bb-af98-75855cea8e48 Apr 29 19:02:21 devstack cinder-volume[84538]: DEBUG oslo_concurrency.processutils [None req-4ddffdc7-fcd2-4d00-997d-31746739a32c tempest-VolumesListAdminTestJSON-1330364154 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-ff7a0714-5788-45e5-810b-2fbdc9dd8132 1073741824 {{(pid=84538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 19:02:21 devstack sudo[90617]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-ff7a0714-5788-45e5-810b-2fbdc9dd8132 1073741824 Apr 29 19:02:21 devstack cinder-volume[84538]: INFO cinder.volume.manager [None req-81d608dc-2bc4-4661-8605-851cb46e6d83 tempest-VolumesDeleteCascade-1314225595 None] Create snapshot completed successfully Apr 29 19:02:21 devstack sudo[90617]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 19:02:22 devstack cinder-volume[84538]: DEBUG oslo_concurrency.processutils [None req-4ddffdc7-fcd2-4d00-997d-31746739a32c tempest-VolumesListAdminTestJSON-1330364154 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-ff7a0714-5788-45e5-810b-2fbdc9dd8132 1073741824" returned: 0 in 0.945s {{(pid=84538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 19:02:22 devstack sudo[90617]: pam_unix(sudo:session): session closed for user root Apr 29 19:02:22 devstack cinder-volume[84538]: DEBUG oslo_concurrency.processutils [None req-4ddffdc7-fcd2-4d00-997d-31746739a32c tempest-VolumesListAdminTestJSON-1330364154 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-ff7a0714-5788-45e5-810b-2fbdc9dd8132 {{(pid=84538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 19:02:22 devstack sudo[90624]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-ff7a0714-5788-45e5-810b-2fbdc9dd8132 Apr 29 19:02:22 devstack sudo[90624]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 19:02:23 devstack cinder-volume[84538]: DEBUG cinder.volume.flows.manager.create_volume [None req-4c7a22c4-86b4-4f3a-b146-84ca97990cc6 tempest-VolumesDeleteCascade-1314225595 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84538) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Apr 29 19:02:23 devstack cinder-volume[84538]: DEBUG cinder.volume.manager [None req-4c7a22c4-86b4-4f3a-b146-84ca97990cc6 tempest-VolumesDeleteCascade-1314225595 None] Flow 'volume_create_manager' (737658e7-ea7e-4890-854c-ffe7e851e14e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84538) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 19:02:23 devstack sudo[90624]: pam_unix(sudo:session): session closed for user root Apr 29 19:02:23 devstack cinder-volume[84538]: DEBUG cinder.volume.manager [None req-4c7a22c4-86b4-4f3a-b146-84ca97990cc6 tempest-VolumesDeleteCascade-1314225595 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ae42fe8f-4d96-4ab7-b917-ea3caa75feb1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 19:02:23 devstack cinder-volume[84538]: DEBUG oslo_concurrency.processutils [None req-4ddffdc7-fcd2-4d00-997d-31746739a32c tempest-VolumesListAdminTestJSON-1330364154 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-ff7a0714-5788-45e5-810b-2fbdc9dd8132" returned: 0 in 0.850s {{(pid=84538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 19:02:23 devstack cinder-volume[84538]: DEBUG cinder.volume.drivers.quobyte [None req-4ddffdc7-fcd2-4d00-997d-31746739a32c tempest-VolumesListAdminTestJSON-1330364154 None] <== create_volume: return (1858ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-34312b00-dd6d-45bb-af98-75855cea8e48'} {{(pid=84538) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 29 19:02:23 devstack cinder-volume[84538]: DEBUG oslo_concurrency.lockutils [None req-4ddffdc7-fcd2-4d00-997d-31746739a32c tempest-VolumesListAdminTestJSON-1330364154 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.863s {{(pid=84538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 19:02:23 devstack cinder-volume[84538]: DEBUG cinder.volume.manager [None req-4c7a22c4-86b4-4f3a-b146-84ca97990cc6 tempest-VolumesDeleteCascade-1314225595 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ae42fe8f-4d96-4ab7-b917-ea3caa75feb1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-29T17:02:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-1594294008',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=399a0e0a-846a-4fe5-9739-8ce2a71d113f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='26acfb1208254d3ca0d297f4abbc3144',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T17:02:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=a6f70eaf-8289-42b0-8ac0-7f1c5c105985,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T17:02:23Z,use_quota=True,user_id='5c5deee661434855ad8181b5b72c64da',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(62b05900-93e3-4190-a88f-1d87324303d1),volume_type_id=62b05900-93e3-4190-a88f-1d87324303d1)' {{(pid=84538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 19:02:23 devstack cinder-volume[84538]: DEBUG cinder.volume.manager [None req-4c7a22c4-86b4-4f3a-b146-84ca97990cc6 tempest-VolumesDeleteCascade-1314225595 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (67bbabb0-e4fd-4dcf-97c3-5003ae7b2858) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 19:02:23 devstack cinder-volume[84538]: DEBUG cinder.volume.manager [None req-4c7a22c4-86b4-4f3a-b146-84ca97990cc6 tempest-VolumesDeleteCascade-1314225595 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (67bbabb0-e4fd-4dcf-97c3-5003ae7b2858) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 19:02:23 devstack cinder-volume[84538]: DEBUG cinder.volume.manager [None req-4c7a22c4-86b4-4f3a-b146-84ca97990cc6 tempest-VolumesDeleteCascade-1314225595 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3ec1d718-7fdc-403d-9879-502b5705b5fd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 19:02:23 devstack cinder-volume[84538]: DEBUG cinder.volume.manager [None req-4c7a22c4-86b4-4f3a-b146-84ca97990cc6 tempest-VolumesDeleteCascade-1314225595 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3ec1d718-7fdc-403d-9879-502b5705b5fd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '399a0e0a-846a-4fe5-9739-8ce2a71d113f', 'volume_name': 'volume-399a0e0a-846a-4fe5-9739-8ce2a71d113f', 'volume_size': 1, 'snapshot_id': 'a6f70eaf-8289-42b0-8ac0-7f1c5c105985'}' {{(pid=84538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 19:02:23 devstack cinder-volume[84538]: DEBUG cinder.volume.manager [None req-4c7a22c4-86b4-4f3a-b146-84ca97990cc6 tempest-VolumesDeleteCascade-1314225595 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3575df7f-2c9c-4673-bcc7-720dc0446d8e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 19:02:23 devstack cinder-volume[84538]: DEBUG cinder.volume.manager [None req-4c7a22c4-86b4-4f3a-b146-84ca97990cc6 tempest-VolumesDeleteCascade-1314225595 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3575df7f-2c9c-4673-bcc7-720dc0446d8e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 19:02:23 devstack cinder-volume[84538]: DEBUG cinder.volume.manager [None req-4c7a22c4-86b4-4f3a-b146-84ca97990cc6 tempest-VolumesDeleteCascade-1314225595 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (10e3eaa5-8c47-453d-b209-23c6e8b1a914) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 19:02:23 devstack cinder-volume[84538]: INFO cinder.volume.flows.manager.create_volume [None req-4c7a22c4-86b4-4f3a-b146-84ca97990cc6 tempest-VolumesDeleteCascade-1314225595 None] Volume 399a0e0a-846a-4fe5-9739-8ce2a71d113f: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-399a0e0a-846a-4fe5-9739-8ce2a71d113f', 'volume_size': 1, 'snapshot_id': 'a6f70eaf-8289-42b0-8ac0-7f1c5c105985'} Apr 29 19:02:23 devstack cinder-volume[84538]: DEBUG oslo_concurrency.lockutils [None req-4c7a22c4-86b4-4f3a-b146-84ca97990cc6 tempest-VolumesDeleteCascade-1314225595 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=84538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 19:02:23 devstack cinder-volume[84538]: DEBUG oslo_concurrency.lockutils [None req-4c7a22c4-86b4-4f3a-b146-84ca97990cc6 tempest-VolumesDeleteCascade-1314225595 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=84538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 19:02:23 devstack cinder-volume[84538]: DEBUG cinder.coordination [None req-4c7a22c4-86b4-4f3a-b146-84ca97990cc6 tempest-VolumesDeleteCascade-1314225595 None] Acquiring lock "cinder-quobyte-a6f70eaf-8289-42b0-8ac0-7f1c5c105985-399a0e0a-846a-4fe5-9739-8ce2a71d113f" by "_create_volume_from_snapshot" {{(pid=84538) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 19:02:23 devstack cinder-volume[84538]: DEBUG cinder.volume.manager [None req-4ddffdc7-fcd2-4d00-997d-31746739a32c tempest-VolumesListAdminTestJSON-1330364154 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (496c280c-ae1b-49aa-b4e3-746c8258c3e8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ff7a0714-5788-45e5-810b-2fbdc9dd8132', 'volume_size': 1}' {{(pid=84538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 19:02:23 devstack cinder-volume[84538]: DEBUG cinder.volume.manager [None req-4ddffdc7-fcd2-4d00-997d-31746739a32c tempest-VolumesListAdminTestJSON-1330364154 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d043bea6-b841-48ae-a9da-3f66f8a54e25) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 19:02:23 devstack cinder-volume[84538]: INFO cinder.volume.flows.manager.create_volume [None req-4ddffdc7-fcd2-4d00-997d-31746739a32c tempest-VolumesListAdminTestJSON-1330364154 None] Volume volume-ff7a0714-5788-45e5-810b-2fbdc9dd8132 (ff7a0714-5788-45e5-810b-2fbdc9dd8132): created successfully Apr 29 19:02:23 devstack cinder-volume[84538]: DEBUG cinder.volume.manager [None req-4ddffdc7-fcd2-4d00-997d-31746739a32c tempest-VolumesListAdminTestJSON-1330364154 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d043bea6-b841-48ae-a9da-3f66f8a54e25) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 19:02:23 devstack cinder-volume[84538]: DEBUG cinder.volume.manager [None req-4ddffdc7-fcd2-4d00-997d-31746739a32c tempest-VolumesListAdminTestJSON-1330364154 None] Flow 'volume_create_manager' (7288c6d3-d32e-4f83-a735-a4f5ac41eb4e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84538) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 19:02:23 devstack cinder-volume[84538]: DEBUG cinder.coordination [None req-4c7a22c4-86b4-4f3a-b146-84ca97990cc6 tempest-VolumesDeleteCascade-1314225595 None] Lock "cinder-quobyte-a6f70eaf-8289-42b0-8ac0-7f1c5c105985-399a0e0a-846a-4fe5-9739-8ce2a71d113f" acquired by "_create_volume_from_snapshot" :: waited 0.040s {{(pid=84538) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 19:02:23 devstack cinder-volume[84538]: DEBUG cinder.volume.drivers.quobyte [None req-4c7a22c4-86b4-4f3a-b146-84ca97990cc6 tempest-VolumesDeleteCascade-1314225595 None] Creating volume 399a0e0a-846a-4fe5-9739-8ce2a71d113f from snapshot a6f70eaf-8289-42b0-8ac0-7f1c5c105985 {{(pid=84538) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:356}} Apr 29 19:02:23 devstack cinder-volume[84538]: DEBUG oslo_concurrency.lockutils [None req-4c7a22c4-86b4-4f3a-b146-84ca97990cc6 tempest-VolumesDeleteCascade-1314225595 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 19:02:23 devstack cinder-volume[84538]: DEBUG oslo_concurrency.lockutils [None req-4c7a22c4-86b4-4f3a-b146-84ca97990cc6 tempest-VolumesDeleteCascade-1314225595 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=84538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 19:02:23 devstack cinder-volume[84538]: DEBUG cinder.volume.drivers.quobyte [None req-4c7a22c4-86b4-4f3a-b146-84ca97990cc6 tempest-VolumesDeleteCascade-1314225595 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-34312b00-dd6d-45bb-af98-75855cea8e48': None} {{(pid=84538) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 19:02:23 devstack cinder-volume[84538]: DEBUG cinder.volume.drivers.quobyte [None req-4c7a22c4-86b4-4f3a-b146-84ca97990cc6 tempest-VolumesDeleteCascade-1314225595 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-34312b00-dd6d-45bb-af98-75855cea8e48'] {{(pid=84538) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 19:02:23 devstack cinder-volume[84538]: DEBUG oslo_concurrency.lockutils [None req-4c7a22c4-86b4-4f3a-b146-84ca97990cc6 tempest-VolumesDeleteCascade-1314225595 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=84538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 19:02:23 devstack cinder-volume[84538]: DEBUG cinder.volume.drivers.quobyte [None req-4c7a22c4-86b4-4f3a-b146-84ca97990cc6 tempest-VolumesDeleteCascade-1314225595 None] Selected osci02.corp.quobyte.com/cinder-vol-34312b00-dd6d-45bb-af98-75855cea8e48 as target Quobyte volume. {{(pid=84538) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 29 19:02:23 devstack cinder-volume[84538]: DEBUG cinder.coordination [None req-4c7a22c4-86b4-4f3a-b146-84ca97990cc6 tempest-VolumesDeleteCascade-1314225595 None] Acquiring lock "cinder-quobyte-399a0e0a-846a-4fe5-9739-8ce2a71d113f" by "_copy_volume_from_snapshot" {{(pid=84538) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 19:02:23 devstack cinder-volume[84538]: INFO cinder.volume.manager [None req-4ddffdc7-fcd2-4d00-997d-31746739a32c tempest-VolumesListAdminTestJSON-1330364154 None] Created volume successfully. Apr 29 19:02:23 devstack cinder-volume[84538]: DEBUG cinder.coordination [None req-4c7a22c4-86b4-4f3a-b146-84ca97990cc6 tempest-VolumesDeleteCascade-1314225595 None] Lock "cinder-quobyte-399a0e0a-846a-4fe5-9739-8ce2a71d113f" acquired by "_copy_volume_from_snapshot" :: waited 0.024s {{(pid=84538) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 19:02:23 devstack cinder-volume[84538]: DEBUG cinder.volume.drivers.quobyte [None req-4c7a22c4-86b4-4f3a-b146-84ca97990cc6 tempest-VolumesDeleteCascade-1314225595 None] snapshot: a6f70eaf-8289-42b0-8ac0-7f1c5c105985, volume: 399a0e0a-846a-4fe5-9739-8ce2a71d113f, {{(pid=84538) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Apr 29 19:02:23 devstack cinder-volume[84538]: DEBUG oslo_concurrency.lockutils [None req-4c7a22c4-86b4-4f3a-b146-84ca97990cc6 tempest-VolumesDeleteCascade-1314225595 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 19:02:23 devstack cinder-volume[84538]: DEBUG oslo_concurrency.lockutils [None req-4c7a22c4-86b4-4f3a-b146-84ca97990cc6 tempest-VolumesDeleteCascade-1314225595 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 19:02:23 devstack cinder-volume[84538]: DEBUG cinder.volume.drivers.quobyte [None req-4c7a22c4-86b4-4f3a-b146-84ca97990cc6 tempest-VolumesDeleteCascade-1314225595 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-34312b00-dd6d-45bb-af98-75855cea8e48': None} {{(pid=84538) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 19:02:23 devstack cinder-volume[84538]: DEBUG cinder.volume.drivers.quobyte [None req-4c7a22c4-86b4-4f3a-b146-84ca97990cc6 tempest-VolumesDeleteCascade-1314225595 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-34312b00-dd6d-45bb-af98-75855cea8e48'] {{(pid=84538) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 19:02:23 devstack cinder-volume[84538]: DEBUG oslo_concurrency.lockutils [None req-4c7a22c4-86b4-4f3a-b146-84ca97990cc6 tempest-VolumesDeleteCascade-1314225595 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=84538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 19:02:23 devstack cinder-volume[84538]: DEBUG oslo.privsep.daemon [-] privsep: reply[bd254937-a341-4e0f-85e5-4cd5c86e834c]: (4, 'qcow2') {{(pid=85803) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 19:02:23 devstack cinder-volume[84538]: DEBUG oslo_concurrency.processutils [None req-4c7a22c4-86b4-4f3a-b146-84ca97990cc6 tempest-VolumesDeleteCascade-1314225595 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-6d573221-9dab-4f46-b8d6-92bad7a9a295.a6f70eaf-8289-42b0-8ac0-7f1c5c105985 {{(pid=84538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 19:02:23 devstack sudo[90628]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-6d573221-9dab-4f46-b8d6-92bad7a9a295.a6f70eaf-8289-42b0-8ac0-7f1c5c105985 Apr 29 19:02:23 devstack sudo[90628]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 19:02:24 devstack sudo[90628]: pam_unix(sudo:session): session closed for user root Apr 29 19:02:24 devstack cinder-volume[84538]: DEBUG oslo_concurrency.processutils [None req-4c7a22c4-86b4-4f3a-b146-84ca97990cc6 tempest-VolumesDeleteCascade-1314225595 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-6d573221-9dab-4f46-b8d6-92bad7a9a295.a6f70eaf-8289-42b0-8ac0-7f1c5c105985" returned: 0 in 0.765s {{(pid=84538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 19:02:24 devstack cinder-volume[84538]: DEBUG cinder.volume.drivers.remotefs [None req-4c7a22c4-86b4-4f3a-b146-84ca97990cc6 tempest-VolumesDeleteCascade-1314225595 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-6d573221-9dab-4f46-b8d6-92bad7a9a295(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=84538) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 29 19:02:24 devstack cinder-volume[84538]: DEBUG cinder.volume.drivers.quobyte [None req-4c7a22c4-86b4-4f3a-b146-84ca97990cc6 tempest-VolumesDeleteCascade-1314225595 None] will copy from snapshot at /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-6d573221-9dab-4f46-b8d6-92bad7a9a295 {{(pid=84538) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Apr 29 19:02:24 devstack cinder-volume[84538]: DEBUG cinder.volume.drivers.quobyte [None req-4c7a22c4-86b4-4f3a-b146-84ca97990cc6 tempest-VolumesDeleteCascade-1314225595 None] Creating direct copy from snapshot {{(pid=84538) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Apr 29 19:02:24 devstack cinder-volume[84538]: DEBUG oslo.privsep.daemon [-] privsep: reply[764c3979-458d-42fa-a348-1970c544e154]: (4, 'qcow2') {{(pid=85803) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 19:02:24 devstack cinder-volume[84538]: DEBUG oslo_concurrency.processutils [None req-4c7a22c4-86b4-4f3a-b146-84ca97990cc6 tempest-VolumesDeleteCascade-1314225595 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-6d573221-9dab-4f46-b8d6-92bad7a9a295 {{(pid=84538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 19:02:24 devstack sudo[90634]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-6d573221-9dab-4f46-b8d6-92bad7a9a295 Apr 29 19:02:24 devstack sudo[90634]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 19:02:24 devstack cinder-volume[84538]: DEBUG cinder.volume.flows.manager.create_volume [None req-830ffbc5-f512-489e-9e0c-7bc445c9c173 tempest-VolumesListAdminTestJSON-1330364154 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84538) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Apr 29 19:02:24 devstack cinder-volume[84538]: DEBUG cinder.volume.manager [None req-830ffbc5-f512-489e-9e0c-7bc445c9c173 tempest-VolumesListAdminTestJSON-1330364154 None] Flow 'volume_create_manager' (37f8be9a-9aba-4d59-b244-0e58ec66a150) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84538) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 19:02:24 devstack cinder-volume[84538]: DEBUG cinder.volume.manager [None req-830ffbc5-f512-489e-9e0c-7bc445c9c173 tempest-VolumesListAdminTestJSON-1330364154 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (589a0fd0-fc6f-49ad-9fd5-70a497e86946) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 19:02:24 devstack cinder-volume[84538]: DEBUG cinder.volume.manager [None req-830ffbc5-f512-489e-9e0c-7bc445c9c173 tempest-VolumesListAdminTestJSON-1330364154 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (589a0fd0-fc6f-49ad-9fd5-70a497e86946) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-29T17:02:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-1762807751',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=513bd8c0-d0eb-43b0-8bc4-a732f5103962,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e7d888ac4b1a4a90a3d7723e60bd9f36',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T17:02:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T17:02:25Z,use_quota=True,user_id='ff657a7ce8464cd9b8b73cc3a7213188',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(62b05900-93e3-4190-a88f-1d87324303d1),volume_type_id=62b05900-93e3-4190-a88f-1d87324303d1)' {{(pid=84538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 19:02:24 devstack cinder-volume[84538]: DEBUG cinder.volume.manager [None req-830ffbc5-f512-489e-9e0c-7bc445c9c173 tempest-VolumesListAdminTestJSON-1330364154 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f7fe4fb6-8c38-4ade-b360-34d2547a7ce1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 19:02:24 devstack cinder-volume[84538]: DEBUG cinder.volume.manager [None req-830ffbc5-f512-489e-9e0c-7bc445c9c173 tempest-VolumesListAdminTestJSON-1330364154 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f7fe4fb6-8c38-4ade-b360-34d2547a7ce1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 19:02:24 devstack cinder-volume[84538]: DEBUG cinder.volume.manager [None req-830ffbc5-f512-489e-9e0c-7bc445c9c173 tempest-VolumesListAdminTestJSON-1330364154 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1de2a64b-2c80-4abd-a3b2-465717329180) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 19:02:24 devstack cinder-volume[84538]: DEBUG cinder.volume.manager [None req-830ffbc5-f512-489e-9e0c-7bc445c9c173 tempest-VolumesListAdminTestJSON-1330364154 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1de2a64b-2c80-4abd-a3b2-465717329180) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '513bd8c0-d0eb-43b0-8bc4-a732f5103962', 'volume_name': 'volume-513bd8c0-d0eb-43b0-8bc4-a732f5103962', 'volume_size': 1}' {{(pid=84538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 19:02:24 devstack cinder-volume[84538]: DEBUG cinder.volume.manager [None req-830ffbc5-f512-489e-9e0c-7bc445c9c173 tempest-VolumesListAdminTestJSON-1330364154 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cdbe3c04-5634-4b88-881c-a2a92843dc89) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 19:02:24 devstack cinder-volume[84538]: DEBUG cinder.volume.manager [None req-830ffbc5-f512-489e-9e0c-7bc445c9c173 tempest-VolumesListAdminTestJSON-1330364154 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cdbe3c04-5634-4b88-881c-a2a92843dc89) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 19:02:24 devstack cinder-volume[84538]: DEBUG cinder.volume.manager [None req-830ffbc5-f512-489e-9e0c-7bc445c9c173 tempest-VolumesListAdminTestJSON-1330364154 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f4175c23-ebd8-486f-a05d-fe7c4b94bb03) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 19:02:24 devstack cinder-volume[84538]: INFO cinder.volume.flows.manager.create_volume [None req-830ffbc5-f512-489e-9e0c-7bc445c9c173 tempest-VolumesListAdminTestJSON-1330364154 None] Volume 513bd8c0-d0eb-43b0-8bc4-a732f5103962: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-513bd8c0-d0eb-43b0-8bc4-a732f5103962', 'volume_size': 1} Apr 29 19:02:24 devstack cinder-volume[84538]: DEBUG oslo_concurrency.lockutils [None req-830ffbc5-f512-489e-9e0c-7bc445c9c173 tempest-VolumesListAdminTestJSON-1330364154 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 19:02:25 devstack cinder-volume[84538]: DEBUG oslo_service.periodic_task [None req-a93183a6-1080-461c-84de-2fcb210d4f60 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=84538) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}} Apr 29 19:02:25 devstack cinder-volume[84538]: DEBUG oslo_concurrency.lockutils [None req-a93183a6-1080-461c-84de-2fcb210d4f60 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 19:02:25 devstack cinder-volume[84538]: DEBUG oslo_concurrency.lockutils [None req-a93183a6-1080-461c-84de-2fcb210d4f60 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=84538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 19:02:25 devstack cinder-volume[84538]: DEBUG cinder.volume.drivers.quobyte [None req-a93183a6-1080-461c-84de-2fcb210d4f60 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-34312b00-dd6d-45bb-af98-75855cea8e48': None} {{(pid=84538) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 19:02:25 devstack cinder-volume[84538]: DEBUG cinder.volume.drivers.quobyte [None req-a93183a6-1080-461c-84de-2fcb210d4f60 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-34312b00-dd6d-45bb-af98-75855cea8e48'] {{(pid=84538) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 19:02:25 devstack cinder-volume[84538]: DEBUG oslo_concurrency.lockutils [None req-a93183a6-1080-461c-84de-2fcb210d4f60 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=84538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 19:02:25 devstack cinder-volume[84538]: DEBUG oslo_concurrency.processutils [None req-a93183a6-1080-461c-84de-2fcb210d4f60 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d {{(pid=84538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 19:02:25 devstack sudo[90639]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d Apr 29 19:02:25 devstack sudo[90639]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 19:02:25 devstack sudo[90634]: pam_unix(sudo:session): session closed for user root Apr 29 19:02:25 devstack cinder-volume[84538]: DEBUG oslo_concurrency.processutils [None req-4c7a22c4-86b4-4f3a-b146-84ca97990cc6 tempest-VolumesDeleteCascade-1314225595 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-6d573221-9dab-4f46-b8d6-92bad7a9a295" returned: 0 in 0.914s {{(pid=84538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 19:02:25 devstack cinder-volume[84538]: DEBUG cinder.utils [None req-4c7a22c4-86b4-4f3a-b146-84ca97990cc6 tempest-VolumesDeleteCascade-1314225595 None] Path /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-399a0e0a-846a-4fe5-9739-8ce2a71d113f not found in is_blk_device check {{(pid=84538) is_blk_device /opt/stack/cinder/cinder/utils.py:602}} Apr 29 19:02:25 devstack cinder-volume[84538]: DEBUG oslo_concurrency.processutils [None req-4c7a22c4-86b4-4f3a-b146-84ca97990cc6 tempest-VolumesDeleteCascade-1314225595 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-6d573221-9dab-4f46-b8d6-92bad7a9a295 /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-399a0e0a-846a-4fe5-9739-8ce2a71d113f {{(pid=84538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 19:02:25 devstack sudo[90641]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-6d573221-9dab-4f46-b8d6-92bad7a9a295 /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-399a0e0a-846a-4fe5-9739-8ce2a71d113f Apr 29 19:02:25 devstack sudo[90641]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 19:02:25 devstack cinder-volume[84538]: DEBUG cinder.volume.flows.manager.create_volume [None req-05e71b29-b456-49df-9ce7-3747018072a0 tempest-VolumesTransfersV355Test-221499813 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84538) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Apr 29 19:02:25 devstack cinder-volume[84538]: DEBUG cinder.volume.manager [None req-05e71b29-b456-49df-9ce7-3747018072a0 tempest-VolumesTransfersV355Test-221499813 None] Flow 'volume_create_manager' (1ee2cf5c-85fb-40f1-9119-60ba052aa396) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84538) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 19:02:25 devstack cinder-volume[84538]: DEBUG cinder.volume.manager [None req-05e71b29-b456-49df-9ce7-3747018072a0 tempest-VolumesTransfersV355Test-221499813 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (47d1e83f-87b9-40b5-90b7-a6bcc9ab8df0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 19:02:25 devstack cinder-volume[84538]: DEBUG cinder.volume.manager [None req-05e71b29-b456-49df-9ce7-3747018072a0 tempest-VolumesTransfersV355Test-221499813 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (47d1e83f-87b9-40b5-90b7-a6bcc9ab8df0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-29T17:02:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV355Test-Volume-1735532747',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=73667715-4c65-4fc6-8afa-ea4c1c41ce40,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b034658e9ebc4112b38e6a60912fd38d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T17:02:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T17:02:25Z,use_quota=True,user_id='239f349d8f964ca3a6fc8db6ce134079',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(62b05900-93e3-4190-a88f-1d87324303d1),volume_type_id=62b05900-93e3-4190-a88f-1d87324303d1)' {{(pid=84538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 19:02:25 devstack cinder-volume[84538]: DEBUG cinder.volume.manager [None req-05e71b29-b456-49df-9ce7-3747018072a0 tempest-VolumesTransfersV355Test-221499813 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8fdfda7a-aa5d-4889-975b-3d47fc9cd149) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 19:02:25 devstack cinder-volume[84538]: DEBUG cinder.volume.manager [None req-05e71b29-b456-49df-9ce7-3747018072a0 tempest-VolumesTransfersV355Test-221499813 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8fdfda7a-aa5d-4889-975b-3d47fc9cd149) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 19:02:25 devstack cinder-volume[84538]: DEBUG cinder.volume.manager [None req-05e71b29-b456-49df-9ce7-3747018072a0 tempest-VolumesTransfersV355Test-221499813 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (62f4517f-2624-4e2a-941c-f2439fc9aff5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 19:02:25 devstack cinder-volume[84538]: DEBUG cinder.volume.manager [None req-05e71b29-b456-49df-9ce7-3747018072a0 tempest-VolumesTransfersV355Test-221499813 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (62f4517f-2624-4e2a-941c-f2439fc9aff5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '73667715-4c65-4fc6-8afa-ea4c1c41ce40', 'volume_name': 'volume-73667715-4c65-4fc6-8afa-ea4c1c41ce40', 'volume_size': 1}' {{(pid=84538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 19:02:25 devstack cinder-volume[84538]: DEBUG cinder.volume.manager [None req-05e71b29-b456-49df-9ce7-3747018072a0 tempest-VolumesTransfersV355Test-221499813 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6018dcf1-4e90-4ef3-b954-44bd6e51403b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 19:02:25 devstack cinder-volume[84538]: DEBUG cinder.volume.manager [None req-05e71b29-b456-49df-9ce7-3747018072a0 tempest-VolumesTransfersV355Test-221499813 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6018dcf1-4e90-4ef3-b954-44bd6e51403b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 19:02:25 devstack cinder-volume[84538]: DEBUG cinder.volume.manager [None req-05e71b29-b456-49df-9ce7-3747018072a0 tempest-VolumesTransfersV355Test-221499813 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (db090ea3-1752-407e-8207-059953b3dcb7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 19:02:25 devstack cinder-volume[84538]: INFO cinder.volume.flows.manager.create_volume [None req-05e71b29-b456-49df-9ce7-3747018072a0 tempest-VolumesTransfersV355Test-221499813 None] Volume 73667715-4c65-4fc6-8afa-ea4c1c41ce40: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-73667715-4c65-4fc6-8afa-ea4c1c41ce40', 'volume_size': 1} Apr 29 19:02:25 devstack cinder-volume[84538]: DEBUG oslo_concurrency.lockutils [None req-05e71b29-b456-49df-9ce7-3747018072a0 tempest-VolumesTransfersV355Test-221499813 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 19:02:25 devstack cinder-volume[84538]: INFO cinder.volume.manager [None req-e3f202f4-782c-418e-8cd9-c06dce6178b1 tempest-GroupsV320Test-1430657874 None] Group tempest-GroupsV320Test-Group-445933183: creating Apr 29 19:02:25 devstack cinder-volume[84538]: INFO cinder.volume.manager [None req-e3f202f4-782c-418e-8cd9-c06dce6178b1 tempest-GroupsV320Test-1430657874 None] Group tempest-GroupsV320Test-Group-445933183: created successfully Apr 29 19:02:25 devstack cinder-volume[84538]: INFO cinder.volume.manager [None req-e3f202f4-782c-418e-8cd9-c06dce6178b1 tempest-GroupsV320Test-1430657874 None] Create group completed successfully. Apr 29 19:02:25 devstack sudo[90639]: pam_unix(sudo:session): session closed for user root Apr 29 19:02:25 devstack cinder-volume[84538]: DEBUG oslo_concurrency.processutils [None req-a93183a6-1080-461c-84de-2fcb210d4f60 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d" returned: 0 in 0.731s {{(pid=84538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 19:02:25 devstack cinder-volume[84538]: DEBUG cinder.manager [None req-a93183a6-1080-461c-84de-2fcb210d4f60 None None] Notifying Schedulers of capabilities ... {{(pid=84538) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 29 19:02:27 devstack cinder-volume[84538]: DEBUG cinder.quota [None req-4e6e348c-4068-4652-bc51-2f0db4fdbb56 tempest-GroupsV320Test-1430657874 None] Created reservations ['c397f3aa-3369-4612-8f8a-9784f720449e'] {{(pid=84538) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 29 19:02:27 devstack cinder-volume[84538]: DEBUG oslo_concurrency.lockutils [None req-4e6e348c-4068-4652-bc51-2f0db4fdbb56 tempest-GroupsV320Test-1430657874 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 19:02:27 devstack cinder-volume[84538]: DEBUG oslo_concurrency.lockutils [None req-4e6e348c-4068-4652-bc51-2f0db4fdbb56 tempest-GroupsV320Test-1430657874 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=84538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 19:02:27 devstack cinder-volume[84538]: DEBUG cinder.volume.drivers.quobyte [None req-4e6e348c-4068-4652-bc51-2f0db4fdbb56 tempest-GroupsV320Test-1430657874 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-34312b00-dd6d-45bb-af98-75855cea8e48': None} {{(pid=84538) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 19:02:27 devstack cinder-volume[84538]: DEBUG cinder.volume.drivers.quobyte [None req-4e6e348c-4068-4652-bc51-2f0db4fdbb56 tempest-GroupsV320Test-1430657874 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-34312b00-dd6d-45bb-af98-75855cea8e48'] {{(pid=84538) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 19:02:27 devstack cinder-volume[84538]: DEBUG oslo_concurrency.lockutils [None req-4e6e348c-4068-4652-bc51-2f0db4fdbb56 tempest-GroupsV320Test-1430657874 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.036s {{(pid=84538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 19:02:27 devstack cinder-volume[84538]: DEBUG oslo_concurrency.processutils [None req-4e6e348c-4068-4652-bc51-2f0db4fdbb56 tempest-GroupsV320Test-1430657874 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d {{(pid=84538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 19:02:27 devstack sudo[90654]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d Apr 29 19:02:27 devstack sudo[90654]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 19:02:29 devstack sudo[90654]: pam_unix(sudo:session): session closed for user root Apr 29 19:02:29 devstack cinder-volume[84538]: DEBUG oslo_concurrency.processutils [None req-4e6e348c-4068-4652-bc51-2f0db4fdbb56 tempest-GroupsV320Test-1430657874 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d" returned: 0 in 1.725s {{(pid=84538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 19:02:29 devstack cinder-volume[84538]: DEBUG cinder.manager [None req-4e6e348c-4068-4652-bc51-2f0db4fdbb56 tempest-GroupsV320Test-1430657874 None] Notifying Schedulers of capabilities ... {{(pid=84538) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 29 19:02:29 devstack cinder-volume[84538]: INFO cinder.volume.manager [None req-4e6e348c-4068-4652-bc51-2f0db4fdbb56 tempest-GroupsV320Test-1430657874 None] Delete group completed successfully. Apr 29 19:02:30 devstack sudo[90641]: pam_unix(sudo:session): session closed for user root Apr 29 19:02:30 devstack cinder-volume[84538]: DEBUG oslo_concurrency.processutils [None req-4c7a22c4-86b4-4f3a-b146-84ca97990cc6 tempest-VolumesDeleteCascade-1314225595 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-6d573221-9dab-4f46-b8d6-92bad7a9a295 /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-399a0e0a-846a-4fe5-9739-8ce2a71d113f" returned: 0 in 5.373s {{(pid=84538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 19:02:30 devstack cinder-volume[84538]: DEBUG oslo.privsep.daemon [-] privsep: reply[2f1606bf-c388-444f-9037-ec5e4f518cd8]: (4, 'qcow2') {{(pid=85803) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 19:02:30 devstack cinder-volume[84538]: DEBUG oslo_concurrency.processutils [None req-4c7a22c4-86b4-4f3a-b146-84ca97990cc6 tempest-VolumesDeleteCascade-1314225595 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-6d573221-9dab-4f46-b8d6-92bad7a9a295 {{(pid=84538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 19:02:30 devstack sudo[90659]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-6d573221-9dab-4f46-b8d6-92bad7a9a295 Apr 29 19:02:30 devstack sudo[90659]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 19:02:31 devstack sudo[90659]: pam_unix(sudo:session): session closed for user root Apr 29 19:02:31 devstack cinder-volume[84538]: DEBUG oslo_concurrency.processutils [None req-4c7a22c4-86b4-4f3a-b146-84ca97990cc6 tempest-VolumesDeleteCascade-1314225595 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-6d573221-9dab-4f46-b8d6-92bad7a9a295" returned: 0 in 0.919s {{(pid=84538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 19:02:31 devstack cinder-volume[84538]: DEBUG cinder.image.image_utils [None req-4c7a22c4-86b4-4f3a-b146-84ca97990cc6 tempest-VolumesDeleteCascade-1314225595 None] Image conversion details: src /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-6d573221-9dab-4f46-b8d6-92bad7a9a295, size 1024.00 MB, duration 5.37 sec, destination /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-399a0e0a-846a-4fe5-9739-8ce2a71d113f {{(pid=84538) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}} Apr 29 19:02:31 devstack cinder-volume[84538]: INFO cinder.image.image_utils [None req-4c7a22c4-86b4-4f3a-b146-84ca97990cc6 tempest-VolumesDeleteCascade-1314225595 None] Converted 1024.00 MB image at 190.53 MB/s Apr 29 19:02:31 devstack cinder-volume[84538]: WARNING cinder.volume.drivers.remotefs [None req-4c7a22c4-86b4-4f3a-b146-84ca97990cc6 tempest-VolumesDeleteCascade-1314225595 None] /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-399a0e0a-846a-4fe5-9739-8ce2a71d113f is being set with open permissions: ugo+rw Apr 29 19:02:31 devstack cinder-volume[84538]: DEBUG oslo_concurrency.processutils [None req-4c7a22c4-86b4-4f3a-b146-84ca97990cc6 tempest-VolumesDeleteCascade-1314225595 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-399a0e0a-846a-4fe5-9739-8ce2a71d113f {{(pid=84538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 19:02:31 devstack sudo[90664]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-399a0e0a-846a-4fe5-9739-8ce2a71d113f Apr 29 19:02:31 devstack sudo[90664]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 19:02:32 devstack sudo[90664]: pam_unix(sudo:session): session closed for user root Apr 29 19:02:32 devstack cinder-volume[84538]: DEBUG oslo_concurrency.processutils [None req-4c7a22c4-86b4-4f3a-b146-84ca97990cc6 tempest-VolumesDeleteCascade-1314225595 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-399a0e0a-846a-4fe5-9739-8ce2a71d113f" returned: 0 in 0.611s {{(pid=84538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 19:02:32 devstack cinder-volume[84538]: DEBUG cinder.coordination [None req-4c7a22c4-86b4-4f3a-b146-84ca97990cc6 tempest-VolumesDeleteCascade-1314225595 None] Lock "cinder-quobyte-399a0e0a-846a-4fe5-9739-8ce2a71d113f" released by "_copy_volume_from_snapshot" :: held 8.700s {{(pid=84538) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 19:02:32 devstack cinder-volume[84538]: DEBUG cinder.coordination [None req-4c7a22c4-86b4-4f3a-b146-84ca97990cc6 tempest-VolumesDeleteCascade-1314225595 None] Lock "cinder-quobyte-a6f70eaf-8289-42b0-8ac0-7f1c5c105985-399a0e0a-846a-4fe5-9739-8ce2a71d113f" released by "_create_volume_from_snapshot" :: held 8.740s {{(pid=84538) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 19:02:32 devstack cinder-volume[84538]: DEBUG oslo_concurrency.lockutils [None req-4c7a22c4-86b4-4f3a-b146-84ca97990cc6 tempest-VolumesDeleteCascade-1314225595 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 8.782s {{(pid=84538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 19:02:32 devstack cinder-volume[84538]: DEBUG oslo_concurrency.lockutils [None req-830ffbc5-f512-489e-9e0c-7bc445c9c173 tempest-VolumesListAdminTestJSON-1330364154 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 7.153s {{(pid=84538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 19:02:32 devstack cinder-volume[84538]: DEBUG cinder.volume.drivers.quobyte [None req-830ffbc5-f512-489e-9e0c-7bc445c9c173 tempest-VolumesListAdminTestJSON-1330364154 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-29T17:02:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-1762807751',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=513bd8c0-d0eb-43b0-8bc4-a732f5103962,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e7d888ac4b1a4a90a3d7723e60bd9f36',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T17:02:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T17:02:25Z,use_quota=True,user_id='ff657a7ce8464cd9b8b73cc3a7213188',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(62b05900-93e3-4190-a88f-1d87324303d1),volume_type_id=62b05900-93e3-4190-a88f-1d87324303d1)}" {{(pid=84538) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 29 19:02:32 devstack cinder-volume[84538]: DEBUG cinder.volume.drivers.remotefs [None req-830ffbc5-f512-489e-9e0c-7bc445c9c173 tempest-VolumesListAdminTestJSON-1330364154 None] Creating volume 513bd8c0-d0eb-43b0-8bc4-a732f5103962 {{(pid=84538) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 29 19:02:32 devstack cinder-volume[84538]: DEBUG oslo_concurrency.lockutils [None req-830ffbc5-f512-489e-9e0c-7bc445c9c173 tempest-VolumesListAdminTestJSON-1330364154 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 19:02:32 devstack cinder-volume[84538]: DEBUG oslo_concurrency.lockutils [None req-830ffbc5-f512-489e-9e0c-7bc445c9c173 tempest-VolumesListAdminTestJSON-1330364154 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 19:02:32 devstack cinder-volume[84538]: DEBUG cinder.volume.drivers.quobyte [None req-830ffbc5-f512-489e-9e0c-7bc445c9c173 tempest-VolumesListAdminTestJSON-1330364154 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-34312b00-dd6d-45bb-af98-75855cea8e48': None} {{(pid=84538) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 19:02:32 devstack cinder-volume[84538]: DEBUG cinder.volume.drivers.quobyte [None req-830ffbc5-f512-489e-9e0c-7bc445c9c173 tempest-VolumesListAdminTestJSON-1330364154 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-34312b00-dd6d-45bb-af98-75855cea8e48'] {{(pid=84538) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 19:02:32 devstack cinder-volume[84538]: DEBUG oslo_concurrency.lockutils [None req-830ffbc5-f512-489e-9e0c-7bc445c9c173 tempest-VolumesListAdminTestJSON-1330364154 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=84538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 19:02:32 devstack cinder-volume[84538]: DEBUG cinder.volume.drivers.quobyte [None req-830ffbc5-f512-489e-9e0c-7bc445c9c173 tempest-VolumesListAdminTestJSON-1330364154 None] Selected osci02.corp.quobyte.com/cinder-vol-34312b00-dd6d-45bb-af98-75855cea8e48 as target Quobyte volume. {{(pid=84538) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 29 19:02:32 devstack cinder-volume[84538]: INFO cinder.volume.drivers.remotefs [None req-830ffbc5-f512-489e-9e0c-7bc445c9c173 tempest-VolumesListAdminTestJSON-1330364154 None] casted to osci02.corp.quobyte.com/cinder-vol-34312b00-dd6d-45bb-af98-75855cea8e48 Apr 29 19:02:32 devstack cinder-volume[84538]: DEBUG oslo_concurrency.processutils [None req-830ffbc5-f512-489e-9e0c-7bc445c9c173 tempest-VolumesListAdminTestJSON-1330364154 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-513bd8c0-d0eb-43b0-8bc4-a732f5103962 1073741824 {{(pid=84538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 19:02:32 devstack sudo[90667]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-513bd8c0-d0eb-43b0-8bc4-a732f5103962 1073741824 Apr 29 19:02:32 devstack sudo[90667]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 19:02:32 devstack cinder-volume[84538]: DEBUG cinder.volume.manager [None req-4c7a22c4-86b4-4f3a-b146-84ca97990cc6 tempest-VolumesDeleteCascade-1314225595 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (10e3eaa5-8c47-453d-b209-23c6e8b1a914) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-399a0e0a-846a-4fe5-9739-8ce2a71d113f', 'volume_size': 1, 'snapshot_id': 'a6f70eaf-8289-42b0-8ac0-7f1c5c105985'}' {{(pid=84538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 19:02:32 devstack cinder-volume[84538]: DEBUG cinder.volume.manager [None req-4c7a22c4-86b4-4f3a-b146-84ca97990cc6 tempest-VolumesDeleteCascade-1314225595 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bc1dbd1e-3eac-44dc-a8f5-6d9140f4b589) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 19:02:32 devstack cinder-volume[84538]: INFO cinder.volume.flows.manager.create_volume [None req-4c7a22c4-86b4-4f3a-b146-84ca97990cc6 tempest-VolumesDeleteCascade-1314225595 None] Volume volume-399a0e0a-846a-4fe5-9739-8ce2a71d113f (399a0e0a-846a-4fe5-9739-8ce2a71d113f): created successfully Apr 29 19:02:32 devstack cinder-volume[84538]: DEBUG cinder.volume.manager [None req-4c7a22c4-86b4-4f3a-b146-84ca97990cc6 tempest-VolumesDeleteCascade-1314225595 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bc1dbd1e-3eac-44dc-a8f5-6d9140f4b589) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 19:02:32 devstack cinder-volume[84538]: DEBUG cinder.volume.manager [None req-4c7a22c4-86b4-4f3a-b146-84ca97990cc6 tempest-VolumesDeleteCascade-1314225595 None] Flow 'volume_create_manager' (737658e7-ea7e-4890-854c-ffe7e851e14e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84538) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 19:02:32 devstack cinder-volume[84538]: INFO cinder.volume.manager [None req-4c7a22c4-86b4-4f3a-b146-84ca97990cc6 tempest-VolumesDeleteCascade-1314225595 None] Created volume successfully. Apr 29 19:02:32 devstack sudo[90667]: pam_unix(sudo:session): session closed for user root Apr 29 19:02:32 devstack cinder-volume[84538]: DEBUG oslo_concurrency.processutils [None req-830ffbc5-f512-489e-9e0c-7bc445c9c173 tempest-VolumesListAdminTestJSON-1330364154 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-513bd8c0-d0eb-43b0-8bc4-a732f5103962 1073741824" returned: 0 in 0.799s {{(pid=84538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 19:02:33 devstack cinder-volume[84538]: DEBUG oslo_concurrency.processutils [None req-830ffbc5-f512-489e-9e0c-7bc445c9c173 tempest-VolumesListAdminTestJSON-1330364154 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-513bd8c0-d0eb-43b0-8bc4-a732f5103962 {{(pid=84538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 19:02:33 devstack sudo[90673]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-513bd8c0-d0eb-43b0-8bc4-a732f5103962 Apr 29 19:02:33 devstack sudo[90673]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 19:02:33 devstack cinder-volume[84538]: DEBUG cinder.coordination [None req-592c924c-002f-46c3-b6ec-ff346276926e tempest-VolumesDeleteCascade-1314225595 None] Acquiring lock "cinder-6d573221-9dab-4f46-b8d6-92bad7a9a295-delete_volume" by "delete_volume" {{(pid=84538) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 19:02:33 devstack cinder-volume[84538]: DEBUG cinder.coordination [None req-592c924c-002f-46c3-b6ec-ff346276926e tempest-VolumesDeleteCascade-1314225595 None] Lock "cinder-6d573221-9dab-4f46-b8d6-92bad7a9a295-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=84538) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 19:02:33 devstack cinder-volume[84538]: DEBUG cinder.volume.manager [None req-592c924c-002f-46c3-b6ec-ff346276926e tempest-VolumesDeleteCascade-1314225595 None] Performing cascade delete. {{(pid=84538) delete_volume /opt/stack/cinder/cinder/volume/manager.py:995}} Apr 29 19:02:33 devstack cinder-volume[84538]: DEBUG cinder.coordination [None req-592c924c-002f-46c3-b6ec-ff346276926e tempest-VolumesDeleteCascade-1314225595 None] Acquiring lock "cinder-a6f70eaf-8289-42b0-8ac0-7f1c5c105985-delete_snapshot" by "delete_snapshot" {{(pid=84538) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 19:02:33 devstack cinder-volume[84538]: DEBUG cinder.coordination [None req-592c924c-002f-46c3-b6ec-ff346276926e tempest-VolumesDeleteCascade-1314225595 None] Lock "cinder-a6f70eaf-8289-42b0-8ac0-7f1c5c105985-delete_snapshot" acquired by "delete_snapshot" :: waited 0.019s {{(pid=84538) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 19:02:33 devstack cinder-volume[84538]: DEBUG cinder.coordination [None req-592c924c-002f-46c3-b6ec-ff346276926e tempest-VolumesDeleteCascade-1314225595 None] Acquiring lock "cinder-quobyte-6d573221-9dab-4f46-b8d6-92bad7a9a295" by "delete_snapshot" {{(pid=84538) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 19:02:33 devstack cinder-volume[84538]: DEBUG cinder.coordination [None req-592c924c-002f-46c3-b6ec-ff346276926e tempest-VolumesDeleteCascade-1314225595 None] Lock "cinder-quobyte-6d573221-9dab-4f46-b8d6-92bad7a9a295" acquired by "delete_snapshot" :: waited 0.015s {{(pid=84538) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 19:02:33 devstack cinder-volume[84538]: DEBUG cinder.coordination [None req-592c924c-002f-46c3-b6ec-ff346276926e tempest-VolumesDeleteCascade-1314225595 None] Acquiring lock "cinder-quobyte-a6f70eaf-8289-42b0-8ac0-7f1c5c105985" by "_delete_snapshot" {{(pid=84538) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 19:02:33 devstack cinder-volume[84538]: DEBUG cinder.coordination [None req-592c924c-002f-46c3-b6ec-ff346276926e tempest-VolumesDeleteCascade-1314225595 None] Lock "cinder-quobyte-a6f70eaf-8289-42b0-8ac0-7f1c5c105985" acquired by "_delete_snapshot" :: waited 0.016s {{(pid=84538) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 19:02:33 devstack cinder-volume[84538]: DEBUG cinder.volume.drivers.remotefs [None req-592c924c-002f-46c3-b6ec-ff346276926e tempest-VolumesDeleteCascade-1314225595 None] Deleting offline snapshot a6f70eaf-8289-42b0-8ac0-7f1c5c105985 of volume 6d573221-9dab-4f46-b8d6-92bad7a9a295 {{(pid=84538) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 29 19:02:33 devstack cinder-volume[84538]: DEBUG cinder.volume.drivers.remotefs [None req-592c924c-002f-46c3-b6ec-ff346276926e tempest-VolumesDeleteCascade-1314225595 None] snapshot_file for this snap is: volume-6d573221-9dab-4f46-b8d6-92bad7a9a295.a6f70eaf-8289-42b0-8ac0-7f1c5c105985 {{(pid=84538) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 29 19:02:33 devstack cinder-volume[84538]: DEBUG oslo.privsep.daemon [-] privsep: reply[6e73387b-17d9-4d8e-aac7-f4735d59a88c]: (4, 'qcow2') {{(pid=85803) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 19:02:33 devstack cinder-volume[84538]: DEBUG oslo_concurrency.processutils [None req-592c924c-002f-46c3-b6ec-ff346276926e tempest-VolumesDeleteCascade-1314225595 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-6d573221-9dab-4f46-b8d6-92bad7a9a295.a6f70eaf-8289-42b0-8ac0-7f1c5c105985 {{(pid=84538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 19:02:33 devstack sudo[90675]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-6d573221-9dab-4f46-b8d6-92bad7a9a295.a6f70eaf-8289-42b0-8ac0-7f1c5c105985 Apr 29 19:02:33 devstack sudo[90675]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 19:02:33 devstack sudo[90673]: pam_unix(sudo:session): session closed for user root Apr 29 19:02:33 devstack cinder-volume[84538]: DEBUG oslo_concurrency.processutils [None req-830ffbc5-f512-489e-9e0c-7bc445c9c173 tempest-VolumesListAdminTestJSON-1330364154 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-513bd8c0-d0eb-43b0-8bc4-a732f5103962" returned: 0 in 0.630s {{(pid=84538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 19:02:33 devstack cinder-volume[84538]: DEBUG cinder.volume.drivers.quobyte [None req-830ffbc5-f512-489e-9e0c-7bc445c9c173 tempest-VolumesListAdminTestJSON-1330364154 None] <== create_volume: return (1502ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-34312b00-dd6d-45bb-af98-75855cea8e48'} {{(pid=84538) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 29 19:02:33 devstack cinder-volume[84538]: DEBUG oslo_concurrency.lockutils [None req-830ffbc5-f512-489e-9e0c-7bc445c9c173 tempest-VolumesListAdminTestJSON-1330364154 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.506s {{(pid=84538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 19:02:33 devstack cinder-volume[84538]: DEBUG oslo_concurrency.lockutils [None req-05e71b29-b456-49df-9ce7-3747018072a0 tempest-VolumesTransfersV355Test-221499813 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 8.303s {{(pid=84538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 19:02:33 devstack cinder-volume[84538]: DEBUG cinder.volume.drivers.quobyte [None req-05e71b29-b456-49df-9ce7-3747018072a0 tempest-VolumesTransfersV355Test-221499813 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-29T17:02:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV355Test-Volume-1735532747',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=73667715-4c65-4fc6-8afa-ea4c1c41ce40,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b034658e9ebc4112b38e6a60912fd38d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T17:02:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T17:02:25Z,use_quota=True,user_id='239f349d8f964ca3a6fc8db6ce134079',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(62b05900-93e3-4190-a88f-1d87324303d1),volume_type_id=62b05900-93e3-4190-a88f-1d87324303d1)}" {{(pid=84538) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 29 19:02:33 devstack cinder-volume[84538]: DEBUG cinder.volume.drivers.remotefs [None req-05e71b29-b456-49df-9ce7-3747018072a0 tempest-VolumesTransfersV355Test-221499813 None] Creating volume 73667715-4c65-4fc6-8afa-ea4c1c41ce40 {{(pid=84538) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 29 19:02:33 devstack cinder-volume[84538]: DEBUG oslo_concurrency.lockutils [None req-05e71b29-b456-49df-9ce7-3747018072a0 tempest-VolumesTransfersV355Test-221499813 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 19:02:33 devstack cinder-volume[84538]: DEBUG oslo_concurrency.lockutils [None req-05e71b29-b456-49df-9ce7-3747018072a0 tempest-VolumesTransfersV355Test-221499813 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 19:02:33 devstack cinder-volume[84538]: DEBUG cinder.volume.drivers.quobyte [None req-05e71b29-b456-49df-9ce7-3747018072a0 tempest-VolumesTransfersV355Test-221499813 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-34312b00-dd6d-45bb-af98-75855cea8e48': None} {{(pid=84538) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 19:02:33 devstack cinder-volume[84538]: DEBUG cinder.volume.drivers.quobyte [None req-05e71b29-b456-49df-9ce7-3747018072a0 tempest-VolumesTransfersV355Test-221499813 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-34312b00-dd6d-45bb-af98-75855cea8e48'] {{(pid=84538) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 19:02:33 devstack cinder-volume[84538]: DEBUG oslo_concurrency.lockutils [None req-05e71b29-b456-49df-9ce7-3747018072a0 tempest-VolumesTransfersV355Test-221499813 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=84538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 19:02:33 devstack cinder-volume[84538]: DEBUG cinder.volume.drivers.quobyte [None req-05e71b29-b456-49df-9ce7-3747018072a0 tempest-VolumesTransfersV355Test-221499813 None] Selected osci02.corp.quobyte.com/cinder-vol-34312b00-dd6d-45bb-af98-75855cea8e48 as target Quobyte volume. {{(pid=84538) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 29 19:02:33 devstack cinder-volume[84538]: INFO cinder.volume.drivers.remotefs [None req-05e71b29-b456-49df-9ce7-3747018072a0 tempest-VolumesTransfersV355Test-221499813 None] casted to osci02.corp.quobyte.com/cinder-vol-34312b00-dd6d-45bb-af98-75855cea8e48 Apr 29 19:02:33 devstack cinder-volume[84538]: DEBUG oslo_concurrency.processutils [None req-05e71b29-b456-49df-9ce7-3747018072a0 tempest-VolumesTransfersV355Test-221499813 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-73667715-4c65-4fc6-8afa-ea4c1c41ce40 1073741824 {{(pid=84538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 19:02:33 devstack sudo[90678]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-73667715-4c65-4fc6-8afa-ea4c1c41ce40 1073741824 Apr 29 19:02:33 devstack sudo[90678]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 19:02:33 devstack cinder-volume[84538]: DEBUG cinder.volume.manager [None req-830ffbc5-f512-489e-9e0c-7bc445c9c173 tempest-VolumesListAdminTestJSON-1330364154 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f4175c23-ebd8-486f-a05d-fe7c4b94bb03) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-513bd8c0-d0eb-43b0-8bc4-a732f5103962', 'volume_size': 1}' {{(pid=84538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 19:02:33 devstack cinder-volume[84538]: DEBUG cinder.volume.manager [None req-830ffbc5-f512-489e-9e0c-7bc445c9c173 tempest-VolumesListAdminTestJSON-1330364154 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f84646e0-74ea-4ee3-9fdc-8abd02bdfa58) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 19:02:33 devstack cinder-volume[84538]: DEBUG dbcounter [-] [84538] Writing DB stats cinder:SELECT=121,cinder:UPDATE=159,cinder:INSERT=36,cinder:DELETE=8 {{(pid=84538) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Apr 29 19:02:33 devstack cinder-volume[84538]: INFO cinder.volume.flows.manager.create_volume [None req-830ffbc5-f512-489e-9e0c-7bc445c9c173 tempest-VolumesListAdminTestJSON-1330364154 None] Volume volume-513bd8c0-d0eb-43b0-8bc4-a732f5103962 (513bd8c0-d0eb-43b0-8bc4-a732f5103962): created successfully Apr 29 19:02:33 devstack cinder-volume[84538]: DEBUG cinder.volume.manager [None req-830ffbc5-f512-489e-9e0c-7bc445c9c173 tempest-VolumesListAdminTestJSON-1330364154 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f84646e0-74ea-4ee3-9fdc-8abd02bdfa58) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 19:02:33 devstack cinder-volume[84538]: DEBUG cinder.volume.manager [None req-830ffbc5-f512-489e-9e0c-7bc445c9c173 tempest-VolumesListAdminTestJSON-1330364154 None] Flow 'volume_create_manager' (37f8be9a-9aba-4d59-b244-0e58ec66a150) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84538) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 19:02:33 devstack cinder-volume[84538]: DEBUG dbcounter [-] [84538] Writing DB stats cinder:SELECT=160,cinder:UPDATE=147,cinder:INSERT=37,cinder:DELETE=10 {{(pid=84538) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Apr 29 19:02:33 devstack cinder-volume[84538]: INFO cinder.volume.manager [None req-830ffbc5-f512-489e-9e0c-7bc445c9c173 tempest-VolumesListAdminTestJSON-1330364154 None] Created volume successfully. Apr 29 19:02:34 devstack sudo[90675]: pam_unix(sudo:session): session closed for user root Apr 29 19:02:34 devstack cinder-volume[84538]: DEBUG oslo_concurrency.processutils [None req-592c924c-002f-46c3-b6ec-ff346276926e tempest-VolumesDeleteCascade-1314225595 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-6d573221-9dab-4f46-b8d6-92bad7a9a295.a6f70eaf-8289-42b0-8ac0-7f1c5c105985" returned: 0 in 0.821s {{(pid=84538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 19:02:34 devstack cinder-volume[84538]: DEBUG cinder.volume.drivers.remotefs [None req-592c924c-002f-46c3-b6ec-ff346276926e tempest-VolumesDeleteCascade-1314225595 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-6d573221-9dab-4f46-b8d6-92bad7a9a295(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=84538) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 29 19:02:34 devstack cinder-volume[84538]: DEBUG oslo.privsep.daemon [-] privsep: reply[36eb56ab-b2c8-4a06-9315-ad1b6a7633ce]: (4, 'qcow2') {{(pid=85803) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 19:02:34 devstack cinder-volume[84538]: DEBUG oslo_concurrency.processutils [None req-592c924c-002f-46c3-b6ec-ff346276926e tempest-VolumesDeleteCascade-1314225595 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-6d573221-9dab-4f46-b8d6-92bad7a9a295 {{(pid=84538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 19:02:34 devstack sudo[90686]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-6d573221-9dab-4f46-b8d6-92bad7a9a295 Apr 29 19:02:34 devstack sudo[90686]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 19:02:34 devstack sudo[90678]: pam_unix(sudo:session): session closed for user root Apr 29 19:02:34 devstack cinder-volume[84538]: DEBUG oslo_concurrency.processutils [None req-05e71b29-b456-49df-9ce7-3747018072a0 tempest-VolumesTransfersV355Test-221499813 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-73667715-4c65-4fc6-8afa-ea4c1c41ce40 1073741824" returned: 0 in 0.915s {{(pid=84538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 19:02:34 devstack cinder-volume[84538]: DEBUG oslo_concurrency.processutils [None req-05e71b29-b456-49df-9ce7-3747018072a0 tempest-VolumesTransfersV355Test-221499813 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-73667715-4c65-4fc6-8afa-ea4c1c41ce40 {{(pid=84538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 19:02:34 devstack sudo[90689]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-73667715-4c65-4fc6-8afa-ea4c1c41ce40 Apr 29 19:02:34 devstack sudo[90689]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 19:02:35 devstack sudo[90686]: pam_unix(sudo:session): session closed for user root Apr 29 19:02:35 devstack cinder-volume[84538]: DEBUG oslo_concurrency.processutils [None req-592c924c-002f-46c3-b6ec-ff346276926e tempest-VolumesDeleteCascade-1314225595 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-6d573221-9dab-4f46-b8d6-92bad7a9a295" returned: 0 in 0.900s {{(pid=84538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 19:02:35 devstack cinder-volume[84538]: DEBUG oslo_concurrency.processutils [None req-592c924c-002f-46c3-b6ec-ff346276926e tempest-VolumesDeleteCascade-1314225595 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-6d573221-9dab-4f46-b8d6-92bad7a9a295.a6f70eaf-8289-42b0-8ac0-7f1c5c105985 {{(pid=84538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 19:02:35 devstack sudo[90695]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-6d573221-9dab-4f46-b8d6-92bad7a9a295.a6f70eaf-8289-42b0-8ac0-7f1c5c105985 Apr 29 19:02:35 devstack cinder-volume[84538]: DEBUG cinder.volume.flows.manager.create_volume [None req-0cb3f522-51c3-40d0-9bc1-339a0b1e2145 tempest-VolumesListAdminTestJSON-1330364154 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84538) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Apr 29 19:02:35 devstack sudo[90695]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 19:02:35 devstack cinder-volume[84538]: DEBUG cinder.volume.manager [None req-0cb3f522-51c3-40d0-9bc1-339a0b1e2145 tempest-VolumesListAdminTestJSON-1330364154 None] Flow 'volume_create_manager' (680133d0-2e66-43e7-b985-bc41ee9ff7e1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84538) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 19:02:35 devstack cinder-volume[84538]: DEBUG cinder.volume.manager [None req-0cb3f522-51c3-40d0-9bc1-339a0b1e2145 tempest-VolumesListAdminTestJSON-1330364154 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (788ff3e2-9893-42af-a7d7-1badd6e9857d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 19:02:35 devstack cinder-volume[84538]: DEBUG cinder.volume.manager [None req-0cb3f522-51c3-40d0-9bc1-339a0b1e2145 tempest-VolumesListAdminTestJSON-1330364154 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (788ff3e2-9893-42af-a7d7-1badd6e9857d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-29T17:02:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-1683733241',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1da7fd8e-b647-42bc-9f29-3bd44f1bc326,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e7d888ac4b1a4a90a3d7723e60bd9f36',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T17:02:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T17:02:35Z,use_quota=True,user_id='ff657a7ce8464cd9b8b73cc3a7213188',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(62b05900-93e3-4190-a88f-1d87324303d1),volume_type_id=62b05900-93e3-4190-a88f-1d87324303d1)' {{(pid=84538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 19:02:35 devstack cinder-volume[84538]: DEBUG cinder.volume.manager [None req-0cb3f522-51c3-40d0-9bc1-339a0b1e2145 tempest-VolumesListAdminTestJSON-1330364154 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4aae25bf-37e0-4128-adb8-2483948ef114) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 19:02:35 devstack cinder-volume[84538]: DEBUG cinder.volume.manager [None req-0cb3f522-51c3-40d0-9bc1-339a0b1e2145 tempest-VolumesListAdminTestJSON-1330364154 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4aae25bf-37e0-4128-adb8-2483948ef114) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 19:02:35 devstack cinder-volume[84538]: DEBUG cinder.volume.manager [None req-0cb3f522-51c3-40d0-9bc1-339a0b1e2145 tempest-VolumesListAdminTestJSON-1330364154 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6d08f45c-17cd-4714-b4ae-e06dc3ccd62f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 19:02:35 devstack cinder-volume[84538]: DEBUG cinder.volume.manager [None req-0cb3f522-51c3-40d0-9bc1-339a0b1e2145 tempest-VolumesListAdminTestJSON-1330364154 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6d08f45c-17cd-4714-b4ae-e06dc3ccd62f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1da7fd8e-b647-42bc-9f29-3bd44f1bc326', 'volume_name': 'volume-1da7fd8e-b647-42bc-9f29-3bd44f1bc326', 'volume_size': 1}' {{(pid=84538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 19:02:35 devstack cinder-volume[84538]: DEBUG cinder.volume.manager [None req-0cb3f522-51c3-40d0-9bc1-339a0b1e2145 tempest-VolumesListAdminTestJSON-1330364154 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2056edf0-a86b-4c81-9182-e4c6abe98ec7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 19:02:35 devstack cinder-volume[84538]: DEBUG cinder.volume.manager [None req-0cb3f522-51c3-40d0-9bc1-339a0b1e2145 tempest-VolumesListAdminTestJSON-1330364154 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2056edf0-a86b-4c81-9182-e4c6abe98ec7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 19:02:35 devstack cinder-volume[84538]: DEBUG cinder.volume.manager [None req-0cb3f522-51c3-40d0-9bc1-339a0b1e2145 tempest-VolumesListAdminTestJSON-1330364154 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6bbefe91-2426-42e0-841b-457f295cc8d9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 19:02:35 devstack cinder-volume[84538]: INFO cinder.volume.flows.manager.create_volume [None req-0cb3f522-51c3-40d0-9bc1-339a0b1e2145 tempest-VolumesListAdminTestJSON-1330364154 None] Volume 1da7fd8e-b647-42bc-9f29-3bd44f1bc326: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1da7fd8e-b647-42bc-9f29-3bd44f1bc326', 'volume_size': 1} Apr 29 19:02:35 devstack cinder-volume[84538]: DEBUG oslo_concurrency.lockutils [None req-0cb3f522-51c3-40d0-9bc1-339a0b1e2145 tempest-VolumesListAdminTestJSON-1330364154 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 19:02:35 devstack sudo[90689]: pam_unix(sudo:session): session closed for user root Apr 29 19:02:35 devstack cinder-volume[84538]: DEBUG oslo_concurrency.processutils [None req-05e71b29-b456-49df-9ce7-3747018072a0 tempest-VolumesTransfersV355Test-221499813 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-73667715-4c65-4fc6-8afa-ea4c1c41ce40" returned: 0 in 0.716s {{(pid=84538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 19:02:35 devstack cinder-volume[84538]: DEBUG cinder.volume.drivers.quobyte [None req-05e71b29-b456-49df-9ce7-3747018072a0 tempest-VolumesTransfersV355Test-221499813 None] <== create_volume: return (1701ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-34312b00-dd6d-45bb-af98-75855cea8e48'} {{(pid=84538) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 29 19:02:35 devstack cinder-volume[84538]: DEBUG oslo_concurrency.lockutils [None req-05e71b29-b456-49df-9ce7-3747018072a0 tempest-VolumesTransfersV355Test-221499813 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.705s {{(pid=84538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 19:02:35 devstack cinder-volume[84538]: DEBUG oslo_concurrency.lockutils [None req-0cb3f522-51c3-40d0-9bc1-339a0b1e2145 tempest-VolumesListAdminTestJSON-1330364154 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.013s {{(pid=84538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 19:02:35 devstack cinder-volume[84538]: DEBUG cinder.volume.drivers.quobyte [None req-0cb3f522-51c3-40d0-9bc1-339a0b1e2145 tempest-VolumesListAdminTestJSON-1330364154 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-29T17:02:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-1683733241',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1da7fd8e-b647-42bc-9f29-3bd44f1bc326,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e7d888ac4b1a4a90a3d7723e60bd9f36',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T17:02:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T17:02:35Z,use_quota=True,user_id='ff657a7ce8464cd9b8b73cc3a7213188',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(62b05900-93e3-4190-a88f-1d87324303d1),volume_type_id=62b05900-93e3-4190-a88f-1d87324303d1)}" {{(pid=84538) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 29 19:02:35 devstack cinder-volume[84538]: DEBUG cinder.volume.drivers.remotefs [None req-0cb3f522-51c3-40d0-9bc1-339a0b1e2145 tempest-VolumesListAdminTestJSON-1330364154 None] Creating volume 1da7fd8e-b647-42bc-9f29-3bd44f1bc326 {{(pid=84538) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 29 19:02:35 devstack cinder-volume[84538]: DEBUG oslo_concurrency.lockutils [None req-0cb3f522-51c3-40d0-9bc1-339a0b1e2145 tempest-VolumesListAdminTestJSON-1330364154 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 19:02:35 devstack cinder-volume[84538]: DEBUG oslo_concurrency.lockutils [None req-0cb3f522-51c3-40d0-9bc1-339a0b1e2145 tempest-VolumesListAdminTestJSON-1330364154 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 19:02:35 devstack cinder-volume[84538]: DEBUG cinder.volume.drivers.quobyte [None req-0cb3f522-51c3-40d0-9bc1-339a0b1e2145 tempest-VolumesListAdminTestJSON-1330364154 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-34312b00-dd6d-45bb-af98-75855cea8e48': None} {{(pid=84538) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 19:02:35 devstack cinder-volume[84538]: DEBUG cinder.volume.drivers.quobyte [None req-0cb3f522-51c3-40d0-9bc1-339a0b1e2145 tempest-VolumesListAdminTestJSON-1330364154 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-34312b00-dd6d-45bb-af98-75855cea8e48'] {{(pid=84538) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 19:02:35 devstack cinder-volume[84538]: DEBUG oslo_concurrency.lockutils [None req-0cb3f522-51c3-40d0-9bc1-339a0b1e2145 tempest-VolumesListAdminTestJSON-1330364154 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=84538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 19:02:35 devstack cinder-volume[84538]: DEBUG cinder.volume.drivers.quobyte [None req-0cb3f522-51c3-40d0-9bc1-339a0b1e2145 tempest-VolumesListAdminTestJSON-1330364154 None] Selected osci02.corp.quobyte.com/cinder-vol-34312b00-dd6d-45bb-af98-75855cea8e48 as target Quobyte volume. {{(pid=84538) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 29 19:02:35 devstack cinder-volume[84538]: INFO cinder.volume.drivers.remotefs [None req-0cb3f522-51c3-40d0-9bc1-339a0b1e2145 tempest-VolumesListAdminTestJSON-1330364154 None] casted to osci02.corp.quobyte.com/cinder-vol-34312b00-dd6d-45bb-af98-75855cea8e48 Apr 29 19:02:35 devstack cinder-volume[84538]: DEBUG oslo_concurrency.processutils [None req-0cb3f522-51c3-40d0-9bc1-339a0b1e2145 tempest-VolumesListAdminTestJSON-1330364154 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-1da7fd8e-b647-42bc-9f29-3bd44f1bc326 1073741824 {{(pid=84538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 19:02:35 devstack cinder-volume[84538]: DEBUG cinder.volume.manager [None req-05e71b29-b456-49df-9ce7-3747018072a0 tempest-VolumesTransfersV355Test-221499813 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (db090ea3-1752-407e-8207-059953b3dcb7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-73667715-4c65-4fc6-8afa-ea4c1c41ce40', 'volume_size': 1}' {{(pid=84538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 19:02:35 devstack cinder-volume[84538]: DEBUG cinder.volume.manager [None req-05e71b29-b456-49df-9ce7-3747018072a0 tempest-VolumesTransfersV355Test-221499813 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b5bf7ff5-fc51-4d16-b2f7-57f5007698c6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 19:02:35 devstack sudo[90697]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-1da7fd8e-b647-42bc-9f29-3bd44f1bc326 1073741824 Apr 29 19:02:35 devstack sudo[90697]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 19:02:35 devstack cinder-volume[84538]: INFO cinder.volume.flows.manager.create_volume [None req-05e71b29-b456-49df-9ce7-3747018072a0 tempest-VolumesTransfersV355Test-221499813 None] Volume volume-73667715-4c65-4fc6-8afa-ea4c1c41ce40 (73667715-4c65-4fc6-8afa-ea4c1c41ce40): created successfully Apr 29 19:02:35 devstack cinder-volume[84538]: DEBUG cinder.volume.manager [None req-05e71b29-b456-49df-9ce7-3747018072a0 tempest-VolumesTransfersV355Test-221499813 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b5bf7ff5-fc51-4d16-b2f7-57f5007698c6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 19:02:35 devstack cinder-volume[84538]: DEBUG cinder.volume.manager [None req-05e71b29-b456-49df-9ce7-3747018072a0 tempest-VolumesTransfersV355Test-221499813 None] Flow 'volume_create_manager' (1ee2cf5c-85fb-40f1-9119-60ba052aa396) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84538) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 19:02:35 devstack cinder-volume[84538]: INFO cinder.volume.manager [None req-05e71b29-b456-49df-9ce7-3747018072a0 tempest-VolumesTransfersV355Test-221499813 None] Created volume successfully. Apr 29 19:02:35 devstack sudo[90695]: pam_unix(sudo:session): session closed for user root Apr 29 19:02:35 devstack cinder-volume[84538]: DEBUG oslo_concurrency.processutils [None req-592c924c-002f-46c3-b6ec-ff346276926e tempest-VolumesDeleteCascade-1314225595 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-6d573221-9dab-4f46-b8d6-92bad7a9a295.a6f70eaf-8289-42b0-8ac0-7f1c5c105985" returned: 0 in 0.732s {{(pid=84538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 19:02:35 devstack cinder-volume[84538]: DEBUG oslo_concurrency.processutils [None req-592c924c-002f-46c3-b6ec-ff346276926e tempest-VolumesDeleteCascade-1314225595 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-6d573221-9dab-4f46-b8d6-92bad7a9a295.a6f70eaf-8289-42b0-8ac0-7f1c5c105985 {{(pid=84538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 19:02:36 devstack sudo[90705]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-6d573221-9dab-4f46-b8d6-92bad7a9a295.a6f70eaf-8289-42b0-8ac0-7f1c5c105985 Apr 29 19:02:36 devstack sudo[90705]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 19:02:36 devstack sudo[90697]: pam_unix(sudo:session): session closed for user root Apr 29 19:02:36 devstack cinder-volume[84538]: DEBUG oslo_concurrency.processutils [None req-0cb3f522-51c3-40d0-9bc1-339a0b1e2145 tempest-VolumesListAdminTestJSON-1330364154 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-1da7fd8e-b647-42bc-9f29-3bd44f1bc326 1073741824" returned: 0 in 0.972s {{(pid=84538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 19:02:36 devstack cinder-volume[84538]: DEBUG oslo_concurrency.processutils [None req-0cb3f522-51c3-40d0-9bc1-339a0b1e2145 tempest-VolumesListAdminTestJSON-1330364154 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-1da7fd8e-b647-42bc-9f29-3bd44f1bc326 {{(pid=84538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 19:02:36 devstack sudo[90708]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-1da7fd8e-b647-42bc-9f29-3bd44f1bc326 Apr 29 19:02:36 devstack sudo[90708]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 19:02:36 devstack sudo[90705]: pam_unix(sudo:session): session closed for user root Apr 29 19:02:36 devstack cinder-volume[84538]: DEBUG oslo_concurrency.processutils [None req-592c924c-002f-46c3-b6ec-ff346276926e tempest-VolumesDeleteCascade-1314225595 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-6d573221-9dab-4f46-b8d6-92bad7a9a295.a6f70eaf-8289-42b0-8ac0-7f1c5c105985" returned: 0 in 0.822s {{(pid=84538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 19:02:36 devstack cinder-volume[84538]: DEBUG cinder.coordination [None req-592c924c-002f-46c3-b6ec-ff346276926e tempest-VolumesDeleteCascade-1314225595 None] Lock "cinder-quobyte-a6f70eaf-8289-42b0-8ac0-7f1c5c105985" released by "_delete_snapshot" :: held 3.387s {{(pid=84538) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 19:02:36 devstack cinder-volume[84538]: DEBUG cinder.coordination [None req-592c924c-002f-46c3-b6ec-ff346276926e tempest-VolumesDeleteCascade-1314225595 None] Lock "cinder-quobyte-6d573221-9dab-4f46-b8d6-92bad7a9a295" released by "delete_snapshot" :: held 3.414s {{(pid=84538) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 19:02:36 devstack cinder-volume[84538]: DEBUG cinder.quota [None req-592c924c-002f-46c3-b6ec-ff346276926e tempest-VolumesDeleteCascade-1314225595 None] Created reservations ['275c62ac-161c-44a0-9159-18a2c112441d', '3ef489a1-fe4d-4950-90a0-a1d62bb074f0', 'dc99fa0d-3dbc-4e9a-ac83-b20196031901', '7752636a-6132-48a6-b04c-26f6c08be5e9'] {{(pid=84538) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 29 19:02:37 devstack cinder-volume[84538]: INFO cinder.volume.manager [None req-592c924c-002f-46c3-b6ec-ff346276926e tempest-VolumesDeleteCascade-1314225595 None] Delete snapshot completed successfully. Apr 29 19:02:37 devstack cinder-volume[84538]: DEBUG cinder.coordination [None req-592c924c-002f-46c3-b6ec-ff346276926e tempest-VolumesDeleteCascade-1314225595 None] Lock "cinder-a6f70eaf-8289-42b0-8ac0-7f1c5c105985-delete_snapshot" released by "delete_snapshot" :: held 3.616s {{(pid=84538) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 19:02:37 devstack cinder-volume[84538]: DEBUG cinder.volume.manager [None req-592c924c-002f-46c3-b6ec-ff346276926e tempest-VolumesDeleteCascade-1314225595 None] Snapshots deleted, issuing volume delete {{(pid=84538) delete_volume /opt/stack/cinder/cinder/volume/manager.py:1010}} Apr 29 19:02:37 devstack cinder-volume[84538]: DEBUG cinder.coordination [None req-592c924c-002f-46c3-b6ec-ff346276926e tempest-VolumesDeleteCascade-1314225595 None] Acquiring lock "cinder-quobyte-6d573221-9dab-4f46-b8d6-92bad7a9a295" by "delete_volume" {{(pid=84538) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 19:02:37 devstack cinder-volume[84538]: DEBUG cinder.coordination [None req-592c924c-002f-46c3-b6ec-ff346276926e tempest-VolumesDeleteCascade-1314225595 None] Lock "cinder-quobyte-6d573221-9dab-4f46-b8d6-92bad7a9a295" acquired by "delete_volume" :: waited 0.018s {{(pid=84538) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 19:02:37 devstack cinder-volume[84538]: DEBUG oslo.privsep.daemon [-] privsep: reply[85f47a4a-200a-4f58-b3ee-a13899f93c75]: (4, 'qcow2') {{(pid=85803) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 19:02:37 devstack cinder-volume[84538]: DEBUG oslo_concurrency.processutils [None req-592c924c-002f-46c3-b6ec-ff346276926e tempest-VolumesDeleteCascade-1314225595 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-6d573221-9dab-4f46-b8d6-92bad7a9a295 {{(pid=84538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 19:02:37 devstack cinder-volume[84538]: INFO cinder.volume.manager [None req-5163e73d-d257-45b1-b237-a83ed1148a6d tempest-VolumesTransfersV355Test-855302072 None] Transfer volume completed successfully. Apr 29 19:02:37 devstack sudo[90708]: pam_unix(sudo:session): session closed for user root Apr 29 19:02:37 devstack cinder-volume[84538]: DEBUG oslo_concurrency.processutils [None req-0cb3f522-51c3-40d0-9bc1-339a0b1e2145 tempest-VolumesListAdminTestJSON-1330364154 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-1da7fd8e-b647-42bc-9f29-3bd44f1bc326" returned: 0 in 0.782s {{(pid=84538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 19:02:37 devstack cinder-volume[84538]: DEBUG cinder.volume.drivers.quobyte [None req-0cb3f522-51c3-40d0-9bc1-339a0b1e2145 tempest-VolumesListAdminTestJSON-1330364154 None] <== create_volume: return (1809ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-34312b00-dd6d-45bb-af98-75855cea8e48'} {{(pid=84538) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 29 19:02:37 devstack cinder-volume[84538]: DEBUG oslo_concurrency.lockutils [None req-0cb3f522-51c3-40d0-9bc1-339a0b1e2145 tempest-VolumesListAdminTestJSON-1330364154 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.812s {{(pid=84538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 19:02:37 devstack cinder-volume[84538]: DEBUG cinder.volume.manager [None req-0cb3f522-51c3-40d0-9bc1-339a0b1e2145 tempest-VolumesListAdminTestJSON-1330364154 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6bbefe91-2426-42e0-841b-457f295cc8d9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1da7fd8e-b647-42bc-9f29-3bd44f1bc326', 'volume_size': 1}' {{(pid=84538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 19:02:37 devstack cinder-volume[84538]: DEBUG cinder.volume.manager [None req-0cb3f522-51c3-40d0-9bc1-339a0b1e2145 tempest-VolumesListAdminTestJSON-1330364154 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (606dc334-b36e-47fa-998c-85e1d9a8a214) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 19:02:37 devstack cinder-volume[84538]: INFO cinder.volume.flows.manager.create_volume [None req-0cb3f522-51c3-40d0-9bc1-339a0b1e2145 tempest-VolumesListAdminTestJSON-1330364154 None] Volume volume-1da7fd8e-b647-42bc-9f29-3bd44f1bc326 (1da7fd8e-b647-42bc-9f29-3bd44f1bc326): created successfully Apr 29 19:02:37 devstack cinder-volume[84538]: DEBUG cinder.volume.manager [None req-0cb3f522-51c3-40d0-9bc1-339a0b1e2145 tempest-VolumesListAdminTestJSON-1330364154 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (606dc334-b36e-47fa-998c-85e1d9a8a214) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 19:02:37 devstack sudo[90712]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-6d573221-9dab-4f46-b8d6-92bad7a9a295 Apr 29 19:02:37 devstack sudo[90712]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 19:02:37 devstack cinder-volume[84538]: DEBUG cinder.volume.manager [None req-0cb3f522-51c3-40d0-9bc1-339a0b1e2145 tempest-VolumesListAdminTestJSON-1330364154 None] Flow 'volume_create_manager' (680133d0-2e66-43e7-b985-bc41ee9ff7e1) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84538) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 19:02:37 devstack cinder-volume[84538]: INFO cinder.volume.manager [None req-0cb3f522-51c3-40d0-9bc1-339a0b1e2145 tempest-VolumesListAdminTestJSON-1330364154 None] Created volume successfully. Apr 29 19:02:37 devstack sudo[90712]: pam_unix(sudo:session): session closed for user root Apr 29 19:02:37 devstack cinder-volume[84538]: DEBUG oslo_concurrency.processutils [None req-592c924c-002f-46c3-b6ec-ff346276926e tempest-VolumesDeleteCascade-1314225595 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-6d573221-9dab-4f46-b8d6-92bad7a9a295" returned: 0 in 0.785s {{(pid=84538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 19:02:37 devstack cinder-volume[84538]: DEBUG oslo_concurrency.processutils [None req-592c924c-002f-46c3-b6ec-ff346276926e tempest-VolumesDeleteCascade-1314225595 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-6d573221-9dab-4f46-b8d6-92bad7a9a295 {{(pid=84538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 19:02:37 devstack sudo[90718]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-6d573221-9dab-4f46-b8d6-92bad7a9a295 Apr 29 19:02:37 devstack sudo[90718]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 19:02:38 devstack cinder-volume[84538]: DEBUG cinder.volume.flows.manager.create_volume [None req-f3b3e1f6-0fae-4942-a061-47448edf054c tempest-VolumesListAdminTestJSON-341502441 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84538) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Apr 29 19:02:38 devstack cinder-volume[84538]: DEBUG cinder.volume.manager [None req-f3b3e1f6-0fae-4942-a061-47448edf054c tempest-VolumesListAdminTestJSON-341502441 None] Flow 'volume_create_manager' (8ce2bc4d-367e-4a8e-8af9-52cf05eb9350) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84538) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 19:02:38 devstack cinder-volume[84538]: DEBUG cinder.volume.manager [None req-f3b3e1f6-0fae-4942-a061-47448edf054c tempest-VolumesListAdminTestJSON-341502441 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (952d9567-b7ba-4681-add4-217e779e2686) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 19:02:38 devstack cinder-volume[84538]: DEBUG cinder.volume.manager [None req-f3b3e1f6-0fae-4942-a061-47448edf054c tempest-VolumesListAdminTestJSON-341502441 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (952d9567-b7ba-4681-add4-217e779e2686) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-29T17:02:38Z,deleted=False,deleted_at=None,display_description=None,display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9a007549-a843-49a3-a898-8019d2adc730,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5d947ffb4843498d8f6d7a84284c6960',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T17:02:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T17:02:38Z,use_quota=True,user_id='179caa9142a14c348a915b41dc4c8f7c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(62b05900-93e3-4190-a88f-1d87324303d1),volume_type_id=62b05900-93e3-4190-a88f-1d87324303d1)' {{(pid=84538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 19:02:38 devstack cinder-volume[84538]: DEBUG cinder.volume.manager [None req-f3b3e1f6-0fae-4942-a061-47448edf054c tempest-VolumesListAdminTestJSON-341502441 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (349f68dc-22f7-4146-88ce-1e8f2de1ce95) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 19:02:38 devstack cinder-volume[84538]: DEBUG cinder.volume.manager [None req-f3b3e1f6-0fae-4942-a061-47448edf054c tempest-VolumesListAdminTestJSON-341502441 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (349f68dc-22f7-4146-88ce-1e8f2de1ce95) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 19:02:38 devstack cinder-volume[84538]: DEBUG cinder.volume.manager [None req-f3b3e1f6-0fae-4942-a061-47448edf054c tempest-VolumesListAdminTestJSON-341502441 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (765931ff-4cf9-4577-bf2f-adb26b3f4a14) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 19:02:38 devstack cinder-volume[84538]: DEBUG cinder.volume.manager [None req-f3b3e1f6-0fae-4942-a061-47448edf054c tempest-VolumesListAdminTestJSON-341502441 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (765931ff-4cf9-4577-bf2f-adb26b3f4a14) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9a007549-a843-49a3-a898-8019d2adc730', 'volume_name': 'volume-9a007549-a843-49a3-a898-8019d2adc730', 'volume_size': 1}' {{(pid=84538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 19:02:38 devstack cinder-volume[84538]: DEBUG cinder.volume.manager [None req-f3b3e1f6-0fae-4942-a061-47448edf054c tempest-VolumesListAdminTestJSON-341502441 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (70e7c933-3b46-4b3d-96d8-a0159c396289) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 19:02:38 devstack cinder-volume[84538]: DEBUG cinder.volume.manager [None req-f3b3e1f6-0fae-4942-a061-47448edf054c tempest-VolumesListAdminTestJSON-341502441 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (70e7c933-3b46-4b3d-96d8-a0159c396289) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 19:02:38 devstack cinder-volume[84538]: DEBUG cinder.volume.manager [None req-f3b3e1f6-0fae-4942-a061-47448edf054c tempest-VolumesListAdminTestJSON-341502441 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6dfc17be-dde0-44af-b098-0e9577adf48b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 19:02:38 devstack cinder-volume[84538]: INFO cinder.volume.flows.manager.create_volume [None req-f3b3e1f6-0fae-4942-a061-47448edf054c tempest-VolumesListAdminTestJSON-341502441 None] Volume 9a007549-a843-49a3-a898-8019d2adc730: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9a007549-a843-49a3-a898-8019d2adc730', 'volume_size': 1} Apr 29 19:02:38 devstack cinder-volume[84538]: DEBUG oslo_concurrency.lockutils [None req-f3b3e1f6-0fae-4942-a061-47448edf054c tempest-VolumesListAdminTestJSON-341502441 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 19:02:38 devstack cinder-volume[84538]: DEBUG oslo_concurrency.lockutils [None req-f3b3e1f6-0fae-4942-a061-47448edf054c tempest-VolumesListAdminTestJSON-341502441 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=84538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 19:02:38 devstack cinder-volume[84538]: DEBUG cinder.volume.drivers.quobyte [None req-f3b3e1f6-0fae-4942-a061-47448edf054c tempest-VolumesListAdminTestJSON-341502441 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-29T17:02:38Z,deleted=False,deleted_at=None,display_description=None,display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9a007549-a843-49a3-a898-8019d2adc730,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5d947ffb4843498d8f6d7a84284c6960',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T17:02:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T17:02:38Z,use_quota=True,user_id='179caa9142a14c348a915b41dc4c8f7c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(62b05900-93e3-4190-a88f-1d87324303d1),volume_type_id=62b05900-93e3-4190-a88f-1d87324303d1)}" {{(pid=84538) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 29 19:02:38 devstack cinder-volume[84538]: DEBUG cinder.volume.drivers.remotefs [None req-f3b3e1f6-0fae-4942-a061-47448edf054c tempest-VolumesListAdminTestJSON-341502441 None] Creating volume 9a007549-a843-49a3-a898-8019d2adc730 {{(pid=84538) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 29 19:02:38 devstack cinder-volume[84538]: DEBUG oslo_concurrency.lockutils [None req-f3b3e1f6-0fae-4942-a061-47448edf054c tempest-VolumesListAdminTestJSON-341502441 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 19:02:38 devstack cinder-volume[84538]: DEBUG oslo_concurrency.lockutils [None req-f3b3e1f6-0fae-4942-a061-47448edf054c tempest-VolumesListAdminTestJSON-341502441 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 19:02:38 devstack cinder-volume[84538]: DEBUG cinder.volume.drivers.quobyte [None req-f3b3e1f6-0fae-4942-a061-47448edf054c tempest-VolumesListAdminTestJSON-341502441 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-34312b00-dd6d-45bb-af98-75855cea8e48': None} {{(pid=84538) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 19:02:38 devstack cinder-volume[84538]: DEBUG cinder.volume.drivers.quobyte [None req-f3b3e1f6-0fae-4942-a061-47448edf054c tempest-VolumesListAdminTestJSON-341502441 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-34312b00-dd6d-45bb-af98-75855cea8e48'] {{(pid=84538) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 19:02:38 devstack cinder-volume[84538]: DEBUG oslo_concurrency.lockutils [None req-f3b3e1f6-0fae-4942-a061-47448edf054c tempest-VolumesListAdminTestJSON-341502441 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=84538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 19:02:38 devstack cinder-volume[84538]: DEBUG cinder.volume.drivers.quobyte [None req-f3b3e1f6-0fae-4942-a061-47448edf054c tempest-VolumesListAdminTestJSON-341502441 None] Selected osci02.corp.quobyte.com/cinder-vol-34312b00-dd6d-45bb-af98-75855cea8e48 as target Quobyte volume. {{(pid=84538) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 29 19:02:38 devstack cinder-volume[84538]: INFO cinder.volume.drivers.remotefs [None req-f3b3e1f6-0fae-4942-a061-47448edf054c tempest-VolumesListAdminTestJSON-341502441 None] casted to osci02.corp.quobyte.com/cinder-vol-34312b00-dd6d-45bb-af98-75855cea8e48 Apr 29 19:02:38 devstack cinder-volume[84538]: DEBUG oslo_concurrency.processutils [None req-f3b3e1f6-0fae-4942-a061-47448edf054c tempest-VolumesListAdminTestJSON-341502441 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-9a007549-a843-49a3-a898-8019d2adc730 1073741824 {{(pid=84538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 19:02:38 devstack sudo[90722]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-9a007549-a843-49a3-a898-8019d2adc730 1073741824 Apr 29 19:02:38 devstack sudo[90722]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 19:02:38 devstack cinder-volume[84538]: DEBUG cinder.coordination [None req-4d3055f1-9bac-47b9-b556-b1f352050c0a tempest-VolumesTransfersV355Test-413540673 None] Acquiring lock "cinder-73667715-4c65-4fc6-8afa-ea4c1c41ce40-delete_volume" by "delete_volume" {{(pid=84538) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 19:02:38 devstack cinder-volume[84538]: DEBUG cinder.coordination [None req-4d3055f1-9bac-47b9-b556-b1f352050c0a tempest-VolumesTransfersV355Test-413540673 None] Lock "cinder-73667715-4c65-4fc6-8afa-ea4c1c41ce40-delete_volume" acquired by "delete_volume" :: waited 0.047s {{(pid=84538) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 19:02:38 devstack cinder-volume[84538]: DEBUG cinder.coordination [None req-4d3055f1-9bac-47b9-b556-b1f352050c0a tempest-VolumesTransfersV355Test-413540673 None] Acquiring lock "cinder-quobyte-73667715-4c65-4fc6-8afa-ea4c1c41ce40" by "delete_volume" {{(pid=84538) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 19:02:38 devstack cinder-volume[84538]: DEBUG cinder.coordination [None req-4d3055f1-9bac-47b9-b556-b1f352050c0a tempest-VolumesTransfersV355Test-413540673 None] Lock "cinder-quobyte-73667715-4c65-4fc6-8afa-ea4c1c41ce40" acquired by "delete_volume" :: waited 0.018s {{(pid=84538) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 19:02:38 devstack cinder-volume[84538]: DEBUG oslo.privsep.daemon [-] privsep: reply[a5aea3ae-84b4-4dc5-8072-ab82ba079fbb]: (4, 'qcow2') {{(pid=85803) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 19:02:38 devstack cinder-volume[84538]: DEBUG oslo_concurrency.processutils [None req-4d3055f1-9bac-47b9-b556-b1f352050c0a tempest-VolumesTransfersV355Test-413540673 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-73667715-4c65-4fc6-8afa-ea4c1c41ce40 {{(pid=84538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 19:02:38 devstack sudo[90724]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-73667715-4c65-4fc6-8afa-ea4c1c41ce40 Apr 29 19:02:38 devstack sudo[90724]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 19:02:38 devstack sudo[90718]: pam_unix(sudo:session): session closed for user root Apr 29 19:02:38 devstack cinder-volume[84538]: DEBUG oslo_concurrency.processutils [None req-592c924c-002f-46c3-b6ec-ff346276926e tempest-VolumesDeleteCascade-1314225595 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-6d573221-9dab-4f46-b8d6-92bad7a9a295" returned: 0 in 0.765s {{(pid=84538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 19:02:38 devstack cinder-volume[84538]: DEBUG cinder.coordination [None req-592c924c-002f-46c3-b6ec-ff346276926e tempest-VolumesDeleteCascade-1314225595 None] Lock "cinder-quobyte-6d573221-9dab-4f46-b8d6-92bad7a9a295" released by "delete_volume" :: held 1.639s {{(pid=84538) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 19:02:38 devstack cinder-volume[84538]: DEBUG cinder.quota [None req-592c924c-002f-46c3-b6ec-ff346276926e tempest-VolumesDeleteCascade-1314225595 None] Created reservations ['d41692ff-bae4-429d-83c1-9bba8f7715fc', '2ce04159-a50d-4e1c-a3cf-b1cbd13e3c26', '49a8b96c-9e28-46ac-9194-77b9c6fb639e', 'c4312a7c-cd0a-4b50-8dce-27e362d947ac'] {{(pid=84538) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 29 19:02:38 devstack cinder-volume[84538]: DEBUG oslo_concurrency.lockutils [None req-592c924c-002f-46c3-b6ec-ff346276926e tempest-VolumesDeleteCascade-1314225595 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 19:02:38 devstack cinder-volume[84538]: DEBUG oslo_concurrency.lockutils [None req-592c924c-002f-46c3-b6ec-ff346276926e tempest-VolumesDeleteCascade-1314225595 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 19:02:38 devstack cinder-volume[84538]: DEBUG cinder.volume.drivers.quobyte [None req-592c924c-002f-46c3-b6ec-ff346276926e tempest-VolumesDeleteCascade-1314225595 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-34312b00-dd6d-45bb-af98-75855cea8e48': None} {{(pid=84538) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 19:02:38 devstack cinder-volume[84538]: DEBUG cinder.volume.drivers.quobyte [None req-592c924c-002f-46c3-b6ec-ff346276926e tempest-VolumesDeleteCascade-1314225595 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-34312b00-dd6d-45bb-af98-75855cea8e48'] {{(pid=84538) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 19:02:38 devstack cinder-volume[84538]: DEBUG oslo_concurrency.lockutils [None req-592c924c-002f-46c3-b6ec-ff346276926e tempest-VolumesDeleteCascade-1314225595 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=84538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 19:02:38 devstack cinder-volume[84538]: DEBUG oslo_concurrency.processutils [None req-592c924c-002f-46c3-b6ec-ff346276926e tempest-VolumesDeleteCascade-1314225595 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d {{(pid=84538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 19:02:38 devstack sudo[90727]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d Apr 29 19:02:38 devstack sudo[90727]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 19:02:39 devstack cinder-volume[84538]: DEBUG cinder.coordination [None req-238022c2-eb13-484c-a29f-48bf68c53854 tempest-VolumesDeleteCascade-1314225595 None] Acquiring lock "cinder-399a0e0a-846a-4fe5-9739-8ce2a71d113f-delete_volume" by "delete_volume" {{(pid=84538) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 19:02:39 devstack cinder-volume[84538]: DEBUG cinder.coordination [None req-238022c2-eb13-484c-a29f-48bf68c53854 tempest-VolumesDeleteCascade-1314225595 None] Lock "cinder-399a0e0a-846a-4fe5-9739-8ce2a71d113f-delete_volume" acquired by "delete_volume" :: waited 0.040s {{(pid=84538) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 19:02:39 devstack cinder-volume[84538]: DEBUG cinder.coordination [None req-238022c2-eb13-484c-a29f-48bf68c53854 tempest-VolumesDeleteCascade-1314225595 None] Acquiring lock "cinder-quobyte-399a0e0a-846a-4fe5-9739-8ce2a71d113f" by "delete_volume" {{(pid=84538) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 19:02:39 devstack cinder-volume[84538]: DEBUG cinder.coordination [None req-238022c2-eb13-484c-a29f-48bf68c53854 tempest-VolumesDeleteCascade-1314225595 None] Lock "cinder-quobyte-399a0e0a-846a-4fe5-9739-8ce2a71d113f" acquired by "delete_volume" :: waited 0.033s {{(pid=84538) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 19:02:39 devstack sudo[90722]: pam_unix(sudo:session): session closed for user root Apr 29 19:02:39 devstack cinder-volume[84538]: DEBUG oslo_concurrency.processutils [None req-f3b3e1f6-0fae-4942-a061-47448edf054c tempest-VolumesListAdminTestJSON-341502441 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-9a007549-a843-49a3-a898-8019d2adc730 1073741824" returned: 0 in 1.177s {{(pid=84538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 19:02:39 devstack cinder-volume[84538]: DEBUG oslo.privsep.daemon [-] privsep: reply[59a0e4e4-047f-4d12-99fd-3e88e5f9856a]: (4, 'qcow2') {{(pid=85803) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 19:02:39 devstack cinder-volume[84538]: DEBUG oslo_concurrency.processutils [None req-238022c2-eb13-484c-a29f-48bf68c53854 tempest-VolumesDeleteCascade-1314225595 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-399a0e0a-846a-4fe5-9739-8ce2a71d113f {{(pid=84538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 19:02:39 devstack cinder-volume[84538]: DEBUG oslo_concurrency.processutils [None req-f3b3e1f6-0fae-4942-a061-47448edf054c tempest-VolumesListAdminTestJSON-341502441 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-9a007549-a843-49a3-a898-8019d2adc730 {{(pid=84538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 19:02:39 devstack sudo[90724]: pam_unix(sudo:session): session closed for user root Apr 29 19:02:39 devstack sudo[90737]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-9a007549-a843-49a3-a898-8019d2adc730 Apr 29 19:02:39 devstack sudo[90737]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 19:02:39 devstack cinder-volume[84538]: DEBUG oslo_concurrency.processutils [None req-4d3055f1-9bac-47b9-b556-b1f352050c0a tempest-VolumesTransfersV355Test-413540673 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-73667715-4c65-4fc6-8afa-ea4c1c41ce40" returned: 0 in 1.052s {{(pid=84538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 19:02:39 devstack cinder-volume[84538]: DEBUG oslo_concurrency.processutils [None req-4d3055f1-9bac-47b9-b556-b1f352050c0a tempest-VolumesTransfersV355Test-413540673 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-73667715-4c65-4fc6-8afa-ea4c1c41ce40 {{(pid=84538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 19:02:39 devstack sudo[90739]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-73667715-4c65-4fc6-8afa-ea4c1c41ce40 Apr 29 19:02:39 devstack sudo[90739]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 19:02:39 devstack sudo[90736]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-399a0e0a-846a-4fe5-9739-8ce2a71d113f Apr 29 19:02:39 devstack sudo[90736]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 19:02:39 devstack sudo[90727]: pam_unix(sudo:session): session closed for user root Apr 29 19:02:39 devstack cinder-volume[84538]: DEBUG oslo_concurrency.processutils [None req-592c924c-002f-46c3-b6ec-ff346276926e tempest-VolumesDeleteCascade-1314225595 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d" returned: 0 in 0.877s {{(pid=84538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 19:02:39 devstack cinder-volume[84538]: DEBUG cinder.manager [None req-592c924c-002f-46c3-b6ec-ff346276926e tempest-VolumesDeleteCascade-1314225595 None] Notifying Schedulers of capabilities ... {{(pid=84538) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 29 19:02:39 devstack cinder-volume[84538]: INFO cinder.volume.manager [None req-592c924c-002f-46c3-b6ec-ff346276926e tempest-VolumesDeleteCascade-1314225595 None] Deleted volume successfully. Apr 29 19:02:39 devstack cinder-volume[84538]: DEBUG cinder.coordination [None req-592c924c-002f-46c3-b6ec-ff346276926e tempest-VolumesDeleteCascade-1314225595 None] Lock "cinder-6d573221-9dab-4f46-b8d6-92bad7a9a295-delete_volume" released by "delete_volume" :: held 6.415s {{(pid=84538) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 19:02:40 devstack sudo[90737]: pam_unix(sudo:session): session closed for user root Apr 29 19:02:40 devstack cinder-volume[84538]: DEBUG oslo_concurrency.processutils [None req-f3b3e1f6-0fae-4942-a061-47448edf054c tempest-VolumesListAdminTestJSON-341502441 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-9a007549-a843-49a3-a898-8019d2adc730" returned: 0 in 0.719s {{(pid=84538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 19:02:40 devstack cinder-volume[84538]: DEBUG cinder.volume.drivers.quobyte [None req-f3b3e1f6-0fae-4942-a061-47448edf054c tempest-VolumesListAdminTestJSON-341502441 None] <== create_volume: return (1985ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-34312b00-dd6d-45bb-af98-75855cea8e48'} {{(pid=84538) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 29 19:02:40 devstack cinder-volume[84538]: DEBUG oslo_concurrency.lockutils [None req-f3b3e1f6-0fae-4942-a061-47448edf054c tempest-VolumesListAdminTestJSON-341502441 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.988s {{(pid=84538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 19:02:40 devstack cinder-volume[84538]: DEBUG cinder.volume.manager [None req-f3b3e1f6-0fae-4942-a061-47448edf054c tempest-VolumesListAdminTestJSON-341502441 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6dfc17be-dde0-44af-b098-0e9577adf48b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9a007549-a843-49a3-a898-8019d2adc730', 'volume_size': 1}' {{(pid=84538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 19:02:40 devstack cinder-volume[84538]: DEBUG cinder.volume.manager [None req-f3b3e1f6-0fae-4942-a061-47448edf054c tempest-VolumesListAdminTestJSON-341502441 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4080b2a2-06cf-4031-b4dc-2b4d4b4a170d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 19:02:40 devstack cinder-volume[84538]: INFO cinder.volume.flows.manager.create_volume [None req-f3b3e1f6-0fae-4942-a061-47448edf054c tempest-VolumesListAdminTestJSON-341502441 None] Volume volume-9a007549-a843-49a3-a898-8019d2adc730 (9a007549-a843-49a3-a898-8019d2adc730): created successfully Apr 29 19:02:40 devstack cinder-volume[84538]: DEBUG cinder.volume.manager [None req-f3b3e1f6-0fae-4942-a061-47448edf054c tempest-VolumesListAdminTestJSON-341502441 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4080b2a2-06cf-4031-b4dc-2b4d4b4a170d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 19:02:40 devstack cinder-volume[84538]: DEBUG cinder.volume.manager [None req-f3b3e1f6-0fae-4942-a061-47448edf054c tempest-VolumesListAdminTestJSON-341502441 None] Flow 'volume_create_manager' (8ce2bc4d-367e-4a8e-8af9-52cf05eb9350) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84538) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 19:02:40 devstack cinder-volume[84538]: INFO cinder.volume.manager [None req-f3b3e1f6-0fae-4942-a061-47448edf054c tempest-VolumesListAdminTestJSON-341502441 None] Created volume successfully. Apr 29 19:02:40 devstack sudo[90739]: pam_unix(sudo:session): session closed for user root Apr 29 19:02:40 devstack cinder-volume[84538]: DEBUG oslo_concurrency.processutils [None req-4d3055f1-9bac-47b9-b556-b1f352050c0a tempest-VolumesTransfersV355Test-413540673 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-73667715-4c65-4fc6-8afa-ea4c1c41ce40" returned: 0 in 0.823s {{(pid=84538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 19:02:40 devstack cinder-volume[84538]: DEBUG cinder.coordination [None req-4d3055f1-9bac-47b9-b556-b1f352050c0a tempest-VolumesTransfersV355Test-413540673 None] Lock "cinder-quobyte-73667715-4c65-4fc6-8afa-ea4c1c41ce40" released by "delete_volume" :: held 1.934s {{(pid=84538) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 19:02:40 devstack cinder-volume[84538]: DEBUG cinder.quota [None req-4d3055f1-9bac-47b9-b556-b1f352050c0a tempest-VolumesTransfersV355Test-413540673 None] Created reservations ['a0dbaa08-0807-4170-bcb4-2ab375984e71', 'de8b8b49-b614-4346-b5bc-a2fbddc4662a', '03c8c4ac-9296-4c58-bd30-ebf7b3e59772', '0b904d53-1382-4e13-8741-3a9db8022887'] {{(pid=84538) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 29 19:02:40 devstack sudo[90736]: pam_unix(sudo:session): session closed for user root Apr 29 19:02:40 devstack cinder-volume[84538]: DEBUG oslo_concurrency.processutils [None req-238022c2-eb13-484c-a29f-48bf68c53854 tempest-VolumesDeleteCascade-1314225595 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-399a0e0a-846a-4fe5-9739-8ce2a71d113f" returned: 0 in 1.017s {{(pid=84538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 19:02:40 devstack cinder-volume[84538]: DEBUG oslo_concurrency.processutils [None req-238022c2-eb13-484c-a29f-48bf68c53854 tempest-VolumesDeleteCascade-1314225595 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-399a0e0a-846a-4fe5-9739-8ce2a71d113f {{(pid=84538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 19:02:40 devstack sudo[90748]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-399a0e0a-846a-4fe5-9739-8ce2a71d113f Apr 29 19:02:40 devstack sudo[90748]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 19:02:40 devstack cinder-volume[84538]: DEBUG oslo_concurrency.lockutils [None req-4d3055f1-9bac-47b9-b556-b1f352050c0a tempest-VolumesTransfersV355Test-413540673 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 19:02:40 devstack cinder-volume[84538]: DEBUG oslo_concurrency.lockutils [None req-4d3055f1-9bac-47b9-b556-b1f352050c0a tempest-VolumesTransfersV355Test-413540673 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 19:02:40 devstack cinder-volume[84538]: DEBUG cinder.volume.drivers.quobyte [None req-4d3055f1-9bac-47b9-b556-b1f352050c0a tempest-VolumesTransfersV355Test-413540673 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-34312b00-dd6d-45bb-af98-75855cea8e48': None} {{(pid=84538) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 19:02:40 devstack cinder-volume[84538]: DEBUG cinder.volume.drivers.quobyte [None req-4d3055f1-9bac-47b9-b556-b1f352050c0a tempest-VolumesTransfersV355Test-413540673 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-34312b00-dd6d-45bb-af98-75855cea8e48'] {{(pid=84538) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 19:02:40 devstack cinder-volume[84538]: DEBUG oslo_concurrency.lockutils [None req-4d3055f1-9bac-47b9-b556-b1f352050c0a tempest-VolumesTransfersV355Test-413540673 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=84538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 19:02:40 devstack cinder-volume[84538]: DEBUG oslo_concurrency.processutils [None req-4d3055f1-9bac-47b9-b556-b1f352050c0a tempest-VolumesTransfersV355Test-413540673 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d {{(pid=84538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 19:02:40 devstack sudo[90750]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d Apr 29 19:02:40 devstack sudo[90750]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 19:02:41 devstack sudo[90748]: pam_unix(sudo:session): session closed for user root Apr 29 19:02:41 devstack cinder-volume[84538]: DEBUG oslo_concurrency.processutils [None req-238022c2-eb13-484c-a29f-48bf68c53854 tempest-VolumesDeleteCascade-1314225595 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-399a0e0a-846a-4fe5-9739-8ce2a71d113f" returned: 0 in 0.868s {{(pid=84538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 19:02:41 devstack cinder-volume[84538]: DEBUG cinder.coordination [None req-238022c2-eb13-484c-a29f-48bf68c53854 tempest-VolumesDeleteCascade-1314225595 None] Lock "cinder-quobyte-399a0e0a-846a-4fe5-9739-8ce2a71d113f" released by "delete_volume" :: held 1.961s {{(pid=84538) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 19:02:41 devstack sudo[90750]: pam_unix(sudo:session): session closed for user root Apr 29 19:02:41 devstack cinder-volume[84538]: DEBUG oslo_concurrency.processutils [None req-4d3055f1-9bac-47b9-b556-b1f352050c0a tempest-VolumesTransfersV355Test-413540673 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d" returned: 0 in 0.887s {{(pid=84538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 19:02:41 devstack cinder-volume[84538]: DEBUG cinder.manager [None req-4d3055f1-9bac-47b9-b556-b1f352050c0a tempest-VolumesTransfersV355Test-413540673 None] Notifying Schedulers of capabilities ... {{(pid=84538) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 29 19:02:41 devstack cinder-volume[84538]: DEBUG cinder.volume.flows.manager.create_volume [None req-abd49951-8b96-4f05-a14a-afe3a32dabb5 tempest-VolumesTransfersV355Test-221499813 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84538) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Apr 29 19:02:41 devstack cinder-volume[84538]: DEBUG cinder.volume.manager [None req-abd49951-8b96-4f05-a14a-afe3a32dabb5 tempest-VolumesTransfersV355Test-221499813 None] Flow 'volume_create_manager' (c2898817-f22f-4489-93b1-15ec766ae1d2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84538) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 19:02:41 devstack cinder-volume[84538]: DEBUG cinder.volume.manager [None req-abd49951-8b96-4f05-a14a-afe3a32dabb5 tempest-VolumesTransfersV355Test-221499813 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (35b1dc2d-8005-4077-a73e-6e5ee05ff222) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 19:02:41 devstack cinder-volume[84538]: INFO cinder.volume.manager [None req-4d3055f1-9bac-47b9-b556-b1f352050c0a tempest-VolumesTransfersV355Test-413540673 None] Deleted volume successfully. Apr 29 19:02:41 devstack cinder-volume[84538]: DEBUG cinder.volume.manager [None req-abd49951-8b96-4f05-a14a-afe3a32dabb5 tempest-VolumesTransfersV355Test-221499813 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (35b1dc2d-8005-4077-a73e-6e5ee05ff222) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-29T17:02:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV355Test-Volume-2126692604',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4fe253ec-263c-4592-ac3f-b8e0eed5395a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b034658e9ebc4112b38e6a60912fd38d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T17:02:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T17:02:41Z,use_quota=True,user_id='239f349d8f964ca3a6fc8db6ce134079',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(62b05900-93e3-4190-a88f-1d87324303d1),volume_type_id=62b05900-93e3-4190-a88f-1d87324303d1)' {{(pid=84538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 19:02:41 devstack cinder-volume[84538]: DEBUG cinder.volume.manager [None req-abd49951-8b96-4f05-a14a-afe3a32dabb5 tempest-VolumesTransfersV355Test-221499813 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4e9b3e32-37fe-49a0-894f-368b6cfaf79d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 19:02:41 devstack cinder-volume[84538]: DEBUG cinder.volume.manager [None req-abd49951-8b96-4f05-a14a-afe3a32dabb5 tempest-VolumesTransfersV355Test-221499813 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4e9b3e32-37fe-49a0-894f-368b6cfaf79d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 19:02:41 devstack cinder-volume[84538]: DEBUG cinder.volume.manager [None req-abd49951-8b96-4f05-a14a-afe3a32dabb5 tempest-VolumesTransfersV355Test-221499813 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (56663812-e5ed-4fd5-9488-1ccfc9018a38) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 19:02:41 devstack cinder-volume[84538]: DEBUG cinder.volume.manager [None req-abd49951-8b96-4f05-a14a-afe3a32dabb5 tempest-VolumesTransfersV355Test-221499813 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (56663812-e5ed-4fd5-9488-1ccfc9018a38) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4fe253ec-263c-4592-ac3f-b8e0eed5395a', 'volume_name': 'volume-4fe253ec-263c-4592-ac3f-b8e0eed5395a', 'volume_size': 1}' {{(pid=84538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 19:02:41 devstack cinder-volume[84538]: DEBUG cinder.volume.manager [None req-abd49951-8b96-4f05-a14a-afe3a32dabb5 tempest-VolumesTransfersV355Test-221499813 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (31d39489-8cc8-40dd-a7f1-71dc332cd1da) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 19:02:41 devstack cinder-volume[84538]: DEBUG cinder.volume.manager [None req-abd49951-8b96-4f05-a14a-afe3a32dabb5 tempest-VolumesTransfersV355Test-221499813 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (31d39489-8cc8-40dd-a7f1-71dc332cd1da) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 19:02:41 devstack cinder-volume[84538]: DEBUG cinder.volume.manager [None req-abd49951-8b96-4f05-a14a-afe3a32dabb5 tempest-VolumesTransfersV355Test-221499813 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6f771fde-c5ec-4c84-b101-3862c0b469e9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 19:02:41 devstack cinder-volume[84538]: INFO cinder.volume.flows.manager.create_volume [None req-abd49951-8b96-4f05-a14a-afe3a32dabb5 tempest-VolumesTransfersV355Test-221499813 None] Volume 4fe253ec-263c-4592-ac3f-b8e0eed5395a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4fe253ec-263c-4592-ac3f-b8e0eed5395a', 'volume_size': 1} Apr 29 19:02:41 devstack cinder-volume[84538]: DEBUG oslo_concurrency.lockutils [None req-abd49951-8b96-4f05-a14a-afe3a32dabb5 tempest-VolumesTransfersV355Test-221499813 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 19:02:41 devstack cinder-volume[84538]: DEBUG oslo_concurrency.lockutils [None req-abd49951-8b96-4f05-a14a-afe3a32dabb5 tempest-VolumesTransfersV355Test-221499813 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=84538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 19:02:41 devstack cinder-volume[84538]: DEBUG cinder.volume.drivers.quobyte [None req-abd49951-8b96-4f05-a14a-afe3a32dabb5 tempest-VolumesTransfersV355Test-221499813 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-29T17:02:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV355Test-Volume-2126692604',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4fe253ec-263c-4592-ac3f-b8e0eed5395a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b034658e9ebc4112b38e6a60912fd38d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T17:02:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T17:02:41Z,use_quota=True,user_id='239f349d8f964ca3a6fc8db6ce134079',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(62b05900-93e3-4190-a88f-1d87324303d1),volume_type_id=62b05900-93e3-4190-a88f-1d87324303d1)}" {{(pid=84538) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 29 19:02:41 devstack cinder-volume[84538]: DEBUG cinder.volume.drivers.remotefs [None req-abd49951-8b96-4f05-a14a-afe3a32dabb5 tempest-VolumesTransfersV355Test-221499813 None] Creating volume 4fe253ec-263c-4592-ac3f-b8e0eed5395a {{(pid=84538) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 29 19:02:41 devstack cinder-volume[84538]: DEBUG oslo_concurrency.lockutils [None req-abd49951-8b96-4f05-a14a-afe3a32dabb5 tempest-VolumesTransfersV355Test-221499813 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 19:02:41 devstack cinder-volume[84538]: DEBUG oslo_concurrency.lockutils [None req-abd49951-8b96-4f05-a14a-afe3a32dabb5 tempest-VolumesTransfersV355Test-221499813 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=84538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 19:02:41 devstack cinder-volume[84538]: DEBUG cinder.volume.drivers.quobyte [None req-abd49951-8b96-4f05-a14a-afe3a32dabb5 tempest-VolumesTransfersV355Test-221499813 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-34312b00-dd6d-45bb-af98-75855cea8e48': None} {{(pid=84538) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 19:02:41 devstack cinder-volume[84538]: DEBUG cinder.volume.drivers.quobyte [None req-abd49951-8b96-4f05-a14a-afe3a32dabb5 tempest-VolumesTransfersV355Test-221499813 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-34312b00-dd6d-45bb-af98-75855cea8e48'] {{(pid=84538) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 19:02:41 devstack cinder-volume[84538]: DEBUG oslo_concurrency.lockutils [None req-abd49951-8b96-4f05-a14a-afe3a32dabb5 tempest-VolumesTransfersV355Test-221499813 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=84538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 19:02:41 devstack cinder-volume[84538]: DEBUG cinder.volume.drivers.quobyte [None req-abd49951-8b96-4f05-a14a-afe3a32dabb5 tempest-VolumesTransfersV355Test-221499813 None] Selected osci02.corp.quobyte.com/cinder-vol-34312b00-dd6d-45bb-af98-75855cea8e48 as target Quobyte volume. {{(pid=84538) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 29 19:02:41 devstack cinder-volume[84538]: INFO cinder.volume.drivers.remotefs [None req-abd49951-8b96-4f05-a14a-afe3a32dabb5 tempest-VolumesTransfersV355Test-221499813 None] casted to osci02.corp.quobyte.com/cinder-vol-34312b00-dd6d-45bb-af98-75855cea8e48 Apr 29 19:02:41 devstack cinder-volume[84538]: DEBUG oslo_concurrency.processutils [None req-abd49951-8b96-4f05-a14a-afe3a32dabb5 tempest-VolumesTransfersV355Test-221499813 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-4fe253ec-263c-4592-ac3f-b8e0eed5395a 1073741824 {{(pid=84538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 19:02:41 devstack cinder-volume[84538]: DEBUG cinder.coordination [None req-46b7c1cd-9663-4a50-ad55-d10a083fcfec tempest-VolumesListAdminTestJSON-341502441 None] Acquiring lock "cinder-9a007549-a843-49a3-a898-8019d2adc730-delete_volume" by "delete_volume" {{(pid=84538) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 19:02:41 devstack sudo[90756]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-4fe253ec-263c-4592-ac3f-b8e0eed5395a 1073741824 Apr 29 19:02:41 devstack sudo[90756]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 19:02:41 devstack cinder-volume[84538]: DEBUG cinder.quota [None req-238022c2-eb13-484c-a29f-48bf68c53854 tempest-VolumesDeleteCascade-1314225595 None] Created reservations ['d1933eca-d82c-4b3a-9037-144c30f24f4e', '8cef4f24-a187-4ce7-968a-22080e77f3b5', 'c3f75739-dafa-4f15-9927-73dc8911babd', '711b04d3-6a4b-4a78-ab3d-17126bbb18a8'] {{(pid=84538) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 29 19:02:41 devstack cinder-volume[84538]: DEBUG cinder.coordination [None req-4d3055f1-9bac-47b9-b556-b1f352050c0a tempest-VolumesTransfersV355Test-413540673 None] Lock "cinder-73667715-4c65-4fc6-8afa-ea4c1c41ce40-delete_volume" released by "delete_volume" :: held 3.219s {{(pid=84538) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 19:02:41 devstack cinder-volume[84538]: DEBUG cinder.coordination [None req-46b7c1cd-9663-4a50-ad55-d10a083fcfec tempest-VolumesListAdminTestJSON-341502441 None] Lock "cinder-9a007549-a843-49a3-a898-8019d2adc730-delete_volume" acquired by "delete_volume" :: waited 0.051s {{(pid=84538) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 19:02:41 devstack cinder-volume[84538]: DEBUG cinder.coordination [None req-46b7c1cd-9663-4a50-ad55-d10a083fcfec tempest-VolumesListAdminTestJSON-341502441 None] Acquiring lock "cinder-quobyte-9a007549-a843-49a3-a898-8019d2adc730" by "delete_volume" {{(pid=84538) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 19:02:41 devstack cinder-volume[84538]: DEBUG cinder.coordination [None req-46b7c1cd-9663-4a50-ad55-d10a083fcfec tempest-VolumesListAdminTestJSON-341502441 None] Lock "cinder-quobyte-9a007549-a843-49a3-a898-8019d2adc730" acquired by "delete_volume" :: waited 0.041s {{(pid=84538) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 19:02:41 devstack cinder-volume[84538]: DEBUG oslo_concurrency.lockutils [None req-238022c2-eb13-484c-a29f-48bf68c53854 tempest-VolumesDeleteCascade-1314225595 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 19:02:41 devstack cinder-volume[84538]: DEBUG oslo_concurrency.lockutils [None req-238022c2-eb13-484c-a29f-48bf68c53854 tempest-VolumesDeleteCascade-1314225595 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 19:02:41 devstack cinder-volume[84538]: DEBUG cinder.volume.drivers.quobyte [None req-238022c2-eb13-484c-a29f-48bf68c53854 tempest-VolumesDeleteCascade-1314225595 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-34312b00-dd6d-45bb-af98-75855cea8e48': None} {{(pid=84538) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 19:02:41 devstack cinder-volume[84538]: DEBUG cinder.volume.drivers.quobyte [None req-238022c2-eb13-484c-a29f-48bf68c53854 tempest-VolumesDeleteCascade-1314225595 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-34312b00-dd6d-45bb-af98-75855cea8e48'] {{(pid=84538) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 19:02:41 devstack cinder-volume[84538]: DEBUG oslo_concurrency.lockutils [None req-238022c2-eb13-484c-a29f-48bf68c53854 tempest-VolumesDeleteCascade-1314225595 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=84538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 19:02:41 devstack cinder-volume[84538]: DEBUG oslo_concurrency.processutils [None req-238022c2-eb13-484c-a29f-48bf68c53854 tempest-VolumesDeleteCascade-1314225595 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d {{(pid=84538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 19:02:41 devstack cinder-volume[84538]: DEBUG oslo.privsep.daemon [-] privsep: reply[9453b758-de32-4372-839b-336421e3cdeb]: (4, 'qcow2') {{(pid=85803) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 19:02:41 devstack cinder-volume[84538]: DEBUG cinder.coordination [None req-8453fdc2-4212-44d5-bdaf-c771f7163272 tempest-VolumesListAdminTestJSON-1330364154 None] Acquiring lock "cinder-1da7fd8e-b647-42bc-9f29-3bd44f1bc326-delete_volume" by "delete_volume" {{(pid=84538) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 19:02:41 devstack cinder-volume[84538]: DEBUG oslo_concurrency.processutils [None req-46b7c1cd-9663-4a50-ad55-d10a083fcfec tempest-VolumesListAdminTestJSON-341502441 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-9a007549-a843-49a3-a898-8019d2adc730 {{(pid=84538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 19:02:41 devstack sudo[90758]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d Apr 29 19:02:41 devstack sudo[90758]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 19:02:41 devstack cinder-volume[84538]: DEBUG cinder.coordination [None req-8453fdc2-4212-44d5-bdaf-c771f7163272 tempest-VolumesListAdminTestJSON-1330364154 None] Lock "cinder-1da7fd8e-b647-42bc-9f29-3bd44f1bc326-delete_volume" acquired by "delete_volume" :: waited 0.062s {{(pid=84538) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 19:02:41 devstack cinder-volume[84538]: DEBUG cinder.coordination [None req-8453fdc2-4212-44d5-bdaf-c771f7163272 tempest-VolumesListAdminTestJSON-1330364154 None] Acquiring lock "cinder-quobyte-1da7fd8e-b647-42bc-9f29-3bd44f1bc326" by "delete_volume" {{(pid=84538) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 19:02:41 devstack cinder-volume[84538]: DEBUG cinder.coordination [None req-8453fdc2-4212-44d5-bdaf-c771f7163272 tempest-VolumesListAdminTestJSON-1330364154 None] Lock "cinder-quobyte-1da7fd8e-b647-42bc-9f29-3bd44f1bc326" acquired by "delete_volume" :: waited 0.026s {{(pid=84538) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 19:02:41 devstack cinder-volume[84538]: DEBUG oslo.privsep.daemon [-] privsep: reply[71a8005b-fad2-4533-9218-de40361848cd]: (4, 'qcow2') {{(pid=85803) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 19:02:41 devstack cinder-volume[84538]: DEBUG oslo_concurrency.processutils [None req-8453fdc2-4212-44d5-bdaf-c771f7163272 tempest-VolumesListAdminTestJSON-1330364154 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-1da7fd8e-b647-42bc-9f29-3bd44f1bc326 {{(pid=84538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 19:02:41 devstack sudo[90759]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-9a007549-a843-49a3-a898-8019d2adc730 Apr 29 19:02:41 devstack sudo[90759]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 19:02:42 devstack sudo[90761]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-1da7fd8e-b647-42bc-9f29-3bd44f1bc326 Apr 29 19:02:42 devstack sudo[90761]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 19:02:42 devstack sudo[90756]: pam_unix(sudo:session): session closed for user root Apr 29 19:02:42 devstack cinder-volume[84538]: DEBUG oslo_concurrency.processutils [None req-abd49951-8b96-4f05-a14a-afe3a32dabb5 tempest-VolumesTransfersV355Test-221499813 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-4fe253ec-263c-4592-ac3f-b8e0eed5395a 1073741824" returned: 0 in 1.152s {{(pid=84538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 19:02:42 devstack cinder-volume[84538]: DEBUG oslo_concurrency.processutils [None req-abd49951-8b96-4f05-a14a-afe3a32dabb5 tempest-VolumesTransfersV355Test-221499813 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-4fe253ec-263c-4592-ac3f-b8e0eed5395a {{(pid=84538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 19:02:42 devstack sudo[90758]: pam_unix(sudo:session): session closed for user root Apr 29 19:02:42 devstack cinder-volume[84538]: DEBUG oslo_concurrency.processutils [None req-238022c2-eb13-484c-a29f-48bf68c53854 tempest-VolumesDeleteCascade-1314225595 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d" returned: 0 in 1.028s {{(pid=84538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 19:02:42 devstack cinder-volume[84538]: DEBUG cinder.manager [None req-238022c2-eb13-484c-a29f-48bf68c53854 tempest-VolumesDeleteCascade-1314225595 None] Notifying Schedulers of capabilities ... {{(pid=84538) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 29 19:02:42 devstack cinder-volume[84538]: INFO cinder.volume.manager [None req-238022c2-eb13-484c-a29f-48bf68c53854 tempest-VolumesDeleteCascade-1314225595 None] Deleted volume successfully. Apr 29 19:02:42 devstack sudo[90775]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-4fe253ec-263c-4592-ac3f-b8e0eed5395a Apr 29 19:02:42 devstack sudo[90775]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 19:02:42 devstack cinder-volume[84538]: DEBUG cinder.coordination [None req-238022c2-eb13-484c-a29f-48bf68c53854 tempest-VolumesDeleteCascade-1314225595 None] Lock "cinder-399a0e0a-846a-4fe5-9739-8ce2a71d113f-delete_volume" released by "delete_volume" :: held 3.554s {{(pid=84538) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 19:02:43 devstack sudo[90761]: pam_unix(sudo:session): session closed for user root Apr 29 19:02:43 devstack cinder-volume[84538]: DEBUG oslo_concurrency.processutils [None req-8453fdc2-4212-44d5-bdaf-c771f7163272 tempest-VolumesListAdminTestJSON-1330364154 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-1da7fd8e-b647-42bc-9f29-3bd44f1bc326" returned: 0 in 1.080s {{(pid=84538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 19:02:43 devstack cinder-volume[84538]: DEBUG oslo_concurrency.processutils [None req-8453fdc2-4212-44d5-bdaf-c771f7163272 tempest-VolumesListAdminTestJSON-1330364154 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-1da7fd8e-b647-42bc-9f29-3bd44f1bc326 {{(pid=84538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 19:02:43 devstack sudo[90759]: pam_unix(sudo:session): session closed for user root Apr 29 19:02:43 devstack cinder-volume[84538]: DEBUG oslo_concurrency.processutils [None req-46b7c1cd-9663-4a50-ad55-d10a083fcfec tempest-VolumesListAdminTestJSON-341502441 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-9a007549-a843-49a3-a898-8019d2adc730" returned: 0 in 1.277s {{(pid=84538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 19:02:43 devstack cinder-volume[84538]: DEBUG oslo_concurrency.processutils [None req-46b7c1cd-9663-4a50-ad55-d10a083fcfec tempest-VolumesListAdminTestJSON-341502441 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-9a007549-a843-49a3-a898-8019d2adc730 {{(pid=84538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 19:02:43 devstack sudo[90778]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-1da7fd8e-b647-42bc-9f29-3bd44f1bc326 Apr 29 19:02:43 devstack sudo[90778]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 19:02:43 devstack sudo[90779]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-9a007549-a843-49a3-a898-8019d2adc730 Apr 29 19:02:43 devstack sudo[90779]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 19:02:43 devstack sudo[90775]: pam_unix(sudo:session): session closed for user root Apr 29 19:02:43 devstack cinder-volume[84538]: DEBUG oslo_concurrency.processutils [None req-abd49951-8b96-4f05-a14a-afe3a32dabb5 tempest-VolumesTransfersV355Test-221499813 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-4fe253ec-263c-4592-ac3f-b8e0eed5395a" returned: 0 in 0.854s {{(pid=84538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 19:02:43 devstack cinder-volume[84538]: DEBUG cinder.volume.drivers.quobyte [None req-abd49951-8b96-4f05-a14a-afe3a32dabb5 tempest-VolumesTransfersV355Test-221499813 None] <== create_volume: return (2073ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-34312b00-dd6d-45bb-af98-75855cea8e48'} {{(pid=84538) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 29 19:02:43 devstack cinder-volume[84538]: DEBUG oslo_concurrency.lockutils [None req-abd49951-8b96-4f05-a14a-afe3a32dabb5 tempest-VolumesTransfersV355Test-221499813 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.075s {{(pid=84538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 19:02:43 devstack cinder-volume[84538]: DEBUG cinder.volume.manager [None req-abd49951-8b96-4f05-a14a-afe3a32dabb5 tempest-VolumesTransfersV355Test-221499813 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6f771fde-c5ec-4c84-b101-3862c0b469e9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4fe253ec-263c-4592-ac3f-b8e0eed5395a', 'volume_size': 1}' {{(pid=84538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 19:02:43 devstack cinder-volume[84538]: DEBUG cinder.volume.manager [None req-abd49951-8b96-4f05-a14a-afe3a32dabb5 tempest-VolumesTransfersV355Test-221499813 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (be14c328-2616-4396-8380-1a239fd91d74) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 19:02:43 devstack cinder-volume[84538]: INFO cinder.volume.flows.manager.create_volume [None req-abd49951-8b96-4f05-a14a-afe3a32dabb5 tempest-VolumesTransfersV355Test-221499813 None] Volume volume-4fe253ec-263c-4592-ac3f-b8e0eed5395a (4fe253ec-263c-4592-ac3f-b8e0eed5395a): created successfully Apr 29 19:02:43 devstack cinder-volume[84538]: DEBUG cinder.volume.manager [None req-abd49951-8b96-4f05-a14a-afe3a32dabb5 tempest-VolumesTransfersV355Test-221499813 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (be14c328-2616-4396-8380-1a239fd91d74) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 19:02:43 devstack cinder-volume[84538]: DEBUG cinder.volume.manager [None req-abd49951-8b96-4f05-a14a-afe3a32dabb5 tempest-VolumesTransfersV355Test-221499813 None] Flow 'volume_create_manager' (c2898817-f22f-4489-93b1-15ec766ae1d2) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84538) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 19:02:43 devstack cinder-volume[84538]: INFO cinder.volume.manager [None req-abd49951-8b96-4f05-a14a-afe3a32dabb5 tempest-VolumesTransfersV355Test-221499813 None] Created volume successfully. Apr 29 19:02:44 devstack sudo[90779]: pam_unix(sudo:session): session closed for user root Apr 29 19:02:44 devstack cinder-volume[84538]: DEBUG oslo_concurrency.processutils [None req-46b7c1cd-9663-4a50-ad55-d10a083fcfec tempest-VolumesListAdminTestJSON-341502441 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-9a007549-a843-49a3-a898-8019d2adc730" returned: 0 in 0.974s {{(pid=84538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 19:02:44 devstack cinder-volume[84538]: DEBUG cinder.coordination [None req-46b7c1cd-9663-4a50-ad55-d10a083fcfec tempest-VolumesListAdminTestJSON-341502441 None] Lock "cinder-quobyte-9a007549-a843-49a3-a898-8019d2adc730" released by "delete_volume" :: held 2.349s {{(pid=84538) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 19:02:44 devstack cinder-volume[84538]: DEBUG cinder.quota [None req-46b7c1cd-9663-4a50-ad55-d10a083fcfec tempest-VolumesListAdminTestJSON-341502441 None] Created reservations ['31277c89-f92e-4b3a-b447-b3b45021b5d5', 'a92f7178-92bc-4168-82a8-191396c1a0a8', '839a4f59-d1cb-4bad-b376-a084e41fd53d', 'a91775be-a60e-477a-9bd4-8512fe3f8e46'] {{(pid=84538) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 29 19:02:44 devstack sudo[90778]: pam_unix(sudo:session): session closed for user root Apr 29 19:02:44 devstack cinder-volume[84538]: DEBUG oslo_concurrency.processutils [None req-8453fdc2-4212-44d5-bdaf-c771f7163272 tempest-VolumesListAdminTestJSON-1330364154 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-1da7fd8e-b647-42bc-9f29-3bd44f1bc326" returned: 0 in 1.112s {{(pid=84538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 19:02:44 devstack cinder-volume[84538]: DEBUG cinder.coordination [None req-8453fdc2-4212-44d5-bdaf-c771f7163272 tempest-VolumesListAdminTestJSON-1330364154 None] Lock "cinder-quobyte-1da7fd8e-b647-42bc-9f29-3bd44f1bc326" released by "delete_volume" :: held 2.262s {{(pid=84538) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 19:02:44 devstack cinder-volume[84538]: DEBUG oslo_concurrency.lockutils [None req-46b7c1cd-9663-4a50-ad55-d10a083fcfec tempest-VolumesListAdminTestJSON-341502441 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 19:02:44 devstack cinder-volume[84538]: DEBUG oslo_concurrency.lockutils [None req-46b7c1cd-9663-4a50-ad55-d10a083fcfec tempest-VolumesListAdminTestJSON-341502441 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 19:02:44 devstack cinder-volume[84538]: DEBUG cinder.volume.drivers.quobyte [None req-46b7c1cd-9663-4a50-ad55-d10a083fcfec tempest-VolumesListAdminTestJSON-341502441 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-34312b00-dd6d-45bb-af98-75855cea8e48': None} {{(pid=84538) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 19:02:44 devstack cinder-volume[84538]: DEBUG cinder.volume.drivers.quobyte [None req-46b7c1cd-9663-4a50-ad55-d10a083fcfec tempest-VolumesListAdminTestJSON-341502441 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-34312b00-dd6d-45bb-af98-75855cea8e48'] {{(pid=84538) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 19:02:44 devstack cinder-volume[84538]: DEBUG oslo_concurrency.lockutils [None req-46b7c1cd-9663-4a50-ad55-d10a083fcfec tempest-VolumesListAdminTestJSON-341502441 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=84538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 19:02:44 devstack cinder-volume[84538]: DEBUG oslo_concurrency.processutils [None req-46b7c1cd-9663-4a50-ad55-d10a083fcfec tempest-VolumesListAdminTestJSON-341502441 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d {{(pid=84538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 19:02:44 devstack cinder-volume[84538]: DEBUG cinder.quota [None req-8453fdc2-4212-44d5-bdaf-c771f7163272 tempest-VolumesListAdminTestJSON-1330364154 None] Created reservations ['c2c83b86-04e9-4a56-93f4-60ccc828f735', '985e3b89-28ff-44ed-bd3b-9198f43139fb', '8229b645-2fa3-41be-b854-84293b679822', '6f207bfa-bc44-46e4-9c75-295bece537f6'] {{(pid=84538) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 29 19:02:44 devstack sudo[90821]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d Apr 29 19:02:44 devstack sudo[90821]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 19:02:44 devstack cinder-volume[84538]: DEBUG oslo_concurrency.lockutils [None req-8453fdc2-4212-44d5-bdaf-c771f7163272 tempest-VolumesListAdminTestJSON-1330364154 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 19:02:44 devstack cinder-volume[84538]: DEBUG oslo_concurrency.lockutils [None req-8453fdc2-4212-44d5-bdaf-c771f7163272 tempest-VolumesListAdminTestJSON-1330364154 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 19:02:44 devstack cinder-volume[84538]: DEBUG cinder.volume.drivers.quobyte [None req-8453fdc2-4212-44d5-bdaf-c771f7163272 tempest-VolumesListAdminTestJSON-1330364154 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-34312b00-dd6d-45bb-af98-75855cea8e48': None} {{(pid=84538) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 19:02:44 devstack cinder-volume[84538]: DEBUG cinder.volume.drivers.quobyte [None req-8453fdc2-4212-44d5-bdaf-c771f7163272 tempest-VolumesListAdminTestJSON-1330364154 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-34312b00-dd6d-45bb-af98-75855cea8e48'] {{(pid=84538) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 19:02:44 devstack cinder-volume[84538]: DEBUG oslo_concurrency.lockutils [None req-8453fdc2-4212-44d5-bdaf-c771f7163272 tempest-VolumesListAdminTestJSON-1330364154 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=84538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 19:02:44 devstack cinder-volume[84538]: DEBUG oslo_concurrency.processutils [None req-8453fdc2-4212-44d5-bdaf-c771f7163272 tempest-VolumesListAdminTestJSON-1330364154 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d {{(pid=84538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 19:02:44 devstack sudo[90823]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d Apr 29 19:02:44 devstack sudo[90823]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 19:02:44 devstack cinder-volume[84538]: DEBUG cinder.coordination [None req-f32ce934-1c01-43f8-ad86-bb9a551fee4c tempest-VolumesTransfersV355Test-413540673 None] Acquiring lock "cinder-4fe253ec-263c-4592-ac3f-b8e0eed5395a-delete_volume" by "delete_volume" {{(pid=84538) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 19:02:44 devstack cinder-volume[84538]: DEBUG cinder.coordination [None req-f32ce934-1c01-43f8-ad86-bb9a551fee4c tempest-VolumesTransfersV355Test-413540673 None] Lock "cinder-4fe253ec-263c-4592-ac3f-b8e0eed5395a-delete_volume" acquired by "delete_volume" :: waited 0.034s {{(pid=84538) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 19:02:45 devstack cinder-volume[84538]: DEBUG cinder.coordination [None req-f32ce934-1c01-43f8-ad86-bb9a551fee4c tempest-VolumesTransfersV355Test-413540673 None] Acquiring lock "cinder-quobyte-4fe253ec-263c-4592-ac3f-b8e0eed5395a" by "delete_volume" {{(pid=84538) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 19:02:45 devstack cinder-volume[84538]: DEBUG cinder.coordination [None req-f32ce934-1c01-43f8-ad86-bb9a551fee4c tempest-VolumesTransfersV355Test-413540673 None] Lock "cinder-quobyte-4fe253ec-263c-4592-ac3f-b8e0eed5395a" acquired by "delete_volume" :: waited 0.017s {{(pid=84538) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 19:02:45 devstack cinder-volume[84538]: DEBUG oslo.privsep.daemon [-] privsep: reply[2cecbed6-26dc-4f11-8ddc-94814e30c176]: (4, 'qcow2') {{(pid=85803) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 19:02:45 devstack cinder-volume[84538]: DEBUG oslo_concurrency.processutils [None req-f32ce934-1c01-43f8-ad86-bb9a551fee4c tempest-VolumesTransfersV355Test-413540673 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-4fe253ec-263c-4592-ac3f-b8e0eed5395a {{(pid=84538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 19:02:45 devstack sudo[90823]: pam_unix(sudo:session): session closed for user root Apr 29 19:02:45 devstack cinder-volume[84538]: DEBUG oslo_concurrency.processutils [None req-8453fdc2-4212-44d5-bdaf-c771f7163272 tempest-VolumesListAdminTestJSON-1330364154 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d" returned: 0 in 0.828s {{(pid=84538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 19:02:45 devstack cinder-volume[84538]: DEBUG cinder.manager [None req-8453fdc2-4212-44d5-bdaf-c771f7163272 tempest-VolumesListAdminTestJSON-1330364154 None] Notifying Schedulers of capabilities ... {{(pid=84538) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 29 19:02:45 devstack cinder-volume[84538]: INFO cinder.volume.manager [None req-8453fdc2-4212-44d5-bdaf-c771f7163272 tempest-VolumesListAdminTestJSON-1330364154 None] Deleted volume successfully. Apr 29 19:02:45 devstack sudo[90827]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-4fe253ec-263c-4592-ac3f-b8e0eed5395a Apr 29 19:02:45 devstack sudo[90827]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 19:02:45 devstack cinder-volume[84538]: DEBUG cinder.coordination [None req-8453fdc2-4212-44d5-bdaf-c771f7163272 tempest-VolumesListAdminTestJSON-1330364154 None] Lock "cinder-1da7fd8e-b647-42bc-9f29-3bd44f1bc326-delete_volume" released by "delete_volume" :: held 3.450s {{(pid=84538) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 19:02:45 devstack cinder-volume[84538]: DEBUG cinder.coordination [None req-45a3d22f-b456-42e1-a01b-5791cb514dcd tempest-VolumesListAdminTestJSON-1330364154 None] Acquiring lock "cinder-513bd8c0-d0eb-43b0-8bc4-a732f5103962-delete_volume" by "delete_volume" {{(pid=84538) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 19:02:45 devstack cinder-volume[84538]: DEBUG cinder.coordination [None req-45a3d22f-b456-42e1-a01b-5791cb514dcd tempest-VolumesListAdminTestJSON-1330364154 None] Lock "cinder-513bd8c0-d0eb-43b0-8bc4-a732f5103962-delete_volume" acquired by "delete_volume" :: waited 0.032s {{(pid=84538) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 19:02:45 devstack sudo[90821]: pam_unix(sudo:session): session closed for user root Apr 29 19:02:45 devstack cinder-volume[84538]: DEBUG oslo_concurrency.processutils [None req-46b7c1cd-9663-4a50-ad55-d10a083fcfec tempest-VolumesListAdminTestJSON-341502441 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d" returned: 0 in 1.137s {{(pid=84538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 19:02:45 devstack cinder-volume[84538]: DEBUG cinder.manager [None req-46b7c1cd-9663-4a50-ad55-d10a083fcfec tempest-VolumesListAdminTestJSON-341502441 None] Notifying Schedulers of capabilities ... {{(pid=84538) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 29 19:02:45 devstack cinder-volume[84538]: INFO cinder.volume.manager [None req-46b7c1cd-9663-4a50-ad55-d10a083fcfec tempest-VolumesListAdminTestJSON-341502441 None] Deleted volume successfully. Apr 29 19:02:45 devstack cinder-volume[84538]: DEBUG cinder.coordination [None req-46b7c1cd-9663-4a50-ad55-d10a083fcfec tempest-VolumesListAdminTestJSON-341502441 None] Lock "cinder-9a007549-a843-49a3-a898-8019d2adc730-delete_volume" released by "delete_volume" :: held 3.850s {{(pid=84538) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 19:02:45 devstack cinder-volume[84538]: DEBUG cinder.coordination [None req-45a3d22f-b456-42e1-a01b-5791cb514dcd tempest-VolumesListAdminTestJSON-1330364154 None] Acquiring lock "cinder-quobyte-513bd8c0-d0eb-43b0-8bc4-a732f5103962" by "delete_volume" {{(pid=84538) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 19:02:45 devstack cinder-volume[84538]: DEBUG cinder.coordination [None req-45a3d22f-b456-42e1-a01b-5791cb514dcd tempest-VolumesListAdminTestJSON-1330364154 None] Lock "cinder-quobyte-513bd8c0-d0eb-43b0-8bc4-a732f5103962" acquired by "delete_volume" :: waited 0.021s {{(pid=84538) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 19:02:45 devstack cinder-volume[84538]: DEBUG oslo.privsep.daemon [-] privsep: reply[881afc9f-1258-44b3-825d-3366e6e6b6f3]: (4, 'qcow2') {{(pid=85803) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 19:02:45 devstack cinder-volume[84538]: DEBUG oslo_concurrency.processutils [None req-45a3d22f-b456-42e1-a01b-5791cb514dcd tempest-VolumesListAdminTestJSON-1330364154 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-513bd8c0-d0eb-43b0-8bc4-a732f5103962 {{(pid=84538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 19:02:45 devstack sudo[90829]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-513bd8c0-d0eb-43b0-8bc4-a732f5103962 Apr 29 19:02:45 devstack sudo[90829]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 19:02:46 devstack sudo[90827]: pam_unix(sudo:session): session closed for user root Apr 29 19:02:46 devstack cinder-volume[84538]: DEBUG oslo_concurrency.processutils [None req-f32ce934-1c01-43f8-ad86-bb9a551fee4c tempest-VolumesTransfersV355Test-413540673 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-4fe253ec-263c-4592-ac3f-b8e0eed5395a" returned: 0 in 1.017s {{(pid=84538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 19:02:46 devstack cinder-volume[84538]: DEBUG oslo_concurrency.processutils [None req-f32ce934-1c01-43f8-ad86-bb9a551fee4c tempest-VolumesTransfersV355Test-413540673 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-4fe253ec-263c-4592-ac3f-b8e0eed5395a {{(pid=84538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 19:02:46 devstack sudo[90835]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-4fe253ec-263c-4592-ac3f-b8e0eed5395a Apr 29 19:02:46 devstack sudo[90835]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 19:02:46 devstack sudo[90829]: pam_unix(sudo:session): session closed for user root Apr 29 19:02:46 devstack cinder-volume[84538]: DEBUG oslo_concurrency.processutils [None req-45a3d22f-b456-42e1-a01b-5791cb514dcd tempest-VolumesListAdminTestJSON-1330364154 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-513bd8c0-d0eb-43b0-8bc4-a732f5103962" returned: 0 in 0.940s {{(pid=84538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 19:02:46 devstack cinder-volume[84538]: DEBUG oslo_concurrency.processutils [None req-45a3d22f-b456-42e1-a01b-5791cb514dcd tempest-VolumesListAdminTestJSON-1330364154 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-513bd8c0-d0eb-43b0-8bc4-a732f5103962 {{(pid=84538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 19:02:46 devstack sudo[90840]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-513bd8c0-d0eb-43b0-8bc4-a732f5103962 Apr 29 19:02:46 devstack sudo[90840]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 19:02:46 devstack sudo[90835]: pam_unix(sudo:session): session closed for user root Apr 29 19:02:46 devstack cinder-volume[84538]: DEBUG oslo_concurrency.processutils [None req-f32ce934-1c01-43f8-ad86-bb9a551fee4c tempest-VolumesTransfersV355Test-413540673 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-4fe253ec-263c-4592-ac3f-b8e0eed5395a" returned: 0 in 0.776s {{(pid=84538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 19:02:46 devstack cinder-volume[84538]: DEBUG cinder.coordination [None req-f32ce934-1c01-43f8-ad86-bb9a551fee4c tempest-VolumesTransfersV355Test-413540673 None] Lock "cinder-quobyte-4fe253ec-263c-4592-ac3f-b8e0eed5395a" released by "delete_volume" :: held 1.880s {{(pid=84538) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 19:02:46 devstack cinder-volume[84538]: DEBUG cinder.quota [None req-f32ce934-1c01-43f8-ad86-bb9a551fee4c tempest-VolumesTransfersV355Test-413540673 None] Created reservations ['85519b50-2cc9-4ee8-b34d-7e6c0767cf03', 'f495c1bc-d74a-4e94-a7be-c556c8486dc9', 'c6cce1a2-5e01-46b6-93b1-53bf94f476a1', '919fdc72-eef5-444f-9e73-c4fddac37943'] {{(pid=84538) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 29 19:02:47 devstack cinder-volume[84538]: DEBUG oslo_concurrency.lockutils [None req-f32ce934-1c01-43f8-ad86-bb9a551fee4c tempest-VolumesTransfersV355Test-413540673 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 19:02:47 devstack cinder-volume[84538]: DEBUG oslo_concurrency.lockutils [None req-f32ce934-1c01-43f8-ad86-bb9a551fee4c tempest-VolumesTransfersV355Test-413540673 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 19:02:47 devstack cinder-volume[84538]: DEBUG cinder.volume.drivers.quobyte [None req-f32ce934-1c01-43f8-ad86-bb9a551fee4c tempest-VolumesTransfersV355Test-413540673 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-34312b00-dd6d-45bb-af98-75855cea8e48': None} {{(pid=84538) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 19:02:47 devstack cinder-volume[84538]: DEBUG cinder.volume.drivers.quobyte [None req-f32ce934-1c01-43f8-ad86-bb9a551fee4c tempest-VolumesTransfersV355Test-413540673 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-34312b00-dd6d-45bb-af98-75855cea8e48'] {{(pid=84538) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 19:02:47 devstack cinder-volume[84538]: DEBUG oslo_concurrency.lockutils [None req-f32ce934-1c01-43f8-ad86-bb9a551fee4c tempest-VolumesTransfersV355Test-413540673 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=84538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 19:02:47 devstack cinder-volume[84538]: DEBUG oslo_concurrency.processutils [None req-f32ce934-1c01-43f8-ad86-bb9a551fee4c tempest-VolumesTransfersV355Test-413540673 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d {{(pid=84538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 19:02:47 devstack sudo[90844]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d Apr 29 19:02:47 devstack sudo[90844]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 19:02:47 devstack sudo[90840]: pam_unix(sudo:session): session closed for user root Apr 29 19:02:47 devstack cinder-volume[84538]: DEBUG oslo_concurrency.processutils [None req-45a3d22f-b456-42e1-a01b-5791cb514dcd tempest-VolumesListAdminTestJSON-1330364154 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-513bd8c0-d0eb-43b0-8bc4-a732f5103962" returned: 0 in 0.748s {{(pid=84538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 19:02:47 devstack cinder-volume[84538]: DEBUG cinder.coordination [None req-45a3d22f-b456-42e1-a01b-5791cb514dcd tempest-VolumesListAdminTestJSON-1330364154 None] Lock "cinder-quobyte-513bd8c0-d0eb-43b0-8bc4-a732f5103962" released by "delete_volume" :: held 1.756s {{(pid=84538) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 19:02:47 devstack cinder-volume[84538]: DEBUG cinder.quota [None req-45a3d22f-b456-42e1-a01b-5791cb514dcd tempest-VolumesListAdminTestJSON-1330364154 None] Created reservations ['32c5cc37-e5e9-47e6-a5ec-fc5e47982498', '04383ec7-b9f8-4681-b0ae-8c92616ff591', 'a58176f5-601e-4155-a999-46f99cf1dd6c', 'ddb1cb73-5708-472d-96b3-3abbdb703369'] {{(pid=84538) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 29 19:02:47 devstack cinder-volume[84538]: DEBUG oslo_concurrency.lockutils [None req-45a3d22f-b456-42e1-a01b-5791cb514dcd tempest-VolumesListAdminTestJSON-1330364154 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 19:02:47 devstack cinder-volume[84538]: DEBUG oslo_concurrency.lockutils [None req-45a3d22f-b456-42e1-a01b-5791cb514dcd tempest-VolumesListAdminTestJSON-1330364154 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 19:02:47 devstack cinder-volume[84538]: DEBUG cinder.volume.drivers.quobyte [None req-45a3d22f-b456-42e1-a01b-5791cb514dcd tempest-VolumesListAdminTestJSON-1330364154 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-34312b00-dd6d-45bb-af98-75855cea8e48': None} {{(pid=84538) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 19:02:47 devstack cinder-volume[84538]: DEBUG cinder.volume.drivers.quobyte [None req-45a3d22f-b456-42e1-a01b-5791cb514dcd tempest-VolumesListAdminTestJSON-1330364154 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-34312b00-dd6d-45bb-af98-75855cea8e48'] {{(pid=84538) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 19:02:47 devstack cinder-volume[84538]: DEBUG oslo_concurrency.lockutils [None req-45a3d22f-b456-42e1-a01b-5791cb514dcd tempest-VolumesListAdminTestJSON-1330364154 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=84538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 19:02:47 devstack cinder-volume[84538]: DEBUG oslo_concurrency.processutils [None req-45a3d22f-b456-42e1-a01b-5791cb514dcd tempest-VolumesListAdminTestJSON-1330364154 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d {{(pid=84538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 19:02:47 devstack sudo[90846]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d Apr 29 19:02:47 devstack sudo[90846]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 19:02:47 devstack cinder-volume[84538]: DEBUG cinder.coordination [None req-0743816b-f3e6-4ddf-b740-2fd9271797b9 tempest-VolumesListAdminTestJSON-1330364154 None] Acquiring lock "cinder-ff7a0714-5788-45e5-810b-2fbdc9dd8132-delete_volume" by "delete_volume" {{(pid=84538) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 19:02:47 devstack cinder-volume[84538]: DEBUG cinder.coordination [None req-0743816b-f3e6-4ddf-b740-2fd9271797b9 tempest-VolumesListAdminTestJSON-1330364154 None] Lock "cinder-ff7a0714-5788-45e5-810b-2fbdc9dd8132-delete_volume" acquired by "delete_volume" :: waited 0.044s {{(pid=84538) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 19:02:47 devstack cinder-volume[84538]: DEBUG cinder.coordination [None req-0743816b-f3e6-4ddf-b740-2fd9271797b9 tempest-VolumesListAdminTestJSON-1330364154 None] Acquiring lock "cinder-quobyte-ff7a0714-5788-45e5-810b-2fbdc9dd8132" by "delete_volume" {{(pid=84538) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 19:02:47 devstack cinder-volume[84538]: DEBUG cinder.coordination [None req-0743816b-f3e6-4ddf-b740-2fd9271797b9 tempest-VolumesListAdminTestJSON-1330364154 None] Lock "cinder-quobyte-ff7a0714-5788-45e5-810b-2fbdc9dd8132" acquired by "delete_volume" :: waited 0.034s {{(pid=84538) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 19:02:48 devstack cinder-volume[84538]: DEBUG oslo.privsep.daemon [-] privsep: reply[22da8ec4-aea5-4d93-9eae-805ad42da6ae]: (4, 'qcow2') {{(pid=85803) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 19:02:48 devstack cinder-volume[84538]: DEBUG oslo_concurrency.processutils [None req-0743816b-f3e6-4ddf-b740-2fd9271797b9 tempest-VolumesListAdminTestJSON-1330364154 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-ff7a0714-5788-45e5-810b-2fbdc9dd8132 {{(pid=84538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 19:02:48 devstack sudo[90844]: pam_unix(sudo:session): session closed for user root Apr 29 19:02:48 devstack cinder-volume[84538]: DEBUG oslo_concurrency.processutils [None req-f32ce934-1c01-43f8-ad86-bb9a551fee4c tempest-VolumesTransfersV355Test-413540673 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d" returned: 0 in 0.957s {{(pid=84538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 19:02:48 devstack cinder-volume[84538]: DEBUG cinder.manager [None req-f32ce934-1c01-43f8-ad86-bb9a551fee4c tempest-VolumesTransfersV355Test-413540673 None] Notifying Schedulers of capabilities ... {{(pid=84538) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 29 19:02:48 devstack cinder-volume[84538]: INFO cinder.volume.manager [None req-f32ce934-1c01-43f8-ad86-bb9a551fee4c tempest-VolumesTransfersV355Test-413540673 None] Deleted volume successfully. Apr 29 19:02:48 devstack cinder-volume[84538]: DEBUG cinder.coordination [None req-f32ce934-1c01-43f8-ad86-bb9a551fee4c tempest-VolumesTransfersV355Test-413540673 None] Lock "cinder-4fe253ec-263c-4592-ac3f-b8e0eed5395a-delete_volume" released by "delete_volume" :: held 3.158s {{(pid=84538) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 19:02:48 devstack sudo[90849]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-ff7a0714-5788-45e5-810b-2fbdc9dd8132 Apr 29 19:02:48 devstack sudo[90849]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 19:02:48 devstack sudo[90846]: pam_unix(sudo:session): session closed for user root Apr 29 19:02:48 devstack cinder-volume[84538]: DEBUG oslo_concurrency.processutils [None req-45a3d22f-b456-42e1-a01b-5791cb514dcd tempest-VolumesListAdminTestJSON-1330364154 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d" returned: 0 in 0.839s {{(pid=84538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 19:02:48 devstack cinder-volume[84538]: DEBUG cinder.manager [None req-45a3d22f-b456-42e1-a01b-5791cb514dcd tempest-VolumesListAdminTestJSON-1330364154 None] Notifying Schedulers of capabilities ... {{(pid=84538) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 29 19:02:48 devstack cinder-volume[84538]: INFO cinder.volume.manager [None req-45a3d22f-b456-42e1-a01b-5791cb514dcd tempest-VolumesListAdminTestJSON-1330364154 None] Deleted volume successfully. Apr 29 19:02:48 devstack cinder-volume[84538]: DEBUG cinder.coordination [None req-45a3d22f-b456-42e1-a01b-5791cb514dcd tempest-VolumesListAdminTestJSON-1330364154 None] Lock "cinder-513bd8c0-d0eb-43b0-8bc4-a732f5103962-delete_volume" released by "delete_volume" :: held 3.048s {{(pid=84538) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 19:02:48 devstack cinder-volume[84538]: DEBUG cinder.volume.flows.manager.create_volume [None req-3cba316b-cb92-4241-9d22-a6715bea4fda tempest-VolumeQuotasAdminTestJSON-31856830 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84538) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Apr 29 19:02:48 devstack cinder-volume[84538]: DEBUG cinder.volume.manager [None req-3cba316b-cb92-4241-9d22-a6715bea4fda tempest-VolumeQuotasAdminTestJSON-31856830 None] Flow 'volume_create_manager' (ee775f00-7635-4d4c-914e-f4a7da48df3c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84538) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 19:02:48 devstack cinder-volume[84538]: DEBUG cinder.volume.manager [None req-3cba316b-cb92-4241-9d22-a6715bea4fda tempest-VolumeQuotasAdminTestJSON-31856830 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ebbcab31-fbc5-4d59-9101-70cdc48f5667) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 19:02:48 devstack cinder-volume[84538]: DEBUG cinder.volume.manager [None req-3cba316b-cb92-4241-9d22-a6715bea4fda tempest-VolumeQuotasAdminTestJSON-31856830 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ebbcab31-fbc5-4d59-9101-70cdc48f5667) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-29T17:02:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-93280422',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e83ca5c7-8264-4827-ac9e-edeb3fead7e1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='523e059c0c5e449cb252c3b6087ed5d9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T17:02:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T17:02:48Z,use_quota=True,user_id='2f3611363bf6458fa06a3cf45bfefcf4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(62b05900-93e3-4190-a88f-1d87324303d1),volume_type_id=62b05900-93e3-4190-a88f-1d87324303d1)' {{(pid=84538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 19:02:48 devstack cinder-volume[84538]: DEBUG cinder.volume.manager [None req-3cba316b-cb92-4241-9d22-a6715bea4fda tempest-VolumeQuotasAdminTestJSON-31856830 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ad2261a4-f496-446b-a7a5-a7b8d5cc9305) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 19:02:48 devstack cinder-volume[84538]: DEBUG cinder.volume.manager [None req-3cba316b-cb92-4241-9d22-a6715bea4fda tempest-VolumeQuotasAdminTestJSON-31856830 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ad2261a4-f496-446b-a7a5-a7b8d5cc9305) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 19:02:48 devstack cinder-volume[84538]: DEBUG cinder.volume.manager [None req-3cba316b-cb92-4241-9d22-a6715bea4fda tempest-VolumeQuotasAdminTestJSON-31856830 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2c902536-87fb-4d0b-bf4f-59a1ca5e6954) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 19:02:48 devstack cinder-volume[84538]: DEBUG cinder.volume.manager [None req-3cba316b-cb92-4241-9d22-a6715bea4fda tempest-VolumeQuotasAdminTestJSON-31856830 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2c902536-87fb-4d0b-bf4f-59a1ca5e6954) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e83ca5c7-8264-4827-ac9e-edeb3fead7e1', 'volume_name': 'volume-e83ca5c7-8264-4827-ac9e-edeb3fead7e1', 'volume_size': 1}' {{(pid=84538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 19:02:48 devstack cinder-volume[84538]: DEBUG cinder.volume.manager [None req-3cba316b-cb92-4241-9d22-a6715bea4fda tempest-VolumeQuotasAdminTestJSON-31856830 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (89aa9158-d0f6-414a-8cbd-5c3fd21a3012) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 19:02:48 devstack cinder-volume[84538]: DEBUG cinder.volume.manager [None req-3cba316b-cb92-4241-9d22-a6715bea4fda tempest-VolumeQuotasAdminTestJSON-31856830 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (89aa9158-d0f6-414a-8cbd-5c3fd21a3012) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 19:02:48 devstack cinder-volume[84538]: DEBUG cinder.volume.manager [None req-3cba316b-cb92-4241-9d22-a6715bea4fda tempest-VolumeQuotasAdminTestJSON-31856830 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0cc4c76a-9f33-4213-bf45-b92457f56921) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 19:02:48 devstack cinder-volume[84538]: INFO cinder.volume.flows.manager.create_volume [None req-3cba316b-cb92-4241-9d22-a6715bea4fda tempest-VolumeQuotasAdminTestJSON-31856830 None] Volume e83ca5c7-8264-4827-ac9e-edeb3fead7e1: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e83ca5c7-8264-4827-ac9e-edeb3fead7e1', 'volume_size': 1} Apr 29 19:02:48 devstack cinder-volume[84538]: DEBUG oslo_concurrency.lockutils [None req-3cba316b-cb92-4241-9d22-a6715bea4fda tempest-VolumeQuotasAdminTestJSON-31856830 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 19:02:48 devstack cinder-volume[84538]: DEBUG oslo_concurrency.lockutils [None req-3cba316b-cb92-4241-9d22-a6715bea4fda tempest-VolumeQuotasAdminTestJSON-31856830 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=84538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 19:02:48 devstack cinder-volume[84538]: DEBUG cinder.volume.drivers.quobyte [None req-3cba316b-cb92-4241-9d22-a6715bea4fda tempest-VolumeQuotasAdminTestJSON-31856830 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-29T17:02:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-93280422',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e83ca5c7-8264-4827-ac9e-edeb3fead7e1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='523e059c0c5e449cb252c3b6087ed5d9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T17:02:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T17:02:48Z,use_quota=True,user_id='2f3611363bf6458fa06a3cf45bfefcf4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(62b05900-93e3-4190-a88f-1d87324303d1),volume_type_id=62b05900-93e3-4190-a88f-1d87324303d1)}" {{(pid=84538) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 29 19:02:48 devstack cinder-volume[84538]: DEBUG cinder.volume.drivers.remotefs [None req-3cba316b-cb92-4241-9d22-a6715bea4fda tempest-VolumeQuotasAdminTestJSON-31856830 None] Creating volume e83ca5c7-8264-4827-ac9e-edeb3fead7e1 {{(pid=84538) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 29 19:02:48 devstack cinder-volume[84538]: DEBUG oslo_concurrency.lockutils [None req-3cba316b-cb92-4241-9d22-a6715bea4fda tempest-VolumeQuotasAdminTestJSON-31856830 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 19:02:48 devstack cinder-volume[84538]: DEBUG oslo_concurrency.lockutils [None req-3cba316b-cb92-4241-9d22-a6715bea4fda tempest-VolumeQuotasAdminTestJSON-31856830 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=84538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 19:02:48 devstack cinder-volume[84538]: DEBUG cinder.volume.drivers.quobyte [None req-3cba316b-cb92-4241-9d22-a6715bea4fda tempest-VolumeQuotasAdminTestJSON-31856830 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-34312b00-dd6d-45bb-af98-75855cea8e48': None} {{(pid=84538) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 19:02:48 devstack cinder-volume[84538]: DEBUG cinder.volume.drivers.quobyte [None req-3cba316b-cb92-4241-9d22-a6715bea4fda tempest-VolumeQuotasAdminTestJSON-31856830 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-34312b00-dd6d-45bb-af98-75855cea8e48'] {{(pid=84538) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 19:02:48 devstack cinder-volume[84538]: DEBUG oslo_concurrency.lockutils [None req-3cba316b-cb92-4241-9d22-a6715bea4fda tempest-VolumeQuotasAdminTestJSON-31856830 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=84538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 19:02:48 devstack cinder-volume[84538]: DEBUG cinder.volume.drivers.quobyte [None req-3cba316b-cb92-4241-9d22-a6715bea4fda tempest-VolumeQuotasAdminTestJSON-31856830 None] Selected osci02.corp.quobyte.com/cinder-vol-34312b00-dd6d-45bb-af98-75855cea8e48 as target Quobyte volume. {{(pid=84538) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 29 19:02:48 devstack cinder-volume[84538]: INFO cinder.volume.drivers.remotefs [None req-3cba316b-cb92-4241-9d22-a6715bea4fda tempest-VolumeQuotasAdminTestJSON-31856830 None] casted to osci02.corp.quobyte.com/cinder-vol-34312b00-dd6d-45bb-af98-75855cea8e48 Apr 29 19:02:48 devstack cinder-volume[84538]: DEBUG oslo_concurrency.processutils [None req-3cba316b-cb92-4241-9d22-a6715bea4fda tempest-VolumeQuotasAdminTestJSON-31856830 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-e83ca5c7-8264-4827-ac9e-edeb3fead7e1 1073741824 {{(pid=84538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 19:02:48 devstack sudo[90853]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-e83ca5c7-8264-4827-ac9e-edeb3fead7e1 1073741824 Apr 29 19:02:48 devstack sudo[90853]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 19:02:48 devstack cinder-volume[84538]: DEBUG cinder.volume.flows.manager.create_volume [None req-c5dc39af-2386-401c-b921-dccb99b607a6 tempest-VolumesTransfersTest-535376244 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84538) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Apr 29 19:02:49 devstack cinder-volume[84538]: DEBUG cinder.volume.manager [None req-c5dc39af-2386-401c-b921-dccb99b607a6 tempest-VolumesTransfersTest-535376244 None] Flow 'volume_create_manager' (992c54f3-3d65-46f2-86da-00143e88ab9f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84538) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 19:02:49 devstack cinder-volume[84538]: DEBUG cinder.volume.manager [None req-c5dc39af-2386-401c-b921-dccb99b607a6 tempest-VolumesTransfersTest-535376244 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ef22d8b2-6e76-4617-b99b-d1e8b6354fa7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 19:02:49 devstack cinder-volume[84538]: DEBUG cinder.volume.manager [None req-c5dc39af-2386-401c-b921-dccb99b607a6 tempest-VolumesTransfersTest-535376244 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ef22d8b2-6e76-4617-b99b-d1e8b6354fa7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-29T17:02:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-1587089680',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e7fdf249-17a4-43e8-ad3c-5321bbc371c6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bd82f87a156b40b0b625aaa2ce2b2821',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T17:02:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T17:02:49Z,use_quota=True,user_id='5f8e19d483704583a76e6304fcab4513',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(62b05900-93e3-4190-a88f-1d87324303d1),volume_type_id=62b05900-93e3-4190-a88f-1d87324303d1)' {{(pid=84538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 19:02:49 devstack cinder-volume[84538]: DEBUG cinder.volume.manager [None req-c5dc39af-2386-401c-b921-dccb99b607a6 tempest-VolumesTransfersTest-535376244 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fb56f398-c0d9-4a08-a1b2-177dedada03e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 19:02:49 devstack sudo[90849]: pam_unix(sudo:session): session closed for user root Apr 29 19:02:49 devstack cinder-volume[84538]: DEBUG cinder.volume.manager [None req-c5dc39af-2386-401c-b921-dccb99b607a6 tempest-VolumesTransfersTest-535376244 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fb56f398-c0d9-4a08-a1b2-177dedada03e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 19:02:49 devstack cinder-volume[84538]: DEBUG cinder.volume.manager [None req-c5dc39af-2386-401c-b921-dccb99b607a6 tempest-VolumesTransfersTest-535376244 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (378a6b40-4ec6-4e8d-a949-15ead99565b3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 19:02:49 devstack cinder-volume[84538]: DEBUG cinder.volume.manager [None req-c5dc39af-2386-401c-b921-dccb99b607a6 tempest-VolumesTransfersTest-535376244 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (378a6b40-4ec6-4e8d-a949-15ead99565b3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e7fdf249-17a4-43e8-ad3c-5321bbc371c6', 'volume_name': 'volume-e7fdf249-17a4-43e8-ad3c-5321bbc371c6', 'volume_size': 1}' {{(pid=84538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 19:02:49 devstack cinder-volume[84538]: DEBUG cinder.volume.manager [None req-c5dc39af-2386-401c-b921-dccb99b607a6 tempest-VolumesTransfersTest-535376244 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5b41b1d4-8d83-4e89-b558-fff2aa4e2e94) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 19:02:49 devstack cinder-volume[84538]: DEBUG cinder.volume.manager [None req-c5dc39af-2386-401c-b921-dccb99b607a6 tempest-VolumesTransfersTest-535376244 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5b41b1d4-8d83-4e89-b558-fff2aa4e2e94) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 19:02:49 devstack cinder-volume[84538]: DEBUG cinder.volume.manager [None req-c5dc39af-2386-401c-b921-dccb99b607a6 tempest-VolumesTransfersTest-535376244 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (64d31cbd-661a-4f35-94d6-8dc2e1ed85d3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 19:02:49 devstack cinder-volume[84538]: INFO cinder.volume.flows.manager.create_volume [None req-c5dc39af-2386-401c-b921-dccb99b607a6 tempest-VolumesTransfersTest-535376244 None] Volume e7fdf249-17a4-43e8-ad3c-5321bbc371c6: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e7fdf249-17a4-43e8-ad3c-5321bbc371c6', 'volume_size': 1} Apr 29 19:02:49 devstack cinder-volume[84538]: DEBUG oslo_concurrency.lockutils [None req-c5dc39af-2386-401c-b921-dccb99b607a6 tempest-VolumesTransfersTest-535376244 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 19:02:49 devstack cinder-volume[84538]: DEBUG oslo_concurrency.processutils [None req-0743816b-f3e6-4ddf-b740-2fd9271797b9 tempest-VolumesListAdminTestJSON-1330364154 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-ff7a0714-5788-45e5-810b-2fbdc9dd8132" returned: 0 in 1.088s {{(pid=84538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 19:02:49 devstack cinder-volume[84538]: DEBUG oslo_concurrency.processutils [None req-0743816b-f3e6-4ddf-b740-2fd9271797b9 tempest-VolumesListAdminTestJSON-1330364154 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-ff7a0714-5788-45e5-810b-2fbdc9dd8132 {{(pid=84538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 19:02:49 devstack sudo[90859]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-ff7a0714-5788-45e5-810b-2fbdc9dd8132 Apr 29 19:02:49 devstack sudo[90859]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 19:02:49 devstack sudo[90853]: pam_unix(sudo:session): session closed for user root Apr 29 19:02:49 devstack cinder-volume[84538]: DEBUG oslo_concurrency.processutils [None req-3cba316b-cb92-4241-9d22-a6715bea4fda tempest-VolumeQuotasAdminTestJSON-31856830 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-e83ca5c7-8264-4827-ac9e-edeb3fead7e1 1073741824" returned: 0 in 1.008s {{(pid=84538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 19:02:49 devstack cinder-volume[84538]: DEBUG oslo_concurrency.processutils [None req-3cba316b-cb92-4241-9d22-a6715bea4fda tempest-VolumeQuotasAdminTestJSON-31856830 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-e83ca5c7-8264-4827-ac9e-edeb3fead7e1 {{(pid=84538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 19:02:49 devstack sudo[90865]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-e83ca5c7-8264-4827-ac9e-edeb3fead7e1 Apr 29 19:02:49 devstack sudo[90865]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 19:02:49 devstack sudo[90859]: pam_unix(sudo:session): session closed for user root Apr 29 19:02:49 devstack cinder-volume[84538]: DEBUG oslo_concurrency.processutils [None req-0743816b-f3e6-4ddf-b740-2fd9271797b9 tempest-VolumesListAdminTestJSON-1330364154 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-ff7a0714-5788-45e5-810b-2fbdc9dd8132" returned: 0 in 0.680s {{(pid=84538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 19:02:49 devstack cinder-volume[84538]: DEBUG cinder.coordination [None req-0743816b-f3e6-4ddf-b740-2fd9271797b9 tempest-VolumesListAdminTestJSON-1330364154 None] Lock "cinder-quobyte-ff7a0714-5788-45e5-810b-2fbdc9dd8132" released by "delete_volume" :: held 1.846s {{(pid=84538) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 19:02:49 devstack cinder-volume[84538]: DEBUG cinder.quota [None req-0743816b-f3e6-4ddf-b740-2fd9271797b9 tempest-VolumesListAdminTestJSON-1330364154 None] Created reservations ['fb9fabf9-a740-4f14-b0f5-dc6e6eee6afd', '2136e36d-99e2-4042-a64f-ddd17ce0ecdf', 'ecc997ae-9a01-4d15-ad94-453517895484', 'd07828c6-5fd4-4fae-92c3-0e4c5d551222'] {{(pid=84538) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 29 19:02:49 devstack cinder-volume[84538]: DEBUG oslo_concurrency.lockutils [None req-0743816b-f3e6-4ddf-b740-2fd9271797b9 tempest-VolumesListAdminTestJSON-1330364154 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 19:02:49 devstack cinder-volume[84538]: DEBUG oslo_concurrency.lockutils [None req-0743816b-f3e6-4ddf-b740-2fd9271797b9 tempest-VolumesListAdminTestJSON-1330364154 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=84538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 19:02:49 devstack cinder-volume[84538]: DEBUG cinder.volume.drivers.quobyte [None req-0743816b-f3e6-4ddf-b740-2fd9271797b9 tempest-VolumesListAdminTestJSON-1330364154 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-34312b00-dd6d-45bb-af98-75855cea8e48': None} {{(pid=84538) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 19:02:49 devstack cinder-volume[84538]: DEBUG cinder.volume.drivers.quobyte [None req-0743816b-f3e6-4ddf-b740-2fd9271797b9 tempest-VolumesListAdminTestJSON-1330364154 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-34312b00-dd6d-45bb-af98-75855cea8e48'] {{(pid=84538) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 19:02:49 devstack cinder-volume[84538]: DEBUG oslo_concurrency.lockutils [None req-0743816b-f3e6-4ddf-b740-2fd9271797b9 tempest-VolumesListAdminTestJSON-1330364154 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=84538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 19:02:49 devstack cinder-volume[84538]: DEBUG oslo_concurrency.processutils [None req-0743816b-f3e6-4ddf-b740-2fd9271797b9 tempest-VolumesListAdminTestJSON-1330364154 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d {{(pid=84538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 19:02:49 devstack sudo[90868]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d Apr 29 19:02:49 devstack sudo[90868]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 19:02:50 devstack sudo[90865]: pam_unix(sudo:session): session closed for user root Apr 29 19:02:50 devstack cinder-volume[84538]: DEBUG oslo_concurrency.processutils [None req-3cba316b-cb92-4241-9d22-a6715bea4fda tempest-VolumeQuotasAdminTestJSON-31856830 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-e83ca5c7-8264-4827-ac9e-edeb3fead7e1" returned: 0 in 0.671s {{(pid=84538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 19:02:50 devstack cinder-volume[84538]: DEBUG cinder.volume.drivers.quobyte [None req-3cba316b-cb92-4241-9d22-a6715bea4fda tempest-VolumeQuotasAdminTestJSON-31856830 None] <== create_volume: return (1730ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-34312b00-dd6d-45bb-af98-75855cea8e48'} {{(pid=84538) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 29 19:02:50 devstack cinder-volume[84538]: DEBUG oslo_concurrency.lockutils [None req-3cba316b-cb92-4241-9d22-a6715bea4fda tempest-VolumeQuotasAdminTestJSON-31856830 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.734s {{(pid=84538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 19:02:50 devstack cinder-volume[84538]: DEBUG oslo_concurrency.lockutils [None req-c5dc39af-2386-401c-b921-dccb99b607a6 tempest-VolumesTransfersTest-535376244 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.170s {{(pid=84538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 19:02:50 devstack cinder-volume[84538]: DEBUG cinder.volume.drivers.quobyte [None req-c5dc39af-2386-401c-b921-dccb99b607a6 tempest-VolumesTransfersTest-535376244 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-29T17:02:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-1587089680',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e7fdf249-17a4-43e8-ad3c-5321bbc371c6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bd82f87a156b40b0b625aaa2ce2b2821',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T17:02:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T17:02:49Z,use_quota=True,user_id='5f8e19d483704583a76e6304fcab4513',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(62b05900-93e3-4190-a88f-1d87324303d1),volume_type_id=62b05900-93e3-4190-a88f-1d87324303d1)}" {{(pid=84538) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 29 19:02:50 devstack cinder-volume[84538]: DEBUG cinder.volume.drivers.remotefs [None req-c5dc39af-2386-401c-b921-dccb99b607a6 tempest-VolumesTransfersTest-535376244 None] Creating volume e7fdf249-17a4-43e8-ad3c-5321bbc371c6 {{(pid=84538) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 29 19:02:50 devstack cinder-volume[84538]: DEBUG oslo_concurrency.lockutils [None req-c5dc39af-2386-401c-b921-dccb99b607a6 tempest-VolumesTransfersTest-535376244 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 19:02:50 devstack cinder-volume[84538]: DEBUG oslo_concurrency.lockutils [None req-c5dc39af-2386-401c-b921-dccb99b607a6 tempest-VolumesTransfersTest-535376244 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=84538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 19:02:50 devstack cinder-volume[84538]: DEBUG cinder.volume.drivers.quobyte [None req-c5dc39af-2386-401c-b921-dccb99b607a6 tempest-VolumesTransfersTest-535376244 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-34312b00-dd6d-45bb-af98-75855cea8e48': None} {{(pid=84538) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 19:02:50 devstack cinder-volume[84538]: DEBUG cinder.volume.drivers.quobyte [None req-c5dc39af-2386-401c-b921-dccb99b607a6 tempest-VolumesTransfersTest-535376244 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-34312b00-dd6d-45bb-af98-75855cea8e48'] {{(pid=84538) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 19:02:50 devstack cinder-volume[84538]: DEBUG oslo_concurrency.lockutils [None req-c5dc39af-2386-401c-b921-dccb99b607a6 tempest-VolumesTransfersTest-535376244 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=84538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 19:02:50 devstack cinder-volume[84538]: DEBUG cinder.volume.drivers.quobyte [None req-c5dc39af-2386-401c-b921-dccb99b607a6 tempest-VolumesTransfersTest-535376244 None] Selected osci02.corp.quobyte.com/cinder-vol-34312b00-dd6d-45bb-af98-75855cea8e48 as target Quobyte volume. {{(pid=84538) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 29 19:02:50 devstack cinder-volume[84538]: INFO cinder.volume.drivers.remotefs [None req-c5dc39af-2386-401c-b921-dccb99b607a6 tempest-VolumesTransfersTest-535376244 None] casted to osci02.corp.quobyte.com/cinder-vol-34312b00-dd6d-45bb-af98-75855cea8e48 Apr 29 19:02:50 devstack cinder-volume[84538]: DEBUG oslo_concurrency.processutils [None req-c5dc39af-2386-401c-b921-dccb99b607a6 tempest-VolumesTransfersTest-535376244 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-e7fdf249-17a4-43e8-ad3c-5321bbc371c6 1073741824 {{(pid=84538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 19:02:50 devstack cinder-volume[84538]: DEBUG cinder.volume.manager [None req-3cba316b-cb92-4241-9d22-a6715bea4fda tempest-VolumeQuotasAdminTestJSON-31856830 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0cc4c76a-9f33-4213-bf45-b92457f56921) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e83ca5c7-8264-4827-ac9e-edeb3fead7e1', 'volume_size': 1}' {{(pid=84538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 19:02:50 devstack sudo[90871]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-e7fdf249-17a4-43e8-ad3c-5321bbc371c6 1073741824 Apr 29 19:02:50 devstack sudo[90871]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 19:02:50 devstack cinder-volume[84538]: DEBUG cinder.volume.manager [None req-3cba316b-cb92-4241-9d22-a6715bea4fda tempest-VolumeQuotasAdminTestJSON-31856830 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (553e127b-6565-49be-b458-df03d94c754d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 19:02:50 devstack cinder-volume[84538]: INFO cinder.volume.flows.manager.create_volume [None req-3cba316b-cb92-4241-9d22-a6715bea4fda tempest-VolumeQuotasAdminTestJSON-31856830 None] Volume volume-e83ca5c7-8264-4827-ac9e-edeb3fead7e1 (e83ca5c7-8264-4827-ac9e-edeb3fead7e1): created successfully Apr 29 19:02:50 devstack cinder-volume[84538]: DEBUG cinder.volume.manager [None req-3cba316b-cb92-4241-9d22-a6715bea4fda tempest-VolumeQuotasAdminTestJSON-31856830 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (553e127b-6565-49be-b458-df03d94c754d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 19:02:50 devstack cinder-volume[84538]: DEBUG cinder.volume.manager [None req-3cba316b-cb92-4241-9d22-a6715bea4fda tempest-VolumeQuotasAdminTestJSON-31856830 None] Flow 'volume_create_manager' (ee775f00-7635-4d4c-914e-f4a7da48df3c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84538) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 19:02:50 devstack cinder-volume[84538]: INFO cinder.volume.manager [None req-3cba316b-cb92-4241-9d22-a6715bea4fda tempest-VolumeQuotasAdminTestJSON-31856830 None] Created volume successfully. Apr 29 19:02:50 devstack sudo[90868]: pam_unix(sudo:session): session closed for user root Apr 29 19:02:50 devstack cinder-volume[84538]: DEBUG oslo_concurrency.processutils [None req-0743816b-f3e6-4ddf-b740-2fd9271797b9 tempest-VolumesListAdminTestJSON-1330364154 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d" returned: 0 in 0.847s {{(pid=84538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 19:02:50 devstack cinder-volume[84538]: DEBUG cinder.manager [None req-0743816b-f3e6-4ddf-b740-2fd9271797b9 tempest-VolumesListAdminTestJSON-1330364154 None] Notifying Schedulers of capabilities ... {{(pid=84538) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 29 19:02:50 devstack cinder-volume[84538]: INFO cinder.volume.manager [None req-0743816b-f3e6-4ddf-b740-2fd9271797b9 tempest-VolumesListAdminTestJSON-1330364154 None] Deleted volume successfully. Apr 29 19:02:50 devstack cinder-volume[84538]: DEBUG cinder.coordination [None req-271c33ad-3c41-4c19-b2f8-a5f598587aca tempest-VolumeQuotasAdminTestJSON-31856830 None] Acquiring lock "cinder-e83ca5c7-8264-4827-ac9e-edeb3fead7e1-delete_volume" by "delete_volume" {{(pid=84538) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 19:02:50 devstack cinder-volume[84538]: DEBUG cinder.coordination [None req-0743816b-f3e6-4ddf-b740-2fd9271797b9 tempest-VolumesListAdminTestJSON-1330364154 None] Lock "cinder-ff7a0714-5788-45e5-810b-2fbdc9dd8132-delete_volume" released by "delete_volume" :: held 3.025s {{(pid=84538) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 19:02:50 devstack cinder-volume[84538]: DEBUG cinder.coordination [None req-271c33ad-3c41-4c19-b2f8-a5f598587aca tempest-VolumeQuotasAdminTestJSON-31856830 None] Lock "cinder-e83ca5c7-8264-4827-ac9e-edeb3fead7e1-delete_volume" acquired by "delete_volume" :: waited 0.033s {{(pid=84538) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 19:02:50 devstack cinder-volume[84538]: DEBUG cinder.coordination [None req-271c33ad-3c41-4c19-b2f8-a5f598587aca tempest-VolumeQuotasAdminTestJSON-31856830 None] Acquiring lock "cinder-quobyte-e83ca5c7-8264-4827-ac9e-edeb3fead7e1" by "delete_volume" {{(pid=84538) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 19:02:50 devstack cinder-volume[84538]: DEBUG cinder.coordination [None req-271c33ad-3c41-4c19-b2f8-a5f598587aca tempest-VolumeQuotasAdminTestJSON-31856830 None] Lock "cinder-quobyte-e83ca5c7-8264-4827-ac9e-edeb3fead7e1" acquired by "delete_volume" :: waited 0.023s {{(pid=84538) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 19:02:51 devstack cinder-volume[84538]: DEBUG oslo.privsep.daemon [-] privsep: reply[6b22e03b-bfba-4ebe-9064-9736e125d7cf]: (4, 'qcow2') {{(pid=85803) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 19:02:51 devstack cinder-volume[84538]: DEBUG oslo_concurrency.processutils [None req-271c33ad-3c41-4c19-b2f8-a5f598587aca tempest-VolumeQuotasAdminTestJSON-31856830 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-e83ca5c7-8264-4827-ac9e-edeb3fead7e1 {{(pid=84538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 19:02:51 devstack sudo[90875]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-e83ca5c7-8264-4827-ac9e-edeb3fead7e1 Apr 29 19:02:51 devstack sudo[90875]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 19:02:51 devstack sudo[90871]: pam_unix(sudo:session): session closed for user root Apr 29 19:02:51 devstack cinder-volume[84538]: DEBUG oslo_concurrency.processutils [None req-c5dc39af-2386-401c-b921-dccb99b607a6 tempest-VolumesTransfersTest-535376244 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-e7fdf249-17a4-43e8-ad3c-5321bbc371c6 1073741824" returned: 0 in 1.222s {{(pid=84538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 19:02:51 devstack cinder-volume[84538]: DEBUG oslo_concurrency.processutils [None req-c5dc39af-2386-401c-b921-dccb99b607a6 tempest-VolumesTransfersTest-535376244 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-e7fdf249-17a4-43e8-ad3c-5321bbc371c6 {{(pid=84538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 19:02:51 devstack sudo[90881]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-e7fdf249-17a4-43e8-ad3c-5321bbc371c6 Apr 29 19:02:51 devstack sudo[90881]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 19:02:51 devstack sudo[90875]: pam_unix(sudo:session): session closed for user root Apr 29 19:02:51 devstack cinder-volume[84538]: DEBUG oslo_concurrency.processutils [None req-271c33ad-3c41-4c19-b2f8-a5f598587aca tempest-VolumeQuotasAdminTestJSON-31856830 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-e83ca5c7-8264-4827-ac9e-edeb3fead7e1" returned: 0 in 0.979s {{(pid=84538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 19:02:51 devstack cinder-volume[84538]: DEBUG oslo_concurrency.processutils [None req-271c33ad-3c41-4c19-b2f8-a5f598587aca tempest-VolumeQuotasAdminTestJSON-31856830 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-e83ca5c7-8264-4827-ac9e-edeb3fead7e1 {{(pid=84538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 19:02:52 devstack sudo[90887]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-e83ca5c7-8264-4827-ac9e-edeb3fead7e1 Apr 29 19:02:52 devstack sudo[90887]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 19:02:52 devstack sudo[90881]: pam_unix(sudo:session): session closed for user root Apr 29 19:02:52 devstack cinder-volume[84538]: DEBUG oslo_concurrency.processutils [None req-c5dc39af-2386-401c-b921-dccb99b607a6 tempest-VolumesTransfersTest-535376244 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-e7fdf249-17a4-43e8-ad3c-5321bbc371c6" returned: 0 in 0.762s {{(pid=84538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 19:02:52 devstack cinder-volume[84538]: DEBUG cinder.volume.drivers.quobyte [None req-c5dc39af-2386-401c-b921-dccb99b607a6 tempest-VolumesTransfersTest-535376244 None] <== create_volume: return (2039ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-34312b00-dd6d-45bb-af98-75855cea8e48'} {{(pid=84538) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 29 19:02:52 devstack cinder-volume[84538]: DEBUG oslo_concurrency.lockutils [None req-c5dc39af-2386-401c-b921-dccb99b607a6 tempest-VolumesTransfersTest-535376244 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.044s {{(pid=84538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 19:02:52 devstack cinder-volume[84538]: DEBUG cinder.volume.manager [None req-c5dc39af-2386-401c-b921-dccb99b607a6 tempest-VolumesTransfersTest-535376244 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (64d31cbd-661a-4f35-94d6-8dc2e1ed85d3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e7fdf249-17a4-43e8-ad3c-5321bbc371c6', 'volume_size': 1}' {{(pid=84538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 19:02:52 devstack cinder-volume[84538]: DEBUG cinder.volume.manager [None req-c5dc39af-2386-401c-b921-dccb99b607a6 tempest-VolumesTransfersTest-535376244 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (88fa0c01-6240-48d9-ba6c-0b08c469f04d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 19:02:52 devstack cinder-volume[84538]: INFO cinder.volume.flows.manager.create_volume [None req-c5dc39af-2386-401c-b921-dccb99b607a6 tempest-VolumesTransfersTest-535376244 None] Volume volume-e7fdf249-17a4-43e8-ad3c-5321bbc371c6 (e7fdf249-17a4-43e8-ad3c-5321bbc371c6): created successfully Apr 29 19:02:52 devstack cinder-volume[84538]: DEBUG cinder.volume.manager [None req-c5dc39af-2386-401c-b921-dccb99b607a6 tempest-VolumesTransfersTest-535376244 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (88fa0c01-6240-48d9-ba6c-0b08c469f04d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 19:02:52 devstack cinder-volume[84538]: DEBUG cinder.volume.manager [None req-c5dc39af-2386-401c-b921-dccb99b607a6 tempest-VolumesTransfersTest-535376244 None] Flow 'volume_create_manager' (992c54f3-3d65-46f2-86da-00143e88ab9f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84538) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 19:02:52 devstack cinder-volume[84538]: INFO cinder.volume.manager [None req-c5dc39af-2386-401c-b921-dccb99b607a6 tempest-VolumesTransfersTest-535376244 None] Created volume successfully. Apr 29 19:02:52 devstack sudo[90887]: pam_unix(sudo:session): session closed for user root Apr 29 19:02:52 devstack cinder-volume[84538]: DEBUG oslo_concurrency.processutils [None req-271c33ad-3c41-4c19-b2f8-a5f598587aca tempest-VolumeQuotasAdminTestJSON-31856830 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-e83ca5c7-8264-4827-ac9e-edeb3fead7e1" returned: 0 in 0.747s {{(pid=84538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 19:02:52 devstack cinder-volume[84538]: DEBUG cinder.coordination [None req-271c33ad-3c41-4c19-b2f8-a5f598587aca tempest-VolumeQuotasAdminTestJSON-31856830 None] Lock "cinder-quobyte-e83ca5c7-8264-4827-ac9e-edeb3fead7e1" released by "delete_volume" :: held 1.807s {{(pid=84538) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 19:02:52 devstack cinder-volume[84538]: DEBUG cinder.quota [None req-271c33ad-3c41-4c19-b2f8-a5f598587aca tempest-VolumeQuotasAdminTestJSON-31856830 None] Created reservations ['3bf29673-05f0-496e-a964-dc94d2858f55', '403c6d29-ac2a-4bf6-ac82-58bb2ea6e41b', '3333cca1-6da2-451f-b0ca-a1c05996f8c9', 'd51635e7-3a8b-4353-b4a0-772b7715c07a'] {{(pid=84538) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 29 19:02:52 devstack cinder-volume[84538]: DEBUG oslo_concurrency.lockutils [None req-271c33ad-3c41-4c19-b2f8-a5f598587aca tempest-VolumeQuotasAdminTestJSON-31856830 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 19:02:52 devstack cinder-volume[84538]: DEBUG oslo_concurrency.lockutils [None req-271c33ad-3c41-4c19-b2f8-a5f598587aca tempest-VolumeQuotasAdminTestJSON-31856830 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 19:02:52 devstack cinder-volume[84538]: DEBUG cinder.volume.drivers.quobyte [None req-271c33ad-3c41-4c19-b2f8-a5f598587aca tempest-VolumeQuotasAdminTestJSON-31856830 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-34312b00-dd6d-45bb-af98-75855cea8e48': None} {{(pid=84538) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 19:02:52 devstack cinder-volume[84538]: DEBUG cinder.volume.drivers.quobyte [None req-271c33ad-3c41-4c19-b2f8-a5f598587aca tempest-VolumeQuotasAdminTestJSON-31856830 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-34312b00-dd6d-45bb-af98-75855cea8e48'] {{(pid=84538) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 19:02:52 devstack cinder-volume[84538]: DEBUG oslo_concurrency.lockutils [None req-271c33ad-3c41-4c19-b2f8-a5f598587aca tempest-VolumeQuotasAdminTestJSON-31856830 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=84538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 19:02:52 devstack cinder-volume[84538]: DEBUG oslo_concurrency.processutils [None req-271c33ad-3c41-4c19-b2f8-a5f598587aca tempest-VolumeQuotasAdminTestJSON-31856830 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d {{(pid=84538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 19:02:52 devstack sudo[90891]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d Apr 29 19:02:52 devstack sudo[90891]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 19:02:53 devstack cinder-volume[84538]: DEBUG cinder.volume.flows.manager.create_volume [None req-55a0e26c-d6b6-457c-aa62-c946e13fbceb tempest-VolumeQuotasAdminTestJSON-31856830 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84538) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Apr 29 19:02:53 devstack sudo[90891]: pam_unix(sudo:session): session closed for user root Apr 29 19:02:53 devstack cinder-volume[84538]: DEBUG cinder.volume.manager [None req-55a0e26c-d6b6-457c-aa62-c946e13fbceb tempest-VolumeQuotasAdminTestJSON-31856830 None] Flow 'volume_create_manager' (1c39f8ac-80c9-4355-ac90-53860a6c6955) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84538) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 19:02:53 devstack cinder-volume[84538]: DEBUG cinder.volume.manager [None req-55a0e26c-d6b6-457c-aa62-c946e13fbceb tempest-VolumeQuotasAdminTestJSON-31856830 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (86742164-7a31-4aba-b0a6-8dd1ad171eec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 19:02:53 devstack cinder-volume[84538]: DEBUG oslo_concurrency.processutils [None req-271c33ad-3c41-4c19-b2f8-a5f598587aca tempest-VolumeQuotasAdminTestJSON-31856830 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d" returned: 0 in 0.953s {{(pid=84538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 19:02:53 devstack cinder-volume[84538]: DEBUG cinder.manager [None req-271c33ad-3c41-4c19-b2f8-a5f598587aca tempest-VolumeQuotasAdminTestJSON-31856830 None] Notifying Schedulers of capabilities ... {{(pid=84538) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 29 19:02:53 devstack cinder-volume[84538]: INFO cinder.volume.manager [None req-271c33ad-3c41-4c19-b2f8-a5f598587aca tempest-VolumeQuotasAdminTestJSON-31856830 None] Deleted volume successfully. Apr 29 19:02:53 devstack cinder-volume[84538]: DEBUG cinder.volume.manager [None req-55a0e26c-d6b6-457c-aa62-c946e13fbceb tempest-VolumeQuotasAdminTestJSON-31856830 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (86742164-7a31-4aba-b0a6-8dd1ad171eec) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-29T17:02:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-72240317',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=33eb0b03-57ba-4223-b34b-b4253cdfbd81,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='523e059c0c5e449cb252c3b6087ed5d9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T17:02:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T17:02:54Z,use_quota=True,user_id='2f3611363bf6458fa06a3cf45bfefcf4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(62b05900-93e3-4190-a88f-1d87324303d1),volume_type_id=62b05900-93e3-4190-a88f-1d87324303d1)' {{(pid=84538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 19:02:53 devstack cinder-volume[84538]: DEBUG cinder.volume.manager [None req-55a0e26c-d6b6-457c-aa62-c946e13fbceb tempest-VolumeQuotasAdminTestJSON-31856830 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2add3d64-339c-4473-af0c-540413806a87) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 19:02:53 devstack cinder-volume[84538]: DEBUG cinder.volume.manager [None req-55a0e26c-d6b6-457c-aa62-c946e13fbceb tempest-VolumeQuotasAdminTestJSON-31856830 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2add3d64-339c-4473-af0c-540413806a87) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 19:02:53 devstack cinder-volume[84538]: DEBUG cinder.volume.manager [None req-55a0e26c-d6b6-457c-aa62-c946e13fbceb tempest-VolumeQuotasAdminTestJSON-31856830 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (252c0f83-b2a1-4915-9458-5b8883c5c0cf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 19:02:53 devstack cinder-volume[84538]: DEBUG cinder.volume.manager [None req-55a0e26c-d6b6-457c-aa62-c946e13fbceb tempest-VolumeQuotasAdminTestJSON-31856830 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (252c0f83-b2a1-4915-9458-5b8883c5c0cf) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '33eb0b03-57ba-4223-b34b-b4253cdfbd81', 'volume_name': 'volume-33eb0b03-57ba-4223-b34b-b4253cdfbd81', 'volume_size': 1}' {{(pid=84538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 19:02:53 devstack cinder-volume[84538]: DEBUG cinder.volume.manager [None req-55a0e26c-d6b6-457c-aa62-c946e13fbceb tempest-VolumeQuotasAdminTestJSON-31856830 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6f1be95e-64b6-46f2-87a8-070ed6fc75fd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 19:02:53 devstack cinder-volume[84538]: DEBUG cinder.volume.manager [None req-55a0e26c-d6b6-457c-aa62-c946e13fbceb tempest-VolumeQuotasAdminTestJSON-31856830 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6f1be95e-64b6-46f2-87a8-070ed6fc75fd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 19:02:53 devstack cinder-volume[84538]: DEBUG cinder.volume.manager [None req-55a0e26c-d6b6-457c-aa62-c946e13fbceb tempest-VolumeQuotasAdminTestJSON-31856830 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fd7a6ae2-6272-41b6-a36d-878dd1b791c2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 19:02:53 devstack cinder-volume[84538]: INFO cinder.volume.flows.manager.create_volume [None req-55a0e26c-d6b6-457c-aa62-c946e13fbceb tempest-VolumeQuotasAdminTestJSON-31856830 None] Volume 33eb0b03-57ba-4223-b34b-b4253cdfbd81: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-33eb0b03-57ba-4223-b34b-b4253cdfbd81', 'volume_size': 1} Apr 29 19:02:53 devstack cinder-volume[84538]: DEBUG oslo_concurrency.lockutils [None req-55a0e26c-d6b6-457c-aa62-c946e13fbceb tempest-VolumeQuotasAdminTestJSON-31856830 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 19:02:53 devstack cinder-volume[84538]: DEBUG oslo_concurrency.lockutils [None req-55a0e26c-d6b6-457c-aa62-c946e13fbceb tempest-VolumeQuotasAdminTestJSON-31856830 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=84538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 19:02:53 devstack cinder-volume[84538]: DEBUG cinder.volume.drivers.quobyte [None req-55a0e26c-d6b6-457c-aa62-c946e13fbceb tempest-VolumeQuotasAdminTestJSON-31856830 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-29T17:02:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-72240317',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=33eb0b03-57ba-4223-b34b-b4253cdfbd81,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='523e059c0c5e449cb252c3b6087ed5d9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T17:02:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T17:02:54Z,use_quota=True,user_id='2f3611363bf6458fa06a3cf45bfefcf4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(62b05900-93e3-4190-a88f-1d87324303d1),volume_type_id=62b05900-93e3-4190-a88f-1d87324303d1)}" {{(pid=84538) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 29 19:02:53 devstack cinder-volume[84538]: DEBUG cinder.volume.drivers.remotefs [None req-55a0e26c-d6b6-457c-aa62-c946e13fbceb tempest-VolumeQuotasAdminTestJSON-31856830 None] Creating volume 33eb0b03-57ba-4223-b34b-b4253cdfbd81 {{(pid=84538) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 29 19:02:53 devstack cinder-volume[84538]: DEBUG oslo_concurrency.lockutils [None req-55a0e26c-d6b6-457c-aa62-c946e13fbceb tempest-VolumeQuotasAdminTestJSON-31856830 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 19:02:53 devstack cinder-volume[84538]: DEBUG oslo_concurrency.lockutils [None req-55a0e26c-d6b6-457c-aa62-c946e13fbceb tempest-VolumeQuotasAdminTestJSON-31856830 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=84538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 19:02:53 devstack cinder-volume[84538]: DEBUG cinder.volume.drivers.quobyte [None req-55a0e26c-d6b6-457c-aa62-c946e13fbceb tempest-VolumeQuotasAdminTestJSON-31856830 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-34312b00-dd6d-45bb-af98-75855cea8e48': None} {{(pid=84538) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 19:02:53 devstack cinder-volume[84538]: DEBUG cinder.volume.drivers.quobyte [None req-55a0e26c-d6b6-457c-aa62-c946e13fbceb tempest-VolumeQuotasAdminTestJSON-31856830 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-34312b00-dd6d-45bb-af98-75855cea8e48'] {{(pid=84538) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 19:02:53 devstack cinder-volume[84538]: DEBUG oslo_concurrency.lockutils [None req-55a0e26c-d6b6-457c-aa62-c946e13fbceb tempest-VolumeQuotasAdminTestJSON-31856830 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=84538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 19:02:53 devstack cinder-volume[84538]: DEBUG cinder.volume.drivers.quobyte [None req-55a0e26c-d6b6-457c-aa62-c946e13fbceb tempest-VolumeQuotasAdminTestJSON-31856830 None] Selected osci02.corp.quobyte.com/cinder-vol-34312b00-dd6d-45bb-af98-75855cea8e48 as target Quobyte volume. {{(pid=84538) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 29 19:02:53 devstack cinder-volume[84538]: INFO cinder.volume.drivers.remotefs [None req-55a0e26c-d6b6-457c-aa62-c946e13fbceb tempest-VolumeQuotasAdminTestJSON-31856830 None] casted to osci02.corp.quobyte.com/cinder-vol-34312b00-dd6d-45bb-af98-75855cea8e48 Apr 29 19:02:53 devstack cinder-volume[84538]: DEBUG oslo_concurrency.processutils [None req-55a0e26c-d6b6-457c-aa62-c946e13fbceb tempest-VolumeQuotasAdminTestJSON-31856830 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-33eb0b03-57ba-4223-b34b-b4253cdfbd81 1073741824 {{(pid=84538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 19:02:53 devstack sudo[90894]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-33eb0b03-57ba-4223-b34b-b4253cdfbd81 1073741824 Apr 29 19:02:53 devstack sudo[90894]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 19:02:53 devstack cinder-volume[84538]: DEBUG cinder.coordination [None req-271c33ad-3c41-4c19-b2f8-a5f598587aca tempest-VolumeQuotasAdminTestJSON-31856830 None] Lock "cinder-e83ca5c7-8264-4827-ac9e-edeb3fead7e1-delete_volume" released by "delete_volume" :: held 3.101s {{(pid=84538) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 19:02:54 devstack cinder-volume[84538]: INFO cinder.volume.manager [None req-4d1996f2-2a60-40cd-b41d-c864952e9060 tempest-VolumesTransfersTest-595461664 None] Transfer volume completed successfully. Apr 29 19:02:54 devstack sudo[90894]: pam_unix(sudo:session): session closed for user root Apr 29 19:02:54 devstack cinder-volume[84538]: DEBUG oslo_concurrency.processutils [None req-55a0e26c-d6b6-457c-aa62-c946e13fbceb tempest-VolumeQuotasAdminTestJSON-31856830 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-33eb0b03-57ba-4223-b34b-b4253cdfbd81 1073741824" returned: 0 in 1.051s {{(pid=84538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 19:02:55 devstack cinder-volume[84538]: DEBUG oslo_concurrency.processutils [None req-55a0e26c-d6b6-457c-aa62-c946e13fbceb tempest-VolumeQuotasAdminTestJSON-31856830 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-33eb0b03-57ba-4223-b34b-b4253cdfbd81 {{(pid=84538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 19:02:55 devstack sudo[90906]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-33eb0b03-57ba-4223-b34b-b4253cdfbd81 Apr 29 19:02:55 devstack sudo[90906]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 19:02:55 devstack sudo[90906]: pam_unix(sudo:session): session closed for user root Apr 29 19:02:55 devstack cinder-volume[84538]: DEBUG oslo_concurrency.processutils [None req-55a0e26c-d6b6-457c-aa62-c946e13fbceb tempest-VolumeQuotasAdminTestJSON-31856830 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-33eb0b03-57ba-4223-b34b-b4253cdfbd81" returned: 0 in 0.867s {{(pid=84538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 19:02:55 devstack cinder-volume[84538]: DEBUG cinder.volume.drivers.quobyte [None req-55a0e26c-d6b6-457c-aa62-c946e13fbceb tempest-VolumeQuotasAdminTestJSON-31856830 None] <== create_volume: return (1990ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-34312b00-dd6d-45bb-af98-75855cea8e48'} {{(pid=84538) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 29 19:02:55 devstack cinder-volume[84538]: DEBUG oslo_concurrency.lockutils [None req-55a0e26c-d6b6-457c-aa62-c946e13fbceb tempest-VolumeQuotasAdminTestJSON-31856830 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.994s {{(pid=84538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 19:02:55 devstack cinder-volume[84538]: DEBUG cinder.volume.manager [None req-55a0e26c-d6b6-457c-aa62-c946e13fbceb tempest-VolumeQuotasAdminTestJSON-31856830 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fd7a6ae2-6272-41b6-a36d-878dd1b791c2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-33eb0b03-57ba-4223-b34b-b4253cdfbd81', 'volume_size': 1}' {{(pid=84538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 19:02:55 devstack cinder-volume[84538]: DEBUG cinder.volume.manager [None req-55a0e26c-d6b6-457c-aa62-c946e13fbceb tempest-VolumeQuotasAdminTestJSON-31856830 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (96d5ae48-856e-49f1-867d-502f66d7f7d8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 19:02:55 devstack cinder-volume[84538]: DEBUG cinder.coordination [None req-3b09da85-ecc1-42c4-91af-0a911abb3118 tempest-VolumesTransfersTest-262831041 None] Acquiring lock "cinder-e7fdf249-17a4-43e8-ad3c-5321bbc371c6-delete_volume" by "delete_volume" {{(pid=84538) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 19:02:55 devstack cinder-volume[84538]: INFO cinder.volume.flows.manager.create_volume [None req-55a0e26c-d6b6-457c-aa62-c946e13fbceb tempest-VolumeQuotasAdminTestJSON-31856830 None] Volume volume-33eb0b03-57ba-4223-b34b-b4253cdfbd81 (33eb0b03-57ba-4223-b34b-b4253cdfbd81): created successfully Apr 29 19:02:56 devstack cinder-volume[84538]: DEBUG cinder.volume.manager [None req-55a0e26c-d6b6-457c-aa62-c946e13fbceb tempest-VolumeQuotasAdminTestJSON-31856830 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (96d5ae48-856e-49f1-867d-502f66d7f7d8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 19:02:56 devstack cinder-volume[84538]: DEBUG cinder.volume.manager [None req-55a0e26c-d6b6-457c-aa62-c946e13fbceb tempest-VolumeQuotasAdminTestJSON-31856830 None] Flow 'volume_create_manager' (1c39f8ac-80c9-4355-ac90-53860a6c6955) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84538) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 19:02:56 devstack cinder-volume[84538]: INFO cinder.volume.manager [None req-55a0e26c-d6b6-457c-aa62-c946e13fbceb tempest-VolumeQuotasAdminTestJSON-31856830 None] Created volume successfully. Apr 29 19:02:56 devstack cinder-volume[84538]: DEBUG cinder.coordination [None req-3b09da85-ecc1-42c4-91af-0a911abb3118 tempest-VolumesTransfersTest-262831041 None] Lock "cinder-e7fdf249-17a4-43e8-ad3c-5321bbc371c6-delete_volume" acquired by "delete_volume" :: waited 0.097s {{(pid=84538) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 19:02:56 devstack cinder-volume[84538]: DEBUG cinder.coordination [None req-3b09da85-ecc1-42c4-91af-0a911abb3118 tempest-VolumesTransfersTest-262831041 None] Acquiring lock "cinder-quobyte-e7fdf249-17a4-43e8-ad3c-5321bbc371c6" by "delete_volume" {{(pid=84538) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 19:02:56 devstack cinder-volume[84538]: DEBUG cinder.coordination [None req-3b09da85-ecc1-42c4-91af-0a911abb3118 tempest-VolumesTransfersTest-262831041 None] Lock "cinder-quobyte-e7fdf249-17a4-43e8-ad3c-5321bbc371c6" acquired by "delete_volume" :: waited 0.017s {{(pid=84538) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 19:02:56 devstack cinder-volume[84538]: DEBUG oslo.privsep.daemon [-] privsep: reply[2449a701-3c57-4879-a954-20c13bcb6fcf]: (4, 'qcow2') {{(pid=85803) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 19:02:56 devstack cinder-volume[84538]: DEBUG oslo_concurrency.processutils [None req-3b09da85-ecc1-42c4-91af-0a911abb3118 tempest-VolumesTransfersTest-262831041 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-e7fdf249-17a4-43e8-ad3c-5321bbc371c6 {{(pid=84538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 19:02:56 devstack sudo[90909]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-e7fdf249-17a4-43e8-ad3c-5321bbc371c6 Apr 29 19:02:56 devstack sudo[90909]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 19:02:57 devstack sudo[90909]: pam_unix(sudo:session): session closed for user root Apr 29 19:02:57 devstack cinder-volume[84538]: DEBUG oslo_concurrency.processutils [None req-3b09da85-ecc1-42c4-91af-0a911abb3118 tempest-VolumesTransfersTest-262831041 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-e7fdf249-17a4-43e8-ad3c-5321bbc371c6" returned: 0 in 0.861s {{(pid=84538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 19:02:57 devstack cinder-volume[84538]: DEBUG oslo_concurrency.processutils [None req-3b09da85-ecc1-42c4-91af-0a911abb3118 tempest-VolumesTransfersTest-262831041 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-e7fdf249-17a4-43e8-ad3c-5321bbc371c6 {{(pid=84538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 19:02:57 devstack sudo[90914]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-e7fdf249-17a4-43e8-ad3c-5321bbc371c6 Apr 29 19:02:57 devstack sudo[90914]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 19:02:57 devstack cinder-volume[84538]: DEBUG cinder.volume.flows.manager.create_volume [None req-a11c8450-cde3-443a-bde3-676eb2244edf tempest-AbsoluteLimitsTests-999255829 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84538) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Apr 29 19:02:57 devstack cinder-volume[84538]: DEBUG cinder.volume.manager [None req-a11c8450-cde3-443a-bde3-676eb2244edf tempest-AbsoluteLimitsTests-999255829 None] Flow 'volume_create_manager' (6079b298-de75-4ac5-a8d9-a6baf849ddb2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84538) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 19:02:57 devstack cinder-volume[84538]: DEBUG cinder.volume.manager [None req-a11c8450-cde3-443a-bde3-676eb2244edf tempest-AbsoluteLimitsTests-999255829 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8a9be9e0-b318-483a-adc2-ff4fc2a5d8dd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 19:02:57 devstack cinder-volume[84538]: DEBUG cinder.volume.manager [None req-a11c8450-cde3-443a-bde3-676eb2244edf tempest-AbsoluteLimitsTests-999255829 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8a9be9e0-b318-483a-adc2-ff4fc2a5d8dd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-29T17:02:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AbsoluteLimitsTests-Volume-953930853',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d51c41e7-e000-4160-b739-908279ccd70a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1f51f9bbfc7e4373a2dfef03c31fcd30',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T17:02:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T17:02:57Z,use_quota=True,user_id='34694df5a25041059deac990debf351b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(62b05900-93e3-4190-a88f-1d87324303d1),volume_type_id=62b05900-93e3-4190-a88f-1d87324303d1)' {{(pid=84538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 19:02:57 devstack cinder-volume[84538]: DEBUG cinder.volume.manager [None req-a11c8450-cde3-443a-bde3-676eb2244edf tempest-AbsoluteLimitsTests-999255829 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (97a66c2e-3e2c-428c-964f-aee55ad1137b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 19:02:57 devstack cinder-volume[84538]: DEBUG cinder.volume.manager [None req-a11c8450-cde3-443a-bde3-676eb2244edf tempest-AbsoluteLimitsTests-999255829 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (97a66c2e-3e2c-428c-964f-aee55ad1137b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 19:02:57 devstack cinder-volume[84538]: DEBUG cinder.volume.manager [None req-a11c8450-cde3-443a-bde3-676eb2244edf tempest-AbsoluteLimitsTests-999255829 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (75ff81eb-edaf-43c3-baf8-efb2be582df7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 19:02:57 devstack cinder-volume[84538]: DEBUG cinder.volume.manager [None req-a11c8450-cde3-443a-bde3-676eb2244edf tempest-AbsoluteLimitsTests-999255829 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (75ff81eb-edaf-43c3-baf8-efb2be582df7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd51c41e7-e000-4160-b739-908279ccd70a', 'volume_name': 'volume-d51c41e7-e000-4160-b739-908279ccd70a', 'volume_size': 1}' {{(pid=84538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 19:02:57 devstack cinder-volume[84538]: DEBUG cinder.volume.manager [None req-a11c8450-cde3-443a-bde3-676eb2244edf tempest-AbsoluteLimitsTests-999255829 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6864cf22-194d-4d06-b125-005e8d8878e3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 19:02:57 devstack cinder-volume[84538]: DEBUG cinder.volume.manager [None req-a11c8450-cde3-443a-bde3-676eb2244edf tempest-AbsoluteLimitsTests-999255829 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6864cf22-194d-4d06-b125-005e8d8878e3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 19:02:57 devstack cinder-volume[84538]: DEBUG cinder.volume.manager [None req-a11c8450-cde3-443a-bde3-676eb2244edf tempest-AbsoluteLimitsTests-999255829 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (dc74ccfb-5c77-43a9-92af-2a3216e30200) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 19:02:57 devstack cinder-volume[84538]: INFO cinder.volume.flows.manager.create_volume [None req-a11c8450-cde3-443a-bde3-676eb2244edf tempest-AbsoluteLimitsTests-999255829 None] Volume d51c41e7-e000-4160-b739-908279ccd70a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d51c41e7-e000-4160-b739-908279ccd70a', 'volume_size': 1} Apr 29 19:02:57 devstack cinder-volume[84538]: DEBUG oslo_concurrency.lockutils [None req-a11c8450-cde3-443a-bde3-676eb2244edf tempest-AbsoluteLimitsTests-999255829 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 19:02:57 devstack cinder-volume[84538]: DEBUG oslo_concurrency.lockutils [None req-a11c8450-cde3-443a-bde3-676eb2244edf tempest-AbsoluteLimitsTests-999255829 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=84538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 19:02:57 devstack cinder-volume[84538]: DEBUG cinder.volume.drivers.quobyte [None req-a11c8450-cde3-443a-bde3-676eb2244edf tempest-AbsoluteLimitsTests-999255829 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-29T17:02:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AbsoluteLimitsTests-Volume-953930853',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d51c41e7-e000-4160-b739-908279ccd70a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1f51f9bbfc7e4373a2dfef03c31fcd30',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T17:02:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T17:02:57Z,use_quota=True,user_id='34694df5a25041059deac990debf351b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(62b05900-93e3-4190-a88f-1d87324303d1),volume_type_id=62b05900-93e3-4190-a88f-1d87324303d1)}" {{(pid=84538) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 29 19:02:57 devstack cinder-volume[84538]: DEBUG cinder.volume.drivers.remotefs [None req-a11c8450-cde3-443a-bde3-676eb2244edf tempest-AbsoluteLimitsTests-999255829 None] Creating volume d51c41e7-e000-4160-b739-908279ccd70a {{(pid=84538) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 29 19:02:57 devstack cinder-volume[84538]: DEBUG oslo_concurrency.lockutils [None req-a11c8450-cde3-443a-bde3-676eb2244edf tempest-AbsoluteLimitsTests-999255829 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 19:02:57 devstack cinder-volume[84538]: DEBUG oslo_concurrency.lockutils [None req-a11c8450-cde3-443a-bde3-676eb2244edf tempest-AbsoluteLimitsTests-999255829 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=84538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 19:02:57 devstack cinder-volume[84538]: DEBUG cinder.volume.drivers.quobyte [None req-a11c8450-cde3-443a-bde3-676eb2244edf tempest-AbsoluteLimitsTests-999255829 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-34312b00-dd6d-45bb-af98-75855cea8e48': None} {{(pid=84538) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 19:02:57 devstack cinder-volume[84538]: DEBUG cinder.volume.drivers.quobyte [None req-a11c8450-cde3-443a-bde3-676eb2244edf tempest-AbsoluteLimitsTests-999255829 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-34312b00-dd6d-45bb-af98-75855cea8e48'] {{(pid=84538) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 19:02:57 devstack cinder-volume[84538]: DEBUG oslo_concurrency.lockutils [None req-a11c8450-cde3-443a-bde3-676eb2244edf tempest-AbsoluteLimitsTests-999255829 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=84538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 19:02:57 devstack cinder-volume[84538]: DEBUG cinder.volume.drivers.quobyte [None req-a11c8450-cde3-443a-bde3-676eb2244edf tempest-AbsoluteLimitsTests-999255829 None] Selected osci02.corp.quobyte.com/cinder-vol-34312b00-dd6d-45bb-af98-75855cea8e48 as target Quobyte volume. {{(pid=84538) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 29 19:02:57 devstack cinder-volume[84538]: INFO cinder.volume.drivers.remotefs [None req-a11c8450-cde3-443a-bde3-676eb2244edf tempest-AbsoluteLimitsTests-999255829 None] casted to osci02.corp.quobyte.com/cinder-vol-34312b00-dd6d-45bb-af98-75855cea8e48 Apr 29 19:02:57 devstack cinder-volume[84538]: DEBUG oslo_concurrency.processutils [None req-a11c8450-cde3-443a-bde3-676eb2244edf tempest-AbsoluteLimitsTests-999255829 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-d51c41e7-e000-4160-b739-908279ccd70a 1073741824 {{(pid=84538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 19:02:57 devstack sudo[90916]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-d51c41e7-e000-4160-b739-908279ccd70a 1073741824 Apr 29 19:02:57 devstack sudo[90916]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 19:02:57 devstack sudo[90914]: pam_unix(sudo:session): session closed for user root Apr 29 19:02:57 devstack cinder-volume[84538]: DEBUG oslo_concurrency.processutils [None req-3b09da85-ecc1-42c4-91af-0a911abb3118 tempest-VolumesTransfersTest-262831041 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-e7fdf249-17a4-43e8-ad3c-5321bbc371c6" returned: 0 in 0.845s {{(pid=84538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 19:02:57 devstack cinder-volume[84538]: INFO cinder.volume.manager [None req-dce34486-2457-448e-9872-97c21fc521ef tempest-VolumeQuotasAdminTestJSON-1500246660 None] Transfer volume completed successfully. Apr 29 19:02:57 devstack cinder-volume[84538]: DEBUG cinder.coordination [None req-3b09da85-ecc1-42c4-91af-0a911abb3118 tempest-VolumesTransfersTest-262831041 None] Lock "cinder-quobyte-e7fdf249-17a4-43e8-ad3c-5321bbc371c6" released by "delete_volume" :: held 1.777s {{(pid=84538) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 19:02:57 devstack cinder-volume[84538]: DEBUG cinder.quota [None req-3b09da85-ecc1-42c4-91af-0a911abb3118 tempest-VolumesTransfersTest-262831041 None] Created reservations ['35a55dda-dc97-429d-977e-6004fb56df8e', 'a57f932a-036b-4503-b972-bab80ceb6654', 'cebb1140-9a71-4dbf-aa80-c02ecd088996', 'a6c19884-d2d2-4fbc-9167-48ed8a78d42e'] {{(pid=84538) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 29 19:02:58 devstack cinder-volume[84538]: DEBUG oslo_concurrency.lockutils [None req-3b09da85-ecc1-42c4-91af-0a911abb3118 tempest-VolumesTransfersTest-262831041 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 19:02:58 devstack cinder-volume[84538]: DEBUG oslo_concurrency.lockutils [None req-3b09da85-ecc1-42c4-91af-0a911abb3118 tempest-VolumesTransfersTest-262831041 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 19:02:58 devstack cinder-volume[84538]: DEBUG cinder.volume.drivers.quobyte [None req-3b09da85-ecc1-42c4-91af-0a911abb3118 tempest-VolumesTransfersTest-262831041 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-34312b00-dd6d-45bb-af98-75855cea8e48': None} {{(pid=84538) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 19:02:58 devstack cinder-volume[84538]: DEBUG cinder.volume.drivers.quobyte [None req-3b09da85-ecc1-42c4-91af-0a911abb3118 tempest-VolumesTransfersTest-262831041 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-34312b00-dd6d-45bb-af98-75855cea8e48'] {{(pid=84538) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 19:02:58 devstack cinder-volume[84538]: DEBUG oslo_concurrency.lockutils [None req-3b09da85-ecc1-42c4-91af-0a911abb3118 tempest-VolumesTransfersTest-262831041 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=84538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 19:02:58 devstack cinder-volume[84538]: DEBUG oslo_concurrency.processutils [None req-3b09da85-ecc1-42c4-91af-0a911abb3118 tempest-VolumesTransfersTest-262831041 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d {{(pid=84538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 19:02:58 devstack sudo[90922]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d Apr 29 19:02:58 devstack sudo[90922]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 19:02:58 devstack sudo[90916]: pam_unix(sudo:session): session closed for user root Apr 29 19:02:58 devstack cinder-volume[84538]: DEBUG oslo_concurrency.processutils [None req-a11c8450-cde3-443a-bde3-676eb2244edf tempest-AbsoluteLimitsTests-999255829 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-d51c41e7-e000-4160-b739-908279ccd70a 1073741824" returned: 0 in 0.991s {{(pid=84538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 19:02:58 devstack cinder-volume[84538]: DEBUG oslo_concurrency.processutils [None req-a11c8450-cde3-443a-bde3-676eb2244edf tempest-AbsoluteLimitsTests-999255829 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-d51c41e7-e000-4160-b739-908279ccd70a {{(pid=84538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 19:02:58 devstack sudo[90926]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-d51c41e7-e000-4160-b739-908279ccd70a Apr 29 19:02:58 devstack sudo[90926]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 19:02:58 devstack sudo[90922]: pam_unix(sudo:session): session closed for user root Apr 29 19:02:58 devstack cinder-volume[84538]: DEBUG oslo_concurrency.processutils [None req-3b09da85-ecc1-42c4-91af-0a911abb3118 tempest-VolumesTransfersTest-262831041 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d" returned: 0 in 0.924s {{(pid=84538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 19:02:58 devstack cinder-volume[84538]: DEBUG cinder.manager [None req-3b09da85-ecc1-42c4-91af-0a911abb3118 tempest-VolumesTransfersTest-262831041 None] Notifying Schedulers of capabilities ... {{(pid=84538) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 29 19:02:58 devstack cinder-volume[84538]: INFO cinder.volume.manager [None req-3b09da85-ecc1-42c4-91af-0a911abb3118 tempest-VolumesTransfersTest-262831041 None] Deleted volume successfully. Apr 29 19:02:58 devstack cinder-volume[84538]: DEBUG cinder.coordination [None req-72079cdc-ed39-44c0-b030-9393413b8f21 tempest-VolumeQuotasAdminTestJSON-2010639699 None] Acquiring lock "cinder-33eb0b03-57ba-4223-b34b-b4253cdfbd81-delete_volume" by "delete_volume" {{(pid=84538) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 19:02:59 devstack cinder-volume[84538]: DEBUG cinder.coordination [None req-3b09da85-ecc1-42c4-91af-0a911abb3118 tempest-VolumesTransfersTest-262831041 None] Lock "cinder-e7fdf249-17a4-43e8-ad3c-5321bbc371c6-delete_volume" released by "delete_volume" :: held 2.960s {{(pid=84538) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 19:02:59 devstack cinder-volume[84538]: DEBUG cinder.coordination [None req-72079cdc-ed39-44c0-b030-9393413b8f21 tempest-VolumeQuotasAdminTestJSON-2010639699 None] Lock "cinder-33eb0b03-57ba-4223-b34b-b4253cdfbd81-delete_volume" acquired by "delete_volume" :: waited 0.046s {{(pid=84538) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 19:02:59 devstack cinder-volume[84538]: DEBUG cinder.volume.flows.manager.create_volume [None req-4774f5f8-7b6e-45f5-8024-9d4b49284648 tempest-VolumesTransfersTest-535376244 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84538) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Apr 29 19:02:59 devstack cinder-volume[84538]: DEBUG cinder.volume.manager [None req-4774f5f8-7b6e-45f5-8024-9d4b49284648 tempest-VolumesTransfersTest-535376244 None] Flow 'volume_create_manager' (f03e858a-9d70-47b8-9b2c-9cab6206fa8a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84538) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 19:02:59 devstack cinder-volume[84538]: DEBUG cinder.volume.manager [None req-4774f5f8-7b6e-45f5-8024-9d4b49284648 tempest-VolumesTransfersTest-535376244 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b5bd7efc-9f5e-41f0-8919-137ee58ca794) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 19:02:59 devstack cinder-volume[84538]: DEBUG cinder.volume.manager [None req-4774f5f8-7b6e-45f5-8024-9d4b49284648 tempest-VolumesTransfersTest-535376244 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b5bd7efc-9f5e-41f0-8919-137ee58ca794) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-29T17:02:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-448021038',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3bb30e27-9811-4db1-8674-31aec1515f02,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bd82f87a156b40b0b625aaa2ce2b2821',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T17:02:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T17:02:59Z,use_quota=True,user_id='5f8e19d483704583a76e6304fcab4513',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(62b05900-93e3-4190-a88f-1d87324303d1),volume_type_id=62b05900-93e3-4190-a88f-1d87324303d1)' {{(pid=84538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 19:02:59 devstack cinder-volume[84538]: DEBUG cinder.volume.manager [None req-4774f5f8-7b6e-45f5-8024-9d4b49284648 tempest-VolumesTransfersTest-535376244 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (27a9dcaf-f8f5-4a8b-87e0-2ff1080a21d0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 19:02:59 devstack cinder-volume[84538]: DEBUG cinder.volume.manager [None req-4774f5f8-7b6e-45f5-8024-9d4b49284648 tempest-VolumesTransfersTest-535376244 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (27a9dcaf-f8f5-4a8b-87e0-2ff1080a21d0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 19:02:59 devstack cinder-volume[84538]: DEBUG cinder.volume.manager [None req-4774f5f8-7b6e-45f5-8024-9d4b49284648 tempest-VolumesTransfersTest-535376244 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9683a9bb-bbf3-4302-91b9-2da200305e6b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 19:02:59 devstack cinder-volume[84538]: DEBUG cinder.volume.manager [None req-4774f5f8-7b6e-45f5-8024-9d4b49284648 tempest-VolumesTransfersTest-535376244 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9683a9bb-bbf3-4302-91b9-2da200305e6b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3bb30e27-9811-4db1-8674-31aec1515f02', 'volume_name': 'volume-3bb30e27-9811-4db1-8674-31aec1515f02', 'volume_size': 1}' {{(pid=84538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 19:02:59 devstack cinder-volume[84538]: DEBUG cinder.volume.manager [None req-4774f5f8-7b6e-45f5-8024-9d4b49284648 tempest-VolumesTransfersTest-535376244 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (dc80b715-d245-4611-bb1e-d96e4909c43b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 19:02:59 devstack cinder-volume[84538]: DEBUG cinder.volume.manager [None req-4774f5f8-7b6e-45f5-8024-9d4b49284648 tempest-VolumesTransfersTest-535376244 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (dc80b715-d245-4611-bb1e-d96e4909c43b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 19:02:59 devstack cinder-volume[84538]: DEBUG cinder.volume.manager [None req-4774f5f8-7b6e-45f5-8024-9d4b49284648 tempest-VolumesTransfersTest-535376244 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (301f29e3-2a05-476d-a82f-d11738da2d78) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 19:02:59 devstack cinder-volume[84538]: INFO cinder.volume.flows.manager.create_volume [None req-4774f5f8-7b6e-45f5-8024-9d4b49284648 tempest-VolumesTransfersTest-535376244 None] Volume 3bb30e27-9811-4db1-8674-31aec1515f02: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3bb30e27-9811-4db1-8674-31aec1515f02', 'volume_size': 1} Apr 29 19:02:59 devstack cinder-volume[84538]: DEBUG oslo_concurrency.lockutils [None req-4774f5f8-7b6e-45f5-8024-9d4b49284648 tempest-VolumesTransfersTest-535376244 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 19:02:59 devstack cinder-volume[84538]: DEBUG cinder.coordination [None req-72079cdc-ed39-44c0-b030-9393413b8f21 tempest-VolumeQuotasAdminTestJSON-2010639699 None] Acquiring lock "cinder-quobyte-33eb0b03-57ba-4223-b34b-b4253cdfbd81" by "delete_volume" {{(pid=84538) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 19:02:59 devstack cinder-volume[84538]: DEBUG cinder.coordination [None req-72079cdc-ed39-44c0-b030-9393413b8f21 tempest-VolumeQuotasAdminTestJSON-2010639699 None] Lock "cinder-quobyte-33eb0b03-57ba-4223-b34b-b4253cdfbd81" acquired by "delete_volume" :: waited 0.016s {{(pid=84538) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 19:02:59 devstack cinder-volume[84538]: DEBUG oslo.privsep.daemon [-] privsep: reply[345b63f7-a347-4f32-b982-330fec55a3a1]: (4, 'qcow2') {{(pid=85803) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 19:02:59 devstack cinder-volume[84538]: DEBUG oslo_concurrency.processutils [None req-72079cdc-ed39-44c0-b030-9393413b8f21 tempest-VolumeQuotasAdminTestJSON-2010639699 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-33eb0b03-57ba-4223-b34b-b4253cdfbd81 {{(pid=84538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 19:02:59 devstack sudo[90926]: pam_unix(sudo:session): session closed for user root Apr 29 19:02:59 devstack cinder-volume[84538]: DEBUG oslo_concurrency.processutils [None req-a11c8450-cde3-443a-bde3-676eb2244edf tempest-AbsoluteLimitsTests-999255829 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-d51c41e7-e000-4160-b739-908279ccd70a" returned: 0 in 0.991s {{(pid=84538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 19:02:59 devstack cinder-volume[84538]: DEBUG cinder.volume.drivers.quobyte [None req-a11c8450-cde3-443a-bde3-676eb2244edf tempest-AbsoluteLimitsTests-999255829 None] <== create_volume: return (2039ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-34312b00-dd6d-45bb-af98-75855cea8e48'} {{(pid=84538) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 29 19:02:59 devstack cinder-volume[84538]: DEBUG oslo_concurrency.lockutils [None req-a11c8450-cde3-443a-bde3-676eb2244edf tempest-AbsoluteLimitsTests-999255829 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.045s {{(pid=84538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 19:02:59 devstack cinder-volume[84538]: DEBUG oslo_concurrency.lockutils [None req-4774f5f8-7b6e-45f5-8024-9d4b49284648 tempest-VolumesTransfersTest-535376244 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.120s {{(pid=84538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 19:02:59 devstack cinder-volume[84538]: DEBUG cinder.volume.drivers.quobyte [None req-4774f5f8-7b6e-45f5-8024-9d4b49284648 tempest-VolumesTransfersTest-535376244 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-29T17:02:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-448021038',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3bb30e27-9811-4db1-8674-31aec1515f02,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bd82f87a156b40b0b625aaa2ce2b2821',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T17:02:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T17:02:59Z,use_quota=True,user_id='5f8e19d483704583a76e6304fcab4513',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(62b05900-93e3-4190-a88f-1d87324303d1),volume_type_id=62b05900-93e3-4190-a88f-1d87324303d1)}" {{(pid=84538) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 29 19:02:59 devstack cinder-volume[84538]: DEBUG cinder.volume.drivers.remotefs [None req-4774f5f8-7b6e-45f5-8024-9d4b49284648 tempest-VolumesTransfersTest-535376244 None] Creating volume 3bb30e27-9811-4db1-8674-31aec1515f02 {{(pid=84538) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 29 19:02:59 devstack cinder-volume[84538]: DEBUG oslo_concurrency.lockutils [None req-4774f5f8-7b6e-45f5-8024-9d4b49284648 tempest-VolumesTransfersTest-535376244 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 19:02:59 devstack cinder-volume[84538]: DEBUG oslo_concurrency.lockutils [None req-4774f5f8-7b6e-45f5-8024-9d4b49284648 tempest-VolumesTransfersTest-535376244 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=84538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 19:02:59 devstack cinder-volume[84538]: DEBUG cinder.volume.drivers.quobyte [None req-4774f5f8-7b6e-45f5-8024-9d4b49284648 tempest-VolumesTransfersTest-535376244 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-34312b00-dd6d-45bb-af98-75855cea8e48': None} {{(pid=84538) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 19:02:59 devstack cinder-volume[84538]: DEBUG cinder.volume.drivers.quobyte [None req-4774f5f8-7b6e-45f5-8024-9d4b49284648 tempest-VolumesTransfersTest-535376244 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-34312b00-dd6d-45bb-af98-75855cea8e48'] {{(pid=84538) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 19:02:59 devstack cinder-volume[84538]: DEBUG oslo_concurrency.lockutils [None req-4774f5f8-7b6e-45f5-8024-9d4b49284648 tempest-VolumesTransfersTest-535376244 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=84538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 19:02:59 devstack cinder-volume[84538]: DEBUG cinder.volume.drivers.quobyte [None req-4774f5f8-7b6e-45f5-8024-9d4b49284648 tempest-VolumesTransfersTest-535376244 None] Selected osci02.corp.quobyte.com/cinder-vol-34312b00-dd6d-45bb-af98-75855cea8e48 as target Quobyte volume. {{(pid=84538) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 29 19:02:59 devstack cinder-volume[84538]: INFO cinder.volume.drivers.remotefs [None req-4774f5f8-7b6e-45f5-8024-9d4b49284648 tempest-VolumesTransfersTest-535376244 None] casted to osci02.corp.quobyte.com/cinder-vol-34312b00-dd6d-45bb-af98-75855cea8e48 Apr 29 19:02:59 devstack cinder-volume[84538]: DEBUG oslo_concurrency.processutils [None req-4774f5f8-7b6e-45f5-8024-9d4b49284648 tempest-VolumesTransfersTest-535376244 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-3bb30e27-9811-4db1-8674-31aec1515f02 1073741824 {{(pid=84538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 19:02:59 devstack sudo[90931]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-3bb30e27-9811-4db1-8674-31aec1515f02 1073741824 Apr 29 19:02:59 devstack sudo[90931]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 19:02:59 devstack cinder-volume[84538]: DEBUG cinder.volume.manager [None req-a11c8450-cde3-443a-bde3-676eb2244edf tempest-AbsoluteLimitsTests-999255829 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (dc74ccfb-5c77-43a9-92af-2a3216e30200) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d51c41e7-e000-4160-b739-908279ccd70a', 'volume_size': 1}' {{(pid=84538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 19:02:59 devstack cinder-volume[84538]: DEBUG cinder.volume.manager [None req-a11c8450-cde3-443a-bde3-676eb2244edf tempest-AbsoluteLimitsTests-999255829 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (307ca08a-0b62-4dfb-82fc-2fa9f0ca11eb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 19:02:59 devstack cinder-volume[84538]: INFO cinder.volume.flows.manager.create_volume [None req-a11c8450-cde3-443a-bde3-676eb2244edf tempest-AbsoluteLimitsTests-999255829 None] Volume volume-d51c41e7-e000-4160-b739-908279ccd70a (d51c41e7-e000-4160-b739-908279ccd70a): created successfully Apr 29 19:02:59 devstack sudo[90930]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-33eb0b03-57ba-4223-b34b-b4253cdfbd81 Apr 29 19:02:59 devstack cinder-volume[84538]: DEBUG cinder.volume.manager [None req-a11c8450-cde3-443a-bde3-676eb2244edf tempest-AbsoluteLimitsTests-999255829 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (307ca08a-0b62-4dfb-82fc-2fa9f0ca11eb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 19:02:59 devstack sudo[90930]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 19:02:59 devstack cinder-volume[84538]: DEBUG cinder.volume.manager [None req-a11c8450-cde3-443a-bde3-676eb2244edf tempest-AbsoluteLimitsTests-999255829 None] Flow 'volume_create_manager' (6079b298-de75-4ac5-a8d9-a6baf849ddb2) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84538) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 19:02:59 devstack cinder-volume[84538]: INFO cinder.volume.manager [None req-a11c8450-cde3-443a-bde3-676eb2244edf tempest-AbsoluteLimitsTests-999255829 None] Created volume successfully. Apr 29 19:03:00 devstack sudo[90930]: pam_unix(sudo:session): session closed for user root Apr 29 19:03:00 devstack cinder-volume[84538]: DEBUG oslo_concurrency.processutils [None req-72079cdc-ed39-44c0-b030-9393413b8f21 tempest-VolumeQuotasAdminTestJSON-2010639699 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-33eb0b03-57ba-4223-b34b-b4253cdfbd81" returned: 0 in 0.905s {{(pid=84538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 19:03:00 devstack cinder-volume[84538]: DEBUG oslo_concurrency.processutils [None req-72079cdc-ed39-44c0-b030-9393413b8f21 tempest-VolumeQuotasAdminTestJSON-2010639699 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-33eb0b03-57ba-4223-b34b-b4253cdfbd81 {{(pid=84538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 19:03:00 devstack sudo[90941]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-33eb0b03-57ba-4223-b34b-b4253cdfbd81 Apr 29 19:03:00 devstack sudo[90941]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 19:03:00 devstack sudo[90931]: pam_unix(sudo:session): session closed for user root Apr 29 19:03:00 devstack cinder-volume[84538]: DEBUG oslo_concurrency.processutils [None req-4774f5f8-7b6e-45f5-8024-9d4b49284648 tempest-VolumesTransfersTest-535376244 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-3bb30e27-9811-4db1-8674-31aec1515f02 1073741824" returned: 0 in 1.013s {{(pid=84538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 19:03:00 devstack cinder-volume[84538]: DEBUG oslo_concurrency.processutils [None req-4774f5f8-7b6e-45f5-8024-9d4b49284648 tempest-VolumesTransfersTest-535376244 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-3bb30e27-9811-4db1-8674-31aec1515f02 {{(pid=84538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 19:03:00 devstack sudo[90944]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-3bb30e27-9811-4db1-8674-31aec1515f02 Apr 29 19:03:00 devstack sudo[90944]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 19:03:00 devstack cinder-volume[84538]: DEBUG cinder.coordination [None req-d1692695-d1cc-4d49-91c3-e78417ee7c96 tempest-AbsoluteLimitsTests-999255829 None] Acquiring lock "cinder-d51c41e7-e000-4160-b739-908279ccd70a-delete_volume" by "delete_volume" {{(pid=84538) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 19:03:00 devstack cinder-volume[84538]: DEBUG cinder.coordination [None req-d1692695-d1cc-4d49-91c3-e78417ee7c96 tempest-AbsoluteLimitsTests-999255829 None] Lock "cinder-d51c41e7-e000-4160-b739-908279ccd70a-delete_volume" acquired by "delete_volume" :: waited 0.033s {{(pid=84538) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 19:03:00 devstack cinder-volume[84538]: DEBUG cinder.coordination [None req-d1692695-d1cc-4d49-91c3-e78417ee7c96 tempest-AbsoluteLimitsTests-999255829 None] Acquiring lock "cinder-quobyte-d51c41e7-e000-4160-b739-908279ccd70a" by "delete_volume" {{(pid=84538) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 19:03:00 devstack cinder-volume[84538]: DEBUG cinder.coordination [None req-d1692695-d1cc-4d49-91c3-e78417ee7c96 tempest-AbsoluteLimitsTests-999255829 None] Lock "cinder-quobyte-d51c41e7-e000-4160-b739-908279ccd70a" acquired by "delete_volume" :: waited 0.020s {{(pid=84538) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 19:03:00 devstack cinder-volume[84538]: DEBUG oslo.privsep.daemon [-] privsep: reply[0ed6732d-f744-4c8d-a32d-3a42a0358514]: (4, 'qcow2') {{(pid=85803) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 19:03:00 devstack cinder-volume[84538]: DEBUG oslo_concurrency.processutils [None req-d1692695-d1cc-4d49-91c3-e78417ee7c96 tempest-AbsoluteLimitsTests-999255829 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-d51c41e7-e000-4160-b739-908279ccd70a {{(pid=84538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 19:03:00 devstack sudo[90946]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-d51c41e7-e000-4160-b739-908279ccd70a Apr 29 19:03:00 devstack sudo[90946]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 19:03:00 devstack sudo[90941]: pam_unix(sudo:session): session closed for user root Apr 29 19:03:00 devstack cinder-volume[84538]: DEBUG oslo_concurrency.processutils [None req-72079cdc-ed39-44c0-b030-9393413b8f21 tempest-VolumeQuotasAdminTestJSON-2010639699 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-33eb0b03-57ba-4223-b34b-b4253cdfbd81" returned: 0 in 0.772s {{(pid=84538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 19:03:01 devstack cinder-volume[84538]: DEBUG cinder.coordination [None req-72079cdc-ed39-44c0-b030-9393413b8f21 tempest-VolumeQuotasAdminTestJSON-2010639699 None] Lock "cinder-quobyte-33eb0b03-57ba-4223-b34b-b4253cdfbd81" released by "delete_volume" :: held 1.738s {{(pid=84538) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 19:03:01 devstack cinder-volume[84538]: DEBUG cinder.quota [None req-72079cdc-ed39-44c0-b030-9393413b8f21 tempest-VolumeQuotasAdminTestJSON-2010639699 None] Created reservations ['2017a565-a6c1-4496-b8e5-3f00a83367f7', '9c56167a-176e-4b4b-bafd-07b0c242c0f6', '83634f27-0ef9-4c65-b3c7-f2e452cae7a4', '91b5c3f8-c3a0-4b41-84f6-16cf9788782b'] {{(pid=84538) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 29 19:03:01 devstack cinder-volume[84538]: DEBUG oslo_concurrency.lockutils [None req-72079cdc-ed39-44c0-b030-9393413b8f21 tempest-VolumeQuotasAdminTestJSON-2010639699 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 19:03:01 devstack cinder-volume[84538]: DEBUG oslo_concurrency.lockutils [None req-72079cdc-ed39-44c0-b030-9393413b8f21 tempest-VolumeQuotasAdminTestJSON-2010639699 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 19:03:01 devstack cinder-volume[84538]: DEBUG cinder.volume.drivers.quobyte [None req-72079cdc-ed39-44c0-b030-9393413b8f21 tempest-VolumeQuotasAdminTestJSON-2010639699 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-34312b00-dd6d-45bb-af98-75855cea8e48': None} {{(pid=84538) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 19:03:01 devstack cinder-volume[84538]: DEBUG cinder.volume.drivers.quobyte [None req-72079cdc-ed39-44c0-b030-9393413b8f21 tempest-VolumeQuotasAdminTestJSON-2010639699 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-34312b00-dd6d-45bb-af98-75855cea8e48'] {{(pid=84538) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 19:03:01 devstack cinder-volume[84538]: DEBUG oslo_concurrency.lockutils [None req-72079cdc-ed39-44c0-b030-9393413b8f21 tempest-VolumeQuotasAdminTestJSON-2010639699 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=84538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 19:03:01 devstack cinder-volume[84538]: DEBUG oslo_concurrency.processutils [None req-72079cdc-ed39-44c0-b030-9393413b8f21 tempest-VolumeQuotasAdminTestJSON-2010639699 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d {{(pid=84538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 19:03:01 devstack sudo[90950]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d Apr 29 19:03:01 devstack sudo[90950]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 19:03:01 devstack sudo[90944]: pam_unix(sudo:session): session closed for user root Apr 29 19:03:01 devstack cinder-volume[84538]: DEBUG oslo_concurrency.processutils [None req-4774f5f8-7b6e-45f5-8024-9d4b49284648 tempest-VolumesTransfersTest-535376244 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-3bb30e27-9811-4db1-8674-31aec1515f02" returned: 0 in 0.891s {{(pid=84538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 19:03:01 devstack cinder-volume[84538]: DEBUG cinder.volume.drivers.quobyte [None req-4774f5f8-7b6e-45f5-8024-9d4b49284648 tempest-VolumesTransfersTest-535376244 None] <== create_volume: return (1977ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-34312b00-dd6d-45bb-af98-75855cea8e48'} {{(pid=84538) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 29 19:03:01 devstack cinder-volume[84538]: DEBUG oslo_concurrency.lockutils [None req-4774f5f8-7b6e-45f5-8024-9d4b49284648 tempest-VolumesTransfersTest-535376244 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.982s {{(pid=84538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 19:03:01 devstack cinder-volume[84538]: DEBUG cinder.volume.manager [None req-4774f5f8-7b6e-45f5-8024-9d4b49284648 tempest-VolumesTransfersTest-535376244 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (301f29e3-2a05-476d-a82f-d11738da2d78) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3bb30e27-9811-4db1-8674-31aec1515f02', 'volume_size': 1}' {{(pid=84538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 19:03:01 devstack cinder-volume[84538]: DEBUG cinder.volume.manager [None req-4774f5f8-7b6e-45f5-8024-9d4b49284648 tempest-VolumesTransfersTest-535376244 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2b38d8b6-9f83-4f8b-927e-33a3432751af) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 19:03:01 devstack cinder-volume[84538]: INFO cinder.volume.flows.manager.create_volume [None req-4774f5f8-7b6e-45f5-8024-9d4b49284648 tempest-VolumesTransfersTest-535376244 None] Volume volume-3bb30e27-9811-4db1-8674-31aec1515f02 (3bb30e27-9811-4db1-8674-31aec1515f02): created successfully Apr 29 19:03:01 devstack cinder-volume[84538]: DEBUG cinder.volume.manager [None req-4774f5f8-7b6e-45f5-8024-9d4b49284648 tempest-VolumesTransfersTest-535376244 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2b38d8b6-9f83-4f8b-927e-33a3432751af) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 19:03:01 devstack cinder-volume[84538]: DEBUG cinder.volume.manager [None req-4774f5f8-7b6e-45f5-8024-9d4b49284648 tempest-VolumesTransfersTest-535376244 None] Flow 'volume_create_manager' (f03e858a-9d70-47b8-9b2c-9cab6206fa8a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84538) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 19:03:01 devstack cinder-volume[84538]: INFO cinder.volume.manager [None req-4774f5f8-7b6e-45f5-8024-9d4b49284648 tempest-VolumesTransfersTest-535376244 None] Created volume successfully. Apr 29 19:03:01 devstack sudo[90946]: pam_unix(sudo:session): session closed for user root Apr 29 19:03:01 devstack cinder-volume[84538]: DEBUG oslo_concurrency.processutils [None req-d1692695-d1cc-4d49-91c3-e78417ee7c96 tempest-AbsoluteLimitsTests-999255829 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-d51c41e7-e000-4160-b739-908279ccd70a" returned: 0 in 0.992s {{(pid=84538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 19:03:01 devstack cinder-volume[84538]: DEBUG oslo_concurrency.processutils [None req-d1692695-d1cc-4d49-91c3-e78417ee7c96 tempest-AbsoluteLimitsTests-999255829 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-d51c41e7-e000-4160-b739-908279ccd70a {{(pid=84538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 19:03:01 devstack sudo[90955]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-d51c41e7-e000-4160-b739-908279ccd70a Apr 29 19:03:01 devstack sudo[90955]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 19:03:02 devstack sudo[90950]: pam_unix(sudo:session): session closed for user root Apr 29 19:03:02 devstack cinder-volume[84538]: DEBUG oslo_concurrency.processutils [None req-72079cdc-ed39-44c0-b030-9393413b8f21 tempest-VolumeQuotasAdminTestJSON-2010639699 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d" returned: 0 in 0.854s {{(pid=84538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 19:03:02 devstack cinder-volume[84538]: DEBUG cinder.manager [None req-72079cdc-ed39-44c0-b030-9393413b8f21 tempest-VolumeQuotasAdminTestJSON-2010639699 None] Notifying Schedulers of capabilities ... {{(pid=84538) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 29 19:03:02 devstack cinder-volume[84538]: INFO cinder.volume.manager [None req-72079cdc-ed39-44c0-b030-9393413b8f21 tempest-VolumeQuotasAdminTestJSON-2010639699 None] Deleted volume successfully. Apr 29 19:03:02 devstack cinder-volume[84538]: DEBUG cinder.coordination [None req-72079cdc-ed39-44c0-b030-9393413b8f21 tempest-VolumeQuotasAdminTestJSON-2010639699 None] Lock "cinder-33eb0b03-57ba-4223-b34b-b4253cdfbd81-delete_volume" released by "delete_volume" :: held 3.089s {{(pid=84538) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 19:03:02 devstack sudo[90955]: pam_unix(sudo:session): session closed for user root Apr 29 19:03:02 devstack cinder-volume[84538]: DEBUG oslo_concurrency.processutils [None req-d1692695-d1cc-4d49-91c3-e78417ee7c96 tempest-AbsoluteLimitsTests-999255829 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-d51c41e7-e000-4160-b739-908279ccd70a" returned: 0 in 0.887s {{(pid=84538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 19:03:02 devstack cinder-volume[84538]: DEBUG cinder.coordination [None req-21e3f865-b43e-4b25-aecd-90e56eb35501 tempest-VolumesTransfersTest-262831041 None] Acquiring lock "cinder-3bb30e27-9811-4db1-8674-31aec1515f02-delete_volume" by "delete_volume" {{(pid=84538) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 19:03:02 devstack cinder-volume[84538]: DEBUG cinder.coordination [None req-d1692695-d1cc-4d49-91c3-e78417ee7c96 tempest-AbsoluteLimitsTests-999255829 None] Lock "cinder-quobyte-d51c41e7-e000-4160-b739-908279ccd70a" released by "delete_volume" :: held 1.977s {{(pid=84538) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 19:03:02 devstack cinder-volume[84538]: DEBUG cinder.coordination [None req-21e3f865-b43e-4b25-aecd-90e56eb35501 tempest-VolumesTransfersTest-262831041 None] Lock "cinder-3bb30e27-9811-4db1-8674-31aec1515f02-delete_volume" acquired by "delete_volume" :: waited 0.050s {{(pid=84538) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 19:03:02 devstack cinder-volume[84538]: DEBUG cinder.coordination [None req-21e3f865-b43e-4b25-aecd-90e56eb35501 tempest-VolumesTransfersTest-262831041 None] Acquiring lock "cinder-quobyte-3bb30e27-9811-4db1-8674-31aec1515f02" by "delete_volume" {{(pid=84538) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 19:03:02 devstack cinder-volume[84538]: DEBUG cinder.quota [None req-d1692695-d1cc-4d49-91c3-e78417ee7c96 tempest-AbsoluteLimitsTests-999255829 None] Created reservations ['20466fe8-6ef4-4a8c-a3f7-191c18c85c9f', '395f566d-6ac4-45e7-8bb4-8bfae803980c', '8899c8cb-25fa-4d45-a678-b90cda317a97', '45ede860-0711-49a2-9c52-453c1bcd3040'] {{(pid=84538) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 29 19:03:02 devstack cinder-volume[84538]: DEBUG cinder.coordination [None req-21e3f865-b43e-4b25-aecd-90e56eb35501 tempest-VolumesTransfersTest-262831041 None] Lock "cinder-quobyte-3bb30e27-9811-4db1-8674-31aec1515f02" acquired by "delete_volume" :: waited 0.032s {{(pid=84538) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 19:03:02 devstack cinder-volume[84538]: DEBUG oslo.privsep.daemon [-] privsep: reply[54ea3ad2-68f9-4998-9b33-16b2480dac28]: (4, 'qcow2') {{(pid=85803) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 19:03:02 devstack cinder-volume[84538]: DEBUG oslo_concurrency.processutils [None req-21e3f865-b43e-4b25-aecd-90e56eb35501 tempest-VolumesTransfersTest-262831041 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-3bb30e27-9811-4db1-8674-31aec1515f02 {{(pid=84538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 19:03:03 devstack cinder-volume[84538]: DEBUG oslo_concurrency.lockutils [None req-d1692695-d1cc-4d49-91c3-e78417ee7c96 tempest-AbsoluteLimitsTests-999255829 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 19:03:03 devstack cinder-volume[84538]: DEBUG oslo_concurrency.lockutils [None req-d1692695-d1cc-4d49-91c3-e78417ee7c96 tempest-AbsoluteLimitsTests-999255829 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 19:03:03 devstack cinder-volume[84538]: DEBUG cinder.volume.drivers.quobyte [None req-d1692695-d1cc-4d49-91c3-e78417ee7c96 tempest-AbsoluteLimitsTests-999255829 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-34312b00-dd6d-45bb-af98-75855cea8e48': None} {{(pid=84538) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 19:03:03 devstack cinder-volume[84538]: DEBUG cinder.volume.drivers.quobyte [None req-d1692695-d1cc-4d49-91c3-e78417ee7c96 tempest-AbsoluteLimitsTests-999255829 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-34312b00-dd6d-45bb-af98-75855cea8e48'] {{(pid=84538) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 19:03:03 devstack cinder-volume[84538]: DEBUG oslo_concurrency.lockutils [None req-d1692695-d1cc-4d49-91c3-e78417ee7c96 tempest-AbsoluteLimitsTests-999255829 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=84538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 19:03:03 devstack cinder-volume[84538]: DEBUG oslo_concurrency.processutils [None req-d1692695-d1cc-4d49-91c3-e78417ee7c96 tempest-AbsoluteLimitsTests-999255829 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d {{(pid=84538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 19:03:03 devstack sudo[90960]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d Apr 29 19:03:03 devstack sudo[90960]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 19:03:03 devstack sudo[90959]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-3bb30e27-9811-4db1-8674-31aec1515f02 Apr 29 19:03:03 devstack sudo[90959]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 19:03:03 devstack sudo[90960]: pam_unix(sudo:session): session closed for user root Apr 29 19:03:03 devstack cinder-volume[84538]: DEBUG oslo_concurrency.processutils [None req-d1692695-d1cc-4d49-91c3-e78417ee7c96 tempest-AbsoluteLimitsTests-999255829 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d" returned: 0 in 0.750s {{(pid=84538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 19:03:03 devstack cinder-volume[84538]: DEBUG cinder.manager [None req-d1692695-d1cc-4d49-91c3-e78417ee7c96 tempest-AbsoluteLimitsTests-999255829 None] Notifying Schedulers of capabilities ... {{(pid=84538) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 29 19:03:03 devstack cinder-volume[84538]: INFO cinder.volume.manager [None req-d1692695-d1cc-4d49-91c3-e78417ee7c96 tempest-AbsoluteLimitsTests-999255829 None] Deleted volume successfully. Apr 29 19:03:03 devstack cinder-volume[84538]: DEBUG cinder.coordination [None req-d1692695-d1cc-4d49-91c3-e78417ee7c96 tempest-AbsoluteLimitsTests-999255829 None] Lock "cinder-d51c41e7-e000-4160-b739-908279ccd70a-delete_volume" released by "delete_volume" :: held 3.195s {{(pid=84538) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 19:03:03 devstack sudo[90959]: pam_unix(sudo:session): session closed for user root Apr 29 19:03:03 devstack cinder-volume[84538]: DEBUG oslo_concurrency.processutils [None req-21e3f865-b43e-4b25-aecd-90e56eb35501 tempest-VolumesTransfersTest-262831041 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-3bb30e27-9811-4db1-8674-31aec1515f02" returned: 0 in 0.936s {{(pid=84538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 19:03:03 devstack cinder-volume[84538]: DEBUG oslo_concurrency.processutils [None req-21e3f865-b43e-4b25-aecd-90e56eb35501 tempest-VolumesTransfersTest-262831041 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-3bb30e27-9811-4db1-8674-31aec1515f02 {{(pid=84538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 19:03:03 devstack sudo[90967]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-3bb30e27-9811-4db1-8674-31aec1515f02 Apr 29 19:03:03 devstack sudo[90967]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 19:03:04 devstack sudo[90967]: pam_unix(sudo:session): session closed for user root Apr 29 19:03:04 devstack cinder-volume[84538]: DEBUG oslo_concurrency.processutils [None req-21e3f865-b43e-4b25-aecd-90e56eb35501 tempest-VolumesTransfersTest-262831041 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-3bb30e27-9811-4db1-8674-31aec1515f02" returned: 0 in 0.886s {{(pid=84538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 19:03:04 devstack cinder-volume[84538]: DEBUG cinder.coordination [None req-21e3f865-b43e-4b25-aecd-90e56eb35501 tempest-VolumesTransfersTest-262831041 None] Lock "cinder-quobyte-3bb30e27-9811-4db1-8674-31aec1515f02" released by "delete_volume" :: held 1.892s {{(pid=84538) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 19:03:04 devstack cinder-volume[84538]: DEBUG cinder.quota [None req-21e3f865-b43e-4b25-aecd-90e56eb35501 tempest-VolumesTransfersTest-262831041 None] Created reservations ['fa853adf-71e6-4a1f-8529-b0a19127c6cd', '3856ada1-861f-4e26-aaae-571842c31103', 'be490369-243c-49aa-85a1-ca9e03c7d0a6', '7fa007da-8f38-49d8-918e-6f7b10c35df1'] {{(pid=84538) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 29 19:03:04 devstack cinder-volume[84538]: DEBUG oslo_concurrency.lockutils [None req-21e3f865-b43e-4b25-aecd-90e56eb35501 tempest-VolumesTransfersTest-262831041 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 19:03:04 devstack cinder-volume[84538]: DEBUG oslo_concurrency.lockutils [None req-21e3f865-b43e-4b25-aecd-90e56eb35501 tempest-VolumesTransfersTest-262831041 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 19:03:04 devstack cinder-volume[84538]: DEBUG cinder.volume.drivers.quobyte [None req-21e3f865-b43e-4b25-aecd-90e56eb35501 tempest-VolumesTransfersTest-262831041 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-34312b00-dd6d-45bb-af98-75855cea8e48': None} {{(pid=84538) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 19:03:04 devstack cinder-volume[84538]: DEBUG cinder.volume.drivers.quobyte [None req-21e3f865-b43e-4b25-aecd-90e56eb35501 tempest-VolumesTransfersTest-262831041 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-34312b00-dd6d-45bb-af98-75855cea8e48'] {{(pid=84538) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 19:03:04 devstack cinder-volume[84538]: DEBUG oslo_concurrency.lockutils [None req-21e3f865-b43e-4b25-aecd-90e56eb35501 tempest-VolumesTransfersTest-262831041 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=84538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 19:03:04 devstack cinder-volume[84538]: DEBUG oslo_concurrency.processutils [None req-21e3f865-b43e-4b25-aecd-90e56eb35501 tempest-VolumesTransfersTest-262831041 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d {{(pid=84538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 19:03:05 devstack sudo[90970]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d Apr 29 19:03:05 devstack sudo[90970]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 19:03:05 devstack sudo[90970]: pam_unix(sudo:session): session closed for user root Apr 29 19:03:05 devstack cinder-volume[84538]: DEBUG oslo_concurrency.processutils [None req-21e3f865-b43e-4b25-aecd-90e56eb35501 tempest-VolumesTransfersTest-262831041 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d" returned: 0 in 0.777s {{(pid=84538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 19:03:05 devstack cinder-volume[84538]: DEBUG cinder.manager [None req-21e3f865-b43e-4b25-aecd-90e56eb35501 tempest-VolumesTransfersTest-262831041 None] Notifying Schedulers of capabilities ... {{(pid=84538) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 29 19:03:05 devstack cinder-volume[84538]: INFO cinder.volume.manager [None req-21e3f865-b43e-4b25-aecd-90e56eb35501 tempest-VolumesTransfersTest-262831041 None] Deleted volume successfully. Apr 29 19:03:05 devstack cinder-volume[84538]: DEBUG cinder.coordination [None req-21e3f865-b43e-4b25-aecd-90e56eb35501 tempest-VolumesTransfersTest-262831041 None] Lock "cinder-3bb30e27-9811-4db1-8674-31aec1515f02-delete_volume" released by "delete_volume" :: held 3.053s {{(pid=84538) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 19:03:07 devstack cinder-volume[84538]: DEBUG cinder.volume.flows.manager.create_volume [None req-0f8a89d0-37d2-4173-b61a-b769199bf823 tempest-VolumesActionsTest-1839563461 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84538) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Apr 29 19:03:07 devstack cinder-volume[84538]: DEBUG cinder.volume.manager [None req-0f8a89d0-37d2-4173-b61a-b769199bf823 tempest-VolumesActionsTest-1839563461 None] Flow 'volume_create_manager' (055b52b3-25a5-40b0-afca-8cf4f88a24e7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84538) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 19:03:07 devstack cinder-volume[84538]: DEBUG cinder.volume.manager [None req-0f8a89d0-37d2-4173-b61a-b769199bf823 tempest-VolumesActionsTest-1839563461 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (42b398d7-c1bc-4501-9bf7-cf9858f4f65f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 19:03:07 devstack cinder-volume[84538]: DEBUG cinder.volume.manager [None req-0f8a89d0-37d2-4173-b61a-b769199bf823 tempest-VolumesActionsTest-1839563461 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (42b398d7-c1bc-4501-9bf7-cf9858f4f65f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-29T17:03:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-2116157785',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c66b0dde-dec4-44cc-b0fe-7b7f63fa3d6a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='054625ed1f544886a7854406f074aa0d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T17:03:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T17:03:08Z,use_quota=True,user_id='8541ed53aada4cdc8d9fe4ba3999f062',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(62b05900-93e3-4190-a88f-1d87324303d1),volume_type_id=62b05900-93e3-4190-a88f-1d87324303d1)' {{(pid=84538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 19:03:07 devstack cinder-volume[84538]: DEBUG cinder.volume.manager [None req-0f8a89d0-37d2-4173-b61a-b769199bf823 tempest-VolumesActionsTest-1839563461 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (89e99cac-64f0-4ee9-a13f-5d77ae1d9bd9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 19:03:07 devstack cinder-volume[84538]: DEBUG cinder.volume.manager [None req-0f8a89d0-37d2-4173-b61a-b769199bf823 tempest-VolumesActionsTest-1839563461 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (89e99cac-64f0-4ee9-a13f-5d77ae1d9bd9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 19:03:07 devstack cinder-volume[84538]: DEBUG cinder.volume.manager [None req-0f8a89d0-37d2-4173-b61a-b769199bf823 tempest-VolumesActionsTest-1839563461 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (413c75cd-1c6f-420e-b527-3acdfb1b6aab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 19:03:07 devstack cinder-volume[84538]: DEBUG cinder.volume.manager [None req-0f8a89d0-37d2-4173-b61a-b769199bf823 tempest-VolumesActionsTest-1839563461 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (413c75cd-1c6f-420e-b527-3acdfb1b6aab) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c66b0dde-dec4-44cc-b0fe-7b7f63fa3d6a', 'volume_name': 'volume-c66b0dde-dec4-44cc-b0fe-7b7f63fa3d6a', 'volume_size': 1}' {{(pid=84538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 19:03:07 devstack cinder-volume[84538]: DEBUG cinder.volume.manager [None req-0f8a89d0-37d2-4173-b61a-b769199bf823 tempest-VolumesActionsTest-1839563461 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e037a588-ea2e-4b0f-9815-2c80126efbe6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 19:03:07 devstack cinder-volume[84538]: DEBUG cinder.volume.manager [None req-0f8a89d0-37d2-4173-b61a-b769199bf823 tempest-VolumesActionsTest-1839563461 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e037a588-ea2e-4b0f-9815-2c80126efbe6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 19:03:07 devstack cinder-volume[84538]: DEBUG cinder.volume.manager [None req-0f8a89d0-37d2-4173-b61a-b769199bf823 tempest-VolumesActionsTest-1839563461 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e64c3bad-cbf8-4654-b526-749b3bdbbcb9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 19:03:07 devstack cinder-volume[84538]: INFO cinder.volume.flows.manager.create_volume [None req-0f8a89d0-37d2-4173-b61a-b769199bf823 tempest-VolumesActionsTest-1839563461 None] Volume c66b0dde-dec4-44cc-b0fe-7b7f63fa3d6a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c66b0dde-dec4-44cc-b0fe-7b7f63fa3d6a', 'volume_size': 1} Apr 29 19:03:07 devstack cinder-volume[84538]: DEBUG oslo_concurrency.lockutils [None req-0f8a89d0-37d2-4173-b61a-b769199bf823 tempest-VolumesActionsTest-1839563461 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 19:03:07 devstack cinder-volume[84538]: DEBUG oslo_concurrency.lockutils [None req-0f8a89d0-37d2-4173-b61a-b769199bf823 tempest-VolumesActionsTest-1839563461 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=84538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 19:03:07 devstack cinder-volume[84538]: DEBUG cinder.volume.drivers.quobyte [None req-0f8a89d0-37d2-4173-b61a-b769199bf823 tempest-VolumesActionsTest-1839563461 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-29T17:03:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-2116157785',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c66b0dde-dec4-44cc-b0fe-7b7f63fa3d6a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='054625ed1f544886a7854406f074aa0d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T17:03:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T17:03:08Z,use_quota=True,user_id='8541ed53aada4cdc8d9fe4ba3999f062',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(62b05900-93e3-4190-a88f-1d87324303d1),volume_type_id=62b05900-93e3-4190-a88f-1d87324303d1)}" {{(pid=84538) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 29 19:03:07 devstack cinder-volume[84538]: DEBUG cinder.volume.drivers.remotefs [None req-0f8a89d0-37d2-4173-b61a-b769199bf823 tempest-VolumesActionsTest-1839563461 None] Creating volume c66b0dde-dec4-44cc-b0fe-7b7f63fa3d6a {{(pid=84538) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 29 19:03:07 devstack cinder-volume[84538]: DEBUG oslo_concurrency.lockutils [None req-0f8a89d0-37d2-4173-b61a-b769199bf823 tempest-VolumesActionsTest-1839563461 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 19:03:07 devstack cinder-volume[84538]: DEBUG oslo_concurrency.lockutils [None req-0f8a89d0-37d2-4173-b61a-b769199bf823 tempest-VolumesActionsTest-1839563461 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=84538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 19:03:07 devstack cinder-volume[84538]: DEBUG cinder.volume.drivers.quobyte [None req-0f8a89d0-37d2-4173-b61a-b769199bf823 tempest-VolumesActionsTest-1839563461 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-34312b00-dd6d-45bb-af98-75855cea8e48': None} {{(pid=84538) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 19:03:07 devstack cinder-volume[84538]: DEBUG cinder.volume.drivers.quobyte [None req-0f8a89d0-37d2-4173-b61a-b769199bf823 tempest-VolumesActionsTest-1839563461 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-34312b00-dd6d-45bb-af98-75855cea8e48'] {{(pid=84538) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 19:03:07 devstack cinder-volume[84538]: DEBUG oslo_concurrency.lockutils [None req-0f8a89d0-37d2-4173-b61a-b769199bf823 tempest-VolumesActionsTest-1839563461 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=84538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 19:03:07 devstack cinder-volume[84538]: DEBUG cinder.volume.drivers.quobyte [None req-0f8a89d0-37d2-4173-b61a-b769199bf823 tempest-VolumesActionsTest-1839563461 None] Selected osci02.corp.quobyte.com/cinder-vol-34312b00-dd6d-45bb-af98-75855cea8e48 as target Quobyte volume. {{(pid=84538) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 29 19:03:07 devstack cinder-volume[84538]: INFO cinder.volume.drivers.remotefs [None req-0f8a89d0-37d2-4173-b61a-b769199bf823 tempest-VolumesActionsTest-1839563461 None] casted to osci02.corp.quobyte.com/cinder-vol-34312b00-dd6d-45bb-af98-75855cea8e48 Apr 29 19:03:07 devstack cinder-volume[84538]: DEBUG oslo_concurrency.processutils [None req-0f8a89d0-37d2-4173-b61a-b769199bf823 tempest-VolumesActionsTest-1839563461 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-c66b0dde-dec4-44cc-b0fe-7b7f63fa3d6a 1073741824 {{(pid=84538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 19:03:07 devstack sudo[90973]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-c66b0dde-dec4-44cc-b0fe-7b7f63fa3d6a 1073741824 Apr 29 19:03:07 devstack sudo[90973]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 19:03:08 devstack sudo[90973]: pam_unix(sudo:session): session closed for user root Apr 29 19:03:08 devstack cinder-volume[84538]: DEBUG oslo_concurrency.processutils [None req-0f8a89d0-37d2-4173-b61a-b769199bf823 tempest-VolumesActionsTest-1839563461 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-c66b0dde-dec4-44cc-b0fe-7b7f63fa3d6a 1073741824" returned: 0 in 1.074s {{(pid=84538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 19:03:08 devstack cinder-volume[84538]: DEBUG oslo_concurrency.processutils [None req-0f8a89d0-37d2-4173-b61a-b769199bf823 tempest-VolumesActionsTest-1839563461 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-c66b0dde-dec4-44cc-b0fe-7b7f63fa3d6a {{(pid=84538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 19:03:09 devstack sudo[90980]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-c66b0dde-dec4-44cc-b0fe-7b7f63fa3d6a Apr 29 19:03:09 devstack sudo[90980]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 19:03:09 devstack sudo[90980]: pam_unix(sudo:session): session closed for user root Apr 29 19:03:09 devstack cinder-volume[84538]: DEBUG oslo_concurrency.processutils [None req-0f8a89d0-37d2-4173-b61a-b769199bf823 tempest-VolumesActionsTest-1839563461 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-c66b0dde-dec4-44cc-b0fe-7b7f63fa3d6a" returned: 0 in 0.799s {{(pid=84538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 19:03:09 devstack cinder-volume[84538]: DEBUG cinder.volume.drivers.quobyte [None req-0f8a89d0-37d2-4173-b61a-b769199bf823 tempest-VolumesActionsTest-1839563461 None] <== create_volume: return (1955ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-34312b00-dd6d-45bb-af98-75855cea8e48'} {{(pid=84538) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 29 19:03:09 devstack cinder-volume[84538]: DEBUG oslo_concurrency.lockutils [None req-0f8a89d0-37d2-4173-b61a-b769199bf823 tempest-VolumesActionsTest-1839563461 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.957s {{(pid=84538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 19:03:09 devstack cinder-volume[84538]: DEBUG cinder.volume.manager [None req-0f8a89d0-37d2-4173-b61a-b769199bf823 tempest-VolumesActionsTest-1839563461 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e64c3bad-cbf8-4654-b526-749b3bdbbcb9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c66b0dde-dec4-44cc-b0fe-7b7f63fa3d6a', 'volume_size': 1}' {{(pid=84538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 19:03:09 devstack cinder-volume[84538]: DEBUG cinder.volume.manager [None req-0f8a89d0-37d2-4173-b61a-b769199bf823 tempest-VolumesActionsTest-1839563461 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (53306279-f33d-4440-942c-b94aa70e889e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 19:03:09 devstack cinder-volume[84538]: INFO cinder.volume.flows.manager.create_volume [None req-0f8a89d0-37d2-4173-b61a-b769199bf823 tempest-VolumesActionsTest-1839563461 None] Volume volume-c66b0dde-dec4-44cc-b0fe-7b7f63fa3d6a (c66b0dde-dec4-44cc-b0fe-7b7f63fa3d6a): created successfully Apr 29 19:03:09 devstack cinder-volume[84538]: DEBUG cinder.volume.manager [None req-0f8a89d0-37d2-4173-b61a-b769199bf823 tempest-VolumesActionsTest-1839563461 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (53306279-f33d-4440-942c-b94aa70e889e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 19:03:09 devstack cinder-volume[84538]: DEBUG cinder.volume.manager [None req-0f8a89d0-37d2-4173-b61a-b769199bf823 tempest-VolumesActionsTest-1839563461 None] Flow 'volume_create_manager' (055b52b3-25a5-40b0-afca-8cf4f88a24e7) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84538) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 19:03:09 devstack cinder-volume[84538]: INFO cinder.volume.manager [None req-0f8a89d0-37d2-4173-b61a-b769199bf823 tempest-VolumesActionsTest-1839563461 None] Created volume successfully. Apr 29 19:03:12 devstack cinder-volume[84538]: DEBUG cinder.volume.flows.manager.create_volume [None req-28b26685-40b1-4dfa-bf99-6988de09bb79 tempest-VolumesTransfersV357Test-932871906 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84538) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Apr 29 19:03:12 devstack cinder-volume[84538]: DEBUG cinder.volume.manager [None req-28b26685-40b1-4dfa-bf99-6988de09bb79 tempest-VolumesTransfersV357Test-932871906 None] Flow 'volume_create_manager' (74aee949-c046-45a4-9597-8e0d861ac17b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84538) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 19:03:12 devstack cinder-volume[84538]: DEBUG cinder.volume.manager [None req-28b26685-40b1-4dfa-bf99-6988de09bb79 tempest-VolumesTransfersV357Test-932871906 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c0ab1f1e-bd0d-4b1f-aa70-1a0f4bbd570f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 19:03:12 devstack cinder-volume[84538]: DEBUG cinder.volume.manager [None req-28b26685-40b1-4dfa-bf99-6988de09bb79 tempest-VolumesTransfersV357Test-932871906 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c0ab1f1e-bd0d-4b1f-aa70-1a0f4bbd570f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-29T17:03:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV357Test-Volume-712275381',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a9960472-ee17-4dc6-b481-6cab11207a0c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7214de4cab6a4ff9b35dbadb494c59ba',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T17:03:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T17:03:12Z,use_quota=True,user_id='eba45756f3e8430287f6d48bad050946',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(62b05900-93e3-4190-a88f-1d87324303d1),volume_type_id=62b05900-93e3-4190-a88f-1d87324303d1)' {{(pid=84538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 19:03:12 devstack cinder-volume[84538]: DEBUG cinder.volume.manager [None req-28b26685-40b1-4dfa-bf99-6988de09bb79 tempest-VolumesTransfersV357Test-932871906 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8783765a-17ed-415a-b1d9-67fecd2d7f09) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 19:03:12 devstack cinder-volume[84538]: DEBUG cinder.volume.manager [None req-28b26685-40b1-4dfa-bf99-6988de09bb79 tempest-VolumesTransfersV357Test-932871906 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8783765a-17ed-415a-b1d9-67fecd2d7f09) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 19:03:12 devstack cinder-volume[84538]: DEBUG cinder.volume.manager [None req-28b26685-40b1-4dfa-bf99-6988de09bb79 tempest-VolumesTransfersV357Test-932871906 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (01c34c8b-b333-4c2c-a90d-3a8ad44de85a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 19:03:12 devstack cinder-volume[84538]: DEBUG cinder.volume.manager [None req-28b26685-40b1-4dfa-bf99-6988de09bb79 tempest-VolumesTransfersV357Test-932871906 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (01c34c8b-b333-4c2c-a90d-3a8ad44de85a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a9960472-ee17-4dc6-b481-6cab11207a0c', 'volume_name': 'volume-a9960472-ee17-4dc6-b481-6cab11207a0c', 'volume_size': 1}' {{(pid=84538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 19:03:12 devstack cinder-volume[84538]: DEBUG cinder.volume.manager [None req-28b26685-40b1-4dfa-bf99-6988de09bb79 tempest-VolumesTransfersV357Test-932871906 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9062f33a-0c0e-4f7b-b3a5-4fac4712cba0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 19:03:12 devstack cinder-volume[84538]: DEBUG cinder.volume.manager [None req-28b26685-40b1-4dfa-bf99-6988de09bb79 tempest-VolumesTransfersV357Test-932871906 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9062f33a-0c0e-4f7b-b3a5-4fac4712cba0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 19:03:12 devstack cinder-volume[84538]: DEBUG cinder.volume.manager [None req-28b26685-40b1-4dfa-bf99-6988de09bb79 tempest-VolumesTransfersV357Test-932871906 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cb646b0a-fe46-4a09-99df-e2c5b08761b8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 19:03:12 devstack cinder-volume[84538]: INFO cinder.volume.flows.manager.create_volume [None req-28b26685-40b1-4dfa-bf99-6988de09bb79 tempest-VolumesTransfersV357Test-932871906 None] Volume a9960472-ee17-4dc6-b481-6cab11207a0c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a9960472-ee17-4dc6-b481-6cab11207a0c', 'volume_size': 1} Apr 29 19:03:12 devstack cinder-volume[84538]: DEBUG oslo_concurrency.lockutils [None req-28b26685-40b1-4dfa-bf99-6988de09bb79 tempest-VolumesTransfersV357Test-932871906 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 19:03:12 devstack cinder-volume[84538]: DEBUG oslo_concurrency.lockutils [None req-28b26685-40b1-4dfa-bf99-6988de09bb79 tempest-VolumesTransfersV357Test-932871906 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=84538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 19:03:12 devstack cinder-volume[84538]: DEBUG cinder.volume.drivers.quobyte [None req-28b26685-40b1-4dfa-bf99-6988de09bb79 tempest-VolumesTransfersV357Test-932871906 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-29T17:03:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV357Test-Volume-712275381',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a9960472-ee17-4dc6-b481-6cab11207a0c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7214de4cab6a4ff9b35dbadb494c59ba',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T17:03:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T17:03:12Z,use_quota=True,user_id='eba45756f3e8430287f6d48bad050946',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(62b05900-93e3-4190-a88f-1d87324303d1),volume_type_id=62b05900-93e3-4190-a88f-1d87324303d1)}" {{(pid=84538) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 29 19:03:12 devstack cinder-volume[84538]: DEBUG cinder.volume.drivers.remotefs [None req-28b26685-40b1-4dfa-bf99-6988de09bb79 tempest-VolumesTransfersV357Test-932871906 None] Creating volume a9960472-ee17-4dc6-b481-6cab11207a0c {{(pid=84538) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 29 19:03:12 devstack cinder-volume[84538]: DEBUG oslo_concurrency.lockutils [None req-28b26685-40b1-4dfa-bf99-6988de09bb79 tempest-VolumesTransfersV357Test-932871906 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 19:03:12 devstack cinder-volume[84538]: DEBUG oslo_concurrency.lockutils [None req-28b26685-40b1-4dfa-bf99-6988de09bb79 tempest-VolumesTransfersV357Test-932871906 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=84538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 19:03:12 devstack cinder-volume[84538]: DEBUG cinder.volume.drivers.quobyte [None req-28b26685-40b1-4dfa-bf99-6988de09bb79 tempest-VolumesTransfersV357Test-932871906 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-34312b00-dd6d-45bb-af98-75855cea8e48': None} {{(pid=84538) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 19:03:12 devstack cinder-volume[84538]: DEBUG cinder.volume.drivers.quobyte [None req-28b26685-40b1-4dfa-bf99-6988de09bb79 tempest-VolumesTransfersV357Test-932871906 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-34312b00-dd6d-45bb-af98-75855cea8e48'] {{(pid=84538) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 19:03:12 devstack cinder-volume[84538]: DEBUG oslo_concurrency.lockutils [None req-28b26685-40b1-4dfa-bf99-6988de09bb79 tempest-VolumesTransfersV357Test-932871906 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=84538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 19:03:12 devstack cinder-volume[84538]: DEBUG cinder.volume.drivers.quobyte [None req-28b26685-40b1-4dfa-bf99-6988de09bb79 tempest-VolumesTransfersV357Test-932871906 None] Selected osci02.corp.quobyte.com/cinder-vol-34312b00-dd6d-45bb-af98-75855cea8e48 as target Quobyte volume. {{(pid=84538) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 29 19:03:12 devstack cinder-volume[84538]: INFO cinder.volume.drivers.remotefs [None req-28b26685-40b1-4dfa-bf99-6988de09bb79 tempest-VolumesTransfersV357Test-932871906 None] casted to osci02.corp.quobyte.com/cinder-vol-34312b00-dd6d-45bb-af98-75855cea8e48 Apr 29 19:03:12 devstack cinder-volume[84538]: DEBUG oslo_concurrency.processutils [None req-28b26685-40b1-4dfa-bf99-6988de09bb79 tempest-VolumesTransfersV357Test-932871906 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-a9960472-ee17-4dc6-b481-6cab11207a0c 1073741824 {{(pid=84538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 19:03:12 devstack sudo[90983]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-a9960472-ee17-4dc6-b481-6cab11207a0c 1073741824 Apr 29 19:03:12 devstack sudo[90983]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 19:03:13 devstack sudo[90983]: pam_unix(sudo:session): session closed for user root Apr 29 19:03:13 devstack cinder-volume[84538]: DEBUG oslo_concurrency.processutils [None req-28b26685-40b1-4dfa-bf99-6988de09bb79 tempest-VolumesTransfersV357Test-932871906 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-a9960472-ee17-4dc6-b481-6cab11207a0c 1073741824" returned: 0 in 1.012s {{(pid=84538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 19:03:13 devstack cinder-volume[84538]: DEBUG oslo_concurrency.processutils [None req-28b26685-40b1-4dfa-bf99-6988de09bb79 tempest-VolumesTransfersV357Test-932871906 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-a9960472-ee17-4dc6-b481-6cab11207a0c {{(pid=84538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 19:03:13 devstack sudo[90993]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-a9960472-ee17-4dc6-b481-6cab11207a0c Apr 29 19:03:13 devstack sudo[90993]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 19:03:14 devstack cinder-volume[84538]: DEBUG cinder.volume.flows.manager.create_volume [None req-10639720-6f6e-498f-b2a6-7706ea0f99a6 tempest-VolumesMetadataTest-963052985 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84538) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Apr 29 19:03:14 devstack cinder-volume[84538]: DEBUG cinder.volume.manager [None req-10639720-6f6e-498f-b2a6-7706ea0f99a6 tempest-VolumesMetadataTest-963052985 None] Flow 'volume_create_manager' (c618dda8-ecbb-4f59-a7c0-5c3a7293c373) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84538) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 19:03:14 devstack cinder-volume[84538]: DEBUG cinder.volume.manager [None req-10639720-6f6e-498f-b2a6-7706ea0f99a6 tempest-VolumesMetadataTest-963052985 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (123750ee-ea0d-40ad-ba4e-28d8436544db) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 19:03:14 devstack sudo[90993]: pam_unix(sudo:session): session closed for user root Apr 29 19:03:14 devstack cinder-volume[84538]: DEBUG oslo_concurrency.processutils [None req-28b26685-40b1-4dfa-bf99-6988de09bb79 tempest-VolumesTransfersV357Test-932871906 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-a9960472-ee17-4dc6-b481-6cab11207a0c" returned: 0 in 0.859s {{(pid=84538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 19:03:14 devstack cinder-volume[84538]: DEBUG cinder.volume.drivers.quobyte [None req-28b26685-40b1-4dfa-bf99-6988de09bb79 tempest-VolumesTransfersV357Test-932871906 None] <== create_volume: return (1914ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-34312b00-dd6d-45bb-af98-75855cea8e48'} {{(pid=84538) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 29 19:03:14 devstack cinder-volume[84538]: DEBUG oslo_concurrency.lockutils [None req-28b26685-40b1-4dfa-bf99-6988de09bb79 tempest-VolumesTransfersV357Test-932871906 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.918s {{(pid=84538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 19:03:14 devstack cinder-volume[84538]: DEBUG cinder.volume.manager [None req-10639720-6f6e-498f-b2a6-7706ea0f99a6 tempest-VolumesMetadataTest-963052985 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (123750ee-ea0d-40ad-ba4e-28d8436544db) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-29T17:03:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesMetadataTest-Volume-25111403',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b692095b-cc12-434c-8c3c-73d118aa099b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='dcea1e4ad1014efd8962cec82fb20cab',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T17:03:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T17:03:14Z,use_quota=True,user_id='1461c52415a847c0bbb9008dfa56bcde',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(62b05900-93e3-4190-a88f-1d87324303d1),volume_type_id=62b05900-93e3-4190-a88f-1d87324303d1)' {{(pid=84538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 19:03:14 devstack cinder-volume[84538]: DEBUG cinder.volume.manager [None req-10639720-6f6e-498f-b2a6-7706ea0f99a6 tempest-VolumesMetadataTest-963052985 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (312f5351-3d3c-47d0-bfac-baba1e8ed9f7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 19:03:14 devstack cinder-volume[84538]: DEBUG cinder.volume.manager [None req-10639720-6f6e-498f-b2a6-7706ea0f99a6 tempest-VolumesMetadataTest-963052985 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (312f5351-3d3c-47d0-bfac-baba1e8ed9f7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 19:03:14 devstack cinder-volume[84538]: DEBUG cinder.volume.manager [None req-10639720-6f6e-498f-b2a6-7706ea0f99a6 tempest-VolumesMetadataTest-963052985 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8c7098e8-6c64-4863-a466-c551455b2ce3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 19:03:14 devstack cinder-volume[84538]: DEBUG cinder.volume.manager [None req-10639720-6f6e-498f-b2a6-7706ea0f99a6 tempest-VolumesMetadataTest-963052985 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8c7098e8-6c64-4863-a466-c551455b2ce3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b692095b-cc12-434c-8c3c-73d118aa099b', 'volume_name': 'volume-b692095b-cc12-434c-8c3c-73d118aa099b', 'volume_size': 1}' {{(pid=84538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 19:03:14 devstack cinder-volume[84538]: DEBUG cinder.volume.manager [None req-10639720-6f6e-498f-b2a6-7706ea0f99a6 tempest-VolumesMetadataTest-963052985 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (45997f50-461b-41db-8950-e022adef497b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 19:03:14 devstack cinder-volume[84538]: DEBUG cinder.volume.manager [None req-10639720-6f6e-498f-b2a6-7706ea0f99a6 tempest-VolumesMetadataTest-963052985 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (45997f50-461b-41db-8950-e022adef497b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 19:03:14 devstack cinder-volume[84538]: DEBUG cinder.volume.manager [None req-10639720-6f6e-498f-b2a6-7706ea0f99a6 tempest-VolumesMetadataTest-963052985 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (53e40ca4-763b-4478-ac8a-fa8b9e125539) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 19:03:14 devstack cinder-volume[84538]: INFO cinder.volume.flows.manager.create_volume [None req-10639720-6f6e-498f-b2a6-7706ea0f99a6 tempest-VolumesMetadataTest-963052985 None] Volume b692095b-cc12-434c-8c3c-73d118aa099b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b692095b-cc12-434c-8c3c-73d118aa099b', 'volume_size': 1} Apr 29 19:03:14 devstack cinder-volume[84538]: DEBUG oslo_concurrency.lockutils [None req-10639720-6f6e-498f-b2a6-7706ea0f99a6 tempest-VolumesMetadataTest-963052985 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 19:03:14 devstack cinder-volume[84538]: DEBUG oslo_concurrency.lockutils [None req-10639720-6f6e-498f-b2a6-7706ea0f99a6 tempest-VolumesMetadataTest-963052985 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=84538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 19:03:14 devstack cinder-volume[84538]: DEBUG cinder.volume.drivers.quobyte [None req-10639720-6f6e-498f-b2a6-7706ea0f99a6 tempest-VolumesMetadataTest-963052985 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-29T17:03:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesMetadataTest-Volume-25111403',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b692095b-cc12-434c-8c3c-73d118aa099b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='dcea1e4ad1014efd8962cec82fb20cab',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T17:03:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T17:03:14Z,use_quota=True,user_id='1461c52415a847c0bbb9008dfa56bcde',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(62b05900-93e3-4190-a88f-1d87324303d1),volume_type_id=62b05900-93e3-4190-a88f-1d87324303d1)}" {{(pid=84538) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 29 19:03:14 devstack cinder-volume[84538]: DEBUG cinder.volume.drivers.remotefs [None req-10639720-6f6e-498f-b2a6-7706ea0f99a6 tempest-VolumesMetadataTest-963052985 None] Creating volume b692095b-cc12-434c-8c3c-73d118aa099b {{(pid=84538) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 29 19:03:14 devstack cinder-volume[84538]: DEBUG oslo_concurrency.lockutils [None req-10639720-6f6e-498f-b2a6-7706ea0f99a6 tempest-VolumesMetadataTest-963052985 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 19:03:14 devstack cinder-volume[84538]: DEBUG oslo_concurrency.lockutils [None req-10639720-6f6e-498f-b2a6-7706ea0f99a6 tempest-VolumesMetadataTest-963052985 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=84538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 19:03:14 devstack cinder-volume[84538]: DEBUG cinder.volume.drivers.quobyte [None req-10639720-6f6e-498f-b2a6-7706ea0f99a6 tempest-VolumesMetadataTest-963052985 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-34312b00-dd6d-45bb-af98-75855cea8e48': None} {{(pid=84538) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 19:03:14 devstack cinder-volume[84538]: DEBUG cinder.volume.drivers.quobyte [None req-10639720-6f6e-498f-b2a6-7706ea0f99a6 tempest-VolumesMetadataTest-963052985 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-34312b00-dd6d-45bb-af98-75855cea8e48'] {{(pid=84538) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 19:03:14 devstack cinder-volume[84538]: DEBUG oslo_concurrency.lockutils [None req-10639720-6f6e-498f-b2a6-7706ea0f99a6 tempest-VolumesMetadataTest-963052985 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=84538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 19:03:14 devstack cinder-volume[84538]: DEBUG cinder.volume.drivers.quobyte [None req-10639720-6f6e-498f-b2a6-7706ea0f99a6 tempest-VolumesMetadataTest-963052985 None] Selected osci02.corp.quobyte.com/cinder-vol-34312b00-dd6d-45bb-af98-75855cea8e48 as target Quobyte volume. {{(pid=84538) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 29 19:03:14 devstack cinder-volume[84538]: INFO cinder.volume.drivers.remotefs [None req-10639720-6f6e-498f-b2a6-7706ea0f99a6 tempest-VolumesMetadataTest-963052985 None] casted to osci02.corp.quobyte.com/cinder-vol-34312b00-dd6d-45bb-af98-75855cea8e48 Apr 29 19:03:14 devstack cinder-volume[84538]: DEBUG oslo_concurrency.processutils [None req-10639720-6f6e-498f-b2a6-7706ea0f99a6 tempest-VolumesMetadataTest-963052985 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-b692095b-cc12-434c-8c3c-73d118aa099b 1073741824 {{(pid=84538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 19:03:14 devstack cinder-volume[84538]: DEBUG cinder.volume.manager [None req-28b26685-40b1-4dfa-bf99-6988de09bb79 tempest-VolumesTransfersV357Test-932871906 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cb646b0a-fe46-4a09-99df-e2c5b08761b8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a9960472-ee17-4dc6-b481-6cab11207a0c', 'volume_size': 1}' {{(pid=84538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 19:03:14 devstack sudo[90997]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-b692095b-cc12-434c-8c3c-73d118aa099b 1073741824 Apr 29 19:03:14 devstack cinder-volume[84538]: DEBUG cinder.volume.manager [None req-28b26685-40b1-4dfa-bf99-6988de09bb79 tempest-VolumesTransfersV357Test-932871906 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (797daf46-cb31-4626-8436-17cff6684e9d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 19:03:14 devstack sudo[90997]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 19:03:14 devstack cinder-volume[84538]: INFO cinder.volume.flows.manager.create_volume [None req-28b26685-40b1-4dfa-bf99-6988de09bb79 tempest-VolumesTransfersV357Test-932871906 None] Volume volume-a9960472-ee17-4dc6-b481-6cab11207a0c (a9960472-ee17-4dc6-b481-6cab11207a0c): created successfully Apr 29 19:03:14 devstack cinder-volume[84538]: DEBUG cinder.volume.manager [None req-28b26685-40b1-4dfa-bf99-6988de09bb79 tempest-VolumesTransfersV357Test-932871906 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (797daf46-cb31-4626-8436-17cff6684e9d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 19:03:14 devstack cinder-volume[84538]: DEBUG cinder.volume.manager [None req-28b26685-40b1-4dfa-bf99-6988de09bb79 tempest-VolumesTransfersV357Test-932871906 None] Flow 'volume_create_manager' (74aee949-c046-45a4-9597-8e0d861ac17b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84538) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 19:03:14 devstack cinder-volume[84538]: INFO cinder.volume.manager [None req-28b26685-40b1-4dfa-bf99-6988de09bb79 tempest-VolumesTransfersV357Test-932871906 None] Created volume successfully. Apr 29 19:03:15 devstack sudo[90997]: pam_unix(sudo:session): session closed for user root Apr 29 19:03:15 devstack cinder-volume[84538]: DEBUG oslo_concurrency.processutils [None req-10639720-6f6e-498f-b2a6-7706ea0f99a6 tempest-VolumesMetadataTest-963052985 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-b692095b-cc12-434c-8c3c-73d118aa099b 1073741824" returned: 0 in 0.884s {{(pid=84538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 19:03:15 devstack cinder-volume[84538]: DEBUG oslo_concurrency.processutils [None req-10639720-6f6e-498f-b2a6-7706ea0f99a6 tempest-VolumesMetadataTest-963052985 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-b692095b-cc12-434c-8c3c-73d118aa099b {{(pid=84538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 19:03:15 devstack sudo[91003]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-b692095b-cc12-434c-8c3c-73d118aa099b Apr 29 19:03:15 devstack sudo[91003]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 19:03:16 devstack sudo[91003]: pam_unix(sudo:session): session closed for user root Apr 29 19:03:16 devstack cinder-volume[84538]: DEBUG oslo_concurrency.processutils [None req-10639720-6f6e-498f-b2a6-7706ea0f99a6 tempest-VolumesMetadataTest-963052985 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-b692095b-cc12-434c-8c3c-73d118aa099b" returned: 0 in 0.657s {{(pid=84538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 19:03:16 devstack cinder-volume[84538]: DEBUG cinder.volume.drivers.quobyte [None req-10639720-6f6e-498f-b2a6-7706ea0f99a6 tempest-VolumesMetadataTest-963052985 None] <== create_volume: return (1583ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-34312b00-dd6d-45bb-af98-75855cea8e48'} {{(pid=84538) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 29 19:03:16 devstack cinder-volume[84538]: DEBUG oslo_concurrency.lockutils [None req-10639720-6f6e-498f-b2a6-7706ea0f99a6 tempest-VolumesMetadataTest-963052985 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.587s {{(pid=84538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 19:03:16 devstack cinder-volume[84538]: DEBUG cinder.volume.manager [None req-10639720-6f6e-498f-b2a6-7706ea0f99a6 tempest-VolumesMetadataTest-963052985 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (53e40ca4-763b-4478-ac8a-fa8b9e125539) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b692095b-cc12-434c-8c3c-73d118aa099b', 'volume_size': 1}' {{(pid=84538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 19:03:16 devstack cinder-volume[84538]: DEBUG cinder.volume.manager [None req-10639720-6f6e-498f-b2a6-7706ea0f99a6 tempest-VolumesMetadataTest-963052985 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bd8f7159-8c73-420d-89eb-c85c0efe6a63) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 19:03:16 devstack cinder-volume[84538]: INFO cinder.volume.flows.manager.create_volume [None req-10639720-6f6e-498f-b2a6-7706ea0f99a6 tempest-VolumesMetadataTest-963052985 None] Volume volume-b692095b-cc12-434c-8c3c-73d118aa099b (b692095b-cc12-434c-8c3c-73d118aa099b): created successfully Apr 29 19:03:16 devstack cinder-volume[84538]: DEBUG cinder.volume.manager [None req-10639720-6f6e-498f-b2a6-7706ea0f99a6 tempest-VolumesMetadataTest-963052985 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bd8f7159-8c73-420d-89eb-c85c0efe6a63) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 19:03:16 devstack cinder-volume[84538]: DEBUG cinder.volume.manager [None req-10639720-6f6e-498f-b2a6-7706ea0f99a6 tempest-VolumesMetadataTest-963052985 None] Flow 'volume_create_manager' (c618dda8-ecbb-4f59-a7c0-5c3a7293c373) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84538) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 19:03:16 devstack cinder-volume[84538]: INFO cinder.volume.manager [None req-10639720-6f6e-498f-b2a6-7706ea0f99a6 tempest-VolumesMetadataTest-963052985 None] Created volume successfully. Apr 29 19:03:16 devstack cinder-volume[84538]: INFO cinder.volume.manager [None req-f5460628-f4ff-4de1-af7c-20b46961b2cf tempest-VolumesTransfersV357Test-1932614700 None] Transfer volume completed successfully. Apr 29 19:03:17 devstack cinder-volume[84538]: DEBUG cinder.coordination [None req-695a6dba-6787-45c1-a3bc-a76b3bc3aa8a tempest-VolumesMetadataTest-963052985 None] Acquiring lock "cinder-b692095b-cc12-434c-8c3c-73d118aa099b-delete_volume" by "delete_volume" {{(pid=84538) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 19:03:17 devstack cinder-volume[84538]: DEBUG cinder.coordination [None req-695a6dba-6787-45c1-a3bc-a76b3bc3aa8a tempest-VolumesMetadataTest-963052985 None] Lock "cinder-b692095b-cc12-434c-8c3c-73d118aa099b-delete_volume" acquired by "delete_volume" :: waited 0.033s {{(pid=84538) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 19:03:17 devstack cinder-volume[84538]: DEBUG cinder.coordination [None req-695a6dba-6787-45c1-a3bc-a76b3bc3aa8a tempest-VolumesMetadataTest-963052985 None] Acquiring lock "cinder-quobyte-b692095b-cc12-434c-8c3c-73d118aa099b" by "delete_volume" {{(pid=84538) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 19:03:17 devstack cinder-volume[84538]: DEBUG cinder.coordination [None req-695a6dba-6787-45c1-a3bc-a76b3bc3aa8a tempest-VolumesMetadataTest-963052985 None] Lock "cinder-quobyte-b692095b-cc12-434c-8c3c-73d118aa099b" acquired by "delete_volume" :: waited 0.023s {{(pid=84538) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 19:03:17 devstack cinder-volume[84538]: DEBUG oslo.privsep.daemon [-] privsep: reply[92b469ed-3823-4493-bc6c-a8706fd224f4]: (4, 'qcow2') {{(pid=85803) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 19:03:17 devstack cinder-volume[84538]: DEBUG oslo_concurrency.processutils [None req-695a6dba-6787-45c1-a3bc-a76b3bc3aa8a tempest-VolumesMetadataTest-963052985 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-b692095b-cc12-434c-8c3c-73d118aa099b {{(pid=84538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 19:03:17 devstack sudo[91006]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-b692095b-cc12-434c-8c3c-73d118aa099b Apr 29 19:03:17 devstack sudo[91006]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 19:03:17 devstack cinder-volume[84538]: DEBUG cinder.coordination [None req-0bc57594-12a0-4e98-b818-3af5a772cc32 tempest-VolumesTransfersV357Test-559180709 None] Acquiring lock "cinder-a9960472-ee17-4dc6-b481-6cab11207a0c-delete_volume" by "delete_volume" {{(pid=84538) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 19:03:17 devstack cinder-volume[84538]: DEBUG cinder.coordination [None req-0bc57594-12a0-4e98-b818-3af5a772cc32 tempest-VolumesTransfersV357Test-559180709 None] Lock "cinder-a9960472-ee17-4dc6-b481-6cab11207a0c-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=84538) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 19:03:17 devstack cinder-volume[84538]: DEBUG cinder.coordination [None req-0bc57594-12a0-4e98-b818-3af5a772cc32 tempest-VolumesTransfersV357Test-559180709 None] Acquiring lock "cinder-quobyte-a9960472-ee17-4dc6-b481-6cab11207a0c" by "delete_volume" {{(pid=84538) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 19:03:17 devstack cinder-volume[84538]: DEBUG cinder.coordination [None req-0bc57594-12a0-4e98-b818-3af5a772cc32 tempest-VolumesTransfersV357Test-559180709 None] Lock "cinder-quobyte-a9960472-ee17-4dc6-b481-6cab11207a0c" acquired by "delete_volume" :: waited 0.023s {{(pid=84538) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 19:03:17 devstack cinder-volume[84538]: DEBUG oslo.privsep.daemon [-] privsep: reply[278ae55b-b8aa-4dd1-9a93-e8e677a6e44c]: (4, 'qcow2') {{(pid=85803) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 19:03:17 devstack cinder-volume[84538]: DEBUG oslo_concurrency.processutils [None req-0bc57594-12a0-4e98-b818-3af5a772cc32 tempest-VolumesTransfersV357Test-559180709 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-a9960472-ee17-4dc6-b481-6cab11207a0c {{(pid=84538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 19:03:17 devstack sudo[91008]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-a9960472-ee17-4dc6-b481-6cab11207a0c Apr 29 19:03:17 devstack sudo[91008]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 19:03:18 devstack sudo[91006]: pam_unix(sudo:session): session closed for user root Apr 29 19:03:18 devstack cinder-volume[84538]: DEBUG oslo_concurrency.processutils [None req-695a6dba-6787-45c1-a3bc-a76b3bc3aa8a tempest-VolumesMetadataTest-963052985 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-b692095b-cc12-434c-8c3c-73d118aa099b" returned: 0 in 0.891s {{(pid=84538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 19:03:18 devstack cinder-volume[84538]: DEBUG oslo_concurrency.processutils [None req-695a6dba-6787-45c1-a3bc-a76b3bc3aa8a tempest-VolumesMetadataTest-963052985 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-b692095b-cc12-434c-8c3c-73d118aa099b {{(pid=84538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 19:03:18 devstack sudo[91014]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-b692095b-cc12-434c-8c3c-73d118aa099b Apr 29 19:03:18 devstack sudo[91014]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 19:03:18 devstack sudo[91008]: pam_unix(sudo:session): session closed for user root Apr 29 19:03:18 devstack cinder-volume[84538]: DEBUG oslo_concurrency.processutils [None req-0bc57594-12a0-4e98-b818-3af5a772cc32 tempest-VolumesTransfersV357Test-559180709 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-a9960472-ee17-4dc6-b481-6cab11207a0c" returned: 0 in 1.172s {{(pid=84538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 19:03:18 devstack cinder-volume[84538]: DEBUG oslo_concurrency.processutils [None req-0bc57594-12a0-4e98-b818-3af5a772cc32 tempest-VolumesTransfersV357Test-559180709 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-a9960472-ee17-4dc6-b481-6cab11207a0c {{(pid=84538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 19:03:18 devstack sudo[91019]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-a9960472-ee17-4dc6-b481-6cab11207a0c Apr 29 19:03:18 devstack sudo[91019]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 19:03:19 devstack sudo[91014]: pam_unix(sudo:session): session closed for user root Apr 29 19:03:19 devstack cinder-volume[84538]: DEBUG oslo_concurrency.processutils [None req-695a6dba-6787-45c1-a3bc-a76b3bc3aa8a tempest-VolumesMetadataTest-963052985 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-b692095b-cc12-434c-8c3c-73d118aa099b" returned: 0 in 1.024s {{(pid=84538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 19:03:19 devstack cinder-volume[84538]: DEBUG cinder.coordination [None req-695a6dba-6787-45c1-a3bc-a76b3bc3aa8a tempest-VolumesMetadataTest-963052985 None] Lock "cinder-quobyte-b692095b-cc12-434c-8c3c-73d118aa099b" released by "delete_volume" :: held 1.982s {{(pid=84538) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 19:03:19 devstack cinder-volume[84538]: DEBUG cinder.quota [None req-695a6dba-6787-45c1-a3bc-a76b3bc3aa8a tempest-VolumesMetadataTest-963052985 None] Created reservations ['5c54140d-4b2f-449b-bd29-4cb1e8fd6699', '1e565355-098c-4399-bb63-90fdb4d9d2ef', '320683e2-4f08-4da3-a875-feccdcdf44d0', '779fea19-e765-4a7c-a7cc-16f04e64b294'] {{(pid=84538) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 29 19:03:19 devstack cinder-volume[84538]: DEBUG oslo_concurrency.lockutils [None req-695a6dba-6787-45c1-a3bc-a76b3bc3aa8a tempest-VolumesMetadataTest-963052985 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 19:03:19 devstack cinder-volume[84538]: DEBUG oslo_concurrency.lockutils [None req-695a6dba-6787-45c1-a3bc-a76b3bc3aa8a tempest-VolumesMetadataTest-963052985 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=84538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 19:03:19 devstack cinder-volume[84538]: DEBUG cinder.volume.drivers.quobyte [None req-695a6dba-6787-45c1-a3bc-a76b3bc3aa8a tempest-VolumesMetadataTest-963052985 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-34312b00-dd6d-45bb-af98-75855cea8e48': None} {{(pid=84538) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 19:03:19 devstack cinder-volume[84538]: DEBUG cinder.volume.drivers.quobyte [None req-695a6dba-6787-45c1-a3bc-a76b3bc3aa8a tempest-VolumesMetadataTest-963052985 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-34312b00-dd6d-45bb-af98-75855cea8e48'] {{(pid=84538) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 19:03:19 devstack cinder-volume[84538]: DEBUG oslo_concurrency.lockutils [None req-695a6dba-6787-45c1-a3bc-a76b3bc3aa8a tempest-VolumesMetadataTest-963052985 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=84538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 19:03:19 devstack cinder-volume[84538]: DEBUG oslo_concurrency.processutils [None req-695a6dba-6787-45c1-a3bc-a76b3bc3aa8a tempest-VolumesMetadataTest-963052985 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d {{(pid=84538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 19:03:19 devstack sudo[91022]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d Apr 29 19:03:19 devstack sudo[91022]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 19:03:19 devstack sudo[91019]: pam_unix(sudo:session): session closed for user root Apr 29 19:03:19 devstack cinder-volume[84538]: DEBUG oslo_concurrency.processutils [None req-0bc57594-12a0-4e98-b818-3af5a772cc32 tempest-VolumesTransfersV357Test-559180709 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-a9960472-ee17-4dc6-b481-6cab11207a0c" returned: 0 in 0.899s {{(pid=84538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 19:03:19 devstack cinder-volume[84538]: DEBUG cinder.coordination [None req-0bc57594-12a0-4e98-b818-3af5a772cc32 tempest-VolumesTransfersV357Test-559180709 None] Lock "cinder-quobyte-a9960472-ee17-4dc6-b481-6cab11207a0c" released by "delete_volume" :: held 2.126s {{(pid=84538) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 19:03:19 devstack cinder-volume[84538]: DEBUG cinder.quota [None req-0bc57594-12a0-4e98-b818-3af5a772cc32 tempest-VolumesTransfersV357Test-559180709 None] Created reservations ['a7781c73-e831-43f4-9b72-663fc5dee068', 'd6e992ea-5893-4dd3-8d31-5fcbe5d218d0', '9f778e08-729c-4612-b3b1-7c1818f6e06c', 'cb69856c-6c38-4bfd-a4d5-a566662b03fc'] {{(pid=84538) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 29 19:03:19 devstack cinder-volume[84538]: DEBUG oslo_concurrency.lockutils [None req-0bc57594-12a0-4e98-b818-3af5a772cc32 tempest-VolumesTransfersV357Test-559180709 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 19:03:19 devstack cinder-volume[84538]: DEBUG oslo_concurrency.lockutils [None req-0bc57594-12a0-4e98-b818-3af5a772cc32 tempest-VolumesTransfersV357Test-559180709 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.005s {{(pid=84538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 19:03:19 devstack cinder-volume[84538]: DEBUG cinder.volume.drivers.quobyte [None req-0bc57594-12a0-4e98-b818-3af5a772cc32 tempest-VolumesTransfersV357Test-559180709 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-34312b00-dd6d-45bb-af98-75855cea8e48': None} {{(pid=84538) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 19:03:19 devstack cinder-volume[84538]: DEBUG cinder.volume.drivers.quobyte [None req-0bc57594-12a0-4e98-b818-3af5a772cc32 tempest-VolumesTransfersV357Test-559180709 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-34312b00-dd6d-45bb-af98-75855cea8e48'] {{(pid=84538) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 19:03:19 devstack cinder-volume[84538]: DEBUG oslo_concurrency.lockutils [None req-0bc57594-12a0-4e98-b818-3af5a772cc32 tempest-VolumesTransfersV357Test-559180709 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=84538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 19:03:19 devstack cinder-volume[84538]: DEBUG oslo_concurrency.processutils [None req-0bc57594-12a0-4e98-b818-3af5a772cc32 tempest-VolumesTransfersV357Test-559180709 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d {{(pid=84538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 19:03:20 devstack sudo[91026]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d Apr 29 19:03:20 devstack sudo[91026]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 19:03:20 devstack sudo[91022]: pam_unix(sudo:session): session closed for user root Apr 29 19:03:20 devstack cinder-volume[84538]: DEBUG oslo_concurrency.processutils [None req-695a6dba-6787-45c1-a3bc-a76b3bc3aa8a tempest-VolumesMetadataTest-963052985 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d" returned: 0 in 1.043s {{(pid=84538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 19:03:20 devstack cinder-volume[84538]: DEBUG cinder.manager [None req-695a6dba-6787-45c1-a3bc-a76b3bc3aa8a tempest-VolumesMetadataTest-963052985 None] Notifying Schedulers of capabilities ... {{(pid=84538) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 29 19:03:20 devstack cinder-volume[84538]: INFO cinder.volume.manager [None req-695a6dba-6787-45c1-a3bc-a76b3bc3aa8a tempest-VolumesMetadataTest-963052985 None] Deleted volume successfully. Apr 29 19:03:20 devstack cinder-volume[84538]: DEBUG cinder.coordination [None req-695a6dba-6787-45c1-a3bc-a76b3bc3aa8a tempest-VolumesMetadataTest-963052985 None] Lock "cinder-b692095b-cc12-434c-8c3c-73d118aa099b-delete_volume" released by "delete_volume" :: held 3.436s {{(pid=84538) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 19:03:21 devstack sudo[91026]: pam_unix(sudo:session): session closed for user root Apr 29 19:03:21 devstack cinder-volume[84538]: DEBUG oslo_concurrency.processutils [None req-0bc57594-12a0-4e98-b818-3af5a772cc32 tempest-VolumesTransfersV357Test-559180709 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d" returned: 0 in 1.199s {{(pid=84538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 19:03:21 devstack cinder-volume[84538]: DEBUG cinder.manager [None req-0bc57594-12a0-4e98-b818-3af5a772cc32 tempest-VolumesTransfersV357Test-559180709 None] Notifying Schedulers of capabilities ... {{(pid=84538) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 29 19:03:21 devstack cinder-volume[84538]: INFO cinder.volume.manager [None req-0bc57594-12a0-4e98-b818-3af5a772cc32 tempest-VolumesTransfersV357Test-559180709 None] Deleted volume successfully. Apr 29 19:03:21 devstack cinder-volume[84538]: DEBUG cinder.coordination [None req-0bc57594-12a0-4e98-b818-3af5a772cc32 tempest-VolumesTransfersV357Test-559180709 None] Lock "cinder-a9960472-ee17-4dc6-b481-6cab11207a0c-delete_volume" released by "delete_volume" :: held 3.661s {{(pid=84538) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 19:03:21 devstack cinder-volume[84538]: DEBUG cinder.volume.flows.manager.create_volume [None req-d9f76fcb-f579-4489-a5f8-b1d50b6f5438 tempest-VolumesTransfersV357Test-932871906 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84538) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Apr 29 19:03:21 devstack cinder-volume[84538]: DEBUG cinder.volume.manager [None req-d9f76fcb-f579-4489-a5f8-b1d50b6f5438 tempest-VolumesTransfersV357Test-932871906 None] Flow 'volume_create_manager' (54822a99-c3ff-4b00-b6fb-8e88b28d8cec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84538) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 19:03:21 devstack cinder-volume[84538]: DEBUG cinder.volume.manager [None req-d9f76fcb-f579-4489-a5f8-b1d50b6f5438 tempest-VolumesTransfersV357Test-932871906 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (aabbb864-cb2b-4e26-bd1f-fe163893f096) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 19:03:21 devstack cinder-volume[84538]: DEBUG cinder.volume.manager [None req-d9f76fcb-f579-4489-a5f8-b1d50b6f5438 tempest-VolumesTransfersV357Test-932871906 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (aabbb864-cb2b-4e26-bd1f-fe163893f096) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-29T17:03:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV357Test-Volume-1390727143',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=00384643-da1d-4530-a780-ab728bd39caf,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7214de4cab6a4ff9b35dbadb494c59ba',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T17:03:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T17:03:22Z,use_quota=True,user_id='eba45756f3e8430287f6d48bad050946',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(62b05900-93e3-4190-a88f-1d87324303d1),volume_type_id=62b05900-93e3-4190-a88f-1d87324303d1)' {{(pid=84538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 19:03:21 devstack cinder-volume[84538]: DEBUG cinder.volume.manager [None req-d9f76fcb-f579-4489-a5f8-b1d50b6f5438 tempest-VolumesTransfersV357Test-932871906 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (11eeee11-4d9e-4ef5-b692-97c690ea3337) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 19:03:21 devstack cinder-volume[84538]: DEBUG cinder.volume.manager [None req-d9f76fcb-f579-4489-a5f8-b1d50b6f5438 tempest-VolumesTransfersV357Test-932871906 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (11eeee11-4d9e-4ef5-b692-97c690ea3337) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 19:03:21 devstack cinder-volume[84538]: DEBUG cinder.volume.manager [None req-d9f76fcb-f579-4489-a5f8-b1d50b6f5438 tempest-VolumesTransfersV357Test-932871906 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c1b4d975-5768-4ae3-a148-f450990018e8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 19:03:21 devstack cinder-volume[84538]: DEBUG cinder.volume.manager [None req-d9f76fcb-f579-4489-a5f8-b1d50b6f5438 tempest-VolumesTransfersV357Test-932871906 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c1b4d975-5768-4ae3-a148-f450990018e8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '00384643-da1d-4530-a780-ab728bd39caf', 'volume_name': 'volume-00384643-da1d-4530-a780-ab728bd39caf', 'volume_size': 1}' {{(pid=84538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 19:03:21 devstack cinder-volume[84538]: DEBUG cinder.volume.manager [None req-d9f76fcb-f579-4489-a5f8-b1d50b6f5438 tempest-VolumesTransfersV357Test-932871906 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (90945072-95ce-4102-9a61-b73012d225e4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 19:03:21 devstack cinder-volume[84538]: DEBUG cinder.volume.manager [None req-d9f76fcb-f579-4489-a5f8-b1d50b6f5438 tempest-VolumesTransfersV357Test-932871906 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (90945072-95ce-4102-9a61-b73012d225e4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 19:03:21 devstack cinder-volume[84538]: DEBUG cinder.volume.manager [None req-d9f76fcb-f579-4489-a5f8-b1d50b6f5438 tempest-VolumesTransfersV357Test-932871906 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (169b7550-08e5-4172-a0eb-8019c06f3bf1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 19:03:21 devstack cinder-volume[84538]: INFO cinder.volume.flows.manager.create_volume [None req-d9f76fcb-f579-4489-a5f8-b1d50b6f5438 tempest-VolumesTransfersV357Test-932871906 None] Volume 00384643-da1d-4530-a780-ab728bd39caf: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-00384643-da1d-4530-a780-ab728bd39caf', 'volume_size': 1} Apr 29 19:03:21 devstack cinder-volume[84538]: DEBUG oslo_concurrency.lockutils [None req-d9f76fcb-f579-4489-a5f8-b1d50b6f5438 tempest-VolumesTransfersV357Test-932871906 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 19:03:21 devstack cinder-volume[84538]: DEBUG oslo_concurrency.lockutils [None req-d9f76fcb-f579-4489-a5f8-b1d50b6f5438 tempest-VolumesTransfersV357Test-932871906 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=84538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 19:03:21 devstack cinder-volume[84538]: DEBUG cinder.volume.drivers.quobyte [None req-d9f76fcb-f579-4489-a5f8-b1d50b6f5438 tempest-VolumesTransfersV357Test-932871906 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-29T17:03:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV357Test-Volume-1390727143',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=00384643-da1d-4530-a780-ab728bd39caf,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7214de4cab6a4ff9b35dbadb494c59ba',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T17:03:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T17:03:22Z,use_quota=True,user_id='eba45756f3e8430287f6d48bad050946',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(62b05900-93e3-4190-a88f-1d87324303d1),volume_type_id=62b05900-93e3-4190-a88f-1d87324303d1)}" {{(pid=84538) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 29 19:03:21 devstack cinder-volume[84538]: DEBUG cinder.volume.drivers.remotefs [None req-d9f76fcb-f579-4489-a5f8-b1d50b6f5438 tempest-VolumesTransfersV357Test-932871906 None] Creating volume 00384643-da1d-4530-a780-ab728bd39caf {{(pid=84538) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 29 19:03:21 devstack cinder-volume[84538]: DEBUG oslo_concurrency.lockutils [None req-d9f76fcb-f579-4489-a5f8-b1d50b6f5438 tempest-VolumesTransfersV357Test-932871906 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 19:03:21 devstack cinder-volume[84538]: DEBUG oslo_concurrency.lockutils [None req-d9f76fcb-f579-4489-a5f8-b1d50b6f5438 tempest-VolumesTransfersV357Test-932871906 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=84538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 19:03:21 devstack cinder-volume[84538]: DEBUG cinder.volume.drivers.quobyte [None req-d9f76fcb-f579-4489-a5f8-b1d50b6f5438 tempest-VolumesTransfersV357Test-932871906 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-34312b00-dd6d-45bb-af98-75855cea8e48': None} {{(pid=84538) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 19:03:21 devstack cinder-volume[84538]: DEBUG cinder.volume.drivers.quobyte [None req-d9f76fcb-f579-4489-a5f8-b1d50b6f5438 tempest-VolumesTransfersV357Test-932871906 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-34312b00-dd6d-45bb-af98-75855cea8e48'] {{(pid=84538) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 19:03:21 devstack cinder-volume[84538]: DEBUG oslo_concurrency.lockutils [None req-d9f76fcb-f579-4489-a5f8-b1d50b6f5438 tempest-VolumesTransfersV357Test-932871906 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=84538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 19:03:21 devstack cinder-volume[84538]: DEBUG cinder.volume.drivers.quobyte [None req-d9f76fcb-f579-4489-a5f8-b1d50b6f5438 tempest-VolumesTransfersV357Test-932871906 None] Selected osci02.corp.quobyte.com/cinder-vol-34312b00-dd6d-45bb-af98-75855cea8e48 as target Quobyte volume. {{(pid=84538) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 29 19:03:21 devstack cinder-volume[84538]: INFO cinder.volume.drivers.remotefs [None req-d9f76fcb-f579-4489-a5f8-b1d50b6f5438 tempest-VolumesTransfersV357Test-932871906 None] casted to osci02.corp.quobyte.com/cinder-vol-34312b00-dd6d-45bb-af98-75855cea8e48 Apr 29 19:03:21 devstack cinder-volume[84538]: DEBUG oslo_concurrency.processutils [None req-d9f76fcb-f579-4489-a5f8-b1d50b6f5438 tempest-VolumesTransfersV357Test-932871906 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-00384643-da1d-4530-a780-ab728bd39caf 1073741824 {{(pid=84538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 19:03:21 devstack sudo[91044]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-00384643-da1d-4530-a780-ab728bd39caf 1073741824 Apr 29 19:03:21 devstack sudo[91044]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 19:03:22 devstack sudo[91044]: pam_unix(sudo:session): session closed for user root Apr 29 19:03:22 devstack cinder-volume[84538]: DEBUG oslo_concurrency.processutils [None req-d9f76fcb-f579-4489-a5f8-b1d50b6f5438 tempest-VolumesTransfersV357Test-932871906 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-00384643-da1d-4530-a780-ab728bd39caf 1073741824" returned: 0 in 0.894s {{(pid=84538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 19:03:22 devstack cinder-volume[84538]: DEBUG oslo_concurrency.processutils [None req-d9f76fcb-f579-4489-a5f8-b1d50b6f5438 tempest-VolumesTransfersV357Test-932871906 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-00384643-da1d-4530-a780-ab728bd39caf {{(pid=84538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 19:03:22 devstack sudo[91050]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-00384643-da1d-4530-a780-ab728bd39caf Apr 29 19:03:22 devstack sudo[91050]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 19:03:23 devstack sudo[91050]: pam_unix(sudo:session): session closed for user root Apr 29 19:03:23 devstack cinder-volume[84538]: DEBUG oslo_concurrency.processutils [None req-d9f76fcb-f579-4489-a5f8-b1d50b6f5438 tempest-VolumesTransfersV357Test-932871906 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-00384643-da1d-4530-a780-ab728bd39caf" returned: 0 in 0.727s {{(pid=84538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 19:03:23 devstack cinder-volume[84538]: DEBUG cinder.volume.drivers.quobyte [None req-d9f76fcb-f579-4489-a5f8-b1d50b6f5438 tempest-VolumesTransfersV357Test-932871906 None] <== create_volume: return (1682ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-34312b00-dd6d-45bb-af98-75855cea8e48'} {{(pid=84538) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 29 19:03:23 devstack cinder-volume[84538]: DEBUG oslo_concurrency.lockutils [None req-d9f76fcb-f579-4489-a5f8-b1d50b6f5438 tempest-VolumesTransfersV357Test-932871906 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.686s {{(pid=84538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 19:03:23 devstack cinder-volume[84538]: DEBUG cinder.volume.manager [None req-d9f76fcb-f579-4489-a5f8-b1d50b6f5438 tempest-VolumesTransfersV357Test-932871906 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (169b7550-08e5-4172-a0eb-8019c06f3bf1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-00384643-da1d-4530-a780-ab728bd39caf', 'volume_size': 1}' {{(pid=84538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 19:03:23 devstack cinder-volume[84538]: DEBUG cinder.volume.manager [None req-d9f76fcb-f579-4489-a5f8-b1d50b6f5438 tempest-VolumesTransfersV357Test-932871906 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5cf4ebaa-c6f0-4d30-93e8-409ebe0dc4d4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 19:03:23 devstack cinder-volume[84538]: INFO cinder.volume.flows.manager.create_volume [None req-d9f76fcb-f579-4489-a5f8-b1d50b6f5438 tempest-VolumesTransfersV357Test-932871906 None] Volume volume-00384643-da1d-4530-a780-ab728bd39caf (00384643-da1d-4530-a780-ab728bd39caf): created successfully Apr 29 19:03:23 devstack cinder-volume[84538]: DEBUG cinder.volume.manager [None req-d9f76fcb-f579-4489-a5f8-b1d50b6f5438 tempest-VolumesTransfersV357Test-932871906 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5cf4ebaa-c6f0-4d30-93e8-409ebe0dc4d4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 19:03:23 devstack cinder-volume[84538]: DEBUG cinder.volume.manager [None req-d9f76fcb-f579-4489-a5f8-b1d50b6f5438 tempest-VolumesTransfersV357Test-932871906 None] Flow 'volume_create_manager' (54822a99-c3ff-4b00-b6fb-8e88b28d8cec) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84538) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 19:03:23 devstack cinder-volume[84538]: INFO cinder.volume.manager [None req-d9f76fcb-f579-4489-a5f8-b1d50b6f5438 tempest-VolumesTransfersV357Test-932871906 None] Created volume successfully. Apr 29 19:03:24 devstack cinder-volume[84538]: DEBUG cinder.volume.flows.manager.create_volume [None req-d1db009c-a69c-4abb-9ff8-3efcf86d6b1f tempest-VolumesSnapshotTestJSON-1345007867 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84538) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Apr 29 19:03:24 devstack cinder-volume[84538]: DEBUG cinder.volume.manager [None req-d1db009c-a69c-4abb-9ff8-3efcf86d6b1f tempest-VolumesSnapshotTestJSON-1345007867 None] Flow 'volume_create_manager' (1415404e-082e-493f-9c49-452dd02fae5e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84538) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 19:03:24 devstack cinder-volume[84538]: DEBUG cinder.volume.manager [None req-d1db009c-a69c-4abb-9ff8-3efcf86d6b1f tempest-VolumesSnapshotTestJSON-1345007867 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3b93c694-0e0e-4b6d-b8df-6c78d5fc2a11) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 19:03:24 devstack cinder-volume[84538]: DEBUG cinder.volume.manager [None req-d1db009c-a69c-4abb-9ff8-3efcf86d6b1f tempest-VolumesSnapshotTestJSON-1345007867 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3b93c694-0e0e-4b6d-b8df-6c78d5fc2a11) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-29T17:03:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-131364716',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8dd11e3d-82b0-43a9-a9a1-cacffe80f65e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cb1bf99b4f1a451dbdf762aff4ec180c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T17:03:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T17:03:24Z,use_quota=True,user_id='987ad9d695504aeba3196f9a11cdf3cf',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(62b05900-93e3-4190-a88f-1d87324303d1),volume_type_id=62b05900-93e3-4190-a88f-1d87324303d1)' {{(pid=84538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 19:03:24 devstack cinder-volume[84538]: DEBUG cinder.volume.manager [None req-d1db009c-a69c-4abb-9ff8-3efcf86d6b1f tempest-VolumesSnapshotTestJSON-1345007867 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cbbee3c6-6806-4d41-9fc3-d0d03c445184) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 19:03:24 devstack cinder-volume[84538]: DEBUG cinder.volume.manager [None req-d1db009c-a69c-4abb-9ff8-3efcf86d6b1f tempest-VolumesSnapshotTestJSON-1345007867 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cbbee3c6-6806-4d41-9fc3-d0d03c445184) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 19:03:24 devstack cinder-volume[84538]: DEBUG cinder.volume.manager [None req-d1db009c-a69c-4abb-9ff8-3efcf86d6b1f tempest-VolumesSnapshotTestJSON-1345007867 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e492f055-09a9-46b1-8a5d-20c1ac326725) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 19:03:24 devstack cinder-volume[84538]: DEBUG cinder.volume.manager [None req-d1db009c-a69c-4abb-9ff8-3efcf86d6b1f tempest-VolumesSnapshotTestJSON-1345007867 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e492f055-09a9-46b1-8a5d-20c1ac326725) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8dd11e3d-82b0-43a9-a9a1-cacffe80f65e', 'volume_name': 'volume-8dd11e3d-82b0-43a9-a9a1-cacffe80f65e', 'volume_size': 1}' {{(pid=84538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 19:03:24 devstack cinder-volume[84538]: DEBUG cinder.volume.manager [None req-d1db009c-a69c-4abb-9ff8-3efcf86d6b1f tempest-VolumesSnapshotTestJSON-1345007867 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (35d77acd-aebc-4b22-bc6e-f422a0c1c414) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 19:03:24 devstack cinder-volume[84538]: DEBUG cinder.volume.manager [None req-d1db009c-a69c-4abb-9ff8-3efcf86d6b1f tempest-VolumesSnapshotTestJSON-1345007867 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (35d77acd-aebc-4b22-bc6e-f422a0c1c414) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 19:03:24 devstack cinder-volume[84538]: DEBUG cinder.volume.manager [None req-d1db009c-a69c-4abb-9ff8-3efcf86d6b1f tempest-VolumesSnapshotTestJSON-1345007867 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d37695ff-44bb-466f-a28f-96dd73da7888) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 19:03:24 devstack cinder-volume[84538]: INFO cinder.volume.flows.manager.create_volume [None req-d1db009c-a69c-4abb-9ff8-3efcf86d6b1f tempest-VolumesSnapshotTestJSON-1345007867 None] Volume 8dd11e3d-82b0-43a9-a9a1-cacffe80f65e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8dd11e3d-82b0-43a9-a9a1-cacffe80f65e', 'volume_size': 1} Apr 29 19:03:24 devstack cinder-volume[84538]: DEBUG oslo_concurrency.lockutils [None req-d1db009c-a69c-4abb-9ff8-3efcf86d6b1f tempest-VolumesSnapshotTestJSON-1345007867 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 19:03:24 devstack cinder-volume[84538]: DEBUG oslo_concurrency.lockutils [None req-d1db009c-a69c-4abb-9ff8-3efcf86d6b1f tempest-VolumesSnapshotTestJSON-1345007867 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=84538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 19:03:24 devstack cinder-volume[84538]: DEBUG cinder.volume.drivers.quobyte [None req-d1db009c-a69c-4abb-9ff8-3efcf86d6b1f tempest-VolumesSnapshotTestJSON-1345007867 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-29T17:03:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-131364716',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8dd11e3d-82b0-43a9-a9a1-cacffe80f65e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cb1bf99b4f1a451dbdf762aff4ec180c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T17:03:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T17:03:24Z,use_quota=True,user_id='987ad9d695504aeba3196f9a11cdf3cf',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(62b05900-93e3-4190-a88f-1d87324303d1),volume_type_id=62b05900-93e3-4190-a88f-1d87324303d1)}" {{(pid=84538) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 29 19:03:24 devstack cinder-volume[84538]: DEBUG cinder.volume.drivers.remotefs [None req-d1db009c-a69c-4abb-9ff8-3efcf86d6b1f tempest-VolumesSnapshotTestJSON-1345007867 None] Creating volume 8dd11e3d-82b0-43a9-a9a1-cacffe80f65e {{(pid=84538) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 29 19:03:24 devstack cinder-volume[84538]: DEBUG oslo_concurrency.lockutils [None req-d1db009c-a69c-4abb-9ff8-3efcf86d6b1f tempest-VolumesSnapshotTestJSON-1345007867 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 19:03:24 devstack cinder-volume[84538]: DEBUG oslo_concurrency.lockutils [None req-d1db009c-a69c-4abb-9ff8-3efcf86d6b1f tempest-VolumesSnapshotTestJSON-1345007867 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=84538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 19:03:24 devstack cinder-volume[84538]: DEBUG cinder.volume.drivers.quobyte [None req-d1db009c-a69c-4abb-9ff8-3efcf86d6b1f tempest-VolumesSnapshotTestJSON-1345007867 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-34312b00-dd6d-45bb-af98-75855cea8e48': None} {{(pid=84538) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 19:03:24 devstack cinder-volume[84538]: DEBUG cinder.volume.drivers.quobyte [None req-d1db009c-a69c-4abb-9ff8-3efcf86d6b1f tempest-VolumesSnapshotTestJSON-1345007867 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-34312b00-dd6d-45bb-af98-75855cea8e48'] {{(pid=84538) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 19:03:24 devstack cinder-volume[84538]: DEBUG oslo_concurrency.lockutils [None req-d1db009c-a69c-4abb-9ff8-3efcf86d6b1f tempest-VolumesSnapshotTestJSON-1345007867 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=84538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 19:03:24 devstack cinder-volume[84538]: DEBUG cinder.volume.drivers.quobyte [None req-d1db009c-a69c-4abb-9ff8-3efcf86d6b1f tempest-VolumesSnapshotTestJSON-1345007867 None] Selected osci02.corp.quobyte.com/cinder-vol-34312b00-dd6d-45bb-af98-75855cea8e48 as target Quobyte volume. {{(pid=84538) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 29 19:03:24 devstack cinder-volume[84538]: INFO cinder.volume.drivers.remotefs [None req-d1db009c-a69c-4abb-9ff8-3efcf86d6b1f tempest-VolumesSnapshotTestJSON-1345007867 None] casted to osci02.corp.quobyte.com/cinder-vol-34312b00-dd6d-45bb-af98-75855cea8e48 Apr 29 19:03:24 devstack cinder-volume[84538]: DEBUG oslo_concurrency.processutils [None req-d1db009c-a69c-4abb-9ff8-3efcf86d6b1f tempest-VolumesSnapshotTestJSON-1345007867 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-8dd11e3d-82b0-43a9-a9a1-cacffe80f65e 1073741824 {{(pid=84538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 19:03:24 devstack cinder-volume[84538]: DEBUG cinder.coordination [None req-f483d93e-2a96-4d07-9dd6-e3f402ac538a tempest-VolumesTransfersV357Test-559180709 None] Acquiring lock "cinder-00384643-da1d-4530-a780-ab728bd39caf-delete_volume" by "delete_volume" {{(pid=84538) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 19:03:24 devstack sudo[91053]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-8dd11e3d-82b0-43a9-a9a1-cacffe80f65e 1073741824 Apr 29 19:03:24 devstack sudo[91053]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 19:03:24 devstack cinder-volume[84538]: DEBUG cinder.coordination [None req-f483d93e-2a96-4d07-9dd6-e3f402ac538a tempest-VolumesTransfersV357Test-559180709 None] Lock "cinder-00384643-da1d-4530-a780-ab728bd39caf-delete_volume" acquired by "delete_volume" :: waited 0.032s {{(pid=84538) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 19:03:24 devstack cinder-volume[84538]: DEBUG cinder.coordination [None req-f483d93e-2a96-4d07-9dd6-e3f402ac538a tempest-VolumesTransfersV357Test-559180709 None] Acquiring lock "cinder-quobyte-00384643-da1d-4530-a780-ab728bd39caf" by "delete_volume" {{(pid=84538) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 19:03:24 devstack cinder-volume[84538]: DEBUG cinder.coordination [None req-f483d93e-2a96-4d07-9dd6-e3f402ac538a tempest-VolumesTransfersV357Test-559180709 None] Lock "cinder-quobyte-00384643-da1d-4530-a780-ab728bd39caf" acquired by "delete_volume" :: waited 0.026s {{(pid=84538) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 19:03:24 devstack cinder-volume[84538]: DEBUG oslo.privsep.daemon [-] privsep: reply[e47bcea0-e113-4e5c-954c-e18b223e1d6c]: (4, 'qcow2') {{(pid=85803) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 19:03:24 devstack cinder-volume[84538]: DEBUG oslo_concurrency.processutils [None req-f483d93e-2a96-4d07-9dd6-e3f402ac538a tempest-VolumesTransfersV357Test-559180709 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-00384643-da1d-4530-a780-ab728bd39caf {{(pid=84538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 19:03:24 devstack sudo[91055]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-00384643-da1d-4530-a780-ab728bd39caf Apr 29 19:03:24 devstack sudo[91055]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 19:03:25 devstack cinder-volume[84538]: DEBUG oslo_service.periodic_task [None req-a93183a6-1080-461c-84de-2fcb210d4f60 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=84538) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}} Apr 29 19:03:25 devstack cinder-volume[84538]: DEBUG oslo_concurrency.lockutils [None req-a93183a6-1080-461c-84de-2fcb210d4f60 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 19:03:25 devstack cinder-volume[84538]: DEBUG oslo_concurrency.lockutils [None req-a93183a6-1080-461c-84de-2fcb210d4f60 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=84538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 19:03:25 devstack cinder-volume[84538]: DEBUG cinder.volume.drivers.quobyte [None req-a93183a6-1080-461c-84de-2fcb210d4f60 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-34312b00-dd6d-45bb-af98-75855cea8e48': None} {{(pid=84538) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 19:03:25 devstack cinder-volume[84538]: DEBUG cinder.volume.drivers.quobyte [None req-a93183a6-1080-461c-84de-2fcb210d4f60 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-34312b00-dd6d-45bb-af98-75855cea8e48'] {{(pid=84538) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 19:03:25 devstack cinder-volume[84538]: DEBUG oslo_concurrency.lockutils [None req-a93183a6-1080-461c-84de-2fcb210d4f60 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=84538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 19:03:25 devstack cinder-volume[84538]: DEBUG oslo_concurrency.processutils [None req-a93183a6-1080-461c-84de-2fcb210d4f60 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d {{(pid=84538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 19:03:25 devstack sudo[91060]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d Apr 29 19:03:25 devstack sudo[91060]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 19:03:25 devstack sudo[91053]: pam_unix(sudo:session): session closed for user root Apr 29 19:03:25 devstack cinder-volume[84538]: DEBUG oslo_concurrency.processutils [None req-d1db009c-a69c-4abb-9ff8-3efcf86d6b1f tempest-VolumesSnapshotTestJSON-1345007867 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-8dd11e3d-82b0-43a9-a9a1-cacffe80f65e 1073741824" returned: 0 in 1.279s {{(pid=84538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 19:03:25 devstack cinder-volume[84538]: DEBUG oslo_concurrency.processutils [None req-d1db009c-a69c-4abb-9ff8-3efcf86d6b1f tempest-VolumesSnapshotTestJSON-1345007867 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-8dd11e3d-82b0-43a9-a9a1-cacffe80f65e {{(pid=84538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 19:03:25 devstack sudo[91067]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-8dd11e3d-82b0-43a9-a9a1-cacffe80f65e Apr 29 19:03:25 devstack sudo[91067]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 19:03:25 devstack sudo[91055]: pam_unix(sudo:session): session closed for user root Apr 29 19:03:26 devstack cinder-volume[84538]: DEBUG oslo_concurrency.processutils [None req-f483d93e-2a96-4d07-9dd6-e3f402ac538a tempest-VolumesTransfersV357Test-559180709 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-00384643-da1d-4530-a780-ab728bd39caf" returned: 0 in 1.427s {{(pid=84538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 19:03:26 devstack cinder-volume[84538]: DEBUG oslo_concurrency.processutils [None req-f483d93e-2a96-4d07-9dd6-e3f402ac538a tempest-VolumesTransfersV357Test-559180709 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-00384643-da1d-4530-a780-ab728bd39caf {{(pid=84538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 19:03:26 devstack sudo[91071]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-00384643-da1d-4530-a780-ab728bd39caf Apr 29 19:03:26 devstack sudo[91071]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 19:03:26 devstack sudo[91060]: pam_unix(sudo:session): session closed for user root Apr 29 19:03:26 devstack cinder-volume[84538]: DEBUG oslo_concurrency.processutils [None req-a93183a6-1080-461c-84de-2fcb210d4f60 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d" returned: 0 in 1.199s {{(pid=84538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 19:03:26 devstack cinder-volume[84538]: DEBUG cinder.manager [None req-a93183a6-1080-461c-84de-2fcb210d4f60 None None] Notifying Schedulers of capabilities ... {{(pid=84538) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 29 19:03:26 devstack sudo[91067]: pam_unix(sudo:session): session closed for user root Apr 29 19:03:26 devstack cinder-volume[84538]: DEBUG oslo_concurrency.processutils [None req-d1db009c-a69c-4abb-9ff8-3efcf86d6b1f tempest-VolumesSnapshotTestJSON-1345007867 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-8dd11e3d-82b0-43a9-a9a1-cacffe80f65e" returned: 0 in 0.881s {{(pid=84538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 19:03:26 devstack cinder-volume[84538]: DEBUG cinder.volume.drivers.quobyte [None req-d1db009c-a69c-4abb-9ff8-3efcf86d6b1f tempest-VolumesSnapshotTestJSON-1345007867 None] <== create_volume: return (2225ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-34312b00-dd6d-45bb-af98-75855cea8e48'} {{(pid=84538) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 29 19:03:26 devstack cinder-volume[84538]: DEBUG oslo_concurrency.lockutils [None req-d1db009c-a69c-4abb-9ff8-3efcf86d6b1f tempest-VolumesSnapshotTestJSON-1345007867 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.234s {{(pid=84538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 19:03:26 devstack cinder-volume[84538]: DEBUG cinder.volume.manager [None req-d1db009c-a69c-4abb-9ff8-3efcf86d6b1f tempest-VolumesSnapshotTestJSON-1345007867 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d37695ff-44bb-466f-a28f-96dd73da7888) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8dd11e3d-82b0-43a9-a9a1-cacffe80f65e', 'volume_size': 1}' {{(pid=84538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 19:03:26 devstack cinder-volume[84538]: DEBUG cinder.volume.manager [None req-d1db009c-a69c-4abb-9ff8-3efcf86d6b1f tempest-VolumesSnapshotTestJSON-1345007867 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d40ab57a-8099-4d3c-b296-35e11c6325ec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 19:03:26 devstack cinder-volume[84538]: INFO cinder.volume.flows.manager.create_volume [None req-d1db009c-a69c-4abb-9ff8-3efcf86d6b1f tempest-VolumesSnapshotTestJSON-1345007867 None] Volume volume-8dd11e3d-82b0-43a9-a9a1-cacffe80f65e (8dd11e3d-82b0-43a9-a9a1-cacffe80f65e): created successfully Apr 29 19:03:26 devstack cinder-volume[84538]: DEBUG cinder.volume.manager [None req-d1db009c-a69c-4abb-9ff8-3efcf86d6b1f tempest-VolumesSnapshotTestJSON-1345007867 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d40ab57a-8099-4d3c-b296-35e11c6325ec) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 19:03:26 devstack cinder-volume[84538]: DEBUG cinder.volume.manager [None req-d1db009c-a69c-4abb-9ff8-3efcf86d6b1f tempest-VolumesSnapshotTestJSON-1345007867 None] Flow 'volume_create_manager' (1415404e-082e-493f-9c49-452dd02fae5e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84538) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 19:03:26 devstack cinder-volume[84538]: INFO cinder.volume.manager [None req-d1db009c-a69c-4abb-9ff8-3efcf86d6b1f tempest-VolumesSnapshotTestJSON-1345007867 None] Created volume successfully. Apr 29 19:03:26 devstack sudo[91071]: pam_unix(sudo:session): session closed for user root Apr 29 19:03:26 devstack cinder-volume[84538]: DEBUG oslo_concurrency.processutils [None req-f483d93e-2a96-4d07-9dd6-e3f402ac538a tempest-VolumesTransfersV357Test-559180709 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-00384643-da1d-4530-a780-ab728bd39caf" returned: 0 in 0.752s {{(pid=84538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 19:03:26 devstack cinder-volume[84538]: DEBUG cinder.coordination [None req-f483d93e-2a96-4d07-9dd6-e3f402ac538a tempest-VolumesTransfersV357Test-559180709 None] Lock "cinder-quobyte-00384643-da1d-4530-a780-ab728bd39caf" released by "delete_volume" :: held 2.229s {{(pid=84538) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 19:03:26 devstack cinder-volume[84538]: DEBUG cinder.quota [None req-f483d93e-2a96-4d07-9dd6-e3f402ac538a tempest-VolumesTransfersV357Test-559180709 None] Created reservations ['016ef113-9642-47e8-ae99-fdba52fbfcb4', '4e9deb20-740f-4d02-8229-6360274cbac8', '90bcf474-927d-4237-9c68-a2d2e0bf120f', 'f1243311-3f2d-4dd2-9ae6-3f6269ef740b'] {{(pid=84538) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 29 19:03:26 devstack cinder-volume[84538]: DEBUG oslo_concurrency.lockutils [None req-f483d93e-2a96-4d07-9dd6-e3f402ac538a tempest-VolumesTransfersV357Test-559180709 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 19:03:26 devstack cinder-volume[84538]: DEBUG oslo_concurrency.lockutils [None req-f483d93e-2a96-4d07-9dd6-e3f402ac538a tempest-VolumesTransfersV357Test-559180709 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 19:03:26 devstack cinder-volume[84538]: DEBUG cinder.volume.drivers.quobyte [None req-f483d93e-2a96-4d07-9dd6-e3f402ac538a tempest-VolumesTransfersV357Test-559180709 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-34312b00-dd6d-45bb-af98-75855cea8e48': None} {{(pid=84538) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 19:03:26 devstack cinder-volume[84538]: DEBUG cinder.volume.drivers.quobyte [None req-f483d93e-2a96-4d07-9dd6-e3f402ac538a tempest-VolumesTransfersV357Test-559180709 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-34312b00-dd6d-45bb-af98-75855cea8e48'] {{(pid=84538) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 19:03:26 devstack cinder-volume[84538]: DEBUG oslo_concurrency.lockutils [None req-f483d93e-2a96-4d07-9dd6-e3f402ac538a tempest-VolumesTransfersV357Test-559180709 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=84538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 19:03:26 devstack cinder-volume[84538]: DEBUG oslo_concurrency.processutils [None req-f483d93e-2a96-4d07-9dd6-e3f402ac538a tempest-VolumesTransfersV357Test-559180709 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d {{(pid=84538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 19:03:26 devstack sudo[91076]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d Apr 29 19:03:26 devstack sudo[91076]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 19:03:27 devstack cinder-volume[84538]: DEBUG cinder.volume.flows.manager.create_volume [None req-3b193580-16a7-4bfb-a137-8083932311dd tempest-VolumesCloneTest-373803938 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84538) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Apr 29 19:03:27 devstack cinder-volume[84538]: DEBUG cinder.volume.manager [None req-3b193580-16a7-4bfb-a137-8083932311dd tempest-VolumesCloneTest-373803938 None] Flow 'volume_create_manager' (f03c9ba2-f3ae-4fb7-8f07-f0932dc7a68c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84538) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 19:03:27 devstack cinder-volume[84538]: DEBUG cinder.volume.manager [None req-3b193580-16a7-4bfb-a137-8083932311dd tempest-VolumesCloneTest-373803938 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e25918ec-b3c9-4ae9-82c7-b437a140af87) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 19:03:27 devstack cinder-volume[84538]: DEBUG cinder.volume.manager [None req-3b193580-16a7-4bfb-a137-8083932311dd tempest-VolumesCloneTest-373803938 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e25918ec-b3c9-4ae9-82c7-b437a140af87) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-29T17:03:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneTest-Volume-44292403',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8218f569-9e10-4c78-9f0b-97ba4a8a1f43,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1a63cb57aa7441829e12224bfd5445dd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T17:03:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T17:03:27Z,use_quota=True,user_id='37a53c40dee449fd91fc8cf32b1de5b5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(62b05900-93e3-4190-a88f-1d87324303d1),volume_type_id=62b05900-93e3-4190-a88f-1d87324303d1)' {{(pid=84538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 19:03:27 devstack cinder-volume[84538]: DEBUG cinder.volume.manager [None req-3b193580-16a7-4bfb-a137-8083932311dd tempest-VolumesCloneTest-373803938 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2040afce-ef79-4b18-a3f2-bb876e85cf57) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 19:03:27 devstack cinder-volume[84538]: DEBUG cinder.volume.manager [None req-3b193580-16a7-4bfb-a137-8083932311dd tempest-VolumesCloneTest-373803938 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2040afce-ef79-4b18-a3f2-bb876e85cf57) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 19:03:27 devstack cinder-volume[84538]: DEBUG cinder.volume.manager [None req-3b193580-16a7-4bfb-a137-8083932311dd tempest-VolumesCloneTest-373803938 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (432039ed-91cf-4db5-b719-09012a8f5cfb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 19:03:27 devstack cinder-volume[84538]: DEBUG cinder.volume.manager [None req-3b193580-16a7-4bfb-a137-8083932311dd tempest-VolumesCloneTest-373803938 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (432039ed-91cf-4db5-b719-09012a8f5cfb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8218f569-9e10-4c78-9f0b-97ba4a8a1f43', 'volume_name': 'volume-8218f569-9e10-4c78-9f0b-97ba4a8a1f43', 'volume_size': 1}' {{(pid=84538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 19:03:27 devstack cinder-volume[84538]: DEBUG cinder.volume.manager [None req-3b193580-16a7-4bfb-a137-8083932311dd tempest-VolumesCloneTest-373803938 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (89868ea4-cb3c-4550-9aa2-1c6336d01da4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 19:03:27 devstack cinder-volume[84538]: DEBUG cinder.volume.manager [None req-3b193580-16a7-4bfb-a137-8083932311dd tempest-VolumesCloneTest-373803938 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (89868ea4-cb3c-4550-9aa2-1c6336d01da4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 19:03:27 devstack cinder-volume[84538]: DEBUG cinder.volume.manager [None req-3b193580-16a7-4bfb-a137-8083932311dd tempest-VolumesCloneTest-373803938 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (99431cb6-0c00-4612-9cd9-3888e83288ca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 19:03:27 devstack cinder-volume[84538]: INFO cinder.volume.flows.manager.create_volume [None req-3b193580-16a7-4bfb-a137-8083932311dd tempest-VolumesCloneTest-373803938 None] Volume 8218f569-9e10-4c78-9f0b-97ba4a8a1f43: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8218f569-9e10-4c78-9f0b-97ba4a8a1f43', 'volume_size': 1} Apr 29 19:03:27 devstack cinder-volume[84538]: DEBUG oslo_concurrency.lockutils [None req-3b193580-16a7-4bfb-a137-8083932311dd tempest-VolumesCloneTest-373803938 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 19:03:27 devstack cinder-volume[84538]: DEBUG oslo_concurrency.lockutils [None req-3b193580-16a7-4bfb-a137-8083932311dd tempest-VolumesCloneTest-373803938 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=84538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 19:03:27 devstack cinder-volume[84538]: DEBUG cinder.volume.drivers.quobyte [None req-3b193580-16a7-4bfb-a137-8083932311dd tempest-VolumesCloneTest-373803938 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-29T17:03:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneTest-Volume-44292403',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8218f569-9e10-4c78-9f0b-97ba4a8a1f43,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1a63cb57aa7441829e12224bfd5445dd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T17:03:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T17:03:27Z,use_quota=True,user_id='37a53c40dee449fd91fc8cf32b1de5b5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(62b05900-93e3-4190-a88f-1d87324303d1),volume_type_id=62b05900-93e3-4190-a88f-1d87324303d1)}" {{(pid=84538) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 29 19:03:27 devstack cinder-volume[84538]: DEBUG cinder.volume.drivers.remotefs [None req-3b193580-16a7-4bfb-a137-8083932311dd tempest-VolumesCloneTest-373803938 None] Creating volume 8218f569-9e10-4c78-9f0b-97ba4a8a1f43 {{(pid=84538) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 29 19:03:27 devstack cinder-volume[84538]: DEBUG oslo_concurrency.lockutils [None req-3b193580-16a7-4bfb-a137-8083932311dd tempest-VolumesCloneTest-373803938 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 19:03:27 devstack cinder-volume[84538]: DEBUG oslo_concurrency.lockutils [None req-3b193580-16a7-4bfb-a137-8083932311dd tempest-VolumesCloneTest-373803938 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=84538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 19:03:27 devstack cinder-volume[84538]: DEBUG cinder.volume.drivers.quobyte [None req-3b193580-16a7-4bfb-a137-8083932311dd tempest-VolumesCloneTest-373803938 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-34312b00-dd6d-45bb-af98-75855cea8e48': None} {{(pid=84538) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 19:03:27 devstack cinder-volume[84538]: DEBUG cinder.volume.drivers.quobyte [None req-3b193580-16a7-4bfb-a137-8083932311dd tempest-VolumesCloneTest-373803938 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-34312b00-dd6d-45bb-af98-75855cea8e48'] {{(pid=84538) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 19:03:27 devstack cinder-volume[84538]: DEBUG oslo_concurrency.lockutils [None req-3b193580-16a7-4bfb-a137-8083932311dd tempest-VolumesCloneTest-373803938 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=84538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 19:03:27 devstack cinder-volume[84538]: DEBUG cinder.volume.drivers.quobyte [None req-3b193580-16a7-4bfb-a137-8083932311dd tempest-VolumesCloneTest-373803938 None] Selected osci02.corp.quobyte.com/cinder-vol-34312b00-dd6d-45bb-af98-75855cea8e48 as target Quobyte volume. {{(pid=84538) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 29 19:03:27 devstack cinder-volume[84538]: INFO cinder.volume.drivers.remotefs [None req-3b193580-16a7-4bfb-a137-8083932311dd tempest-VolumesCloneTest-373803938 None] casted to osci02.corp.quobyte.com/cinder-vol-34312b00-dd6d-45bb-af98-75855cea8e48 Apr 29 19:03:27 devstack cinder-volume[84538]: DEBUG oslo_concurrency.processutils [None req-3b193580-16a7-4bfb-a137-8083932311dd tempest-VolumesCloneTest-373803938 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-8218f569-9e10-4c78-9f0b-97ba4a8a1f43 1073741824 {{(pid=84538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 19:03:27 devstack sudo[91078]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-8218f569-9e10-4c78-9f0b-97ba4a8a1f43 1073741824 Apr 29 19:03:27 devstack sudo[91078]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 19:03:27 devstack sudo[91076]: pam_unix(sudo:session): session closed for user root Apr 29 19:03:27 devstack cinder-volume[84538]: DEBUG oslo_concurrency.processutils [None req-f483d93e-2a96-4d07-9dd6-e3f402ac538a tempest-VolumesTransfersV357Test-559180709 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d" returned: 0 in 0.664s {{(pid=84538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 19:03:27 devstack cinder-volume[84538]: DEBUG cinder.manager [None req-f483d93e-2a96-4d07-9dd6-e3f402ac538a tempest-VolumesTransfersV357Test-559180709 None] Notifying Schedulers of capabilities ... {{(pid=84538) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 29 19:03:27 devstack cinder-volume[84538]: INFO cinder.volume.manager [None req-f483d93e-2a96-4d07-9dd6-e3f402ac538a tempest-VolumesTransfersV357Test-559180709 None] Deleted volume successfully. Apr 29 19:03:27 devstack cinder-volume[84538]: DEBUG cinder.coordination [None req-f483d93e-2a96-4d07-9dd6-e3f402ac538a tempest-VolumesTransfersV357Test-559180709 None] Lock "cinder-00384643-da1d-4530-a780-ab728bd39caf-delete_volume" released by "delete_volume" :: held 3.133s {{(pid=84538) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 19:03:27 devstack cinder-volume[84538]: DEBUG oslo_concurrency.lockutils [None req-214f4586-ad46-45de-ac8a-6eb57768d93e tempest-VolumesSnapshotTestJSON-1345007867 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=84538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 19:03:28 devstack sudo[91078]: pam_unix(sudo:session): session closed for user root Apr 29 19:03:28 devstack cinder-volume[84538]: DEBUG oslo_concurrency.processutils [None req-3b193580-16a7-4bfb-a137-8083932311dd tempest-VolumesCloneTest-373803938 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-8218f569-9e10-4c78-9f0b-97ba4a8a1f43 1073741824" returned: 0 in 0.925s {{(pid=84538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 19:03:28 devstack cinder-volume[84538]: DEBUG oslo_concurrency.processutils [None req-3b193580-16a7-4bfb-a137-8083932311dd tempest-VolumesCloneTest-373803938 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-8218f569-9e10-4c78-9f0b-97ba4a8a1f43 {{(pid=84538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 19:03:28 devstack sudo[91086]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-8218f569-9e10-4c78-9f0b-97ba4a8a1f43 Apr 29 19:03:28 devstack sudo[91086]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 19:03:28 devstack sudo[91086]: pam_unix(sudo:session): session closed for user root Apr 29 19:03:28 devstack cinder-volume[84538]: DEBUG oslo_concurrency.processutils [None req-3b193580-16a7-4bfb-a137-8083932311dd tempest-VolumesCloneTest-373803938 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-8218f569-9e10-4c78-9f0b-97ba4a8a1f43" returned: 0 in 0.640s {{(pid=84538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 19:03:28 devstack cinder-volume[84538]: DEBUG cinder.volume.drivers.quobyte [None req-3b193580-16a7-4bfb-a137-8083932311dd tempest-VolumesCloneTest-373803938 None] <== create_volume: return (1622ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-34312b00-dd6d-45bb-af98-75855cea8e48'} {{(pid=84538) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 29 19:03:28 devstack cinder-volume[84538]: DEBUG oslo_concurrency.lockutils [None req-3b193580-16a7-4bfb-a137-8083932311dd tempest-VolumesCloneTest-373803938 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.624s {{(pid=84538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 19:03:28 devstack cinder-volume[84538]: DEBUG oslo_concurrency.lockutils [None req-214f4586-ad46-45de-ac8a-6eb57768d93e tempest-VolumesSnapshotTestJSON-1345007867 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 1.067s {{(pid=84538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 19:03:28 devstack cinder-volume[84538]: DEBUG cinder.volume.drivers.remotefs [None req-214f4586-ad46-45de-ac8a-6eb57768d93e tempest-VolumesSnapshotTestJSON-1345007867 None] Creating offline snapshot 4099804f-527a-439c-97b2-5b0381a74fc8 of volume 8dd11e3d-82b0-43a9-a9a1-cacffe80f65e {{(pid=84538) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}} Apr 29 19:03:28 devstack cinder-volume[84538]: DEBUG cinder.volume.manager [None req-3b193580-16a7-4bfb-a137-8083932311dd tempest-VolumesCloneTest-373803938 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (99431cb6-0c00-4612-9cd9-3888e83288ca) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8218f569-9e10-4c78-9f0b-97ba4a8a1f43', 'volume_size': 1}' {{(pid=84538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 19:03:28 devstack cinder-volume[84538]: DEBUG cinder.volume.manager [None req-3b193580-16a7-4bfb-a137-8083932311dd tempest-VolumesCloneTest-373803938 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (eb5e2af5-3be5-4cf1-ac45-9d19721695a9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 19:03:28 devstack cinder-volume[84538]: DEBUG oslo.privsep.daemon [-] privsep: reply[ec82fa3a-bcda-4dc6-bd06-573fa26045ca]: (4, 'qcow2') {{(pid=85803) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 19:03:28 devstack cinder-volume[84538]: DEBUG oslo_concurrency.processutils [None req-214f4586-ad46-45de-ac8a-6eb57768d93e tempest-VolumesSnapshotTestJSON-1345007867 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-8dd11e3d-82b0-43a9-a9a1-cacffe80f65e {{(pid=84538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 19:03:28 devstack cinder-volume[84538]: INFO cinder.volume.flows.manager.create_volume [None req-3b193580-16a7-4bfb-a137-8083932311dd tempest-VolumesCloneTest-373803938 None] Volume volume-8218f569-9e10-4c78-9f0b-97ba4a8a1f43 (8218f569-9e10-4c78-9f0b-97ba4a8a1f43): created successfully Apr 29 19:03:28 devstack cinder-volume[84538]: DEBUG cinder.volume.manager [None req-3b193580-16a7-4bfb-a137-8083932311dd tempest-VolumesCloneTest-373803938 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (eb5e2af5-3be5-4cf1-ac45-9d19721695a9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 19:03:28 devstack cinder-volume[84538]: DEBUG cinder.volume.manager [None req-3b193580-16a7-4bfb-a137-8083932311dd tempest-VolumesCloneTest-373803938 None] Flow 'volume_create_manager' (f03c9ba2-f3ae-4fb7-8f07-f0932dc7a68c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84538) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 19:03:29 devstack cinder-volume[84538]: INFO cinder.volume.manager [None req-3b193580-16a7-4bfb-a137-8083932311dd tempest-VolumesCloneTest-373803938 None] Created volume successfully. Apr 29 19:03:29 devstack sudo[91089]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-8dd11e3d-82b0-43a9-a9a1-cacffe80f65e Apr 29 19:03:29 devstack sudo[91089]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 19:03:29 devstack sudo[91089]: pam_unix(sudo:session): session closed for user root Apr 29 19:03:29 devstack cinder-volume[84538]: DEBUG cinder.volume.flows.manager.create_volume [None req-bd948904-07b0-4568-8a0d-8b9602936fe2 tempest-VolumesCloneTest-373803938 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84538) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Apr 29 19:03:29 devstack cinder-volume[84538]: DEBUG oslo_concurrency.processutils [None req-214f4586-ad46-45de-ac8a-6eb57768d93e tempest-VolumesSnapshotTestJSON-1345007867 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-8dd11e3d-82b0-43a9-a9a1-cacffe80f65e" returned: 0 in 0.952s {{(pid=84538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 19:03:29 devstack cinder-volume[84538]: DEBUG oslo_concurrency.processutils [None req-214f4586-ad46-45de-ac8a-6eb57768d93e tempest-VolumesSnapshotTestJSON-1345007867 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-8dd11e3d-82b0-43a9-a9a1-cacffe80f65e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-8dd11e3d-82b0-43a9-a9a1-cacffe80f65e.4099804f-527a-439c-97b2-5b0381a74fc8 1G {{(pid=84538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 19:03:29 devstack sudo[91097]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-8dd11e3d-82b0-43a9-a9a1-cacffe80f65e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-8dd11e3d-82b0-43a9-a9a1-cacffe80f65e.4099804f-527a-439c-97b2-5b0381a74fc8 1G Apr 29 19:03:29 devstack sudo[91097]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 19:03:29 devstack cinder-volume[84538]: DEBUG cinder.volume.manager [None req-bd948904-07b0-4568-8a0d-8b9602936fe2 tempest-VolumesCloneTest-373803938 None] Flow 'volume_create_manager' (d5ece641-ef66-49f3-89aa-2a7de2b96b5a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84538) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 19:03:29 devstack cinder-volume[84538]: DEBUG cinder.volume.manager [None req-bd948904-07b0-4568-8a0d-8b9602936fe2 tempest-VolumesCloneTest-373803938 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f671d1c4-34fa-43ba-9b28-30fdcc0a84b3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 19:03:29 devstack cinder-volume[84538]: DEBUG cinder.volume.manager [None req-bd948904-07b0-4568-8a0d-8b9602936fe2 tempest-VolumesCloneTest-373803938 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f671d1c4-34fa-43ba-9b28-30fdcc0a84b3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-29T17:03:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneTest-Volume-2006401405',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0847f52e-6f72-457b-84ac-89f960065e54,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1a63cb57aa7441829e12224bfd5445dd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T17:03:30Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=,source_volid=8218f569-9e10-4c78-9f0b-97ba4a8a1f43,status='creating',terminated_at=None,updated_at=2026-04-29T17:03:30Z,use_quota=True,user_id='37a53c40dee449fd91fc8cf32b1de5b5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(62b05900-93e3-4190-a88f-1d87324303d1),volume_type_id=62b05900-93e3-4190-a88f-1d87324303d1)' {{(pid=84538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 19:03:29 devstack cinder-volume[84538]: DEBUG cinder.volume.manager [None req-bd948904-07b0-4568-8a0d-8b9602936fe2 tempest-VolumesCloneTest-373803938 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ef1a3ab4-1117-4bf5-8ec8-c2448af69148) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 19:03:30 devstack cinder-volume[84538]: DEBUG cinder.volume.manager [None req-bd948904-07b0-4568-8a0d-8b9602936fe2 tempest-VolumesCloneTest-373803938 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ef1a3ab4-1117-4bf5-8ec8-c2448af69148) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 19:03:30 devstack cinder-volume[84538]: DEBUG cinder.volume.manager [None req-bd948904-07b0-4568-8a0d-8b9602936fe2 tempest-VolumesCloneTest-373803938 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (80b0cbda-77fd-426a-ac5d-b369b94c3df6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 19:03:30 devstack cinder-volume[84538]: DEBUG cinder.volume.manager [None req-bd948904-07b0-4568-8a0d-8b9602936fe2 tempest-VolumesCloneTest-373803938 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (80b0cbda-77fd-426a-ac5d-b369b94c3df6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'source_vol', 'volume_id': '0847f52e-6f72-457b-84ac-89f960065e54', 'volume_name': 'volume-0847f52e-6f72-457b-84ac-89f960065e54', 'volume_size': 2, 'source_volid': '8218f569-9e10-4c78-9f0b-97ba4a8a1f43', 'source_volstatus': 'available'}' {{(pid=84538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 19:03:30 devstack cinder-volume[84538]: DEBUG cinder.volume.manager [None req-bd948904-07b0-4568-8a0d-8b9602936fe2 tempest-VolumesCloneTest-373803938 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a9e2b909-7a1e-44cf-8c86-086f1e535fd1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 19:03:30 devstack cinder-volume[84538]: DEBUG cinder.volume.manager [None req-bd948904-07b0-4568-8a0d-8b9602936fe2 tempest-VolumesCloneTest-373803938 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a9e2b909-7a1e-44cf-8c86-086f1e535fd1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 19:03:30 devstack cinder-volume[84538]: DEBUG cinder.volume.manager [None req-bd948904-07b0-4568-8a0d-8b9602936fe2 tempest-VolumesCloneTest-373803938 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3b9a729c-f516-4492-ac29-c426a618c5be) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 19:03:30 devstack cinder-volume[84538]: INFO cinder.volume.flows.manager.create_volume [None req-bd948904-07b0-4568-8a0d-8b9602936fe2 tempest-VolumesCloneTest-373803938 None] Volume 0847f52e-6f72-457b-84ac-89f960065e54: being created as source_vol with specification: {'status': 'creating', 'volume_name': 'volume-0847f52e-6f72-457b-84ac-89f960065e54', 'volume_size': 2, 'source_volid': '8218f569-9e10-4c78-9f0b-97ba4a8a1f43', 'source_volstatus': 'available'} Apr 29 19:03:30 devstack cinder-volume[84538]: DEBUG oslo_concurrency.lockutils [None req-bd948904-07b0-4568-8a0d-8b9602936fe2 tempest-VolumesCloneTest-373803938 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" {{(pid=84538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 19:03:30 devstack sudo[91097]: pam_unix(sudo:session): session closed for user root Apr 29 19:03:30 devstack cinder-volume[84538]: DEBUG oslo_concurrency.processutils [None req-214f4586-ad46-45de-ac8a-6eb57768d93e tempest-VolumesSnapshotTestJSON-1345007867 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-8dd11e3d-82b0-43a9-a9a1-cacffe80f65e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-8dd11e3d-82b0-43a9-a9a1-cacffe80f65e.4099804f-527a-439c-97b2-5b0381a74fc8 1G" returned: 0 in 1.034s {{(pid=84538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 19:03:30 devstack cinder-volume[84538]: DEBUG oslo_concurrency.processutils [None req-214f4586-ad46-45de-ac8a-6eb57768d93e tempest-VolumesSnapshotTestJSON-1345007867 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-8dd11e3d-82b0-43a9-a9a1-cacffe80f65e -F qcow2 /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-8dd11e3d-82b0-43a9-a9a1-cacffe80f65e.4099804f-527a-439c-97b2-5b0381a74fc8 {{(pid=84538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 19:03:31 devstack sudo[91148]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-8dd11e3d-82b0-43a9-a9a1-cacffe80f65e -F qcow2 /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-8dd11e3d-82b0-43a9-a9a1-cacffe80f65e.4099804f-527a-439c-97b2-5b0381a74fc8 Apr 29 19:03:31 devstack sudo[91148]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 19:03:32 devstack sudo[91148]: pam_unix(sudo:session): session closed for user root Apr 29 19:03:32 devstack cinder-volume[84538]: DEBUG oslo_concurrency.processutils [None req-214f4586-ad46-45de-ac8a-6eb57768d93e tempest-VolumesSnapshotTestJSON-1345007867 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-8dd11e3d-82b0-43a9-a9a1-cacffe80f65e -F qcow2 /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-8dd11e3d-82b0-43a9-a9a1-cacffe80f65e.4099804f-527a-439c-97b2-5b0381a74fc8" returned: 0 in 1.114s {{(pid=84538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 19:03:32 devstack cinder-volume[84538]: WARNING cinder.volume.drivers.remotefs [None req-214f4586-ad46-45de-ac8a-6eb57768d93e tempest-VolumesSnapshotTestJSON-1345007867 None] /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-8dd11e3d-82b0-43a9-a9a1-cacffe80f65e.4099804f-527a-439c-97b2-5b0381a74fc8 is being set with open permissions: ugo+rw Apr 29 19:03:32 devstack cinder-volume[84538]: DEBUG oslo_concurrency.processutils [None req-214f4586-ad46-45de-ac8a-6eb57768d93e tempest-VolumesSnapshotTestJSON-1345007867 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-8dd11e3d-82b0-43a9-a9a1-cacffe80f65e.4099804f-527a-439c-97b2-5b0381a74fc8 {{(pid=84538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 19:03:32 devstack sudo[91168]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-8dd11e3d-82b0-43a9-a9a1-cacffe80f65e.4099804f-527a-439c-97b2-5b0381a74fc8 Apr 29 19:03:32 devstack sudo[91168]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 19:03:32 devstack sudo[91168]: pam_unix(sudo:session): session closed for user root Apr 29 19:03:32 devstack cinder-volume[84538]: DEBUG oslo_concurrency.processutils [None req-214f4586-ad46-45de-ac8a-6eb57768d93e tempest-VolumesSnapshotTestJSON-1345007867 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-8dd11e3d-82b0-43a9-a9a1-cacffe80f65e.4099804f-527a-439c-97b2-5b0381a74fc8" returned: 0 in 0.787s {{(pid=84538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 19:03:32 devstack cinder-volume[84538]: DEBUG oslo_concurrency.processutils [None req-214f4586-ad46-45de-ac8a-6eb57768d93e tempest-VolumesSnapshotTestJSON-1345007867 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-8dd11e3d-82b0-43a9-a9a1-cacffe80f65e.info {{(pid=84538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 19:03:33 devstack sudo[91174]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-8dd11e3d-82b0-43a9-a9a1-cacffe80f65e.info Apr 29 19:03:33 devstack sudo[91174]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 19:03:33 devstack sudo[91174]: pam_unix(sudo:session): session closed for user root Apr 29 19:03:33 devstack cinder-volume[84538]: DEBUG oslo_concurrency.processutils [None req-214f4586-ad46-45de-ac8a-6eb57768d93e tempest-VolumesSnapshotTestJSON-1345007867 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-8dd11e3d-82b0-43a9-a9a1-cacffe80f65e.info" returned: 0 in 0.829s {{(pid=84538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 19:03:33 devstack cinder-volume[84538]: WARNING cinder.volume.drivers.remotefs [None req-214f4586-ad46-45de-ac8a-6eb57768d93e tempest-VolumesSnapshotTestJSON-1345007867 None] /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-8dd11e3d-82b0-43a9-a9a1-cacffe80f65e.info is being set with open permissions: ugo+rw Apr 29 19:03:33 devstack cinder-volume[84538]: DEBUG oslo_concurrency.processutils [None req-214f4586-ad46-45de-ac8a-6eb57768d93e tempest-VolumesSnapshotTestJSON-1345007867 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-8dd11e3d-82b0-43a9-a9a1-cacffe80f65e.info {{(pid=84538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 19:03:33 devstack sudo[91178]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-8dd11e3d-82b0-43a9-a9a1-cacffe80f65e.info Apr 29 19:03:33 devstack sudo[91178]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 19:03:34 devstack cinder-volume[84538]: DEBUG cinder.coordination [None req-ec63779d-a01d-4b70-8410-87c78f116ef9 tempest-VolumesActionsTest-1839563461 None] Acquiring lock "cinder-c66b0dde-dec4-44cc-b0fe-7b7f63fa3d6a" by "attach_volume" {{(pid=84538) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 19:03:34 devstack cinder-volume[84538]: DEBUG cinder.coordination [None req-ec63779d-a01d-4b70-8410-87c78f116ef9 tempest-VolumesActionsTest-1839563461 None] Lock "cinder-c66b0dde-dec4-44cc-b0fe-7b7f63fa3d6a" acquired by "attach_volume" :: waited 0.032s {{(pid=84538) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 19:03:34 devstack cinder-volume[84538]: DEBUG dbcounter [-] [84538] Writing DB stats cinder:SELECT=124,cinder:INSERT=43,cinder:UPDATE=184,cinder:DELETE=10 {{(pid=84538) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Apr 29 19:03:34 devstack sudo[91178]: pam_unix(sudo:session): session closed for user root Apr 29 19:03:34 devstack cinder-volume[84538]: DEBUG oslo_concurrency.processutils [None req-214f4586-ad46-45de-ac8a-6eb57768d93e tempest-VolumesSnapshotTestJSON-1345007867 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-8dd11e3d-82b0-43a9-a9a1-cacffe80f65e.info" returned: 0 in 0.814s {{(pid=84538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 19:03:34 devstack cinder-volume[84538]: DEBUG oslo_concurrency.lockutils [None req-214f4586-ad46-45de-ac8a-6eb57768d93e tempest-VolumesSnapshotTestJSON-1345007867 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 5.691s {{(pid=84538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 19:03:34 devstack cinder-volume[84538]: DEBUG oslo_concurrency.lockutils [None req-bd948904-07b0-4568-8a0d-8b9602936fe2 tempest-VolumesCloneTest-373803938 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: waited 4.561s {{(pid=84538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 19:03:34 devstack cinder-volume[84538]: INFO cinder.volume.drivers.remotefs [None req-bd948904-07b0-4568-8a0d-8b9602936fe2 tempest-VolumesCloneTest-373803938 None] Cloning volume 8218f569-9e10-4c78-9f0b-97ba4a8a1f43 to volume 0847f52e-6f72-457b-84ac-89f960065e54 Apr 29 19:03:34 devstack cinder-volume[84538]: DEBUG dbcounter [-] [84538] Writing DB stats cinder:DELETE=22,cinder:SELECT=118,cinder:UPDATE=175,cinder:INSERT=41 {{(pid=84538) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Apr 29 19:03:34 devstack cinder-volume[84538]: DEBUG cinder.volume.drivers.remotefs [None req-bd948904-07b0-4568-8a0d-8b9602936fe2 tempest-VolumesCloneTest-373803938 None] Creating offline snapshot 83569178-e32d-4952-a25b-d3a52283f2f6 of volume 8218f569-9e10-4c78-9f0b-97ba4a8a1f43 {{(pid=84538) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}} Apr 29 19:03:34 devstack cinder-volume[84538]: DEBUG oslo.privsep.daemon [-] privsep: reply[a4d87c7a-5b7f-415c-b238-647b1f4f230a]: (4, 'qcow2') {{(pid=85803) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 19:03:34 devstack cinder-volume[84538]: DEBUG oslo_concurrency.processutils [None req-bd948904-07b0-4568-8a0d-8b9602936fe2 tempest-VolumesCloneTest-373803938 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-8218f569-9e10-4c78-9f0b-97ba4a8a1f43 {{(pid=84538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 19:03:34 devstack cinder-volume[84538]: INFO cinder.volume.manager [None req-214f4586-ad46-45de-ac8a-6eb57768d93e tempest-VolumesSnapshotTestJSON-1345007867 None] Create snapshot completed successfully Apr 29 19:03:34 devstack cinder-volume[84538]: INFO cinder.volume.manager [None req-ec63779d-a01d-4b70-8410-87c78f116ef9 tempest-VolumesActionsTest-1839563461 None] Attaching volume c66b0dde-dec4-44cc-b0fe-7b7f63fa3d6a to instance ea6d6fe4-4c31-4f33-977d-01d4fa1f02d0 at mountpoint /dev/vdb on host None. Apr 29 19:03:34 devstack cinder-volume[84538]: INFO cinder.volume.manager [None req-ec63779d-a01d-4b70-8410-87c78f116ef9 tempest-VolumesActionsTest-1839563461 None] Attach volume completed successfully. Apr 29 19:03:34 devstack cinder-volume[84538]: DEBUG cinder.coordination [None req-ec63779d-a01d-4b70-8410-87c78f116ef9 tempest-VolumesActionsTest-1839563461 None] Lock "cinder-c66b0dde-dec4-44cc-b0fe-7b7f63fa3d6a" released by "attach_volume" :: held 0.289s {{(pid=84538) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 19:03:34 devstack sudo[91181]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-8218f569-9e10-4c78-9f0b-97ba4a8a1f43 Apr 29 19:03:34 devstack sudo[91181]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 19:03:35 devstack cinder-volume[84538]: DEBUG cinder.coordination [None req-231a24b9-3049-45c6-83c7-8cc3b7d7c73f tempest-VolumesActionsTest-1839563461 None] Acquiring lock "cinder-c66b0dde-dec4-44cc-b0fe-7b7f63fa3d6a-detach_volume" by "detach_volume" {{(pid=84538) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 19:03:35 devstack cinder-volume[84538]: DEBUG cinder.coordination [None req-231a24b9-3049-45c6-83c7-8cc3b7d7c73f tempest-VolumesActionsTest-1839563461 None] Lock "cinder-c66b0dde-dec4-44cc-b0fe-7b7f63fa3d6a-detach_volume" acquired by "detach_volume" :: waited 0.034s {{(pid=84538) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 19:03:35 devstack cinder-volume[84538]: INFO cinder.volume.manager [None req-231a24b9-3049-45c6-83c7-8cc3b7d7c73f tempest-VolumesActionsTest-1839563461 None] Detaching volume c66b0dde-dec4-44cc-b0fe-7b7f63fa3d6a from instance ea6d6fe4-4c31-4f33-977d-01d4fa1f02d0. Apr 29 19:03:35 devstack cinder-volume[84538]: INFO cinder.volume.manager [None req-231a24b9-3049-45c6-83c7-8cc3b7d7c73f tempest-VolumesActionsTest-1839563461 None] Detach volume completed successfully. Apr 29 19:03:35 devstack cinder-volume[84538]: DEBUG cinder.coordination [None req-231a24b9-3049-45c6-83c7-8cc3b7d7c73f tempest-VolumesActionsTest-1839563461 None] Lock "cinder-c66b0dde-dec4-44cc-b0fe-7b7f63fa3d6a-detach_volume" released by "detach_volume" :: held 0.124s {{(pid=84538) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 19:03:35 devstack cinder-volume[84538]: DEBUG cinder.coordination [None req-05c77684-52e2-46d9-a37d-7b124126a58b tempest-VolumesSnapshotTestJSON-1345007867 None] Acquiring lock "cinder-4099804f-527a-439c-97b2-5b0381a74fc8-delete_snapshot" by "delete_snapshot" {{(pid=84538) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 19:03:35 devstack cinder-volume[84538]: DEBUG cinder.coordination [None req-05c77684-52e2-46d9-a37d-7b124126a58b tempest-VolumesSnapshotTestJSON-1345007867 None] Lock "cinder-4099804f-527a-439c-97b2-5b0381a74fc8-delete_snapshot" acquired by "delete_snapshot" :: waited 0.031s {{(pid=84538) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 19:03:35 devstack cinder-volume[84538]: DEBUG cinder.coordination [None req-05c77684-52e2-46d9-a37d-7b124126a58b tempest-VolumesSnapshotTestJSON-1345007867 None] Acquiring lock "cinder-quobyte-8dd11e3d-82b0-43a9-a9a1-cacffe80f65e" by "delete_snapshot" {{(pid=84538) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 19:03:35 devstack cinder-volume[84538]: DEBUG cinder.coordination [None req-05c77684-52e2-46d9-a37d-7b124126a58b tempest-VolumesSnapshotTestJSON-1345007867 None] Lock "cinder-quobyte-8dd11e3d-82b0-43a9-a9a1-cacffe80f65e" acquired by "delete_snapshot" :: waited 0.020s {{(pid=84538) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 19:03:35 devstack cinder-volume[84538]: DEBUG cinder.coordination [None req-05c77684-52e2-46d9-a37d-7b124126a58b tempest-VolumesSnapshotTestJSON-1345007867 None] Acquiring lock "cinder-quobyte-4099804f-527a-439c-97b2-5b0381a74fc8" by "_delete_snapshot" {{(pid=84538) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 19:03:35 devstack cinder-volume[84538]: DEBUG cinder.coordination [None req-05c77684-52e2-46d9-a37d-7b124126a58b tempest-VolumesSnapshotTestJSON-1345007867 None] Lock "cinder-quobyte-4099804f-527a-439c-97b2-5b0381a74fc8" acquired by "_delete_snapshot" :: waited 0.017s {{(pid=84538) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 19:03:35 devstack cinder-volume[84538]: DEBUG cinder.volume.drivers.remotefs [None req-05c77684-52e2-46d9-a37d-7b124126a58b tempest-VolumesSnapshotTestJSON-1345007867 None] Deleting offline snapshot 4099804f-527a-439c-97b2-5b0381a74fc8 of volume 8dd11e3d-82b0-43a9-a9a1-cacffe80f65e {{(pid=84538) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 29 19:03:35 devstack cinder-volume[84538]: DEBUG cinder.volume.drivers.remotefs [None req-05c77684-52e2-46d9-a37d-7b124126a58b tempest-VolumesSnapshotTestJSON-1345007867 None] snapshot_file for this snap is: volume-8dd11e3d-82b0-43a9-a9a1-cacffe80f65e.4099804f-527a-439c-97b2-5b0381a74fc8 {{(pid=84538) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 29 19:03:35 devstack cinder-volume[84538]: DEBUG oslo.privsep.daemon [-] privsep: reply[ca9a1ecb-5cb5-4ca3-a01a-a6c7e08d18bb]: (4, 'qcow2') {{(pid=85803) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 19:03:35 devstack cinder-volume[84538]: DEBUG oslo_concurrency.processutils [None req-05c77684-52e2-46d9-a37d-7b124126a58b tempest-VolumesSnapshotTestJSON-1345007867 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-8dd11e3d-82b0-43a9-a9a1-cacffe80f65e.4099804f-527a-439c-97b2-5b0381a74fc8 {{(pid=84538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 19:03:35 devstack sudo[91181]: pam_unix(sudo:session): session closed for user root Apr 29 19:03:35 devstack cinder-volume[84538]: DEBUG oslo_concurrency.processutils [None req-bd948904-07b0-4568-8a0d-8b9602936fe2 tempest-VolumesCloneTest-373803938 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-8218f569-9e10-4c78-9f0b-97ba4a8a1f43" returned: 0 in 1.023s {{(pid=84538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 19:03:35 devstack cinder-volume[84538]: DEBUG oslo_concurrency.processutils [None req-bd948904-07b0-4568-8a0d-8b9602936fe2 tempest-VolumesCloneTest-373803938 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-8218f569-9e10-4c78-9f0b-97ba4a8a1f43,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-8218f569-9e10-4c78-9f0b-97ba4a8a1f43.83569178-e32d-4952-a25b-d3a52283f2f6 1G {{(pid=84538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 19:03:35 devstack sudo[91187]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-8218f569-9e10-4c78-9f0b-97ba4a8a1f43,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-8218f569-9e10-4c78-9f0b-97ba4a8a1f43.83569178-e32d-4952-a25b-d3a52283f2f6 1G Apr 29 19:03:35 devstack sudo[91187]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 19:03:35 devstack sudo[91186]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-8dd11e3d-82b0-43a9-a9a1-cacffe80f65e.4099804f-527a-439c-97b2-5b0381a74fc8 Apr 29 19:03:35 devstack sudo[91186]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 19:03:36 devstack sudo[91186]: pam_unix(sudo:session): session closed for user root Apr 29 19:03:36 devstack cinder-volume[84538]: DEBUG oslo_concurrency.processutils [None req-05c77684-52e2-46d9-a37d-7b124126a58b tempest-VolumesSnapshotTestJSON-1345007867 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-8dd11e3d-82b0-43a9-a9a1-cacffe80f65e.4099804f-527a-439c-97b2-5b0381a74fc8" returned: 0 in 1.174s {{(pid=84538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 19:03:36 devstack cinder-volume[84538]: DEBUG cinder.volume.drivers.remotefs [None req-05c77684-52e2-46d9-a37d-7b124126a58b tempest-VolumesSnapshotTestJSON-1345007867 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-8dd11e3d-82b0-43a9-a9a1-cacffe80f65e(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=84538) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 29 19:03:36 devstack sudo[91187]: pam_unix(sudo:session): session closed for user root Apr 29 19:03:36 devstack cinder-volume[84538]: DEBUG oslo_concurrency.processutils [None req-bd948904-07b0-4568-8a0d-8b9602936fe2 tempest-VolumesCloneTest-373803938 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-8218f569-9e10-4c78-9f0b-97ba4a8a1f43,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-8218f569-9e10-4c78-9f0b-97ba4a8a1f43.83569178-e32d-4952-a25b-d3a52283f2f6 1G" returned: 0 in 1.119s {{(pid=84538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 19:03:36 devstack cinder-volume[84538]: DEBUG oslo_concurrency.processutils [None req-bd948904-07b0-4568-8a0d-8b9602936fe2 tempest-VolumesCloneTest-373803938 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-8218f569-9e10-4c78-9f0b-97ba4a8a1f43 -F qcow2 /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-8218f569-9e10-4c78-9f0b-97ba4a8a1f43.83569178-e32d-4952-a25b-d3a52283f2f6 {{(pid=84538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 19:03:36 devstack cinder-volume[84538]: DEBUG oslo.privsep.daemon [-] privsep: reply[14baca1e-ea65-4ae6-9612-71d79dbf9708]: (4, 'qcow2') {{(pid=85803) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 19:03:36 devstack cinder-volume[84538]: DEBUG oslo_concurrency.processutils [None req-05c77684-52e2-46d9-a37d-7b124126a58b tempest-VolumesSnapshotTestJSON-1345007867 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-8dd11e3d-82b0-43a9-a9a1-cacffe80f65e {{(pid=84538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 19:03:36 devstack sudo[91198]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-8218f569-9e10-4c78-9f0b-97ba4a8a1f43 -F qcow2 /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-8218f569-9e10-4c78-9f0b-97ba4a8a1f43.83569178-e32d-4952-a25b-d3a52283f2f6 Apr 29 19:03:36 devstack sudo[91198]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 19:03:37 devstack sudo[91199]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-8dd11e3d-82b0-43a9-a9a1-cacffe80f65e Apr 29 19:03:37 devstack sudo[91199]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 19:03:37 devstack sudo[91199]: pam_unix(sudo:session): session closed for user root Apr 29 19:03:37 devstack cinder-volume[84538]: DEBUG oslo_concurrency.processutils [None req-05c77684-52e2-46d9-a37d-7b124126a58b tempest-VolumesSnapshotTestJSON-1345007867 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-8dd11e3d-82b0-43a9-a9a1-cacffe80f65e" returned: 0 in 1.042s {{(pid=84538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 19:03:37 devstack cinder-volume[84538]: DEBUG oslo_concurrency.processutils [None req-05c77684-52e2-46d9-a37d-7b124126a58b tempest-VolumesSnapshotTestJSON-1345007867 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-8dd11e3d-82b0-43a9-a9a1-cacffe80f65e.4099804f-527a-439c-97b2-5b0381a74fc8 {{(pid=84538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 19:03:37 devstack sudo[91250]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-8dd11e3d-82b0-43a9-a9a1-cacffe80f65e.4099804f-527a-439c-97b2-5b0381a74fc8 Apr 29 19:03:37 devstack sudo[91250]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 19:03:38 devstack sudo[91198]: pam_unix(sudo:session): session closed for user root Apr 29 19:03:38 devstack cinder-volume[84538]: DEBUG oslo_concurrency.processutils [None req-bd948904-07b0-4568-8a0d-8b9602936fe2 tempest-VolumesCloneTest-373803938 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-8218f569-9e10-4c78-9f0b-97ba4a8a1f43 -F qcow2 /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-8218f569-9e10-4c78-9f0b-97ba4a8a1f43.83569178-e32d-4952-a25b-d3a52283f2f6" returned: 0 in 1.261s {{(pid=84538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 19:03:38 devstack cinder-volume[84538]: WARNING cinder.volume.drivers.remotefs [None req-bd948904-07b0-4568-8a0d-8b9602936fe2 tempest-VolumesCloneTest-373803938 None] /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-8218f569-9e10-4c78-9f0b-97ba4a8a1f43.83569178-e32d-4952-a25b-d3a52283f2f6 is being set with open permissions: ugo+rw Apr 29 19:03:38 devstack cinder-volume[84538]: DEBUG oslo_concurrency.processutils [None req-bd948904-07b0-4568-8a0d-8b9602936fe2 tempest-VolumesCloneTest-373803938 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-8218f569-9e10-4c78-9f0b-97ba4a8a1f43.83569178-e32d-4952-a25b-d3a52283f2f6 {{(pid=84538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 19:03:38 devstack sudo[91253]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-8218f569-9e10-4c78-9f0b-97ba4a8a1f43.83569178-e32d-4952-a25b-d3a52283f2f6 Apr 29 19:03:38 devstack sudo[91253]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 19:03:38 devstack cinder-volume[84538]: DEBUG cinder.volume.flows.manager.create_volume [None req-e34c3c5c-0114-48b4-809f-b813247c2fa1 tempest-VolumesNegativeTest-977478995 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84538) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Apr 29 19:03:38 devstack cinder-volume[84538]: DEBUG cinder.volume.manager [None req-e34c3c5c-0114-48b4-809f-b813247c2fa1 tempest-VolumesNegativeTest-977478995 None] Flow 'volume_create_manager' (5f046098-8333-4b51-9816-d38569581987) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84538) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 19:03:38 devstack cinder-volume[84538]: DEBUG cinder.volume.manager [None req-e34c3c5c-0114-48b4-809f-b813247c2fa1 tempest-VolumesNegativeTest-977478995 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (463d8a7a-9038-411c-9843-64e3548a9700) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 19:03:38 devstack cinder-volume[84538]: DEBUG cinder.volume.manager [None req-e34c3c5c-0114-48b4-809f-b813247c2fa1 tempest-VolumesNegativeTest-977478995 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (463d8a7a-9038-411c-9843-64e3548a9700) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-29T17:03:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesNegativeTest-Volume-147475981',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=91c56b82-361f-4d22-a978-1b0e33f6688c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c760efb9fd674e46a135f4006797225d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T17:03:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T17:03:39Z,use_quota=True,user_id='a0d75a73cf5d4fe0a4277cb538197837',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(62b05900-93e3-4190-a88f-1d87324303d1),volume_type_id=62b05900-93e3-4190-a88f-1d87324303d1)' {{(pid=84538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 19:03:38 devstack cinder-volume[84538]: DEBUG cinder.volume.manager [None req-e34c3c5c-0114-48b4-809f-b813247c2fa1 tempest-VolumesNegativeTest-977478995 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (90b910ce-9270-4c78-b553-929f3319f4dd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 19:03:38 devstack cinder-volume[84538]: DEBUG cinder.volume.manager [None req-e34c3c5c-0114-48b4-809f-b813247c2fa1 tempest-VolumesNegativeTest-977478995 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (90b910ce-9270-4c78-b553-929f3319f4dd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 19:03:38 devstack cinder-volume[84538]: DEBUG cinder.volume.manager [None req-e34c3c5c-0114-48b4-809f-b813247c2fa1 tempest-VolumesNegativeTest-977478995 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bee3b00e-cb20-4e1e-8af8-97f23c09fe32) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 19:03:38 devstack cinder-volume[84538]: DEBUG cinder.volume.manager [None req-e34c3c5c-0114-48b4-809f-b813247c2fa1 tempest-VolumesNegativeTest-977478995 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bee3b00e-cb20-4e1e-8af8-97f23c09fe32) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '91c56b82-361f-4d22-a978-1b0e33f6688c', 'volume_name': 'volume-91c56b82-361f-4d22-a978-1b0e33f6688c', 'volume_size': 1}' {{(pid=84538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 19:03:38 devstack cinder-volume[84538]: DEBUG cinder.volume.manager [None req-e34c3c5c-0114-48b4-809f-b813247c2fa1 tempest-VolumesNegativeTest-977478995 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0d863fad-795a-44a8-a5b3-b20920490030) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 19:03:38 devstack cinder-volume[84538]: DEBUG cinder.volume.manager [None req-e34c3c5c-0114-48b4-809f-b813247c2fa1 tempest-VolumesNegativeTest-977478995 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0d863fad-795a-44a8-a5b3-b20920490030) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 19:03:38 devstack cinder-volume[84538]: DEBUG cinder.volume.manager [None req-e34c3c5c-0114-48b4-809f-b813247c2fa1 tempest-VolumesNegativeTest-977478995 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5575e144-8c01-42cc-b6b1-4c220cbf02e7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 19:03:38 devstack cinder-volume[84538]: INFO cinder.volume.flows.manager.create_volume [None req-e34c3c5c-0114-48b4-809f-b813247c2fa1 tempest-VolumesNegativeTest-977478995 None] Volume 91c56b82-361f-4d22-a978-1b0e33f6688c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-91c56b82-361f-4d22-a978-1b0e33f6688c', 'volume_size': 1} Apr 29 19:03:38 devstack cinder-volume[84538]: DEBUG oslo_concurrency.lockutils [None req-e34c3c5c-0114-48b4-809f-b813247c2fa1 tempest-VolumesNegativeTest-977478995 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 19:03:38 devstack sudo[91250]: pam_unix(sudo:session): session closed for user root Apr 29 19:03:38 devstack cinder-volume[84538]: DEBUG oslo_concurrency.processutils [None req-05c77684-52e2-46d9-a37d-7b124126a58b tempest-VolumesSnapshotTestJSON-1345007867 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-8dd11e3d-82b0-43a9-a9a1-cacffe80f65e.4099804f-527a-439c-97b2-5b0381a74fc8" returned: 0 in 0.898s {{(pid=84538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 19:03:38 devstack cinder-volume[84538]: DEBUG oslo_concurrency.processutils [None req-05c77684-52e2-46d9-a37d-7b124126a58b tempest-VolumesSnapshotTestJSON-1345007867 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-8dd11e3d-82b0-43a9-a9a1-cacffe80f65e.4099804f-527a-439c-97b2-5b0381a74fc8 {{(pid=84538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 19:03:38 devstack sudo[91253]: pam_unix(sudo:session): session closed for user root Apr 29 19:03:38 devstack cinder-volume[84538]: DEBUG oslo_concurrency.processutils [None req-bd948904-07b0-4568-8a0d-8b9602936fe2 tempest-VolumesCloneTest-373803938 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-8218f569-9e10-4c78-9f0b-97ba4a8a1f43.83569178-e32d-4952-a25b-d3a52283f2f6" returned: 0 in 0.706s {{(pid=84538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 19:03:38 devstack sudo[91262]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-8dd11e3d-82b0-43a9-a9a1-cacffe80f65e.4099804f-527a-439c-97b2-5b0381a74fc8 Apr 29 19:03:38 devstack sudo[91262]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 19:03:38 devstack cinder-volume[84538]: DEBUG oslo_concurrency.processutils [None req-bd948904-07b0-4568-8a0d-8b9602936fe2 tempest-VolumesCloneTest-373803938 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-8218f569-9e10-4c78-9f0b-97ba4a8a1f43.info {{(pid=84538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 19:03:38 devstack sudo[91264]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-8218f569-9e10-4c78-9f0b-97ba4a8a1f43.info Apr 29 19:03:38 devstack sudo[91264]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 19:03:39 devstack sudo[91262]: pam_unix(sudo:session): session closed for user root Apr 29 19:03:39 devstack cinder-volume[84538]: DEBUG oslo_concurrency.processutils [None req-05c77684-52e2-46d9-a37d-7b124126a58b tempest-VolumesSnapshotTestJSON-1345007867 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-8dd11e3d-82b0-43a9-a9a1-cacffe80f65e.4099804f-527a-439c-97b2-5b0381a74fc8" returned: 0 in 0.661s {{(pid=84538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 19:03:39 devstack cinder-volume[84538]: DEBUG cinder.coordination [None req-05c77684-52e2-46d9-a37d-7b124126a58b tempest-VolumesSnapshotTestJSON-1345007867 None] Lock "cinder-quobyte-4099804f-527a-439c-97b2-5b0381a74fc8" released by "_delete_snapshot" :: held 3.910s {{(pid=84538) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 19:03:39 devstack cinder-volume[84538]: DEBUG cinder.coordination [None req-05c77684-52e2-46d9-a37d-7b124126a58b tempest-VolumesSnapshotTestJSON-1345007867 None] Lock "cinder-quobyte-8dd11e3d-82b0-43a9-a9a1-cacffe80f65e" released by "delete_snapshot" :: held 3.935s {{(pid=84538) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 19:03:39 devstack sudo[91264]: pam_unix(sudo:session): session closed for user root Apr 29 19:03:39 devstack cinder-volume[84538]: DEBUG oslo_concurrency.processutils [None req-bd948904-07b0-4568-8a0d-8b9602936fe2 tempest-VolumesCloneTest-373803938 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-8218f569-9e10-4c78-9f0b-97ba4a8a1f43.info" returned: 0 in 0.678s {{(pid=84538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 19:03:39 devstack cinder-volume[84538]: WARNING cinder.volume.drivers.remotefs [None req-bd948904-07b0-4568-8a0d-8b9602936fe2 tempest-VolumesCloneTest-373803938 None] /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-8218f569-9e10-4c78-9f0b-97ba4a8a1f43.info is being set with open permissions: ugo+rw Apr 29 19:03:39 devstack cinder-volume[84538]: DEBUG oslo_concurrency.processutils [None req-bd948904-07b0-4568-8a0d-8b9602936fe2 tempest-VolumesCloneTest-373803938 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-8218f569-9e10-4c78-9f0b-97ba4a8a1f43.info {{(pid=84538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 19:03:39 devstack sudo[91269]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-8218f569-9e10-4c78-9f0b-97ba4a8a1f43.info Apr 29 19:03:39 devstack sudo[91269]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 19:03:39 devstack cinder-volume[84538]: DEBUG cinder.quota [None req-05c77684-52e2-46d9-a37d-7b124126a58b tempest-VolumesSnapshotTestJSON-1345007867 None] Created reservations ['1557529a-1078-4454-9893-d4d94b5ce6a3', '7cc91c86-ef41-4c75-a441-7f9bbfe23519', '651a01a7-3566-44d4-8bd1-ed190efa59a7', 'e61fffe7-b430-41e4-ac14-29d83eb74e9d'] {{(pid=84538) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 29 19:03:39 devstack cinder-volume[84538]: INFO cinder.volume.manager [None req-05c77684-52e2-46d9-a37d-7b124126a58b tempest-VolumesSnapshotTestJSON-1345007867 None] Delete snapshot completed successfully. Apr 29 19:03:39 devstack cinder-volume[84538]: DEBUG cinder.coordination [None req-05c77684-52e2-46d9-a37d-7b124126a58b tempest-VolumesSnapshotTestJSON-1345007867 None] Lock "cinder-4099804f-527a-439c-97b2-5b0381a74fc8-delete_snapshot" released by "delete_snapshot" :: held 4.165s {{(pid=84538) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 19:03:40 devstack sudo[91269]: pam_unix(sudo:session): session closed for user root Apr 29 19:03:40 devstack cinder-volume[84538]: DEBUG oslo_concurrency.processutils [None req-bd948904-07b0-4568-8a0d-8b9602936fe2 tempest-VolumesCloneTest-373803938 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-8218f569-9e10-4c78-9f0b-97ba4a8a1f43.info" returned: 0 in 0.676s {{(pid=84538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 19:03:40 devstack cinder-volume[84538]: DEBUG cinder.coordination [None req-bd948904-07b0-4568-8a0d-8b9602936fe2 tempest-VolumesCloneTest-373803938 None] Acquiring lock "cinder-quobyte-0847f52e-6f72-457b-84ac-89f960065e54" by "_copy_volume_from_snapshot" {{(pid=84538) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 19:03:40 devstack cinder-volume[84538]: DEBUG cinder.coordination [None req-bd948904-07b0-4568-8a0d-8b9602936fe2 tempest-VolumesCloneTest-373803938 None] Lock "cinder-quobyte-0847f52e-6f72-457b-84ac-89f960065e54" acquired by "_copy_volume_from_snapshot" :: waited 0.023s {{(pid=84538) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 19:03:40 devstack cinder-volume[84538]: DEBUG cinder.volume.drivers.quobyte [None req-bd948904-07b0-4568-8a0d-8b9602936fe2 tempest-VolumesCloneTest-373803938 None] snapshot: 83569178-e32d-4952-a25b-d3a52283f2f6, volume: 0847f52e-6f72-457b-84ac-89f960065e54, {{(pid=84538) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Apr 29 19:03:40 devstack cinder-volume[84538]: DEBUG oslo_concurrency.lockutils [None req-bd948904-07b0-4568-8a0d-8b9602936fe2 tempest-VolumesCloneTest-373803938 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 19:03:40 devstack cinder-volume[84538]: DEBUG oslo_concurrency.lockutils [None req-bd948904-07b0-4568-8a0d-8b9602936fe2 tempest-VolumesCloneTest-373803938 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 19:03:40 devstack cinder-volume[84538]: DEBUG cinder.volume.drivers.quobyte [None req-bd948904-07b0-4568-8a0d-8b9602936fe2 tempest-VolumesCloneTest-373803938 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-34312b00-dd6d-45bb-af98-75855cea8e48': None} {{(pid=84538) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 19:03:40 devstack cinder-volume[84538]: DEBUG cinder.volume.drivers.quobyte [None req-bd948904-07b0-4568-8a0d-8b9602936fe2 tempest-VolumesCloneTest-373803938 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-34312b00-dd6d-45bb-af98-75855cea8e48'] {{(pid=84538) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 19:03:40 devstack cinder-volume[84538]: DEBUG oslo_concurrency.lockutils [None req-bd948904-07b0-4568-8a0d-8b9602936fe2 tempest-VolumesCloneTest-373803938 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=84538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 19:03:40 devstack cinder-volume[84538]: DEBUG cinder.volume.flows.manager.create_volume [None req-0864efd1-4860-4ee6-ac45-e5ad0ac39609 tempest-VolumesSnapshotTestJSON-1345007867 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84538) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Apr 29 19:03:40 devstack cinder-volume[84538]: DEBUG cinder.volume.manager [None req-0864efd1-4860-4ee6-ac45-e5ad0ac39609 tempest-VolumesSnapshotTestJSON-1345007867 None] Flow 'volume_create_manager' (ed3ee879-ac99-47c6-9979-b11dc2c86115) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84538) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 19:03:40 devstack cinder-volume[84538]: DEBUG cinder.volume.manager [None req-0864efd1-4860-4ee6-ac45-e5ad0ac39609 tempest-VolumesSnapshotTestJSON-1345007867 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6291f2a0-e455-44de-a0bd-84447cef040b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 19:03:40 devstack cinder-volume[84538]: DEBUG oslo.privsep.daemon [-] privsep: reply[603f7892-4da5-412a-9491-202a9e527170]: (4, 'qcow2') {{(pid=85803) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 19:03:40 devstack cinder-volume[84538]: DEBUG oslo_concurrency.processutils [None req-bd948904-07b0-4568-8a0d-8b9602936fe2 tempest-VolumesCloneTest-373803938 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-8218f569-9e10-4c78-9f0b-97ba4a8a1f43.83569178-e32d-4952-a25b-d3a52283f2f6 {{(pid=84538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 19:03:40 devstack cinder-volume[84538]: DEBUG cinder.volume.manager [None req-0864efd1-4860-4ee6-ac45-e5ad0ac39609 tempest-VolumesSnapshotTestJSON-1345007867 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6291f2a0-e455-44de-a0bd-84447cef040b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-29T17:03:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-305083836',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e72a11b7-a7b1-4fb8-8fb5-76ae1df74693,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cb1bf99b4f1a451dbdf762aff4ec180c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T17:03:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T17:03:40Z,use_quota=True,user_id='987ad9d695504aeba3196f9a11cdf3cf',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(62b05900-93e3-4190-a88f-1d87324303d1),volume_type_id=62b05900-93e3-4190-a88f-1d87324303d1)' {{(pid=84538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 19:03:40 devstack cinder-volume[84538]: DEBUG cinder.volume.manager [None req-0864efd1-4860-4ee6-ac45-e5ad0ac39609 tempest-VolumesSnapshotTestJSON-1345007867 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (734e4dc7-81d0-4479-be14-e752614e0196) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 19:03:40 devstack cinder-volume[84538]: DEBUG cinder.volume.manager [None req-0864efd1-4860-4ee6-ac45-e5ad0ac39609 tempest-VolumesSnapshotTestJSON-1345007867 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (734e4dc7-81d0-4479-be14-e752614e0196) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 19:03:40 devstack cinder-volume[84538]: DEBUG cinder.volume.manager [None req-0864efd1-4860-4ee6-ac45-e5ad0ac39609 tempest-VolumesSnapshotTestJSON-1345007867 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ede7ee7f-9757-4d46-9e38-8906f7226b95) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 19:03:40 devstack cinder-volume[84538]: DEBUG cinder.volume.manager [None req-0864efd1-4860-4ee6-ac45-e5ad0ac39609 tempest-VolumesSnapshotTestJSON-1345007867 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ede7ee7f-9757-4d46-9e38-8906f7226b95) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e72a11b7-a7b1-4fb8-8fb5-76ae1df74693', 'volume_name': 'volume-e72a11b7-a7b1-4fb8-8fb5-76ae1df74693', 'volume_size': 1}' {{(pid=84538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 19:03:40 devstack cinder-volume[84538]: DEBUG cinder.volume.manager [None req-0864efd1-4860-4ee6-ac45-e5ad0ac39609 tempest-VolumesSnapshotTestJSON-1345007867 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b60fb0cc-5c53-4a66-a8e8-240725dd2b5a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 19:03:40 devstack cinder-volume[84538]: DEBUG cinder.volume.manager [None req-0864efd1-4860-4ee6-ac45-e5ad0ac39609 tempest-VolumesSnapshotTestJSON-1345007867 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b60fb0cc-5c53-4a66-a8e8-240725dd2b5a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 19:03:40 devstack cinder-volume[84538]: DEBUG cinder.volume.manager [None req-0864efd1-4860-4ee6-ac45-e5ad0ac39609 tempest-VolumesSnapshotTestJSON-1345007867 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c1601a3e-fe63-4734-b033-bf1286d3c201) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 19:03:40 devstack cinder-volume[84538]: INFO cinder.volume.flows.manager.create_volume [None req-0864efd1-4860-4ee6-ac45-e5ad0ac39609 tempest-VolumesSnapshotTestJSON-1345007867 None] Volume e72a11b7-a7b1-4fb8-8fb5-76ae1df74693: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e72a11b7-a7b1-4fb8-8fb5-76ae1df74693', 'volume_size': 1} Apr 29 19:03:40 devstack cinder-volume[84538]: DEBUG oslo_concurrency.lockutils [None req-0864efd1-4860-4ee6-ac45-e5ad0ac39609 tempest-VolumesSnapshotTestJSON-1345007867 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 19:03:40 devstack sudo[91272]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-8218f569-9e10-4c78-9f0b-97ba4a8a1f43.83569178-e32d-4952-a25b-d3a52283f2f6 Apr 29 19:03:40 devstack sudo[91272]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 19:03:41 devstack sudo[91272]: pam_unix(sudo:session): session closed for user root Apr 29 19:03:41 devstack cinder-volume[84538]: DEBUG oslo_concurrency.processutils [None req-bd948904-07b0-4568-8a0d-8b9602936fe2 tempest-VolumesCloneTest-373803938 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-8218f569-9e10-4c78-9f0b-97ba4a8a1f43.83569178-e32d-4952-a25b-d3a52283f2f6" returned: 0 in 0.720s {{(pid=84538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 19:03:41 devstack cinder-volume[84538]: DEBUG cinder.volume.drivers.remotefs [None req-bd948904-07b0-4568-8a0d-8b9602936fe2 tempest-VolumesCloneTest-373803938 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-8218f569-9e10-4c78-9f0b-97ba4a8a1f43(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=84538) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 29 19:03:41 devstack cinder-volume[84538]: DEBUG cinder.volume.drivers.quobyte [None req-bd948904-07b0-4568-8a0d-8b9602936fe2 tempest-VolumesCloneTest-373803938 None] will copy from snapshot at /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-8218f569-9e10-4c78-9f0b-97ba4a8a1f43 {{(pid=84538) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Apr 29 19:03:41 devstack cinder-volume[84538]: DEBUG cinder.volume.drivers.quobyte [None req-bd948904-07b0-4568-8a0d-8b9602936fe2 tempest-VolumesCloneTest-373803938 None] Creating direct copy from snapshot {{(pid=84538) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Apr 29 19:03:41 devstack cinder-volume[84538]: DEBUG oslo.privsep.daemon [-] privsep: reply[db8ba731-d33c-4056-9599-de3485df066d]: (4, 'qcow2') {{(pid=85803) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 19:03:41 devstack cinder-volume[84538]: DEBUG oslo_concurrency.processutils [None req-bd948904-07b0-4568-8a0d-8b9602936fe2 tempest-VolumesCloneTest-373803938 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-8218f569-9e10-4c78-9f0b-97ba4a8a1f43 {{(pid=84538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 19:03:41 devstack sudo[91279]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-8218f569-9e10-4c78-9f0b-97ba4a8a1f43 Apr 29 19:03:41 devstack sudo[91279]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 19:03:41 devstack sudo[91279]: pam_unix(sudo:session): session closed for user root Apr 29 19:03:41 devstack cinder-volume[84538]: DEBUG oslo_concurrency.processutils [None req-bd948904-07b0-4568-8a0d-8b9602936fe2 tempest-VolumesCloneTest-373803938 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-8218f569-9e10-4c78-9f0b-97ba4a8a1f43" returned: 0 in 0.717s {{(pid=84538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 19:03:41 devstack cinder-volume[84538]: DEBUG cinder.utils [None req-bd948904-07b0-4568-8a0d-8b9602936fe2 tempest-VolumesCloneTest-373803938 None] Path /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-0847f52e-6f72-457b-84ac-89f960065e54 not found in is_blk_device check {{(pid=84538) is_blk_device /opt/stack/cinder/cinder/utils.py:602}} Apr 29 19:03:41 devstack cinder-volume[84538]: DEBUG oslo_concurrency.processutils [None req-bd948904-07b0-4568-8a0d-8b9602936fe2 tempest-VolumesCloneTest-373803938 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-8218f569-9e10-4c78-9f0b-97ba4a8a1f43 /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-0847f52e-6f72-457b-84ac-89f960065e54 {{(pid=84538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 19:03:41 devstack sudo[91284]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-8218f569-9e10-4c78-9f0b-97ba4a8a1f43 /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-0847f52e-6f72-457b-84ac-89f960065e54 Apr 29 19:03:41 devstack sudo[91284]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 19:03:46 devstack sudo[91284]: pam_unix(sudo:session): session closed for user root Apr 29 19:03:46 devstack cinder-volume[84538]: DEBUG oslo_concurrency.processutils [None req-bd948904-07b0-4568-8a0d-8b9602936fe2 tempest-VolumesCloneTest-373803938 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-8218f569-9e10-4c78-9f0b-97ba4a8a1f43 /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-0847f52e-6f72-457b-84ac-89f960065e54" returned: 0 in 5.153s {{(pid=84538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 19:03:46 devstack cinder-volume[84538]: DEBUG oslo.privsep.daemon [-] privsep: reply[dc742870-3c51-4035-9a74-f2118cd1fc16]: (4, 'qcow2') {{(pid=85803) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 19:03:46 devstack cinder-volume[84538]: DEBUG oslo_concurrency.processutils [None req-bd948904-07b0-4568-8a0d-8b9602936fe2 tempest-VolumesCloneTest-373803938 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-8218f569-9e10-4c78-9f0b-97ba4a8a1f43 {{(pid=84538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 19:03:47 devstack sudo[91336]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-8218f569-9e10-4c78-9f0b-97ba4a8a1f43 Apr 29 19:03:47 devstack sudo[91336]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 19:03:47 devstack sudo[91336]: pam_unix(sudo:session): session closed for user root Apr 29 19:03:47 devstack cinder-volume[84538]: DEBUG oslo_concurrency.processutils [None req-bd948904-07b0-4568-8a0d-8b9602936fe2 tempest-VolumesCloneTest-373803938 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-8218f569-9e10-4c78-9f0b-97ba4a8a1f43" returned: 0 in 0.869s {{(pid=84538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 19:03:47 devstack cinder-volume[84538]: DEBUG cinder.image.image_utils [None req-bd948904-07b0-4568-8a0d-8b9602936fe2 tempest-VolumesCloneTest-373803938 None] Image conversion details: src /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-8218f569-9e10-4c78-9f0b-97ba4a8a1f43, size 1024.00 MB, duration 5.16 sec, destination /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-0847f52e-6f72-457b-84ac-89f960065e54 {{(pid=84538) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}} Apr 29 19:03:47 devstack cinder-volume[84538]: INFO cinder.image.image_utils [None req-bd948904-07b0-4568-8a0d-8b9602936fe2 tempest-VolumesCloneTest-373803938 None] Converted 1024.00 MB image at 198.60 MB/s Apr 29 19:03:47 devstack cinder-volume[84538]: WARNING cinder.volume.drivers.remotefs [None req-bd948904-07b0-4568-8a0d-8b9602936fe2 tempest-VolumesCloneTest-373803938 None] /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-0847f52e-6f72-457b-84ac-89f960065e54 is being set with open permissions: ugo+rw Apr 29 19:03:47 devstack cinder-volume[84538]: DEBUG oslo_concurrency.processutils [None req-bd948904-07b0-4568-8a0d-8b9602936fe2 tempest-VolumesCloneTest-373803938 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-0847f52e-6f72-457b-84ac-89f960065e54 {{(pid=84538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 19:03:47 devstack sudo[91342]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-0847f52e-6f72-457b-84ac-89f960065e54 Apr 29 19:03:47 devstack sudo[91342]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 19:03:48 devstack sudo[91342]: pam_unix(sudo:session): session closed for user root Apr 29 19:03:48 devstack cinder-volume[84538]: DEBUG oslo_concurrency.processutils [None req-bd948904-07b0-4568-8a0d-8b9602936fe2 tempest-VolumesCloneTest-373803938 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-0847f52e-6f72-457b-84ac-89f960065e54" returned: 0 in 0.597s {{(pid=84538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 19:03:48 devstack cinder-volume[84538]: DEBUG cinder.coordination [None req-bd948904-07b0-4568-8a0d-8b9602936fe2 tempest-VolumesCloneTest-373803938 None] Lock "cinder-quobyte-0847f52e-6f72-457b-84ac-89f960065e54" released by "_copy_volume_from_snapshot" :: held 8.164s {{(pid=84538) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 19:03:48 devstack cinder-volume[84538]: DEBUG cinder.coordination [None req-bd948904-07b0-4568-8a0d-8b9602936fe2 tempest-VolumesCloneTest-373803938 None] Acquiring lock "cinder-quobyte-83569178-e32d-4952-a25b-d3a52283f2f6" by "_delete_snapshot" {{(pid=84538) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 19:03:48 devstack cinder-volume[84538]: DEBUG cinder.coordination [None req-bd948904-07b0-4568-8a0d-8b9602936fe2 tempest-VolumesCloneTest-373803938 None] Lock "cinder-quobyte-83569178-e32d-4952-a25b-d3a52283f2f6" acquired by "_delete_snapshot" :: waited 0.013s {{(pid=84538) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 19:03:48 devstack cinder-volume[84538]: DEBUG cinder.volume.drivers.remotefs [None req-bd948904-07b0-4568-8a0d-8b9602936fe2 tempest-VolumesCloneTest-373803938 None] Deleting offline snapshot 83569178-e32d-4952-a25b-d3a52283f2f6 of volume 8218f569-9e10-4c78-9f0b-97ba4a8a1f43 {{(pid=84538) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 29 19:03:48 devstack cinder-volume[84538]: DEBUG cinder.volume.drivers.remotefs [None req-bd948904-07b0-4568-8a0d-8b9602936fe2 tempest-VolumesCloneTest-373803938 None] snapshot_file for this snap is: volume-8218f569-9e10-4c78-9f0b-97ba4a8a1f43.83569178-e32d-4952-a25b-d3a52283f2f6 {{(pid=84538) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 29 19:03:48 devstack cinder-volume[84538]: DEBUG oslo.privsep.daemon [-] privsep: reply[1826f2cb-e504-4dc4-870c-e54308cd01bc]: (4, 'qcow2') {{(pid=85803) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 19:03:48 devstack cinder-volume[84538]: DEBUG oslo_concurrency.processutils [None req-bd948904-07b0-4568-8a0d-8b9602936fe2 tempest-VolumesCloneTest-373803938 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-8218f569-9e10-4c78-9f0b-97ba4a8a1f43.83569178-e32d-4952-a25b-d3a52283f2f6 {{(pid=84538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 19:03:48 devstack sudo[91346]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-8218f569-9e10-4c78-9f0b-97ba4a8a1f43.83569178-e32d-4952-a25b-d3a52283f2f6 Apr 29 19:03:48 devstack sudo[91346]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 19:03:49 devstack sudo[91346]: pam_unix(sudo:session): session closed for user root Apr 29 19:03:49 devstack cinder-volume[84538]: DEBUG oslo_concurrency.processutils [None req-bd948904-07b0-4568-8a0d-8b9602936fe2 tempest-VolumesCloneTest-373803938 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-8218f569-9e10-4c78-9f0b-97ba4a8a1f43.83569178-e32d-4952-a25b-d3a52283f2f6" returned: 0 in 0.746s {{(pid=84538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 19:03:49 devstack cinder-volume[84538]: DEBUG cinder.volume.drivers.remotefs [None req-bd948904-07b0-4568-8a0d-8b9602936fe2 tempest-VolumesCloneTest-373803938 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-8218f569-9e10-4c78-9f0b-97ba4a8a1f43(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=84538) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 29 19:03:49 devstack cinder-volume[84538]: DEBUG oslo.privsep.daemon [-] privsep: reply[7ac0131b-85ca-4d50-b4cc-1ab1238a7ed2]: (4, 'qcow2') {{(pid=85803) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 19:03:49 devstack cinder-volume[84538]: DEBUG oslo_concurrency.processutils [None req-bd948904-07b0-4568-8a0d-8b9602936fe2 tempest-VolumesCloneTest-373803938 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-8218f569-9e10-4c78-9f0b-97ba4a8a1f43 {{(pid=84538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 19:03:49 devstack sudo[91351]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-8218f569-9e10-4c78-9f0b-97ba4a8a1f43 Apr 29 19:03:49 devstack sudo[91351]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 19:03:50 devstack sudo[91351]: pam_unix(sudo:session): session closed for user root Apr 29 19:03:50 devstack cinder-volume[84538]: DEBUG oslo_concurrency.processutils [None req-bd948904-07b0-4568-8a0d-8b9602936fe2 tempest-VolumesCloneTest-373803938 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-8218f569-9e10-4c78-9f0b-97ba4a8a1f43" returned: 0 in 0.716s {{(pid=84538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 19:03:50 devstack cinder-volume[84538]: DEBUG oslo_concurrency.processutils [None req-bd948904-07b0-4568-8a0d-8b9602936fe2 tempest-VolumesCloneTest-373803938 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-8218f569-9e10-4c78-9f0b-97ba4a8a1f43.83569178-e32d-4952-a25b-d3a52283f2f6 {{(pid=84538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 19:03:50 devstack sudo[91356]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-8218f569-9e10-4c78-9f0b-97ba4a8a1f43.83569178-e32d-4952-a25b-d3a52283f2f6 Apr 29 19:03:50 devstack sudo[91356]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 19:03:50 devstack cinder-volume[84538]: DEBUG dbcounter [-] [84538] Writing DB stats cinder:INSERT=3,cinder:SELECT=17,cinder:UPDATE=9 {{(pid=84538) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Apr 29 19:03:50 devstack sudo[91356]: pam_unix(sudo:session): session closed for user root Apr 29 19:03:50 devstack cinder-volume[84538]: DEBUG oslo_concurrency.processutils [None req-bd948904-07b0-4568-8a0d-8b9602936fe2 tempest-VolumesCloneTest-373803938 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-8218f569-9e10-4c78-9f0b-97ba4a8a1f43.83569178-e32d-4952-a25b-d3a52283f2f6" returned: 0 in 0.686s {{(pid=84538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 19:03:50 devstack cinder-volume[84538]: DEBUG oslo_concurrency.processutils [None req-bd948904-07b0-4568-8a0d-8b9602936fe2 tempest-VolumesCloneTest-373803938 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-8218f569-9e10-4c78-9f0b-97ba4a8a1f43.83569178-e32d-4952-a25b-d3a52283f2f6 {{(pid=84538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 19:03:50 devstack sudo[91361]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-8218f569-9e10-4c78-9f0b-97ba4a8a1f43.83569178-e32d-4952-a25b-d3a52283f2f6 Apr 29 19:03:50 devstack sudo[91361]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 19:03:51 devstack sudo[91361]: pam_unix(sudo:session): session closed for user root Apr 29 19:03:51 devstack cinder-volume[84538]: DEBUG oslo_concurrency.processutils [None req-bd948904-07b0-4568-8a0d-8b9602936fe2 tempest-VolumesCloneTest-373803938 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-8218f569-9e10-4c78-9f0b-97ba4a8a1f43.83569178-e32d-4952-a25b-d3a52283f2f6" returned: 0 in 0.614s {{(pid=84538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 19:03:51 devstack cinder-volume[84538]: DEBUG cinder.coordination [None req-bd948904-07b0-4568-8a0d-8b9602936fe2 tempest-VolumesCloneTest-373803938 None] Lock "cinder-quobyte-83569178-e32d-4952-a25b-d3a52283f2f6" released by "_delete_snapshot" :: held 2.878s {{(pid=84538) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 19:03:51 devstack cinder-volume[84538]: DEBUG oslo_concurrency.lockutils [None req-bd948904-07b0-4568-8a0d-8b9602936fe2 tempest-VolumesCloneTest-373803938 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: held 16.794s {{(pid=84538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 19:03:51 devstack cinder-volume[84538]: DEBUG oslo_concurrency.lockutils [None req-e34c3c5c-0114-48b4-809f-b813247c2fa1 tempest-VolumesNegativeTest-977478995 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 12.588s {{(pid=84538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 19:03:51 devstack cinder-volume[84538]: DEBUG cinder.volume.drivers.quobyte [None req-e34c3c5c-0114-48b4-809f-b813247c2fa1 tempest-VolumesNegativeTest-977478995 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-29T17:03:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesNegativeTest-Volume-147475981',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=91c56b82-361f-4d22-a978-1b0e33f6688c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c760efb9fd674e46a135f4006797225d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T17:03:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T17:03:39Z,use_quota=True,user_id='a0d75a73cf5d4fe0a4277cb538197837',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(62b05900-93e3-4190-a88f-1d87324303d1),volume_type_id=62b05900-93e3-4190-a88f-1d87324303d1)}" {{(pid=84538) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 29 19:03:51 devstack cinder-volume[84538]: DEBUG cinder.volume.drivers.remotefs [None req-e34c3c5c-0114-48b4-809f-b813247c2fa1 tempest-VolumesNegativeTest-977478995 None] Creating volume 91c56b82-361f-4d22-a978-1b0e33f6688c {{(pid=84538) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 29 19:03:51 devstack cinder-volume[84538]: DEBUG oslo_concurrency.lockutils [None req-e34c3c5c-0114-48b4-809f-b813247c2fa1 tempest-VolumesNegativeTest-977478995 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 19:03:51 devstack cinder-volume[84538]: DEBUG oslo_concurrency.lockutils [None req-e34c3c5c-0114-48b4-809f-b813247c2fa1 tempest-VolumesNegativeTest-977478995 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=84538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 19:03:51 devstack cinder-volume[84538]: DEBUG cinder.volume.drivers.quobyte [None req-e34c3c5c-0114-48b4-809f-b813247c2fa1 tempest-VolumesNegativeTest-977478995 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-34312b00-dd6d-45bb-af98-75855cea8e48': None} {{(pid=84538) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 19:03:51 devstack cinder-volume[84538]: DEBUG cinder.volume.drivers.quobyte [None req-e34c3c5c-0114-48b4-809f-b813247c2fa1 tempest-VolumesNegativeTest-977478995 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-34312b00-dd6d-45bb-af98-75855cea8e48'] {{(pid=84538) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 19:03:51 devstack cinder-volume[84538]: DEBUG oslo_concurrency.lockutils [None req-e34c3c5c-0114-48b4-809f-b813247c2fa1 tempest-VolumesNegativeTest-977478995 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=84538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 19:03:51 devstack cinder-volume[84538]: DEBUG cinder.volume.drivers.quobyte [None req-e34c3c5c-0114-48b4-809f-b813247c2fa1 tempest-VolumesNegativeTest-977478995 None] Selected osci02.corp.quobyte.com/cinder-vol-34312b00-dd6d-45bb-af98-75855cea8e48 as target Quobyte volume. {{(pid=84538) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 29 19:03:51 devstack cinder-volume[84538]: INFO cinder.volume.drivers.remotefs [None req-e34c3c5c-0114-48b4-809f-b813247c2fa1 tempest-VolumesNegativeTest-977478995 None] casted to osci02.corp.quobyte.com/cinder-vol-34312b00-dd6d-45bb-af98-75855cea8e48 Apr 29 19:03:51 devstack cinder-volume[84538]: DEBUG oslo_concurrency.processutils [None req-e34c3c5c-0114-48b4-809f-b813247c2fa1 tempest-VolumesNegativeTest-977478995 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-91c56b82-361f-4d22-a978-1b0e33f6688c 1073741824 {{(pid=84538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 19:03:51 devstack sudo[91364]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-91c56b82-361f-4d22-a978-1b0e33f6688c 1073741824 Apr 29 19:03:51 devstack sudo[91364]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 19:03:51 devstack cinder-volume[84538]: DEBUG cinder.volume.manager [None req-bd948904-07b0-4568-8a0d-8b9602936fe2 tempest-VolumesCloneTest-373803938 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3b9a729c-f516-4492-ac29-c426a618c5be) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0847f52e-6f72-457b-84ac-89f960065e54', 'volume_size': 2, 'source_volid': '8218f569-9e10-4c78-9f0b-97ba4a8a1f43', 'source_volstatus': 'available'}' {{(pid=84538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 19:03:51 devstack cinder-volume[84538]: DEBUG cinder.volume.manager [None req-bd948904-07b0-4568-8a0d-8b9602936fe2 tempest-VolumesCloneTest-373803938 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ecf1cbdc-3e23-4833-b964-f403d4eed88a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 19:03:51 devstack cinder-volume[84538]: INFO cinder.volume.flows.manager.create_volume [None req-bd948904-07b0-4568-8a0d-8b9602936fe2 tempest-VolumesCloneTest-373803938 None] Volume volume-0847f52e-6f72-457b-84ac-89f960065e54 (0847f52e-6f72-457b-84ac-89f960065e54): created successfully Apr 29 19:03:51 devstack cinder-volume[84538]: DEBUG cinder.volume.manager [None req-bd948904-07b0-4568-8a0d-8b9602936fe2 tempest-VolumesCloneTest-373803938 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ecf1cbdc-3e23-4833-b964-f403d4eed88a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 19:03:51 devstack cinder-volume[84538]: DEBUG cinder.volume.manager [None req-bd948904-07b0-4568-8a0d-8b9602936fe2 tempest-VolumesCloneTest-373803938 None] Flow 'volume_create_manager' (d5ece641-ef66-49f3-89aa-2a7de2b96b5a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84538) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 19:03:51 devstack cinder-volume[84538]: INFO cinder.volume.manager [None req-bd948904-07b0-4568-8a0d-8b9602936fe2 tempest-VolumesCloneTest-373803938 None] Created volume successfully. Apr 29 19:03:52 devstack cinder-volume[84538]: DEBUG cinder.coordination [None req-cfc0cdb7-3269-42d6-8093-65a41124808f tempest-VolumesCloneTest-373803938 None] Acquiring lock "cinder-0847f52e-6f72-457b-84ac-89f960065e54-delete_volume" by "delete_volume" {{(pid=84538) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 19:03:52 devstack cinder-volume[84538]: DEBUG cinder.coordination [None req-cfc0cdb7-3269-42d6-8093-65a41124808f tempest-VolumesCloneTest-373803938 None] Lock "cinder-0847f52e-6f72-457b-84ac-89f960065e54-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=84538) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 19:03:52 devstack cinder-volume[84538]: DEBUG cinder.coordination [None req-cfc0cdb7-3269-42d6-8093-65a41124808f tempest-VolumesCloneTest-373803938 None] Acquiring lock "cinder-quobyte-0847f52e-6f72-457b-84ac-89f960065e54" by "delete_volume" {{(pid=84538) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 19:03:52 devstack cinder-volume[84538]: DEBUG cinder.coordination [None req-cfc0cdb7-3269-42d6-8093-65a41124808f tempest-VolumesCloneTest-373803938 None] Lock "cinder-quobyte-0847f52e-6f72-457b-84ac-89f960065e54" acquired by "delete_volume" :: waited 0.017s {{(pid=84538) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 19:03:52 devstack cinder-volume[84538]: DEBUG oslo.privsep.daemon [-] privsep: reply[02395d85-4676-479f-abc5-b7132f68343a]: (4, 'qcow2') {{(pid=85803) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 19:03:52 devstack cinder-volume[84538]: DEBUG oslo_concurrency.processutils [None req-cfc0cdb7-3269-42d6-8093-65a41124808f tempest-VolumesCloneTest-373803938 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-0847f52e-6f72-457b-84ac-89f960065e54 {{(pid=84538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 19:03:52 devstack sudo[91369]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-0847f52e-6f72-457b-84ac-89f960065e54 Apr 29 19:03:52 devstack sudo[91369]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 19:03:52 devstack sudo[91364]: pam_unix(sudo:session): session closed for user root Apr 29 19:03:52 devstack cinder-volume[84538]: DEBUG oslo_concurrency.processutils [None req-e34c3c5c-0114-48b4-809f-b813247c2fa1 tempest-VolumesNegativeTest-977478995 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-91c56b82-361f-4d22-a978-1b0e33f6688c 1073741824" returned: 0 in 1.033s {{(pid=84538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 19:03:52 devstack cinder-volume[84538]: DEBUG oslo_concurrency.processutils [None req-e34c3c5c-0114-48b4-809f-b813247c2fa1 tempest-VolumesNegativeTest-977478995 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-91c56b82-361f-4d22-a978-1b0e33f6688c {{(pid=84538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 19:03:52 devstack sudo[91372]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-91c56b82-361f-4d22-a978-1b0e33f6688c Apr 29 19:03:52 devstack sudo[91372]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 19:03:52 devstack sudo[91369]: pam_unix(sudo:session): session closed for user root Apr 29 19:03:52 devstack cinder-volume[84538]: DEBUG oslo_concurrency.processutils [None req-cfc0cdb7-3269-42d6-8093-65a41124808f tempest-VolumesCloneTest-373803938 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-0847f52e-6f72-457b-84ac-89f960065e54" returned: 0 in 0.839s {{(pid=84538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 19:03:52 devstack cinder-volume[84538]: DEBUG oslo_concurrency.processutils [None req-cfc0cdb7-3269-42d6-8093-65a41124808f tempest-VolumesCloneTest-373803938 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-0847f52e-6f72-457b-84ac-89f960065e54 {{(pid=84538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 19:03:53 devstack sudo[91382]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-0847f52e-6f72-457b-84ac-89f960065e54 Apr 29 19:03:53 devstack sudo[91382]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 19:03:53 devstack sudo[91372]: pam_unix(sudo:session): session closed for user root Apr 29 19:03:53 devstack cinder-volume[84538]: DEBUG oslo_concurrency.processutils [None req-e34c3c5c-0114-48b4-809f-b813247c2fa1 tempest-VolumesNegativeTest-977478995 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-91c56b82-361f-4d22-a978-1b0e33f6688c" returned: 0 in 0.799s {{(pid=84538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 19:03:53 devstack cinder-volume[84538]: DEBUG cinder.volume.drivers.quobyte [None req-e34c3c5c-0114-48b4-809f-b813247c2fa1 tempest-VolumesNegativeTest-977478995 None] <== create_volume: return (1894ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-34312b00-dd6d-45bb-af98-75855cea8e48'} {{(pid=84538) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 29 19:03:53 devstack cinder-volume[84538]: DEBUG oslo_concurrency.lockutils [None req-e34c3c5c-0114-48b4-809f-b813247c2fa1 tempest-VolumesNegativeTest-977478995 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.899s {{(pid=84538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 19:03:53 devstack cinder-volume[84538]: DEBUG oslo_concurrency.lockutils [None req-0864efd1-4860-4ee6-ac45-e5ad0ac39609 tempest-VolumesSnapshotTestJSON-1345007867 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 12.905s {{(pid=84538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 19:03:53 devstack cinder-volume[84538]: DEBUG cinder.volume.drivers.quobyte [None req-0864efd1-4860-4ee6-ac45-e5ad0ac39609 tempest-VolumesSnapshotTestJSON-1345007867 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-29T17:03:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-305083836',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e72a11b7-a7b1-4fb8-8fb5-76ae1df74693,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cb1bf99b4f1a451dbdf762aff4ec180c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T17:03:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T17:03:40Z,use_quota=True,user_id='987ad9d695504aeba3196f9a11cdf3cf',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(62b05900-93e3-4190-a88f-1d87324303d1),volume_type_id=62b05900-93e3-4190-a88f-1d87324303d1)}" {{(pid=84538) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 29 19:03:53 devstack cinder-volume[84538]: DEBUG cinder.volume.drivers.remotefs [None req-0864efd1-4860-4ee6-ac45-e5ad0ac39609 tempest-VolumesSnapshotTestJSON-1345007867 None] Creating volume e72a11b7-a7b1-4fb8-8fb5-76ae1df74693 {{(pid=84538) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 29 19:03:53 devstack cinder-volume[84538]: DEBUG oslo_concurrency.lockutils [None req-0864efd1-4860-4ee6-ac45-e5ad0ac39609 tempest-VolumesSnapshotTestJSON-1345007867 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 19:03:53 devstack cinder-volume[84538]: DEBUG oslo_concurrency.lockutils [None req-0864efd1-4860-4ee6-ac45-e5ad0ac39609 tempest-VolumesSnapshotTestJSON-1345007867 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=84538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 19:03:53 devstack cinder-volume[84538]: DEBUG cinder.volume.drivers.quobyte [None req-0864efd1-4860-4ee6-ac45-e5ad0ac39609 tempest-VolumesSnapshotTestJSON-1345007867 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-34312b00-dd6d-45bb-af98-75855cea8e48': None} {{(pid=84538) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 19:03:53 devstack cinder-volume[84538]: DEBUG cinder.volume.drivers.quobyte [None req-0864efd1-4860-4ee6-ac45-e5ad0ac39609 tempest-VolumesSnapshotTestJSON-1345007867 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-34312b00-dd6d-45bb-af98-75855cea8e48'] {{(pid=84538) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 19:03:53 devstack cinder-volume[84538]: DEBUG oslo_concurrency.lockutils [None req-0864efd1-4860-4ee6-ac45-e5ad0ac39609 tempest-VolumesSnapshotTestJSON-1345007867 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=84538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 19:03:53 devstack cinder-volume[84538]: DEBUG cinder.volume.drivers.quobyte [None req-0864efd1-4860-4ee6-ac45-e5ad0ac39609 tempest-VolumesSnapshotTestJSON-1345007867 None] Selected osci02.corp.quobyte.com/cinder-vol-34312b00-dd6d-45bb-af98-75855cea8e48 as target Quobyte volume. {{(pid=84538) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 29 19:03:53 devstack cinder-volume[84538]: INFO cinder.volume.drivers.remotefs [None req-0864efd1-4860-4ee6-ac45-e5ad0ac39609 tempest-VolumesSnapshotTestJSON-1345007867 None] casted to osci02.corp.quobyte.com/cinder-vol-34312b00-dd6d-45bb-af98-75855cea8e48 Apr 29 19:03:53 devstack cinder-volume[84538]: DEBUG oslo_concurrency.processutils [None req-0864efd1-4860-4ee6-ac45-e5ad0ac39609 tempest-VolumesSnapshotTestJSON-1345007867 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-e72a11b7-a7b1-4fb8-8fb5-76ae1df74693 1073741824 {{(pid=84538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 19:03:53 devstack cinder-volume[84538]: DEBUG cinder.volume.manager [None req-e34c3c5c-0114-48b4-809f-b813247c2fa1 tempest-VolumesNegativeTest-977478995 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5575e144-8c01-42cc-b6b1-4c220cbf02e7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-91c56b82-361f-4d22-a978-1b0e33f6688c', 'volume_size': 1}' {{(pid=84538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 19:03:53 devstack sudo[91394]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-e72a11b7-a7b1-4fb8-8fb5-76ae1df74693 1073741824 Apr 29 19:03:53 devstack sudo[91394]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 19:03:53 devstack cinder-volume[84538]: DEBUG cinder.volume.manager [None req-e34c3c5c-0114-48b4-809f-b813247c2fa1 tempest-VolumesNegativeTest-977478995 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (44bc848d-0181-4b14-966a-e653ab16f90f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 19:03:53 devstack cinder-volume[84538]: INFO cinder.volume.flows.manager.create_volume [None req-e34c3c5c-0114-48b4-809f-b813247c2fa1 tempest-VolumesNegativeTest-977478995 None] Volume volume-91c56b82-361f-4d22-a978-1b0e33f6688c (91c56b82-361f-4d22-a978-1b0e33f6688c): created successfully Apr 29 19:03:53 devstack cinder-volume[84538]: DEBUG cinder.volume.manager [None req-e34c3c5c-0114-48b4-809f-b813247c2fa1 tempest-VolumesNegativeTest-977478995 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (44bc848d-0181-4b14-966a-e653ab16f90f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 19:03:53 devstack cinder-volume[84538]: DEBUG cinder.volume.manager [None req-e34c3c5c-0114-48b4-809f-b813247c2fa1 tempest-VolumesNegativeTest-977478995 None] Flow 'volume_create_manager' (5f046098-8333-4b51-9816-d38569581987) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84538) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 19:03:53 devstack cinder-volume[84538]: INFO cinder.volume.manager [None req-e34c3c5c-0114-48b4-809f-b813247c2fa1 tempest-VolumesNegativeTest-977478995 None] Created volume successfully. Apr 29 19:03:53 devstack sudo[91382]: pam_unix(sudo:session): session closed for user root Apr 29 19:03:53 devstack cinder-volume[84538]: DEBUG oslo_concurrency.processutils [None req-cfc0cdb7-3269-42d6-8093-65a41124808f tempest-VolumesCloneTest-373803938 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-0847f52e-6f72-457b-84ac-89f960065e54" returned: 0 in 0.696s {{(pid=84538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 19:03:53 devstack cinder-volume[84538]: DEBUG cinder.coordination [None req-cfc0cdb7-3269-42d6-8093-65a41124808f tempest-VolumesCloneTest-373803938 None] Lock "cinder-quobyte-0847f52e-6f72-457b-84ac-89f960065e54" released by "delete_volume" :: held 1.584s {{(pid=84538) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 19:03:53 devstack cinder-volume[84538]: DEBUG cinder.quota [None req-cfc0cdb7-3269-42d6-8093-65a41124808f tempest-VolumesCloneTest-373803938 None] Created reservations ['45829a06-0491-424f-9eeb-86236590c161', '0fafde19-7b5e-405e-a435-fc64e3dcc53b', '11a14a58-05f1-4d2f-82d8-26494ccc0068', '2f46433b-4fd3-4631-888f-19378d1ba417'] {{(pid=84538) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 29 19:03:53 devstack cinder-volume[84538]: DEBUG oslo_concurrency.lockutils [None req-cfc0cdb7-3269-42d6-8093-65a41124808f tempest-VolumesCloneTest-373803938 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 19:03:53 devstack cinder-volume[84538]: DEBUG oslo_concurrency.lockutils [None req-cfc0cdb7-3269-42d6-8093-65a41124808f tempest-VolumesCloneTest-373803938 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 19:03:53 devstack cinder-volume[84538]: DEBUG cinder.volume.drivers.quobyte [None req-cfc0cdb7-3269-42d6-8093-65a41124808f tempest-VolumesCloneTest-373803938 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-34312b00-dd6d-45bb-af98-75855cea8e48': None} {{(pid=84538) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 19:03:53 devstack cinder-volume[84538]: DEBUG cinder.volume.drivers.quobyte [None req-cfc0cdb7-3269-42d6-8093-65a41124808f tempest-VolumesCloneTest-373803938 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-34312b00-dd6d-45bb-af98-75855cea8e48'] {{(pid=84538) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 19:03:53 devstack cinder-volume[84538]: DEBUG oslo_concurrency.lockutils [None req-cfc0cdb7-3269-42d6-8093-65a41124808f tempest-VolumesCloneTest-373803938 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=84538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 19:03:53 devstack cinder-volume[84538]: DEBUG oslo_concurrency.processutils [None req-cfc0cdb7-3269-42d6-8093-65a41124808f tempest-VolumesCloneTest-373803938 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d {{(pid=84538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 19:03:53 devstack sudo[91399]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d Apr 29 19:03:53 devstack sudo[91399]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 19:03:54 devstack sudo[91394]: pam_unix(sudo:session): session closed for user root Apr 29 19:03:54 devstack cinder-volume[84538]: DEBUG oslo_concurrency.processutils [None req-0864efd1-4860-4ee6-ac45-e5ad0ac39609 tempest-VolumesSnapshotTestJSON-1345007867 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-e72a11b7-a7b1-4fb8-8fb5-76ae1df74693 1073741824" returned: 0 in 1.081s {{(pid=84538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 19:03:54 devstack cinder-volume[84538]: DEBUG cinder.coordination [None req-0d72820d-c025-499b-bb3c-492420b64867 tempest-VolumesCloneTest-373803938 None] Acquiring lock "cinder-8218f569-9e10-4c78-9f0b-97ba4a8a1f43-delete_volume" by "delete_volume" {{(pid=84538) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 19:03:54 devstack cinder-volume[84538]: DEBUG oslo_concurrency.processutils [None req-0864efd1-4860-4ee6-ac45-e5ad0ac39609 tempest-VolumesSnapshotTestJSON-1345007867 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-e72a11b7-a7b1-4fb8-8fb5-76ae1df74693 {{(pid=84538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 19:03:54 devstack cinder-volume[84538]: DEBUG cinder.coordination [None req-0d72820d-c025-499b-bb3c-492420b64867 tempest-VolumesCloneTest-373803938 None] Lock "cinder-8218f569-9e10-4c78-9f0b-97ba4a8a1f43-delete_volume" acquired by "delete_volume" :: waited 0.039s {{(pid=84538) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 19:03:54 devstack sudo[91399]: pam_unix(sudo:session): session closed for user root Apr 29 19:03:54 devstack cinder-volume[84538]: DEBUG oslo_concurrency.processutils [None req-cfc0cdb7-3269-42d6-8093-65a41124808f tempest-VolumesCloneTest-373803938 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d" returned: 0 in 0.737s {{(pid=84538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 19:03:54 devstack cinder-volume[84538]: DEBUG cinder.manager [None req-cfc0cdb7-3269-42d6-8093-65a41124808f tempest-VolumesCloneTest-373803938 None] Notifying Schedulers of capabilities ... {{(pid=84538) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 29 19:03:54 devstack sudo[91412]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-e72a11b7-a7b1-4fb8-8fb5-76ae1df74693 Apr 29 19:03:54 devstack sudo[91412]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 19:03:54 devstack cinder-volume[84538]: INFO cinder.volume.manager [None req-cfc0cdb7-3269-42d6-8093-65a41124808f tempest-VolumesCloneTest-373803938 None] Deleted volume successfully. Apr 29 19:03:54 devstack cinder-volume[84538]: DEBUG cinder.coordination [None req-cfc0cdb7-3269-42d6-8093-65a41124808f tempest-VolumesCloneTest-373803938 None] Lock "cinder-0847f52e-6f72-457b-84ac-89f960065e54-delete_volume" released by "delete_volume" :: held 2.536s {{(pid=84538) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 19:03:54 devstack cinder-volume[84538]: DEBUG cinder.coordination [None req-0d72820d-c025-499b-bb3c-492420b64867 tempest-VolumesCloneTest-373803938 None] Acquiring lock "cinder-quobyte-8218f569-9e10-4c78-9f0b-97ba4a8a1f43" by "delete_volume" {{(pid=84538) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 19:03:54 devstack cinder-volume[84538]: DEBUG cinder.coordination [None req-0d72820d-c025-499b-bb3c-492420b64867 tempest-VolumesCloneTest-373803938 None] Lock "cinder-quobyte-8218f569-9e10-4c78-9f0b-97ba4a8a1f43" acquired by "delete_volume" :: waited 0.015s {{(pid=84538) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 19:03:54 devstack cinder-volume[84538]: DEBUG oslo.privsep.daemon [-] privsep: reply[b66ca8ef-5255-4afa-be97-c76a450da7e2]: (4, 'qcow2') {{(pid=85803) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 19:03:54 devstack cinder-volume[84538]: DEBUG oslo_concurrency.processutils [None req-0d72820d-c025-499b-bb3c-492420b64867 tempest-VolumesCloneTest-373803938 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-8218f569-9e10-4c78-9f0b-97ba4a8a1f43 {{(pid=84538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 19:03:54 devstack sudo[91414]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-8218f569-9e10-4c78-9f0b-97ba4a8a1f43 Apr 29 19:03:54 devstack sudo[91414]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 19:03:55 devstack sudo[91412]: pam_unix(sudo:session): session closed for user root Apr 29 19:03:55 devstack cinder-volume[84538]: DEBUG oslo_concurrency.processutils [None req-0864efd1-4860-4ee6-ac45-e5ad0ac39609 tempest-VolumesSnapshotTestJSON-1345007867 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-e72a11b7-a7b1-4fb8-8fb5-76ae1df74693" returned: 0 in 0.757s {{(pid=84538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 19:03:55 devstack cinder-volume[84538]: DEBUG cinder.volume.drivers.quobyte [None req-0864efd1-4860-4ee6-ac45-e5ad0ac39609 tempest-VolumesSnapshotTestJSON-1345007867 None] <== create_volume: return (1930ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-34312b00-dd6d-45bb-af98-75855cea8e48'} {{(pid=84538) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 29 19:03:55 devstack cinder-volume[84538]: DEBUG oslo_concurrency.lockutils [None req-0864efd1-4860-4ee6-ac45-e5ad0ac39609 tempest-VolumesSnapshotTestJSON-1345007867 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.935s {{(pid=84538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 19:03:55 devstack cinder-volume[84538]: DEBUG cinder.volume.manager [None req-0864efd1-4860-4ee6-ac45-e5ad0ac39609 tempest-VolumesSnapshotTestJSON-1345007867 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c1601a3e-fe63-4734-b033-bf1286d3c201) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e72a11b7-a7b1-4fb8-8fb5-76ae1df74693', 'volume_size': 1}' {{(pid=84538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 19:03:55 devstack cinder-volume[84538]: DEBUG cinder.volume.manager [None req-0864efd1-4860-4ee6-ac45-e5ad0ac39609 tempest-VolumesSnapshotTestJSON-1345007867 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (196715f5-ebba-4d3a-acbf-9322e7f43b1f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 19:03:55 devstack cinder-volume[84538]: INFO cinder.volume.flows.manager.create_volume [None req-0864efd1-4860-4ee6-ac45-e5ad0ac39609 tempest-VolumesSnapshotTestJSON-1345007867 None] Volume volume-e72a11b7-a7b1-4fb8-8fb5-76ae1df74693 (e72a11b7-a7b1-4fb8-8fb5-76ae1df74693): created successfully Apr 29 19:03:55 devstack cinder-volume[84538]: DEBUG cinder.volume.manager [None req-0864efd1-4860-4ee6-ac45-e5ad0ac39609 tempest-VolumesSnapshotTestJSON-1345007867 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (196715f5-ebba-4d3a-acbf-9322e7f43b1f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 19:03:55 devstack cinder-volume[84538]: DEBUG cinder.volume.manager [None req-0864efd1-4860-4ee6-ac45-e5ad0ac39609 tempest-VolumesSnapshotTestJSON-1345007867 None] Flow 'volume_create_manager' (ed3ee879-ac99-47c6-9979-b11dc2c86115) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84538) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 19:03:55 devstack cinder-volume[84538]: INFO cinder.volume.manager [None req-0864efd1-4860-4ee6-ac45-e5ad0ac39609 tempest-VolumesSnapshotTestJSON-1345007867 None] Created volume successfully. Apr 29 19:03:55 devstack sudo[91414]: pam_unix(sudo:session): session closed for user root Apr 29 19:03:55 devstack cinder-volume[84538]: DEBUG oslo_concurrency.processutils [None req-0d72820d-c025-499b-bb3c-492420b64867 tempest-VolumesCloneTest-373803938 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-8218f569-9e10-4c78-9f0b-97ba4a8a1f43" returned: 0 in 0.922s {{(pid=84538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 19:03:55 devstack cinder-volume[84538]: DEBUG oslo_concurrency.processutils [None req-0d72820d-c025-499b-bb3c-492420b64867 tempest-VolumesCloneTest-373803938 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-8218f569-9e10-4c78-9f0b-97ba4a8a1f43 {{(pid=84538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 19:03:55 devstack sudo[91424]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-8218f569-9e10-4c78-9f0b-97ba4a8a1f43 Apr 29 19:03:55 devstack sudo[91424]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 19:03:55 devstack cinder-volume[84538]: DEBUG oslo_concurrency.lockutils [None req-c0a35efb-77fd-43d1-8b20-dc01e681475d tempest-VolumesSnapshotTestJSON-1345007867 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=84538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 19:03:55 devstack cinder-volume[84538]: DEBUG oslo_concurrency.lockutils [None req-c0a35efb-77fd-43d1-8b20-dc01e681475d tempest-VolumesSnapshotTestJSON-1345007867 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=84538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 19:03:55 devstack cinder-volume[84538]: DEBUG cinder.volume.drivers.remotefs [None req-c0a35efb-77fd-43d1-8b20-dc01e681475d tempest-VolumesSnapshotTestJSON-1345007867 None] Creating offline snapshot 1323141a-218a-4b4d-81f8-5f7f8d53e83c of volume e72a11b7-a7b1-4fb8-8fb5-76ae1df74693 {{(pid=84538) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}} Apr 29 19:03:55 devstack cinder-volume[84538]: DEBUG oslo.privsep.daemon [-] privsep: reply[ff3c882a-c16b-49f2-9c95-5b721f11c236]: (4, 'qcow2') {{(pid=85803) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 19:03:55 devstack cinder-volume[84538]: DEBUG oslo_concurrency.processutils [None req-c0a35efb-77fd-43d1-8b20-dc01e681475d tempest-VolumesSnapshotTestJSON-1345007867 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-e72a11b7-a7b1-4fb8-8fb5-76ae1df74693 {{(pid=84538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 19:03:55 devstack sudo[91426]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-e72a11b7-a7b1-4fb8-8fb5-76ae1df74693 Apr 29 19:03:55 devstack sudo[91426]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 19:03:56 devstack sudo[91424]: pam_unix(sudo:session): session closed for user root Apr 29 19:03:56 devstack cinder-volume[84538]: DEBUG oslo_concurrency.processutils [None req-0d72820d-c025-499b-bb3c-492420b64867 tempest-VolumesCloneTest-373803938 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-8218f569-9e10-4c78-9f0b-97ba4a8a1f43" returned: 0 in 0.752s {{(pid=84538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 19:03:56 devstack cinder-volume[84538]: DEBUG cinder.coordination [None req-0d72820d-c025-499b-bb3c-492420b64867 tempest-VolumesCloneTest-373803938 None] Lock "cinder-quobyte-8218f569-9e10-4c78-9f0b-97ba4a8a1f43" released by "delete_volume" :: held 1.745s {{(pid=84538) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 19:03:56 devstack cinder-volume[84538]: DEBUG cinder.quota [None req-0d72820d-c025-499b-bb3c-492420b64867 tempest-VolumesCloneTest-373803938 None] Created reservations ['074b3d92-5b2f-4752-af4c-80409b919a36', 'f47d415d-5a9c-4bf4-85fc-ac3f31fa74ad', '68cd7b01-76b9-45b0-883e-b25747effe20', '9d7c23df-5392-461e-a62e-48f1d8c7e9f7'] {{(pid=84538) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 29 19:03:56 devstack cinder-volume[84538]: DEBUG oslo_concurrency.lockutils [None req-0d72820d-c025-499b-bb3c-492420b64867 tempest-VolumesCloneTest-373803938 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 19:03:56 devstack cinder-volume[84538]: DEBUG oslo_concurrency.lockutils [None req-0d72820d-c025-499b-bb3c-492420b64867 tempest-VolumesCloneTest-373803938 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 19:03:56 devstack cinder-volume[84538]: DEBUG cinder.volume.drivers.quobyte [None req-0d72820d-c025-499b-bb3c-492420b64867 tempest-VolumesCloneTest-373803938 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-34312b00-dd6d-45bb-af98-75855cea8e48': None} {{(pid=84538) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 19:03:56 devstack cinder-volume[84538]: DEBUG cinder.volume.drivers.quobyte [None req-0d72820d-c025-499b-bb3c-492420b64867 tempest-VolumesCloneTest-373803938 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-34312b00-dd6d-45bb-af98-75855cea8e48'] {{(pid=84538) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 19:03:56 devstack cinder-volume[84538]: DEBUG oslo_concurrency.lockutils [None req-0d72820d-c025-499b-bb3c-492420b64867 tempest-VolumesCloneTest-373803938 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=84538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 19:03:56 devstack cinder-volume[84538]: DEBUG oslo_concurrency.processutils [None req-0d72820d-c025-499b-bb3c-492420b64867 tempest-VolumesCloneTest-373803938 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d {{(pid=84538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 19:03:56 devstack sudo[91436]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d Apr 29 19:03:56 devstack sudo[91436]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 19:03:56 devstack sudo[91426]: pam_unix(sudo:session): session closed for user root Apr 29 19:03:56 devstack cinder-volume[84538]: DEBUG oslo_concurrency.processutils [None req-c0a35efb-77fd-43d1-8b20-dc01e681475d tempest-VolumesSnapshotTestJSON-1345007867 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-e72a11b7-a7b1-4fb8-8fb5-76ae1df74693" returned: 0 in 0.793s {{(pid=84538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 19:03:56 devstack cinder-volume[84538]: DEBUG oslo_concurrency.processutils [None req-c0a35efb-77fd-43d1-8b20-dc01e681475d tempest-VolumesSnapshotTestJSON-1345007867 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-e72a11b7-a7b1-4fb8-8fb5-76ae1df74693,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-e72a11b7-a7b1-4fb8-8fb5-76ae1df74693.1323141a-218a-4b4d-81f8-5f7f8d53e83c 1G {{(pid=84538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 19:03:56 devstack sudo[91440]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-e72a11b7-a7b1-4fb8-8fb5-76ae1df74693,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-e72a11b7-a7b1-4fb8-8fb5-76ae1df74693.1323141a-218a-4b4d-81f8-5f7f8d53e83c 1G Apr 29 19:03:56 devstack sudo[91440]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 19:03:57 devstack sudo[91436]: pam_unix(sudo:session): session closed for user root Apr 29 19:03:57 devstack cinder-volume[84538]: DEBUG oslo_concurrency.processutils [None req-0d72820d-c025-499b-bb3c-492420b64867 tempest-VolumesCloneTest-373803938 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d" returned: 0 in 0.758s {{(pid=84538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 19:03:57 devstack cinder-volume[84538]: DEBUG cinder.manager [None req-0d72820d-c025-499b-bb3c-492420b64867 tempest-VolumesCloneTest-373803938 None] Notifying Schedulers of capabilities ... {{(pid=84538) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 29 19:03:57 devstack cinder-volume[84538]: INFO cinder.volume.manager [None req-0d72820d-c025-499b-bb3c-492420b64867 tempest-VolumesCloneTest-373803938 None] Deleted volume successfully. Apr 29 19:03:57 devstack cinder-volume[84538]: DEBUG cinder.coordination [None req-0d72820d-c025-499b-bb3c-492420b64867 tempest-VolumesCloneTest-373803938 None] Lock "cinder-8218f569-9e10-4c78-9f0b-97ba4a8a1f43-delete_volume" released by "delete_volume" :: held 2.740s {{(pid=84538) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 19:03:57 devstack sudo[91440]: pam_unix(sudo:session): session closed for user root Apr 29 19:03:57 devstack cinder-volume[84538]: DEBUG oslo_concurrency.processutils [None req-c0a35efb-77fd-43d1-8b20-dc01e681475d tempest-VolumesSnapshotTestJSON-1345007867 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-e72a11b7-a7b1-4fb8-8fb5-76ae1df74693,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-e72a11b7-a7b1-4fb8-8fb5-76ae1df74693.1323141a-218a-4b4d-81f8-5f7f8d53e83c 1G" returned: 0 in 0.868s {{(pid=84538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 19:03:57 devstack cinder-volume[84538]: DEBUG oslo_concurrency.processutils [None req-c0a35efb-77fd-43d1-8b20-dc01e681475d tempest-VolumesSnapshotTestJSON-1345007867 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e72a11b7-a7b1-4fb8-8fb5-76ae1df74693 -F qcow2 /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-e72a11b7-a7b1-4fb8-8fb5-76ae1df74693.1323141a-218a-4b4d-81f8-5f7f8d53e83c {{(pid=84538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 19:03:57 devstack sudo[91447]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e72a11b7-a7b1-4fb8-8fb5-76ae1df74693 -F qcow2 /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-e72a11b7-a7b1-4fb8-8fb5-76ae1df74693.1323141a-218a-4b4d-81f8-5f7f8d53e83c Apr 29 19:03:57 devstack sudo[91447]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 19:03:58 devstack sudo[91447]: pam_unix(sudo:session): session closed for user root Apr 29 19:03:58 devstack cinder-volume[84538]: DEBUG oslo_concurrency.processutils [None req-c0a35efb-77fd-43d1-8b20-dc01e681475d tempest-VolumesSnapshotTestJSON-1345007867 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e72a11b7-a7b1-4fb8-8fb5-76ae1df74693 -F qcow2 /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-e72a11b7-a7b1-4fb8-8fb5-76ae1df74693.1323141a-218a-4b4d-81f8-5f7f8d53e83c" returned: 0 in 0.957s {{(pid=84538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 19:03:58 devstack cinder-volume[84538]: WARNING cinder.volume.drivers.remotefs [None req-c0a35efb-77fd-43d1-8b20-dc01e681475d tempest-VolumesSnapshotTestJSON-1345007867 None] /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-e72a11b7-a7b1-4fb8-8fb5-76ae1df74693.1323141a-218a-4b4d-81f8-5f7f8d53e83c is being set with open permissions: ugo+rw Apr 29 19:03:58 devstack cinder-volume[84538]: DEBUG oslo_concurrency.processutils [None req-c0a35efb-77fd-43d1-8b20-dc01e681475d tempest-VolumesSnapshotTestJSON-1345007867 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-e72a11b7-a7b1-4fb8-8fb5-76ae1df74693.1323141a-218a-4b4d-81f8-5f7f8d53e83c {{(pid=84538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 19:03:58 devstack sudo[91508]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-e72a11b7-a7b1-4fb8-8fb5-76ae1df74693.1323141a-218a-4b4d-81f8-5f7f8d53e83c Apr 29 19:03:58 devstack sudo[91508]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 19:03:59 devstack sudo[91508]: pam_unix(sudo:session): session closed for user root Apr 29 19:03:59 devstack cinder-volume[84538]: DEBUG oslo_concurrency.processutils [None req-c0a35efb-77fd-43d1-8b20-dc01e681475d tempest-VolumesSnapshotTestJSON-1345007867 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-e72a11b7-a7b1-4fb8-8fb5-76ae1df74693.1323141a-218a-4b4d-81f8-5f7f8d53e83c" returned: 0 in 0.966s {{(pid=84538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 19:03:59 devstack cinder-volume[84538]: DEBUG oslo_concurrency.processutils [None req-c0a35efb-77fd-43d1-8b20-dc01e681475d tempest-VolumesSnapshotTestJSON-1345007867 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-e72a11b7-a7b1-4fb8-8fb5-76ae1df74693.info {{(pid=84538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 19:03:59 devstack sudo[91522]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-e72a11b7-a7b1-4fb8-8fb5-76ae1df74693.info Apr 29 19:03:59 devstack sudo[91522]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 19:04:00 devstack sudo[91522]: pam_unix(sudo:session): session closed for user root Apr 29 19:04:00 devstack cinder-volume[84538]: DEBUG oslo_concurrency.processutils [None req-c0a35efb-77fd-43d1-8b20-dc01e681475d tempest-VolumesSnapshotTestJSON-1345007867 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-e72a11b7-a7b1-4fb8-8fb5-76ae1df74693.info" returned: 0 in 1.242s {{(pid=84538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 19:04:00 devstack cinder-volume[84538]: WARNING cinder.volume.drivers.remotefs [None req-c0a35efb-77fd-43d1-8b20-dc01e681475d tempest-VolumesSnapshotTestJSON-1345007867 None] /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-e72a11b7-a7b1-4fb8-8fb5-76ae1df74693.info is being set with open permissions: ugo+rw Apr 29 19:04:00 devstack cinder-volume[84538]: DEBUG oslo_concurrency.processutils [None req-c0a35efb-77fd-43d1-8b20-dc01e681475d tempest-VolumesSnapshotTestJSON-1345007867 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-e72a11b7-a7b1-4fb8-8fb5-76ae1df74693.info {{(pid=84538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 19:04:00 devstack sudo[91526]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-e72a11b7-a7b1-4fb8-8fb5-76ae1df74693.info Apr 29 19:04:00 devstack sudo[91526]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 19:04:01 devstack sudo[91526]: pam_unix(sudo:session): session closed for user root Apr 29 19:04:01 devstack cinder-volume[84538]: DEBUG oslo_concurrency.processutils [None req-c0a35efb-77fd-43d1-8b20-dc01e681475d tempest-VolumesSnapshotTestJSON-1345007867 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-e72a11b7-a7b1-4fb8-8fb5-76ae1df74693.info" returned: 0 in 1.168s {{(pid=84538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 19:04:01 devstack cinder-volume[84538]: DEBUG oslo_concurrency.lockutils [None req-c0a35efb-77fd-43d1-8b20-dc01e681475d tempest-VolumesSnapshotTestJSON-1345007867 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 6.156s {{(pid=84538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 19:04:02 devstack cinder-volume[84538]: INFO cinder.volume.manager [None req-c0a35efb-77fd-43d1-8b20-dc01e681475d tempest-VolumesSnapshotTestJSON-1345007867 None] Create snapshot completed successfully Apr 29 19:04:02 devstack cinder-volume[84538]: DEBUG cinder.volume.flows.manager.create_volume [None req-0db3d153-5f13-48ed-b831-719a206d5401 tempest-VolumesCloneNegativeTest-1365523109 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84538) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Apr 29 19:04:02 devstack cinder-volume[84538]: DEBUG cinder.volume.manager [None req-0db3d153-5f13-48ed-b831-719a206d5401 tempest-VolumesCloneNegativeTest-1365523109 None] Flow 'volume_create_manager' (fcfac5ff-7a8e-433a-9f9c-cf45afe4c5d3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84538) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 19:04:02 devstack cinder-volume[84538]: DEBUG cinder.volume.manager [None req-0db3d153-5f13-48ed-b831-719a206d5401 tempest-VolumesCloneNegativeTest-1365523109 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (78ad3b25-0169-4d70-b605-c2d4b61a9773) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 19:04:02 devstack cinder-volume[84538]: DEBUG cinder.volume.manager [None req-0db3d153-5f13-48ed-b831-719a206d5401 tempest-VolumesCloneNegativeTest-1365523109 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (78ad3b25-0169-4d70-b605-c2d4b61a9773) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-29T17:04:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneNegativeTest-Volume-1172605653',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0c889b12-8d6f-42f7-88cf-dcf0a52a3ae5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ecd28211f5664d6bbf30d1a21f467c3f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T17:04:02Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T17:04:02Z,use_quota=True,user_id='f7aa1ad8a4474a7fbac73a33596d73db',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(62b05900-93e3-4190-a88f-1d87324303d1),volume_type_id=62b05900-93e3-4190-a88f-1d87324303d1)' {{(pid=84538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 19:04:02 devstack cinder-volume[84538]: DEBUG cinder.volume.manager [None req-0db3d153-5f13-48ed-b831-719a206d5401 tempest-VolumesCloneNegativeTest-1365523109 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (08219806-65ff-4a0a-a4a9-d707f2efebe6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 19:04:02 devstack cinder-volume[84538]: DEBUG cinder.volume.manager [None req-0db3d153-5f13-48ed-b831-719a206d5401 tempest-VolumesCloneNegativeTest-1365523109 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (08219806-65ff-4a0a-a4a9-d707f2efebe6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 19:04:02 devstack cinder-volume[84538]: DEBUG cinder.volume.manager [None req-0db3d153-5f13-48ed-b831-719a206d5401 tempest-VolumesCloneNegativeTest-1365523109 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bff8d0cd-4943-4912-b741-ebb6981f2ffe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 19:04:02 devstack cinder-volume[84538]: DEBUG cinder.volume.manager [None req-0db3d153-5f13-48ed-b831-719a206d5401 tempest-VolumesCloneNegativeTest-1365523109 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bff8d0cd-4943-4912-b741-ebb6981f2ffe) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0c889b12-8d6f-42f7-88cf-dcf0a52a3ae5', 'volume_name': 'volume-0c889b12-8d6f-42f7-88cf-dcf0a52a3ae5', 'volume_size': 2}' {{(pid=84538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 19:04:02 devstack cinder-volume[84538]: DEBUG cinder.volume.manager [None req-0db3d153-5f13-48ed-b831-719a206d5401 tempest-VolumesCloneNegativeTest-1365523109 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f62b0660-c446-4c62-abf2-7e627d4542aa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 19:04:02 devstack cinder-volume[84538]: DEBUG cinder.volume.manager [None req-0db3d153-5f13-48ed-b831-719a206d5401 tempest-VolumesCloneNegativeTest-1365523109 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f62b0660-c446-4c62-abf2-7e627d4542aa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 19:04:02 devstack cinder-volume[84538]: DEBUG cinder.volume.manager [None req-0db3d153-5f13-48ed-b831-719a206d5401 tempest-VolumesCloneNegativeTest-1365523109 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (944b1c02-a7f6-4ea5-bcbf-d138a65a7f08) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 19:04:02 devstack cinder-volume[84538]: INFO cinder.volume.flows.manager.create_volume [None req-0db3d153-5f13-48ed-b831-719a206d5401 tempest-VolumesCloneNegativeTest-1365523109 None] Volume 0c889b12-8d6f-42f7-88cf-dcf0a52a3ae5: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0c889b12-8d6f-42f7-88cf-dcf0a52a3ae5', 'volume_size': 2} Apr 29 19:04:02 devstack cinder-volume[84538]: DEBUG oslo_concurrency.lockutils [None req-0db3d153-5f13-48ed-b831-719a206d5401 tempest-VolumesCloneNegativeTest-1365523109 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 19:04:02 devstack cinder-volume[84538]: DEBUG oslo_concurrency.lockutils [None req-0db3d153-5f13-48ed-b831-719a206d5401 tempest-VolumesCloneNegativeTest-1365523109 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=84538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 19:04:02 devstack cinder-volume[84538]: DEBUG cinder.volume.drivers.quobyte [None req-0db3d153-5f13-48ed-b831-719a206d5401 tempest-VolumesCloneNegativeTest-1365523109 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-29T17:04:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneNegativeTest-Volume-1172605653',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0c889b12-8d6f-42f7-88cf-dcf0a52a3ae5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ecd28211f5664d6bbf30d1a21f467c3f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T17:04:02Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T17:04:02Z,use_quota=True,user_id='f7aa1ad8a4474a7fbac73a33596d73db',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(62b05900-93e3-4190-a88f-1d87324303d1),volume_type_id=62b05900-93e3-4190-a88f-1d87324303d1)}" {{(pid=84538) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 29 19:04:02 devstack cinder-volume[84538]: DEBUG cinder.volume.drivers.remotefs [None req-0db3d153-5f13-48ed-b831-719a206d5401 tempest-VolumesCloneNegativeTest-1365523109 None] Creating volume 0c889b12-8d6f-42f7-88cf-dcf0a52a3ae5 {{(pid=84538) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 29 19:04:02 devstack cinder-volume[84538]: DEBUG oslo_concurrency.lockutils [None req-0db3d153-5f13-48ed-b831-719a206d5401 tempest-VolumesCloneNegativeTest-1365523109 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 19:04:02 devstack cinder-volume[84538]: DEBUG oslo_concurrency.lockutils [None req-0db3d153-5f13-48ed-b831-719a206d5401 tempest-VolumesCloneNegativeTest-1365523109 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=84538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 19:04:02 devstack cinder-volume[84538]: DEBUG cinder.volume.drivers.quobyte [None req-0db3d153-5f13-48ed-b831-719a206d5401 tempest-VolumesCloneNegativeTest-1365523109 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-34312b00-dd6d-45bb-af98-75855cea8e48': None} {{(pid=84538) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 19:04:02 devstack cinder-volume[84538]: DEBUG cinder.volume.drivers.quobyte [None req-0db3d153-5f13-48ed-b831-719a206d5401 tempest-VolumesCloneNegativeTest-1365523109 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-34312b00-dd6d-45bb-af98-75855cea8e48'] {{(pid=84538) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 19:04:02 devstack cinder-volume[84538]: DEBUG oslo_concurrency.lockutils [None req-0db3d153-5f13-48ed-b831-719a206d5401 tempest-VolumesCloneNegativeTest-1365523109 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=84538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 19:04:02 devstack cinder-volume[84538]: DEBUG cinder.volume.drivers.quobyte [None req-0db3d153-5f13-48ed-b831-719a206d5401 tempest-VolumesCloneNegativeTest-1365523109 None] Selected osci02.corp.quobyte.com/cinder-vol-34312b00-dd6d-45bb-af98-75855cea8e48 as target Quobyte volume. {{(pid=84538) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 29 19:04:02 devstack cinder-volume[84538]: INFO cinder.volume.drivers.remotefs [None req-0db3d153-5f13-48ed-b831-719a206d5401 tempest-VolumesCloneNegativeTest-1365523109 None] casted to osci02.corp.quobyte.com/cinder-vol-34312b00-dd6d-45bb-af98-75855cea8e48 Apr 29 19:04:02 devstack cinder-volume[84538]: DEBUG oslo_concurrency.processutils [None req-0db3d153-5f13-48ed-b831-719a206d5401 tempest-VolumesCloneNegativeTest-1365523109 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-0c889b12-8d6f-42f7-88cf-dcf0a52a3ae5 2147483648 {{(pid=84538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 19:04:02 devstack cinder-volume[84538]: DEBUG cinder.coordination [None req-f226f3dc-8bad-4a29-b856-938646422ba3 tempest-VolumesActionsTest-1839563461 None] Acquiring lock "cinder-c66b0dde-dec4-44cc-b0fe-7b7f63fa3d6a" by "attach_volume" {{(pid=84538) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 19:04:02 devstack sudo[91540]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-0c889b12-8d6f-42f7-88cf-dcf0a52a3ae5 2147483648 Apr 29 19:04:02 devstack sudo[91540]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 19:04:02 devstack cinder-volume[84538]: DEBUG cinder.coordination [None req-f226f3dc-8bad-4a29-b856-938646422ba3 tempest-VolumesActionsTest-1839563461 None] Lock "cinder-c66b0dde-dec4-44cc-b0fe-7b7f63fa3d6a" acquired by "attach_volume" :: waited 0.050s {{(pid=84538) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 19:04:02 devstack cinder-volume[84538]: INFO cinder.volume.manager [None req-f226f3dc-8bad-4a29-b856-938646422ba3 tempest-VolumesActionsTest-1839563461 None] Attaching volume c66b0dde-dec4-44cc-b0fe-7b7f63fa3d6a to instance 4003557c-fd4a-4b5e-8b76-2eef7fa2a904 at mountpoint /dev/vdb on host None. Apr 29 19:04:02 devstack cinder-volume[84538]: INFO cinder.volume.manager [None req-f226f3dc-8bad-4a29-b856-938646422ba3 tempest-VolumesActionsTest-1839563461 None] Attach volume completed successfully. Apr 29 19:04:02 devstack cinder-volume[84538]: DEBUG cinder.coordination [None req-f226f3dc-8bad-4a29-b856-938646422ba3 tempest-VolumesActionsTest-1839563461 None] Lock "cinder-c66b0dde-dec4-44cc-b0fe-7b7f63fa3d6a" released by "attach_volume" :: held 0.263s {{(pid=84538) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 19:04:03 devstack cinder-volume[84538]: DEBUG cinder.coordination [None req-dab9a471-e31f-4f3f-a4eb-1d938de1aa9c tempest-VolumesActionsTest-1839563461 None] Acquiring lock "cinder-c66b0dde-dec4-44cc-b0fe-7b7f63fa3d6a-detach_volume" by "detach_volume" {{(pid=84538) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 19:04:03 devstack cinder-volume[84538]: DEBUG cinder.volume.flows.manager.create_volume [None req-a6ee8318-10b6-4f22-afb8-9627580e4205 tempest-VolumesSnapshotTestJSON-1345007867 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84538) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Apr 29 19:04:03 devstack cinder-volume[84538]: DEBUG cinder.coordination [None req-dab9a471-e31f-4f3f-a4eb-1d938de1aa9c tempest-VolumesActionsTest-1839563461 None] Lock "cinder-c66b0dde-dec4-44cc-b0fe-7b7f63fa3d6a-detach_volume" acquired by "detach_volume" :: waited 0.041s {{(pid=84538) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 19:04:03 devstack cinder-volume[84538]: INFO cinder.volume.manager [None req-dab9a471-e31f-4f3f-a4eb-1d938de1aa9c tempest-VolumesActionsTest-1839563461 None] Detaching volume c66b0dde-dec4-44cc-b0fe-7b7f63fa3d6a from instance 4003557c-fd4a-4b5e-8b76-2eef7fa2a904. Apr 29 19:04:03 devstack cinder-volume[84538]: DEBUG cinder.volume.manager [None req-a6ee8318-10b6-4f22-afb8-9627580e4205 tempest-VolumesSnapshotTestJSON-1345007867 None] Flow 'volume_create_manager' (2b8d45f7-5255-496b-90be-197142fc4eff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84538) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 19:04:03 devstack cinder-volume[84538]: DEBUG cinder.volume.manager [None req-a6ee8318-10b6-4f22-afb8-9627580e4205 tempest-VolumesSnapshotTestJSON-1345007867 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e4c9fab0-ebda-4a95-b1f2-7a5349e50cef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 19:04:03 devstack cinder-volume[84538]: DEBUG cinder.volume.manager [None req-a6ee8318-10b6-4f22-afb8-9627580e4205 tempest-VolumesSnapshotTestJSON-1345007867 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e4c9fab0-ebda-4a95-b1f2-7a5349e50cef) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-29T17:04:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-2125377774',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=931fd71e-c4de-486c-b345-507d333d6cae,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cb1bf99b4f1a451dbdf762aff4ec180c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T17:04:03Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=1323141a-218a-4b4d-81f8-5f7f8d53e83c,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T17:04:03Z,use_quota=True,user_id='987ad9d695504aeba3196f9a11cdf3cf',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(62b05900-93e3-4190-a88f-1d87324303d1),volume_type_id=62b05900-93e3-4190-a88f-1d87324303d1)' {{(pid=84538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 19:04:03 devstack cinder-volume[84538]: DEBUG cinder.volume.manager [None req-a6ee8318-10b6-4f22-afb8-9627580e4205 tempest-VolumesSnapshotTestJSON-1345007867 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5b73e049-1554-47ee-bdab-1292a4102888) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 19:04:03 devstack cinder-volume[84538]: DEBUG cinder.volume.manager [None req-a6ee8318-10b6-4f22-afb8-9627580e4205 tempest-VolumesSnapshotTestJSON-1345007867 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5b73e049-1554-47ee-bdab-1292a4102888) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 19:04:03 devstack cinder-volume[84538]: DEBUG cinder.volume.manager [None req-a6ee8318-10b6-4f22-afb8-9627580e4205 tempest-VolumesSnapshotTestJSON-1345007867 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (035a96d6-724c-4104-b405-adc00d4cb084) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 19:04:03 devstack cinder-volume[84538]: DEBUG cinder.volume.manager [None req-a6ee8318-10b6-4f22-afb8-9627580e4205 tempest-VolumesSnapshotTestJSON-1345007867 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (035a96d6-724c-4104-b405-adc00d4cb084) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '931fd71e-c4de-486c-b345-507d333d6cae', 'volume_name': 'volume-931fd71e-c4de-486c-b345-507d333d6cae', 'volume_size': 2, 'snapshot_id': '1323141a-218a-4b4d-81f8-5f7f8d53e83c'}' {{(pid=84538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 19:04:03 devstack cinder-volume[84538]: DEBUG cinder.volume.manager [None req-a6ee8318-10b6-4f22-afb8-9627580e4205 tempest-VolumesSnapshotTestJSON-1345007867 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (971f6cae-1e36-4b84-811f-1dee1dc44071) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 19:04:03 devstack cinder-volume[84538]: DEBUG cinder.volume.manager [None req-a6ee8318-10b6-4f22-afb8-9627580e4205 tempest-VolumesSnapshotTestJSON-1345007867 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (971f6cae-1e36-4b84-811f-1dee1dc44071) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 19:04:03 devstack cinder-volume[84538]: DEBUG cinder.volume.manager [None req-a6ee8318-10b6-4f22-afb8-9627580e4205 tempest-VolumesSnapshotTestJSON-1345007867 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (55fa6b4a-c601-47e9-8b1a-2d6b224b3dbc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 19:04:03 devstack cinder-volume[84538]: INFO cinder.volume.flows.manager.create_volume [None req-a6ee8318-10b6-4f22-afb8-9627580e4205 tempest-VolumesSnapshotTestJSON-1345007867 None] Volume 931fd71e-c4de-486c-b345-507d333d6cae: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-931fd71e-c4de-486c-b345-507d333d6cae', 'volume_size': 2, 'snapshot_id': '1323141a-218a-4b4d-81f8-5f7f8d53e83c'} Apr 29 19:04:03 devstack cinder-volume[84538]: DEBUG oslo_concurrency.lockutils [None req-a6ee8318-10b6-4f22-afb8-9627580e4205 tempest-VolumesSnapshotTestJSON-1345007867 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=84538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 19:04:03 devstack cinder-volume[84538]: INFO cinder.volume.manager [None req-dab9a471-e31f-4f3f-a4eb-1d938de1aa9c tempest-VolumesActionsTest-1839563461 None] Detach volume completed successfully. Apr 29 19:04:03 devstack cinder-volume[84538]: DEBUG cinder.coordination [None req-dab9a471-e31f-4f3f-a4eb-1d938de1aa9c tempest-VolumesActionsTest-1839563461 None] Lock "cinder-c66b0dde-dec4-44cc-b0fe-7b7f63fa3d6a-detach_volume" released by "detach_volume" :: held 0.155s {{(pid=84538) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 19:04:04 devstack sudo[91540]: pam_unix(sudo:session): session closed for user root Apr 29 19:04:04 devstack cinder-volume[84538]: DEBUG oslo_concurrency.processutils [None req-0db3d153-5f13-48ed-b831-719a206d5401 tempest-VolumesCloneNegativeTest-1365523109 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-0c889b12-8d6f-42f7-88cf-dcf0a52a3ae5 2147483648" returned: 0 in 1.603s {{(pid=84538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 19:04:04 devstack cinder-volume[84538]: DEBUG oslo_concurrency.processutils [None req-0db3d153-5f13-48ed-b831-719a206d5401 tempest-VolumesCloneNegativeTest-1365523109 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-0c889b12-8d6f-42f7-88cf-dcf0a52a3ae5 {{(pid=84538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 19:04:04 devstack sudo[91554]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-0c889b12-8d6f-42f7-88cf-dcf0a52a3ae5 Apr 29 19:04:04 devstack sudo[91554]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 19:04:04 devstack sudo[91554]: pam_unix(sudo:session): session closed for user root Apr 29 19:04:04 devstack cinder-volume[84538]: DEBUG oslo_concurrency.processutils [None req-0db3d153-5f13-48ed-b831-719a206d5401 tempest-VolumesCloneNegativeTest-1365523109 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-0c889b12-8d6f-42f7-88cf-dcf0a52a3ae5" returned: 0 in 0.708s {{(pid=84538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 19:04:04 devstack cinder-volume[84538]: DEBUG cinder.volume.drivers.quobyte [None req-0db3d153-5f13-48ed-b831-719a206d5401 tempest-VolumesCloneNegativeTest-1365523109 None] <== create_volume: return (2409ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-34312b00-dd6d-45bb-af98-75855cea8e48'} {{(pid=84538) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 29 19:04:04 devstack cinder-volume[84538]: DEBUG oslo_concurrency.lockutils [None req-0db3d153-5f13-48ed-b831-719a206d5401 tempest-VolumesCloneNegativeTest-1365523109 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.416s {{(pid=84538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 19:04:04 devstack cinder-volume[84538]: DEBUG oslo_concurrency.lockutils [None req-a6ee8318-10b6-4f22-afb8-9627580e4205 tempest-VolumesSnapshotTestJSON-1345007867 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 1.448s {{(pid=84538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 19:04:04 devstack cinder-volume[84538]: DEBUG cinder.coordination [None req-a6ee8318-10b6-4f22-afb8-9627580e4205 tempest-VolumesSnapshotTestJSON-1345007867 None] Acquiring lock "cinder-quobyte-1323141a-218a-4b4d-81f8-5f7f8d53e83c-931fd71e-c4de-486c-b345-507d333d6cae" by "_create_volume_from_snapshot" {{(pid=84538) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 19:04:04 devstack cinder-volume[84538]: DEBUG cinder.volume.manager [None req-0db3d153-5f13-48ed-b831-719a206d5401 tempest-VolumesCloneNegativeTest-1365523109 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (944b1c02-a7f6-4ea5-bcbf-d138a65a7f08) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0c889b12-8d6f-42f7-88cf-dcf0a52a3ae5', 'volume_size': 2}' {{(pid=84538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 19:04:04 devstack cinder-volume[84538]: DEBUG cinder.volume.manager [None req-0db3d153-5f13-48ed-b831-719a206d5401 tempest-VolumesCloneNegativeTest-1365523109 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (494dccd5-bbb1-4c9a-b07c-96b3866bc585) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 19:04:04 devstack cinder-volume[84538]: INFO cinder.volume.flows.manager.create_volume [None req-0db3d153-5f13-48ed-b831-719a206d5401 tempest-VolumesCloneNegativeTest-1365523109 None] Volume volume-0c889b12-8d6f-42f7-88cf-dcf0a52a3ae5 (0c889b12-8d6f-42f7-88cf-dcf0a52a3ae5): created successfully Apr 29 19:04:04 devstack cinder-volume[84538]: DEBUG cinder.volume.manager [None req-0db3d153-5f13-48ed-b831-719a206d5401 tempest-VolumesCloneNegativeTest-1365523109 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (494dccd5-bbb1-4c9a-b07c-96b3866bc585) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 19:04:04 devstack cinder-volume[84538]: DEBUG cinder.volume.manager [None req-0db3d153-5f13-48ed-b831-719a206d5401 tempest-VolumesCloneNegativeTest-1365523109 None] Flow 'volume_create_manager' (fcfac5ff-7a8e-433a-9f9c-cf45afe4c5d3) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84538) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 19:04:04 devstack cinder-volume[84538]: DEBUG cinder.coordination [None req-a6ee8318-10b6-4f22-afb8-9627580e4205 tempest-VolumesSnapshotTestJSON-1345007867 None] Lock "cinder-quobyte-1323141a-218a-4b4d-81f8-5f7f8d53e83c-931fd71e-c4de-486c-b345-507d333d6cae" acquired by "_create_volume_from_snapshot" :: waited 0.060s {{(pid=84538) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 19:04:04 devstack cinder-volume[84538]: DEBUG cinder.volume.drivers.quobyte [None req-a6ee8318-10b6-4f22-afb8-9627580e4205 tempest-VolumesSnapshotTestJSON-1345007867 None] Creating volume 931fd71e-c4de-486c-b345-507d333d6cae from snapshot 1323141a-218a-4b4d-81f8-5f7f8d53e83c {{(pid=84538) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:356}} Apr 29 19:04:04 devstack cinder-volume[84538]: DEBUG oslo_concurrency.lockutils [None req-a6ee8318-10b6-4f22-afb8-9627580e4205 tempest-VolumesSnapshotTestJSON-1345007867 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 19:04:04 devstack cinder-volume[84538]: DEBUG oslo_concurrency.lockutils [None req-a6ee8318-10b6-4f22-afb8-9627580e4205 tempest-VolumesSnapshotTestJSON-1345007867 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 19:04:04 devstack cinder-volume[84538]: DEBUG cinder.volume.drivers.quobyte [None req-a6ee8318-10b6-4f22-afb8-9627580e4205 tempest-VolumesSnapshotTestJSON-1345007867 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-34312b00-dd6d-45bb-af98-75855cea8e48': None} {{(pid=84538) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 19:04:04 devstack cinder-volume[84538]: DEBUG cinder.volume.drivers.quobyte [None req-a6ee8318-10b6-4f22-afb8-9627580e4205 tempest-VolumesSnapshotTestJSON-1345007867 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-34312b00-dd6d-45bb-af98-75855cea8e48'] {{(pid=84538) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 19:04:04 devstack cinder-volume[84538]: DEBUG oslo_concurrency.lockutils [None req-a6ee8318-10b6-4f22-afb8-9627580e4205 tempest-VolumesSnapshotTestJSON-1345007867 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=84538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 19:04:04 devstack cinder-volume[84538]: DEBUG cinder.volume.drivers.quobyte [None req-a6ee8318-10b6-4f22-afb8-9627580e4205 tempest-VolumesSnapshotTestJSON-1345007867 None] Selected osci02.corp.quobyte.com/cinder-vol-34312b00-dd6d-45bb-af98-75855cea8e48 as target Quobyte volume. {{(pid=84538) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 29 19:04:04 devstack cinder-volume[84538]: DEBUG cinder.coordination [None req-a6ee8318-10b6-4f22-afb8-9627580e4205 tempest-VolumesSnapshotTestJSON-1345007867 None] Acquiring lock "cinder-quobyte-931fd71e-c4de-486c-b345-507d333d6cae" by "_copy_volume_from_snapshot" {{(pid=84538) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 19:04:04 devstack cinder-volume[84538]: INFO cinder.volume.manager [None req-0db3d153-5f13-48ed-b831-719a206d5401 tempest-VolumesCloneNegativeTest-1365523109 None] Created volume successfully. Apr 29 19:04:04 devstack cinder-volume[84538]: DEBUG cinder.coordination [None req-a6ee8318-10b6-4f22-afb8-9627580e4205 tempest-VolumesSnapshotTestJSON-1345007867 None] Lock "cinder-quobyte-931fd71e-c4de-486c-b345-507d333d6cae" acquired by "_copy_volume_from_snapshot" :: waited 0.025s {{(pid=84538) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 19:04:04 devstack cinder-volume[84538]: DEBUG cinder.volume.drivers.quobyte [None req-a6ee8318-10b6-4f22-afb8-9627580e4205 tempest-VolumesSnapshotTestJSON-1345007867 None] snapshot: 1323141a-218a-4b4d-81f8-5f7f8d53e83c, volume: 931fd71e-c4de-486c-b345-507d333d6cae, {{(pid=84538) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Apr 29 19:04:04 devstack cinder-volume[84538]: DEBUG oslo_concurrency.lockutils [None req-a6ee8318-10b6-4f22-afb8-9627580e4205 tempest-VolumesSnapshotTestJSON-1345007867 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 19:04:04 devstack cinder-volume[84538]: DEBUG oslo_concurrency.lockutils [None req-a6ee8318-10b6-4f22-afb8-9627580e4205 tempest-VolumesSnapshotTestJSON-1345007867 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 19:04:04 devstack cinder-volume[84538]: DEBUG cinder.volume.drivers.quobyte [None req-a6ee8318-10b6-4f22-afb8-9627580e4205 tempest-VolumesSnapshotTestJSON-1345007867 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-34312b00-dd6d-45bb-af98-75855cea8e48': None} {{(pid=84538) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 19:04:04 devstack cinder-volume[84538]: DEBUG cinder.volume.drivers.quobyte [None req-a6ee8318-10b6-4f22-afb8-9627580e4205 tempest-VolumesSnapshotTestJSON-1345007867 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-34312b00-dd6d-45bb-af98-75855cea8e48'] {{(pid=84538) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 19:04:04 devstack cinder-volume[84538]: DEBUG oslo_concurrency.lockutils [None req-a6ee8318-10b6-4f22-afb8-9627580e4205 tempest-VolumesSnapshotTestJSON-1345007867 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=84538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 19:04:05 devstack cinder-volume[84538]: DEBUG oslo.privsep.daemon [-] privsep: reply[a8b2eb4f-dbda-4791-be7d-9c91c1f1e748]: (4, 'qcow2') {{(pid=85803) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 19:04:05 devstack cinder-volume[84538]: DEBUG oslo_concurrency.processutils [None req-a6ee8318-10b6-4f22-afb8-9627580e4205 tempest-VolumesSnapshotTestJSON-1345007867 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-e72a11b7-a7b1-4fb8-8fb5-76ae1df74693.1323141a-218a-4b4d-81f8-5f7f8d53e83c {{(pid=84538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 19:04:05 devstack sudo[91557]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-e72a11b7-a7b1-4fb8-8fb5-76ae1df74693.1323141a-218a-4b4d-81f8-5f7f8d53e83c Apr 29 19:04:05 devstack sudo[91557]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 19:04:05 devstack cinder-volume[84538]: DEBUG cinder.coordination [None req-823162e5-3f5a-46db-bef2-9de32941d3ce tempest-VolumesCloneNegativeTest-1365523109 None] Acquiring lock "cinder-0c889b12-8d6f-42f7-88cf-dcf0a52a3ae5-delete_volume" by "delete_volume" {{(pid=84538) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 19:04:05 devstack cinder-volume[84538]: DEBUG cinder.coordination [None req-823162e5-3f5a-46db-bef2-9de32941d3ce tempest-VolumesCloneNegativeTest-1365523109 None] Lock "cinder-0c889b12-8d6f-42f7-88cf-dcf0a52a3ae5-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=84538) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 19:04:05 devstack cinder-volume[84538]: DEBUG cinder.coordination [None req-823162e5-3f5a-46db-bef2-9de32941d3ce tempest-VolumesCloneNegativeTest-1365523109 None] Acquiring lock "cinder-quobyte-0c889b12-8d6f-42f7-88cf-dcf0a52a3ae5" by "delete_volume" {{(pid=84538) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 19:04:05 devstack cinder-volume[84538]: DEBUG cinder.coordination [None req-823162e5-3f5a-46db-bef2-9de32941d3ce tempest-VolumesCloneNegativeTest-1365523109 None] Lock "cinder-quobyte-0c889b12-8d6f-42f7-88cf-dcf0a52a3ae5" acquired by "delete_volume" :: waited 0.027s {{(pid=84538) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 19:04:05 devstack cinder-volume[84538]: DEBUG oslo.privsep.daemon [-] privsep: reply[68e83165-f5e9-4839-87dc-83814099801b]: (4, 'qcow2') {{(pid=85803) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 19:04:05 devstack cinder-volume[84538]: DEBUG oslo_concurrency.processutils [None req-823162e5-3f5a-46db-bef2-9de32941d3ce tempest-VolumesCloneNegativeTest-1365523109 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-0c889b12-8d6f-42f7-88cf-dcf0a52a3ae5 {{(pid=84538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 19:04:06 devstack sudo[91557]: pam_unix(sudo:session): session closed for user root Apr 29 19:04:06 devstack cinder-volume[84538]: DEBUG oslo_concurrency.processutils [None req-a6ee8318-10b6-4f22-afb8-9627580e4205 tempest-VolumesSnapshotTestJSON-1345007867 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-e72a11b7-a7b1-4fb8-8fb5-76ae1df74693.1323141a-218a-4b4d-81f8-5f7f8d53e83c" returned: 0 in 1.015s {{(pid=84538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 19:04:06 devstack cinder-volume[84538]: DEBUG cinder.volume.drivers.remotefs [None req-a6ee8318-10b6-4f22-afb8-9627580e4205 tempest-VolumesSnapshotTestJSON-1345007867 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-e72a11b7-a7b1-4fb8-8fb5-76ae1df74693(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=84538) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 29 19:04:06 devstack cinder-volume[84538]: DEBUG cinder.volume.drivers.quobyte [None req-a6ee8318-10b6-4f22-afb8-9627580e4205 tempest-VolumesSnapshotTestJSON-1345007867 None] will copy from snapshot at /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-e72a11b7-a7b1-4fb8-8fb5-76ae1df74693 {{(pid=84538) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Apr 29 19:04:06 devstack cinder-volume[84538]: DEBUG cinder.volume.drivers.quobyte [None req-a6ee8318-10b6-4f22-afb8-9627580e4205 tempest-VolumesSnapshotTestJSON-1345007867 None] Creating direct copy from snapshot {{(pid=84538) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Apr 29 19:04:06 devstack cinder-volume[84538]: DEBUG oslo.privsep.daemon [-] privsep: reply[fd02c0c3-45fb-4196-af55-db69ce14885c]: (4, 'qcow2') {{(pid=85803) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 19:04:06 devstack cinder-volume[84538]: DEBUG oslo_concurrency.processutils [None req-a6ee8318-10b6-4f22-afb8-9627580e4205 tempest-VolumesSnapshotTestJSON-1345007867 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-e72a11b7-a7b1-4fb8-8fb5-76ae1df74693 {{(pid=84538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 19:04:06 devstack sudo[91604]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-0c889b12-8d6f-42f7-88cf-dcf0a52a3ae5 Apr 29 19:04:06 devstack sudo[91604]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 19:04:06 devstack sudo[91605]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-e72a11b7-a7b1-4fb8-8fb5-76ae1df74693 Apr 29 19:04:06 devstack sudo[91605]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 19:04:06 devstack sudo[91604]: pam_unix(sudo:session): session closed for user root Apr 29 19:04:06 devstack cinder-volume[84538]: DEBUG oslo_concurrency.processutils [None req-823162e5-3f5a-46db-bef2-9de32941d3ce tempest-VolumesCloneNegativeTest-1365523109 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-0c889b12-8d6f-42f7-88cf-dcf0a52a3ae5" returned: 0 in 0.758s {{(pid=84538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 19:04:06 devstack cinder-volume[84538]: DEBUG oslo_concurrency.processutils [None req-823162e5-3f5a-46db-bef2-9de32941d3ce tempest-VolumesCloneNegativeTest-1365523109 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-0c889b12-8d6f-42f7-88cf-dcf0a52a3ae5 {{(pid=84538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 19:04:06 devstack sudo[91614]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-0c889b12-8d6f-42f7-88cf-dcf0a52a3ae5 Apr 29 19:04:06 devstack sudo[91614]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 19:04:06 devstack sudo[91605]: pam_unix(sudo:session): session closed for user root Apr 29 19:04:06 devstack cinder-volume[84538]: DEBUG oslo_concurrency.processutils [None req-a6ee8318-10b6-4f22-afb8-9627580e4205 tempest-VolumesSnapshotTestJSON-1345007867 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-e72a11b7-a7b1-4fb8-8fb5-76ae1df74693" returned: 0 in 0.875s {{(pid=84538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 19:04:06 devstack cinder-volume[84538]: DEBUG cinder.utils [None req-a6ee8318-10b6-4f22-afb8-9627580e4205 tempest-VolumesSnapshotTestJSON-1345007867 None] Path /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-931fd71e-c4de-486c-b345-507d333d6cae not found in is_blk_device check {{(pid=84538) is_blk_device /opt/stack/cinder/cinder/utils.py:602}} Apr 29 19:04:06 devstack cinder-volume[84538]: DEBUG oslo_concurrency.processutils [None req-a6ee8318-10b6-4f22-afb8-9627580e4205 tempest-VolumesSnapshotTestJSON-1345007867 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-e72a11b7-a7b1-4fb8-8fb5-76ae1df74693 /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-931fd71e-c4de-486c-b345-507d333d6cae {{(pid=84538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 19:04:06 devstack sudo[91618]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-e72a11b7-a7b1-4fb8-8fb5-76ae1df74693 /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-931fd71e-c4de-486c-b345-507d333d6cae Apr 29 19:04:07 devstack sudo[91618]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 19:04:07 devstack sudo[91614]: pam_unix(sudo:session): session closed for user root Apr 29 19:04:07 devstack cinder-volume[84538]: DEBUG oslo_concurrency.processutils [None req-823162e5-3f5a-46db-bef2-9de32941d3ce tempest-VolumesCloneNegativeTest-1365523109 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-0c889b12-8d6f-42f7-88cf-dcf0a52a3ae5" returned: 0 in 0.755s {{(pid=84538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 19:04:07 devstack cinder-volume[84538]: DEBUG cinder.coordination [None req-823162e5-3f5a-46db-bef2-9de32941d3ce tempest-VolumesCloneNegativeTest-1365523109 None] Lock "cinder-quobyte-0c889b12-8d6f-42f7-88cf-dcf0a52a3ae5" released by "delete_volume" :: held 1.591s {{(pid=84538) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 19:04:07 devstack cinder-volume[84538]: DEBUG cinder.quota [None req-823162e5-3f5a-46db-bef2-9de32941d3ce tempest-VolumesCloneNegativeTest-1365523109 None] Created reservations ['d994a0d9-c184-4999-848d-e0baddd188ee', 'eddd6555-1ab4-42bf-88bf-a39bac7446ff', '0131c37c-2b48-4fe7-9127-73553d8b0ca7', 'f1856210-d3cc-4ef3-b4aa-8c931f742054'] {{(pid=84538) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 29 19:04:07 devstack cinder-volume[84538]: DEBUG oslo_concurrency.lockutils [None req-823162e5-3f5a-46db-bef2-9de32941d3ce tempest-VolumesCloneNegativeTest-1365523109 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 19:04:07 devstack cinder-volume[84538]: DEBUG oslo_concurrency.lockutils [None req-823162e5-3f5a-46db-bef2-9de32941d3ce tempest-VolumesCloneNegativeTest-1365523109 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 19:04:07 devstack cinder-volume[84538]: DEBUG cinder.volume.drivers.quobyte [None req-823162e5-3f5a-46db-bef2-9de32941d3ce tempest-VolumesCloneNegativeTest-1365523109 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-34312b00-dd6d-45bb-af98-75855cea8e48': None} {{(pid=84538) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 19:04:07 devstack cinder-volume[84538]: DEBUG cinder.volume.drivers.quobyte [None req-823162e5-3f5a-46db-bef2-9de32941d3ce tempest-VolumesCloneNegativeTest-1365523109 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-34312b00-dd6d-45bb-af98-75855cea8e48'] {{(pid=84538) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 19:04:07 devstack cinder-volume[84538]: DEBUG oslo_concurrency.lockutils [None req-823162e5-3f5a-46db-bef2-9de32941d3ce tempest-VolumesCloneNegativeTest-1365523109 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=84538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 19:04:07 devstack cinder-volume[84538]: DEBUG oslo_concurrency.processutils [None req-823162e5-3f5a-46db-bef2-9de32941d3ce tempest-VolumesCloneNegativeTest-1365523109 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d {{(pid=84538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 19:04:07 devstack sudo[91629]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d Apr 29 19:04:07 devstack sudo[91629]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 19:04:08 devstack sudo[91629]: pam_unix(sudo:session): session closed for user root Apr 29 19:04:08 devstack cinder-volume[84538]: DEBUG oslo_concurrency.processutils [None req-823162e5-3f5a-46db-bef2-9de32941d3ce tempest-VolumesCloneNegativeTest-1365523109 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d" returned: 0 in 0.933s {{(pid=84538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 19:04:08 devstack cinder-volume[84538]: DEBUG cinder.manager [None req-823162e5-3f5a-46db-bef2-9de32941d3ce tempest-VolumesCloneNegativeTest-1365523109 None] Notifying Schedulers of capabilities ... {{(pid=84538) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 29 19:04:08 devstack cinder-volume[84538]: INFO cinder.volume.manager [None req-823162e5-3f5a-46db-bef2-9de32941d3ce tempest-VolumesCloneNegativeTest-1365523109 None] Deleted volume successfully. Apr 29 19:04:08 devstack cinder-volume[84538]: DEBUG cinder.coordination [None req-823162e5-3f5a-46db-bef2-9de32941d3ce tempest-VolumesCloneNegativeTest-1365523109 None] Lock "cinder-0c889b12-8d6f-42f7-88cf-dcf0a52a3ae5-delete_volume" released by "delete_volume" :: held 2.836s {{(pid=84538) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 19:04:15 devstack sudo[91618]: pam_unix(sudo:session): session closed for user root Apr 29 19:04:15 devstack cinder-volume[84538]: DEBUG oslo_concurrency.processutils [None req-a6ee8318-10b6-4f22-afb8-9627580e4205 tempest-VolumesSnapshotTestJSON-1345007867 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-e72a11b7-a7b1-4fb8-8fb5-76ae1df74693 /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-931fd71e-c4de-486c-b345-507d333d6cae" returned: 0 in 8.143s {{(pid=84538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 19:04:15 devstack cinder-volume[84538]: DEBUG oslo.privsep.daemon [-] privsep: reply[1c191ec6-bd73-4937-ba2c-e3596c895a4e]: (4, 'qcow2') {{(pid=85803) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 19:04:15 devstack cinder-volume[84538]: DEBUG oslo_concurrency.processutils [None req-a6ee8318-10b6-4f22-afb8-9627580e4205 tempest-VolumesSnapshotTestJSON-1345007867 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-e72a11b7-a7b1-4fb8-8fb5-76ae1df74693 {{(pid=84538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 19:04:15 devstack sudo[91708]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-e72a11b7-a7b1-4fb8-8fb5-76ae1df74693 Apr 29 19:04:15 devstack sudo[91708]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 19:04:16 devstack cinder-volume[84538]: DEBUG oslo_concurrency.lockutils [None req-ce1579a2-bed4-45eb-b6ed-9187e5e886b8 tempest-VolumesActionsTest-1839563461 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" {{(pid=84538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 19:04:16 devstack sudo[91708]: pam_unix(sudo:session): session closed for user root Apr 29 19:04:16 devstack cinder-volume[84538]: DEBUG oslo_concurrency.processutils [None req-a6ee8318-10b6-4f22-afb8-9627580e4205 tempest-VolumesSnapshotTestJSON-1345007867 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-e72a11b7-a7b1-4fb8-8fb5-76ae1df74693" returned: 0 in 1.285s {{(pid=84538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 19:04:16 devstack cinder-volume[84538]: DEBUG cinder.image.image_utils [None req-a6ee8318-10b6-4f22-afb8-9627580e4205 tempest-VolumesSnapshotTestJSON-1345007867 None] Image conversion details: src /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-e72a11b7-a7b1-4fb8-8fb5-76ae1df74693, size 1024.00 MB, duration 8.14 sec, destination /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-931fd71e-c4de-486c-b345-507d333d6cae {{(pid=84538) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}} Apr 29 19:04:16 devstack cinder-volume[84538]: INFO cinder.image.image_utils [None req-a6ee8318-10b6-4f22-afb8-9627580e4205 tempest-VolumesSnapshotTestJSON-1345007867 None] Converted 1024.00 MB image at 125.73 MB/s Apr 29 19:04:16 devstack cinder-volume[84538]: WARNING cinder.volume.drivers.remotefs [None req-a6ee8318-10b6-4f22-afb8-9627580e4205 tempest-VolumesSnapshotTestJSON-1345007867 None] /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-931fd71e-c4de-486c-b345-507d333d6cae is being set with open permissions: ugo+rw Apr 29 19:04:16 devstack cinder-volume[84538]: DEBUG oslo_concurrency.processutils [None req-a6ee8318-10b6-4f22-afb8-9627580e4205 tempest-VolumesSnapshotTestJSON-1345007867 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-931fd71e-c4de-486c-b345-507d333d6cae {{(pid=84538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 19:04:16 devstack sudo[91714]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-931fd71e-c4de-486c-b345-507d333d6cae Apr 29 19:04:16 devstack sudo[91714]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 19:04:16 devstack cinder-volume[84538]: DEBUG cinder.volume.flows.manager.create_volume [None req-7b4dda2d-ee01-4355-895a-b453361715df tempest-VolumesListTestJSON-1695505021 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84538) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Apr 29 19:04:16 devstack cinder-volume[84538]: DEBUG cinder.volume.manager [None req-7b4dda2d-ee01-4355-895a-b453361715df tempest-VolumesListTestJSON-1695505021 None] Flow 'volume_create_manager' (9165497e-2f79-461c-864a-22b43d3c1f29) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84538) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 19:04:16 devstack cinder-volume[84538]: DEBUG cinder.volume.manager [None req-7b4dda2d-ee01-4355-895a-b453361715df tempest-VolumesListTestJSON-1695505021 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2e3f650a-fb8b-4b10-9b59-09cb5e9d7ccb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 19:04:16 devstack cinder-volume[84538]: DEBUG cinder.volume.manager [None req-7b4dda2d-ee01-4355-895a-b453361715df tempest-VolumesListTestJSON-1695505021 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2e3f650a-fb8b-4b10-9b59-09cb5e9d7ccb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-29T17:04:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-539320422',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f710366c-9c8d-4ce5-82ec-661e3abbfbd0,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='ec2a7decc4f54bab96570e941c207171',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T17:04:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T17:04:17Z,use_quota=True,user_id='d06c72522a3c4026ac17a414ac13121f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(62b05900-93e3-4190-a88f-1d87324303d1),volume_type_id=62b05900-93e3-4190-a88f-1d87324303d1)' {{(pid=84538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 19:04:16 devstack cinder-volume[84538]: DEBUG cinder.volume.manager [None req-7b4dda2d-ee01-4355-895a-b453361715df tempest-VolumesListTestJSON-1695505021 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c6bb0732-a5e0-437a-acd8-9ae823d7597b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 19:04:16 devstack cinder-volume[84538]: DEBUG cinder.volume.manager [None req-7b4dda2d-ee01-4355-895a-b453361715df tempest-VolumesListTestJSON-1695505021 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c6bb0732-a5e0-437a-acd8-9ae823d7597b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 19:04:16 devstack cinder-volume[84538]: DEBUG cinder.volume.manager [None req-7b4dda2d-ee01-4355-895a-b453361715df tempest-VolumesListTestJSON-1695505021 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1ad8b75a-11c9-408d-ac63-952a74a565bf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 19:04:16 devstack cinder-volume[84538]: DEBUG cinder.volume.manager [None req-7b4dda2d-ee01-4355-895a-b453361715df tempest-VolumesListTestJSON-1695505021 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1ad8b75a-11c9-408d-ac63-952a74a565bf) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f710366c-9c8d-4ce5-82ec-661e3abbfbd0', 'volume_name': 'volume-f710366c-9c8d-4ce5-82ec-661e3abbfbd0', 'volume_size': 1}' {{(pid=84538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 19:04:17 devstack cinder-volume[84538]: DEBUG cinder.volume.manager [None req-7b4dda2d-ee01-4355-895a-b453361715df tempest-VolumesListTestJSON-1695505021 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bb223e47-e11b-40d8-bd20-0e33381c4b75) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 19:04:17 devstack cinder-volume[84538]: DEBUG cinder.volume.manager [None req-7b4dda2d-ee01-4355-895a-b453361715df tempest-VolumesListTestJSON-1695505021 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bb223e47-e11b-40d8-bd20-0e33381c4b75) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 19:04:17 devstack cinder-volume[84538]: DEBUG cinder.volume.manager [None req-7b4dda2d-ee01-4355-895a-b453361715df tempest-VolumesListTestJSON-1695505021 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f2aec2fe-94d2-4dc0-a138-85a90dba1fc9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 19:04:17 devstack cinder-volume[84538]: INFO cinder.volume.flows.manager.create_volume [None req-7b4dda2d-ee01-4355-895a-b453361715df tempest-VolumesListTestJSON-1695505021 None] Volume f710366c-9c8d-4ce5-82ec-661e3abbfbd0: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f710366c-9c8d-4ce5-82ec-661e3abbfbd0', 'volume_size': 1} Apr 29 19:04:17 devstack cinder-volume[84538]: DEBUG oslo_concurrency.lockutils [None req-7b4dda2d-ee01-4355-895a-b453361715df tempest-VolumesListTestJSON-1695505021 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 19:04:17 devstack sudo[91714]: pam_unix(sudo:session): session closed for user root Apr 29 19:04:17 devstack cinder-volume[84538]: DEBUG oslo_concurrency.processutils [None req-a6ee8318-10b6-4f22-afb8-9627580e4205 tempest-VolumesSnapshotTestJSON-1345007867 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-931fd71e-c4de-486c-b345-507d333d6cae" returned: 0 in 0.840s {{(pid=84538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 19:04:17 devstack cinder-volume[84538]: DEBUG cinder.coordination [None req-a6ee8318-10b6-4f22-afb8-9627580e4205 tempest-VolumesSnapshotTestJSON-1345007867 None] Lock "cinder-quobyte-931fd71e-c4de-486c-b345-507d333d6cae" released by "_copy_volume_from_snapshot" :: held 12.281s {{(pid=84538) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 19:04:17 devstack cinder-volume[84538]: DEBUG cinder.coordination [None req-a6ee8318-10b6-4f22-afb8-9627580e4205 tempest-VolumesSnapshotTestJSON-1345007867 None] Lock "cinder-quobyte-1323141a-218a-4b4d-81f8-5f7f8d53e83c-931fd71e-c4de-486c-b345-507d333d6cae" released by "_create_volume_from_snapshot" :: held 12.336s {{(pid=84538) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 19:04:17 devstack cinder-volume[84538]: DEBUG oslo_concurrency.lockutils [None req-a6ee8318-10b6-4f22-afb8-9627580e4205 tempest-VolumesSnapshotTestJSON-1345007867 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 12.398s {{(pid=84538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 19:04:17 devstack cinder-volume[84538]: DEBUG oslo_concurrency.lockutils [None req-ce1579a2-bed4-45eb-b6ed-9187e5e886b8 tempest-VolumesActionsTest-1839563461 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: waited 0.930s {{(pid=84538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 19:04:17 devstack cinder-volume[84538]: DEBUG oslo.privsep.daemon [-] privsep: reply[1712271b-91b1-4055-b579-95814e65d7ae]: (4, 'qcow2') {{(pid=85803) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 19:04:17 devstack cinder-volume[84538]: DEBUG oslo_concurrency.processutils [None req-ce1579a2-bed4-45eb-b6ed-9187e5e886b8 tempest-VolumesActionsTest-1839563461 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-c66b0dde-dec4-44cc-b0fe-7b7f63fa3d6a {{(pid=84538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 19:04:17 devstack cinder-volume[84538]: DEBUG cinder.volume.manager [None req-a6ee8318-10b6-4f22-afb8-9627580e4205 tempest-VolumesSnapshotTestJSON-1345007867 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (55fa6b4a-c601-47e9-8b1a-2d6b224b3dbc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-931fd71e-c4de-486c-b345-507d333d6cae', 'volume_size': 2, 'snapshot_id': '1323141a-218a-4b4d-81f8-5f7f8d53e83c'}' {{(pid=84538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 19:04:17 devstack cinder-volume[84538]: DEBUG cinder.volume.manager [None req-a6ee8318-10b6-4f22-afb8-9627580e4205 tempest-VolumesSnapshotTestJSON-1345007867 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (46e3384d-d942-4871-807c-71c7b10e0226) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 19:04:17 devstack cinder-volume[84538]: INFO cinder.volume.flows.manager.create_volume [None req-a6ee8318-10b6-4f22-afb8-9627580e4205 tempest-VolumesSnapshotTestJSON-1345007867 None] Volume volume-931fd71e-c4de-486c-b345-507d333d6cae (931fd71e-c4de-486c-b345-507d333d6cae): created successfully Apr 29 19:04:17 devstack cinder-volume[84538]: DEBUG cinder.volume.manager [None req-a6ee8318-10b6-4f22-afb8-9627580e4205 tempest-VolumesSnapshotTestJSON-1345007867 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (46e3384d-d942-4871-807c-71c7b10e0226) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 19:04:17 devstack cinder-volume[84538]: DEBUG cinder.volume.manager [None req-a6ee8318-10b6-4f22-afb8-9627580e4205 tempest-VolumesSnapshotTestJSON-1345007867 None] Flow 'volume_create_manager' (2b8d45f7-5255-496b-90be-197142fc4eff) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84538) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 19:04:17 devstack cinder-volume[84538]: INFO cinder.volume.manager [None req-a6ee8318-10b6-4f22-afb8-9627580e4205 tempest-VolumesSnapshotTestJSON-1345007867 None] Created volume successfully. Apr 29 19:04:17 devstack sudo[91757]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-c66b0dde-dec4-44cc-b0fe-7b7f63fa3d6a Apr 29 19:04:17 devstack sudo[91757]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 19:04:18 devstack sudo[91757]: pam_unix(sudo:session): session closed for user root Apr 29 19:04:18 devstack cinder-volume[84538]: DEBUG oslo_concurrency.processutils [None req-ce1579a2-bed4-45eb-b6ed-9187e5e886b8 tempest-VolumesActionsTest-1839563461 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-c66b0dde-dec4-44cc-b0fe-7b7f63fa3d6a" returned: 0 in 0.752s {{(pid=84538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 19:04:18 devstack cinder-volume[84538]: DEBUG oslo.privsep.daemon [-] privsep: reply[45f1f8f6-7e8a-4a23-a837-bd0443a90e9f]: (4, 'qcow2') {{(pid=85803) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 19:04:18 devstack cinder-volume[84538]: DEBUG oslo_concurrency.processutils [None req-ce1579a2-bed4-45eb-b6ed-9187e5e886b8 tempest-VolumesActionsTest-1839563461 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-c66b0dde-dec4-44cc-b0fe-7b7f63fa3d6a {{(pid=84538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 19:04:18 devstack sudo[91763]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-c66b0dde-dec4-44cc-b0fe-7b7f63fa3d6a Apr 29 19:04:18 devstack sudo[91763]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 19:04:18 devstack cinder-volume[84538]: DEBUG cinder.coordination [None req-093ef90a-762f-4f7c-8442-c46a5bee1eae tempest-VolumesSnapshotTestJSON-1345007867 None] Acquiring lock "cinder-931fd71e-c4de-486c-b345-507d333d6cae-delete_volume" by "delete_volume" {{(pid=84538) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 19:04:18 devstack cinder-volume[84538]: DEBUG cinder.coordination [None req-093ef90a-762f-4f7c-8442-c46a5bee1eae tempest-VolumesSnapshotTestJSON-1345007867 None] Lock "cinder-931fd71e-c4de-486c-b345-507d333d6cae-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=84538) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 19:04:18 devstack cinder-volume[84538]: DEBUG cinder.coordination [None req-093ef90a-762f-4f7c-8442-c46a5bee1eae tempest-VolumesSnapshotTestJSON-1345007867 None] Acquiring lock "cinder-quobyte-931fd71e-c4de-486c-b345-507d333d6cae" by "delete_volume" {{(pid=84538) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 19:04:18 devstack cinder-volume[84538]: DEBUG cinder.coordination [None req-093ef90a-762f-4f7c-8442-c46a5bee1eae tempest-VolumesSnapshotTestJSON-1345007867 None] Lock "cinder-quobyte-931fd71e-c4de-486c-b345-507d333d6cae" acquired by "delete_volume" :: waited 0.032s {{(pid=84538) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 19:04:18 devstack cinder-volume[84538]: DEBUG oslo.privsep.daemon [-] privsep: reply[82febe94-a4e2-4da7-846f-92627d0a63f0]: (4, 'qcow2') {{(pid=85803) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 19:04:18 devstack cinder-volume[84538]: DEBUG oslo_concurrency.processutils [None req-093ef90a-762f-4f7c-8442-c46a5bee1eae tempest-VolumesSnapshotTestJSON-1345007867 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-931fd71e-c4de-486c-b345-507d333d6cae {{(pid=84538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 19:04:18 devstack sudo[91766]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-931fd71e-c4de-486c-b345-507d333d6cae Apr 29 19:04:18 devstack sudo[91766]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 19:04:18 devstack sudo[91763]: pam_unix(sudo:session): session closed for user root Apr 29 19:04:18 devstack cinder-volume[84538]: DEBUG oslo_concurrency.processutils [None req-ce1579a2-bed4-45eb-b6ed-9187e5e886b8 tempest-VolumesActionsTest-1839563461 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-c66b0dde-dec4-44cc-b0fe-7b7f63fa3d6a" returned: 0 in 0.814s {{(pid=84538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 19:04:18 devstack cinder-volume[84538]: DEBUG oslo_concurrency.processutils [None req-ce1579a2-bed4-45eb-b6ed-9187e5e886b8 tempest-VolumesActionsTest-1839563461 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-c66b0dde-dec4-44cc-b0fe-7b7f63fa3d6a /opt/stack/data/cinder/conversion/c66b0dde-dec4-44cc-b0fe-7b7f63fa3d6a.temp_image.74d595d7-fda8-47e0-8358-bb17480705a242vt95es.img {{(pid=84538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 19:04:18 devstack sudo[91772]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-c66b0dde-dec4-44cc-b0fe-7b7f63fa3d6a /opt/stack/data/cinder/conversion/c66b0dde-dec4-44cc-b0fe-7b7f63fa3d6a.temp_image.74d595d7-fda8-47e0-8358-bb17480705a242vt95es.img Apr 29 19:04:18 devstack sudo[91772]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 19:04:19 devstack sudo[91766]: pam_unix(sudo:session): session closed for user root Apr 29 19:04:19 devstack cinder-volume[84538]: DEBUG oslo_concurrency.processutils [None req-093ef90a-762f-4f7c-8442-c46a5bee1eae tempest-VolumesSnapshotTestJSON-1345007867 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-931fd71e-c4de-486c-b345-507d333d6cae" returned: 0 in 0.766s {{(pid=84538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 19:04:19 devstack cinder-volume[84538]: DEBUG oslo_concurrency.processutils [None req-093ef90a-762f-4f7c-8442-c46a5bee1eae tempest-VolumesSnapshotTestJSON-1345007867 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-931fd71e-c4de-486c-b345-507d333d6cae {{(pid=84538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 19:04:19 devstack sudo[91777]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-931fd71e-c4de-486c-b345-507d333d6cae Apr 29 19:04:19 devstack sudo[91777]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 19:04:19 devstack sudo[91777]: pam_unix(sudo:session): session closed for user root Apr 29 19:04:19 devstack cinder-volume[84538]: DEBUG oslo_concurrency.processutils [None req-093ef90a-762f-4f7c-8442-c46a5bee1eae tempest-VolumesSnapshotTestJSON-1345007867 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-931fd71e-c4de-486c-b345-507d333d6cae" returned: 0 in 0.736s {{(pid=84538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 19:04:19 devstack cinder-volume[84538]: DEBUG cinder.coordination [None req-093ef90a-762f-4f7c-8442-c46a5bee1eae tempest-VolumesSnapshotTestJSON-1345007867 None] Lock "cinder-quobyte-931fd71e-c4de-486c-b345-507d333d6cae" released by "delete_volume" :: held 1.598s {{(pid=84538) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 19:04:20 devstack cinder-volume[84538]: DEBUG cinder.quota [None req-093ef90a-762f-4f7c-8442-c46a5bee1eae tempest-VolumesSnapshotTestJSON-1345007867 None] Created reservations ['b617794c-5538-4309-891c-4b41eae87c7d', '6f868270-19d1-4d3b-be72-d0d13ddafe96', 'a8a1e22b-08cd-49b0-b1fa-6db9f489ec38', '7cdcb0b5-70fa-406f-9bc8-092dfdc80015'] {{(pid=84538) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 29 19:04:20 devstack cinder-volume[84538]: DEBUG oslo_concurrency.lockutils [None req-093ef90a-762f-4f7c-8442-c46a5bee1eae tempest-VolumesSnapshotTestJSON-1345007867 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 19:04:20 devstack cinder-volume[84538]: DEBUG oslo_concurrency.lockutils [None req-093ef90a-762f-4f7c-8442-c46a5bee1eae tempest-VolumesSnapshotTestJSON-1345007867 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 19:04:20 devstack cinder-volume[84538]: DEBUG cinder.volume.drivers.quobyte [None req-093ef90a-762f-4f7c-8442-c46a5bee1eae tempest-VolumesSnapshotTestJSON-1345007867 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-34312b00-dd6d-45bb-af98-75855cea8e48': None} {{(pid=84538) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 19:04:20 devstack cinder-volume[84538]: DEBUG cinder.volume.drivers.quobyte [None req-093ef90a-762f-4f7c-8442-c46a5bee1eae tempest-VolumesSnapshotTestJSON-1345007867 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-34312b00-dd6d-45bb-af98-75855cea8e48'] {{(pid=84538) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 19:04:20 devstack cinder-volume[84538]: DEBUG oslo_concurrency.lockutils [None req-093ef90a-762f-4f7c-8442-c46a5bee1eae tempest-VolumesSnapshotTestJSON-1345007867 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=84538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 19:04:20 devstack cinder-volume[84538]: DEBUG oslo_concurrency.processutils [None req-093ef90a-762f-4f7c-8442-c46a5bee1eae tempest-VolumesSnapshotTestJSON-1345007867 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d {{(pid=84538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 19:04:20 devstack sudo[91790]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d Apr 29 19:04:20 devstack sudo[91790]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 19:04:20 devstack cinder-volume[84538]: DEBUG cinder.coordination [None req-d3260f59-7ef0-461f-83c6-97b638ed6dc4 tempest-VolumesSnapshotTestJSON-1345007867 None] Acquiring lock "cinder-1323141a-218a-4b4d-81f8-5f7f8d53e83c-delete_snapshot" by "delete_snapshot" {{(pid=84538) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 19:04:20 devstack cinder-volume[84538]: DEBUG cinder.coordination [None req-d3260f59-7ef0-461f-83c6-97b638ed6dc4 tempest-VolumesSnapshotTestJSON-1345007867 None] Lock "cinder-1323141a-218a-4b4d-81f8-5f7f8d53e83c-delete_snapshot" acquired by "delete_snapshot" :: waited 0.030s {{(pid=84538) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 19:04:20 devstack cinder-volume[84538]: DEBUG cinder.coordination [None req-d3260f59-7ef0-461f-83c6-97b638ed6dc4 tempest-VolumesSnapshotTestJSON-1345007867 None] Acquiring lock "cinder-quobyte-e72a11b7-a7b1-4fb8-8fb5-76ae1df74693" by "delete_snapshot" {{(pid=84538) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 19:04:20 devstack cinder-volume[84538]: DEBUG cinder.coordination [None req-d3260f59-7ef0-461f-83c6-97b638ed6dc4 tempest-VolumesSnapshotTestJSON-1345007867 None] Lock "cinder-quobyte-e72a11b7-a7b1-4fb8-8fb5-76ae1df74693" acquired by "delete_snapshot" :: waited 0.026s {{(pid=84538) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 19:04:20 devstack cinder-volume[84538]: DEBUG cinder.coordination [None req-d3260f59-7ef0-461f-83c6-97b638ed6dc4 tempest-VolumesSnapshotTestJSON-1345007867 None] Acquiring lock "cinder-quobyte-1323141a-218a-4b4d-81f8-5f7f8d53e83c" by "_delete_snapshot" {{(pid=84538) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 19:04:20 devstack cinder-volume[84538]: DEBUG cinder.coordination [None req-d3260f59-7ef0-461f-83c6-97b638ed6dc4 tempest-VolumesSnapshotTestJSON-1345007867 None] Lock "cinder-quobyte-1323141a-218a-4b4d-81f8-5f7f8d53e83c" acquired by "_delete_snapshot" :: waited 0.032s {{(pid=84538) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 19:04:20 devstack cinder-volume[84538]: DEBUG cinder.volume.drivers.remotefs [None req-d3260f59-7ef0-461f-83c6-97b638ed6dc4 tempest-VolumesSnapshotTestJSON-1345007867 None] Deleting offline snapshot 1323141a-218a-4b4d-81f8-5f7f8d53e83c of volume e72a11b7-a7b1-4fb8-8fb5-76ae1df74693 {{(pid=84538) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 29 19:04:20 devstack cinder-volume[84538]: DEBUG cinder.volume.drivers.remotefs [None req-d3260f59-7ef0-461f-83c6-97b638ed6dc4 tempest-VolumesSnapshotTestJSON-1345007867 None] snapshot_file for this snap is: volume-e72a11b7-a7b1-4fb8-8fb5-76ae1df74693.1323141a-218a-4b4d-81f8-5f7f8d53e83c {{(pid=84538) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 29 19:04:20 devstack cinder-volume[84538]: DEBUG oslo.privsep.daemon [-] privsep: reply[bfebe679-bb2e-4c79-a1ee-fa68724fb913]: (4, 'qcow2') {{(pid=85803) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 19:04:20 devstack cinder-volume[84538]: DEBUG oslo_concurrency.processutils [None req-d3260f59-7ef0-461f-83c6-97b638ed6dc4 tempest-VolumesSnapshotTestJSON-1345007867 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-e72a11b7-a7b1-4fb8-8fb5-76ae1df74693.1323141a-218a-4b4d-81f8-5f7f8d53e83c {{(pid=84538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 19:04:21 devstack sudo[91792]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-e72a11b7-a7b1-4fb8-8fb5-76ae1df74693.1323141a-218a-4b4d-81f8-5f7f8d53e83c Apr 29 19:04:21 devstack sudo[91792]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 19:04:21 devstack sudo[91790]: pam_unix(sudo:session): session closed for user root Apr 29 19:04:21 devstack cinder-volume[84538]: DEBUG oslo_concurrency.processutils [None req-093ef90a-762f-4f7c-8442-c46a5bee1eae tempest-VolumesSnapshotTestJSON-1345007867 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d" returned: 0 in 1.340s {{(pid=84538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 19:04:21 devstack cinder-volume[84538]: DEBUG cinder.manager [None req-093ef90a-762f-4f7c-8442-c46a5bee1eae tempest-VolumesSnapshotTestJSON-1345007867 None] Notifying Schedulers of capabilities ... {{(pid=84538) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 29 19:04:21 devstack cinder-volume[84538]: INFO cinder.volume.manager [None req-093ef90a-762f-4f7c-8442-c46a5bee1eae tempest-VolumesSnapshotTestJSON-1345007867 None] Deleted volume successfully. Apr 29 19:04:21 devstack cinder-volume[84538]: DEBUG cinder.coordination [None req-093ef90a-762f-4f7c-8442-c46a5bee1eae tempest-VolumesSnapshotTestJSON-1345007867 None] Lock "cinder-931fd71e-c4de-486c-b345-507d333d6cae-delete_volume" released by "delete_volume" :: held 3.439s {{(pid=84538) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 19:04:22 devstack sudo[91792]: pam_unix(sudo:session): session closed for user root Apr 29 19:04:22 devstack cinder-volume[84538]: DEBUG oslo_concurrency.processutils [None req-d3260f59-7ef0-461f-83c6-97b638ed6dc4 tempest-VolumesSnapshotTestJSON-1345007867 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-e72a11b7-a7b1-4fb8-8fb5-76ae1df74693.1323141a-218a-4b4d-81f8-5f7f8d53e83c" returned: 0 in 1.812s {{(pid=84538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 19:04:22 devstack cinder-volume[84538]: DEBUG cinder.volume.drivers.remotefs [None req-d3260f59-7ef0-461f-83c6-97b638ed6dc4 tempest-VolumesSnapshotTestJSON-1345007867 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-e72a11b7-a7b1-4fb8-8fb5-76ae1df74693(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=84538) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 29 19:04:22 devstack cinder-volume[84538]: DEBUG oslo.privsep.daemon [-] privsep: reply[78afca38-ad71-4b2b-a2bc-690ccd807c7d]: (4, 'qcow2') {{(pid=85803) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 19:04:22 devstack cinder-volume[84538]: DEBUG oslo_concurrency.processutils [None req-d3260f59-7ef0-461f-83c6-97b638ed6dc4 tempest-VolumesSnapshotTestJSON-1345007867 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-e72a11b7-a7b1-4fb8-8fb5-76ae1df74693 {{(pid=84538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 19:04:23 devstack sudo[91799]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-e72a11b7-a7b1-4fb8-8fb5-76ae1df74693 Apr 29 19:04:23 devstack sudo[91799]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 19:04:24 devstack sudo[91799]: pam_unix(sudo:session): session closed for user root Apr 29 19:04:24 devstack cinder-volume[84538]: DEBUG oslo_concurrency.processutils [None req-d3260f59-7ef0-461f-83c6-97b638ed6dc4 tempest-VolumesSnapshotTestJSON-1345007867 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-e72a11b7-a7b1-4fb8-8fb5-76ae1df74693" returned: 0 in 1.738s {{(pid=84538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 19:04:24 devstack cinder-volume[84538]: DEBUG oslo_concurrency.processutils [None req-d3260f59-7ef0-461f-83c6-97b638ed6dc4 tempest-VolumesSnapshotTestJSON-1345007867 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-e72a11b7-a7b1-4fb8-8fb5-76ae1df74693.1323141a-218a-4b4d-81f8-5f7f8d53e83c {{(pid=84538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 19:04:24 devstack sudo[91804]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-e72a11b7-a7b1-4fb8-8fb5-76ae1df74693.1323141a-218a-4b4d-81f8-5f7f8d53e83c Apr 29 19:04:24 devstack sudo[91804]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 19:04:24 devstack sudo[91772]: pam_unix(sudo:session): session closed for user root Apr 29 19:04:24 devstack cinder-volume[84538]: DEBUG oslo_concurrency.processutils [None req-ce1579a2-bed4-45eb-b6ed-9187e5e886b8 tempest-VolumesActionsTest-1839563461 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-c66b0dde-dec4-44cc-b0fe-7b7f63fa3d6a /opt/stack/data/cinder/conversion/c66b0dde-dec4-44cc-b0fe-7b7f63fa3d6a.temp_image.74d595d7-fda8-47e0-8358-bb17480705a242vt95es.img" returned: 0 in 5.625s {{(pid=84538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 19:04:24 devstack cinder-volume[84538]: DEBUG oslo.privsep.daemon [-] privsep: reply[845f9b32-3863-4150-9ab8-606a7b1f41f0]: (4, 'qcow2') {{(pid=85803) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 19:04:24 devstack cinder-volume[84538]: DEBUG oslo_concurrency.processutils [None req-ce1579a2-bed4-45eb-b6ed-9187e5e886b8 tempest-VolumesActionsTest-1839563461 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-c66b0dde-dec4-44cc-b0fe-7b7f63fa3d6a {{(pid=84538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 19:04:24 devstack sudo[91806]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-c66b0dde-dec4-44cc-b0fe-7b7f63fa3d6a Apr 29 19:04:24 devstack sudo[91806]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 19:04:25 devstack cinder-volume[84538]: DEBUG oslo_service.periodic_task [None req-a93183a6-1080-461c-84de-2fcb210d4f60 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=84538) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}} Apr 29 19:04:25 devstack cinder-volume[84538]: DEBUG oslo_concurrency.lockutils [None req-a93183a6-1080-461c-84de-2fcb210d4f60 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 19:04:25 devstack cinder-volume[84538]: DEBUG oslo_concurrency.lockutils [None req-a93183a6-1080-461c-84de-2fcb210d4f60 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=84538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 19:04:25 devstack cinder-volume[84538]: DEBUG cinder.volume.drivers.quobyte [None req-a93183a6-1080-461c-84de-2fcb210d4f60 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-34312b00-dd6d-45bb-af98-75855cea8e48': None} {{(pid=84538) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 19:04:25 devstack cinder-volume[84538]: DEBUG cinder.volume.drivers.quobyte [None req-a93183a6-1080-461c-84de-2fcb210d4f60 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-34312b00-dd6d-45bb-af98-75855cea8e48'] {{(pid=84538) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 19:04:25 devstack cinder-volume[84538]: DEBUG oslo_concurrency.lockutils [None req-a93183a6-1080-461c-84de-2fcb210d4f60 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=84538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 19:04:25 devstack cinder-volume[84538]: DEBUG oslo_concurrency.processutils [None req-a93183a6-1080-461c-84de-2fcb210d4f60 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d {{(pid=84538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 19:04:25 devstack sudo[91804]: pam_unix(sudo:session): session closed for user root Apr 29 19:04:25 devstack cinder-volume[84538]: DEBUG oslo_concurrency.processutils [None req-d3260f59-7ef0-461f-83c6-97b638ed6dc4 tempest-VolumesSnapshotTestJSON-1345007867 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-e72a11b7-a7b1-4fb8-8fb5-76ae1df74693.1323141a-218a-4b4d-81f8-5f7f8d53e83c" returned: 0 in 0.712s {{(pid=84538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 19:04:25 devstack sudo[91812]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d Apr 29 19:04:25 devstack sudo[91812]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 19:04:25 devstack cinder-volume[84538]: DEBUG oslo_concurrency.processutils [None req-d3260f59-7ef0-461f-83c6-97b638ed6dc4 tempest-VolumesSnapshotTestJSON-1345007867 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-e72a11b7-a7b1-4fb8-8fb5-76ae1df74693.1323141a-218a-4b4d-81f8-5f7f8d53e83c {{(pid=84538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 19:04:25 devstack sudo[91816]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-e72a11b7-a7b1-4fb8-8fb5-76ae1df74693.1323141a-218a-4b4d-81f8-5f7f8d53e83c Apr 29 19:04:25 devstack sudo[91816]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 19:04:25 devstack sudo[91806]: pam_unix(sudo:session): session closed for user root Apr 29 19:04:25 devstack cinder-volume[84538]: DEBUG oslo_concurrency.processutils [None req-ce1579a2-bed4-45eb-b6ed-9187e5e886b8 tempest-VolumesActionsTest-1839563461 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-c66b0dde-dec4-44cc-b0fe-7b7f63fa3d6a" returned: 0 in 0.973s {{(pid=84538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 19:04:25 devstack cinder-volume[84538]: DEBUG cinder.image.image_utils [None req-ce1579a2-bed4-45eb-b6ed-9187e5e886b8 tempest-VolumesActionsTest-1839563461 None] Image conversion details: src /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-c66b0dde-dec4-44cc-b0fe-7b7f63fa3d6a, size 1024.00 MB, duration 5.63 sec, destination /opt/stack/data/cinder/conversion/c66b0dde-dec4-44cc-b0fe-7b7f63fa3d6a.temp_image.74d595d7-fda8-47e0-8358-bb17480705a242vt95es.img {{(pid=84538) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}} Apr 29 19:04:25 devstack cinder-volume[84538]: INFO cinder.image.image_utils [None req-ce1579a2-bed4-45eb-b6ed-9187e5e886b8 tempest-VolumesActionsTest-1839563461 None] Converted 1024.00 MB image at 181.99 MB/s Apr 29 19:04:25 devstack cinder-volume[84538]: DEBUG cinder.image.image_utils [None req-ce1579a2-bed4-45eb-b6ed-9187e5e886b8 tempest-VolumesActionsTest-1839563461 None] 74d595d7-fda8-47e0-8358-bb17480705a2 was raw, no need to convert to raw {{(pid=84538) upload_volume /opt/stack/cinder/cinder/image/image_utils.py:1159}} Apr 29 19:04:25 devstack sudo[91812]: pam_unix(sudo:session): session closed for user root Apr 29 19:04:25 devstack cinder-volume[84538]: DEBUG oslo_concurrency.processutils [None req-a93183a6-1080-461c-84de-2fcb210d4f60 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d" returned: 0 in 0.744s {{(pid=84538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 19:04:25 devstack cinder-volume[84538]: DEBUG cinder.manager [None req-a93183a6-1080-461c-84de-2fcb210d4f60 None None] Notifying Schedulers of capabilities ... {{(pid=84538) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 29 19:04:25 devstack sudo[91816]: pam_unix(sudo:session): session closed for user root Apr 29 19:04:25 devstack cinder-volume[84538]: DEBUG oslo_concurrency.processutils [None req-d3260f59-7ef0-461f-83c6-97b638ed6dc4 tempest-VolumesSnapshotTestJSON-1345007867 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-e72a11b7-a7b1-4fb8-8fb5-76ae1df74693.1323141a-218a-4b4d-81f8-5f7f8d53e83c" returned: 0 in 0.753s {{(pid=84538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 19:04:25 devstack cinder-volume[84538]: DEBUG cinder.coordination [None req-d3260f59-7ef0-461f-83c6-97b638ed6dc4 tempest-VolumesSnapshotTestJSON-1345007867 None] Lock "cinder-quobyte-1323141a-218a-4b4d-81f8-5f7f8d53e83c" released by "_delete_snapshot" :: held 5.211s {{(pid=84538) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 19:04:25 devstack cinder-volume[84538]: DEBUG cinder.coordination [None req-d3260f59-7ef0-461f-83c6-97b638ed6dc4 tempest-VolumesSnapshotTestJSON-1345007867 None] Lock "cinder-quobyte-e72a11b7-a7b1-4fb8-8fb5-76ae1df74693" released by "delete_snapshot" :: held 5.253s {{(pid=84538) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 19:04:26 devstack cinder-volume[84538]: DEBUG cinder.quota [None req-d3260f59-7ef0-461f-83c6-97b638ed6dc4 tempest-VolumesSnapshotTestJSON-1345007867 None] Created reservations ['fff2e157-48a6-4b38-9cea-153f03f51ae4', '6f28d2fd-6d09-48b2-b276-b3d90e89761e', 'd7561028-dcb8-4439-bfbc-c51d1ef7e641', 'd08b7770-855b-43c6-89ab-b71383f2410d'] {{(pid=84538) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 29 19:04:26 devstack cinder-volume[84538]: INFO cinder.volume.manager [None req-d3260f59-7ef0-461f-83c6-97b638ed6dc4 tempest-VolumesSnapshotTestJSON-1345007867 None] Delete snapshot completed successfully. Apr 29 19:04:26 devstack cinder-volume[84538]: DEBUG cinder.coordination [None req-d3260f59-7ef0-461f-83c6-97b638ed6dc4 tempest-VolumesSnapshotTestJSON-1345007867 None] Lock "cinder-1323141a-218a-4b4d-81f8-5f7f8d53e83c-delete_snapshot" released by "delete_snapshot" :: held 5.431s {{(pid=84538) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 19:04:27 devstack cinder-volume[84538]: DEBUG cinder.coordination [None req-bf41cfcf-4e86-448e-bf68-bc89af57dba2 tempest-VolumesSnapshotTestJSON-1345007867 None] Acquiring lock "cinder-e72a11b7-a7b1-4fb8-8fb5-76ae1df74693-delete_volume" by "delete_volume" {{(pid=84538) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 19:04:27 devstack cinder-volume[84538]: DEBUG cinder.coordination [None req-bf41cfcf-4e86-448e-bf68-bc89af57dba2 tempest-VolumesSnapshotTestJSON-1345007867 None] Lock "cinder-e72a11b7-a7b1-4fb8-8fb5-76ae1df74693-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=84538) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 19:04:27 devstack cinder-volume[84538]: DEBUG cinder.coordination [None req-bf41cfcf-4e86-448e-bf68-bc89af57dba2 tempest-VolumesSnapshotTestJSON-1345007867 None] Acquiring lock "cinder-quobyte-e72a11b7-a7b1-4fb8-8fb5-76ae1df74693" by "delete_volume" {{(pid=84538) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 19:04:27 devstack cinder-volume[84538]: DEBUG cinder.coordination [None req-bf41cfcf-4e86-448e-bf68-bc89af57dba2 tempest-VolumesSnapshotTestJSON-1345007867 None] Lock "cinder-quobyte-e72a11b7-a7b1-4fb8-8fb5-76ae1df74693" acquired by "delete_volume" :: waited 0.039s {{(pid=84538) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 19:04:27 devstack cinder-volume[84538]: DEBUG oslo.privsep.daemon [-] privsep: reply[d1e361e2-002c-473b-b9f6-926b041db9e1]: (4, 'qcow2') {{(pid=85803) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 19:04:27 devstack cinder-volume[84538]: DEBUG oslo_concurrency.processutils [None req-bf41cfcf-4e86-448e-bf68-bc89af57dba2 tempest-VolumesSnapshotTestJSON-1345007867 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-e72a11b7-a7b1-4fb8-8fb5-76ae1df74693 {{(pid=84538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 19:04:27 devstack sudo[91822]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-e72a11b7-a7b1-4fb8-8fb5-76ae1df74693 Apr 29 19:04:27 devstack sudo[91822]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 19:04:28 devstack sudo[91822]: pam_unix(sudo:session): session closed for user root Apr 29 19:04:28 devstack cinder-volume[84538]: DEBUG oslo_concurrency.processutils [None req-bf41cfcf-4e86-448e-bf68-bc89af57dba2 tempest-VolumesSnapshotTestJSON-1345007867 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-e72a11b7-a7b1-4fb8-8fb5-76ae1df74693" returned: 0 in 0.898s {{(pid=84538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 19:04:28 devstack cinder-volume[84538]: DEBUG oslo_concurrency.processutils [None req-bf41cfcf-4e86-448e-bf68-bc89af57dba2 tempest-VolumesSnapshotTestJSON-1345007867 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-e72a11b7-a7b1-4fb8-8fb5-76ae1df74693 {{(pid=84538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 19:04:28 devstack sudo[91830]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-e72a11b7-a7b1-4fb8-8fb5-76ae1df74693 Apr 29 19:04:28 devstack sudo[91830]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 19:04:29 devstack sudo[91830]: pam_unix(sudo:session): session closed for user root Apr 29 19:04:29 devstack cinder-volume[84538]: DEBUG oslo_concurrency.processutils [None req-bf41cfcf-4e86-448e-bf68-bc89af57dba2 tempest-VolumesSnapshotTestJSON-1345007867 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-e72a11b7-a7b1-4fb8-8fb5-76ae1df74693" returned: 0 in 0.734s {{(pid=84538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 19:04:29 devstack cinder-volume[84538]: DEBUG cinder.coordination [None req-bf41cfcf-4e86-448e-bf68-bc89af57dba2 tempest-VolumesSnapshotTestJSON-1345007867 None] Lock "cinder-quobyte-e72a11b7-a7b1-4fb8-8fb5-76ae1df74693" released by "delete_volume" :: held 1.725s {{(pid=84538) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 19:04:29 devstack cinder-volume[84538]: DEBUG cinder.quota [None req-bf41cfcf-4e86-448e-bf68-bc89af57dba2 tempest-VolumesSnapshotTestJSON-1345007867 None] Created reservations ['dcffd779-b2bb-4cdc-863a-e4a6e1158516', 'b96ac407-ef1f-4adc-9a12-9f67effb5e48', '4982eb13-c9ae-47db-9918-bd92924dc028', '24633cc7-ad4e-46bd-8071-f50e0961ce1d'] {{(pid=84538) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 29 19:04:29 devstack cinder-volume[84538]: DEBUG oslo_concurrency.lockutils [None req-bf41cfcf-4e86-448e-bf68-bc89af57dba2 tempest-VolumesSnapshotTestJSON-1345007867 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 19:04:29 devstack cinder-volume[84538]: DEBUG oslo_concurrency.lockutils [None req-bf41cfcf-4e86-448e-bf68-bc89af57dba2 tempest-VolumesSnapshotTestJSON-1345007867 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 19:04:29 devstack cinder-volume[84538]: DEBUG cinder.volume.drivers.quobyte [None req-bf41cfcf-4e86-448e-bf68-bc89af57dba2 tempest-VolumesSnapshotTestJSON-1345007867 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-34312b00-dd6d-45bb-af98-75855cea8e48': None} {{(pid=84538) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 19:04:29 devstack cinder-volume[84538]: DEBUG cinder.volume.drivers.quobyte [None req-bf41cfcf-4e86-448e-bf68-bc89af57dba2 tempest-VolumesSnapshotTestJSON-1345007867 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-34312b00-dd6d-45bb-af98-75855cea8e48'] {{(pid=84538) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 19:04:29 devstack cinder-volume[84538]: DEBUG oslo_concurrency.lockutils [None req-bf41cfcf-4e86-448e-bf68-bc89af57dba2 tempest-VolumesSnapshotTestJSON-1345007867 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=84538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 19:04:29 devstack cinder-volume[84538]: DEBUG oslo_concurrency.processutils [None req-bf41cfcf-4e86-448e-bf68-bc89af57dba2 tempest-VolumesSnapshotTestJSON-1345007867 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d {{(pid=84538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 19:04:29 devstack sudo[91833]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d Apr 29 19:04:29 devstack sudo[91833]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 19:04:30 devstack sudo[91833]: pam_unix(sudo:session): session closed for user root Apr 29 19:04:30 devstack cinder-volume[84538]: DEBUG oslo_concurrency.processutils [None req-bf41cfcf-4e86-448e-bf68-bc89af57dba2 tempest-VolumesSnapshotTestJSON-1345007867 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d" returned: 0 in 0.968s {{(pid=84538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 19:04:30 devstack cinder-volume[84538]: DEBUG cinder.manager [None req-bf41cfcf-4e86-448e-bf68-bc89af57dba2 tempest-VolumesSnapshotTestJSON-1345007867 None] Notifying Schedulers of capabilities ... {{(pid=84538) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 29 19:04:30 devstack cinder-volume[84538]: INFO cinder.volume.manager [None req-bf41cfcf-4e86-448e-bf68-bc89af57dba2 tempest-VolumesSnapshotTestJSON-1345007867 None] Deleted volume successfully. Apr 29 19:04:30 devstack cinder-volume[84538]: DEBUG cinder.coordination [None req-bf41cfcf-4e86-448e-bf68-bc89af57dba2 tempest-VolumesSnapshotTestJSON-1345007867 None] Lock "cinder-e72a11b7-a7b1-4fb8-8fb5-76ae1df74693-delete_volume" released by "delete_volume" :: held 3.059s {{(pid=84538) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 19:04:30 devstack cinder-volume[84538]: DEBUG cinder.volume.flows.manager.create_volume [None req-046af1f7-b1fa-437a-a6cc-804f03e46ef6 tempest-VolumesSnapshotTestJSON-1345007867 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84538) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Apr 29 19:04:30 devstack cinder-volume[84538]: DEBUG cinder.volume.manager [None req-046af1f7-b1fa-437a-a6cc-804f03e46ef6 tempest-VolumesSnapshotTestJSON-1345007867 None] Flow 'volume_create_manager' (abb6d996-d9e1-4e3e-85f3-c4e98e99893d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84538) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 19:04:30 devstack cinder-volume[84538]: DEBUG cinder.volume.manager [None req-046af1f7-b1fa-437a-a6cc-804f03e46ef6 tempest-VolumesSnapshotTestJSON-1345007867 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1fb6d2bf-7e49-42bc-8c22-434099349783) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 19:04:30 devstack cinder-volume[84538]: DEBUG cinder.volume.manager [None req-046af1f7-b1fa-437a-a6cc-804f03e46ef6 tempest-VolumesSnapshotTestJSON-1345007867 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1fb6d2bf-7e49-42bc-8c22-434099349783) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-29T17:04:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-965883433',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8ffdf26a-b64d-43d0-8e13-5805979ca936,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cb1bf99b4f1a451dbdf762aff4ec180c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T17:04:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T17:04:30Z,use_quota=True,user_id='987ad9d695504aeba3196f9a11cdf3cf',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(62b05900-93e3-4190-a88f-1d87324303d1),volume_type_id=62b05900-93e3-4190-a88f-1d87324303d1)' {{(pid=84538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 19:04:30 devstack cinder-volume[84538]: DEBUG cinder.volume.manager [None req-046af1f7-b1fa-437a-a6cc-804f03e46ef6 tempest-VolumesSnapshotTestJSON-1345007867 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b3fe7553-2a62-4189-9bbd-7292984f6191) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 19:04:30 devstack cinder-volume[84538]: DEBUG cinder.volume.manager [None req-046af1f7-b1fa-437a-a6cc-804f03e46ef6 tempest-VolumesSnapshotTestJSON-1345007867 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b3fe7553-2a62-4189-9bbd-7292984f6191) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 19:04:30 devstack cinder-volume[84538]: DEBUG cinder.volume.manager [None req-046af1f7-b1fa-437a-a6cc-804f03e46ef6 tempest-VolumesSnapshotTestJSON-1345007867 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e0dd13fd-c2ee-4ffe-b06c-f90ca00e857e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 19:04:30 devstack cinder-volume[84538]: DEBUG cinder.volume.manager [None req-046af1f7-b1fa-437a-a6cc-804f03e46ef6 tempest-VolumesSnapshotTestJSON-1345007867 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e0dd13fd-c2ee-4ffe-b06c-f90ca00e857e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8ffdf26a-b64d-43d0-8e13-5805979ca936', 'volume_name': 'volume-8ffdf26a-b64d-43d0-8e13-5805979ca936', 'volume_size': 1}' {{(pid=84538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 19:04:30 devstack cinder-volume[84538]: DEBUG cinder.volume.manager [None req-046af1f7-b1fa-437a-a6cc-804f03e46ef6 tempest-VolumesSnapshotTestJSON-1345007867 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (158478a5-e7e0-4c26-a619-cd9d49f72d53) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 19:04:30 devstack cinder-volume[84538]: DEBUG cinder.volume.manager [None req-046af1f7-b1fa-437a-a6cc-804f03e46ef6 tempest-VolumesSnapshotTestJSON-1345007867 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (158478a5-e7e0-4c26-a619-cd9d49f72d53) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 19:04:30 devstack cinder-volume[84538]: DEBUG cinder.volume.manager [None req-046af1f7-b1fa-437a-a6cc-804f03e46ef6 tempest-VolumesSnapshotTestJSON-1345007867 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4341a5b9-031d-407d-9b35-94dab495ea22) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 19:04:30 devstack cinder-volume[84538]: INFO cinder.volume.flows.manager.create_volume [None req-046af1f7-b1fa-437a-a6cc-804f03e46ef6 tempest-VolumesSnapshotTestJSON-1345007867 None] Volume 8ffdf26a-b64d-43d0-8e13-5805979ca936: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8ffdf26a-b64d-43d0-8e13-5805979ca936', 'volume_size': 1} Apr 29 19:04:30 devstack cinder-volume[84538]: DEBUG oslo_concurrency.lockutils [None req-046af1f7-b1fa-437a-a6cc-804f03e46ef6 tempest-VolumesSnapshotTestJSON-1345007867 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 19:04:30 devstack cinder-volume[84538]: DEBUG cinder.coordination [None req-399dc4b9-920e-451d-9815-e1915bfb8b80 tempest-VolumesNegativeTest-977478995 None] Acquiring lock "cinder-91c56b82-361f-4d22-a978-1b0e33f6688c-delete_volume" by "delete_volume" {{(pid=84538) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 19:04:30 devstack cinder-volume[84538]: DEBUG cinder.coordination [None req-399dc4b9-920e-451d-9815-e1915bfb8b80 tempest-VolumesNegativeTest-977478995 None] Lock "cinder-91c56b82-361f-4d22-a978-1b0e33f6688c-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=84538) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 19:04:30 devstack cinder-volume[84538]: DEBUG cinder.coordination [None req-399dc4b9-920e-451d-9815-e1915bfb8b80 tempest-VolumesNegativeTest-977478995 None] Acquiring lock "cinder-quobyte-91c56b82-361f-4d22-a978-1b0e33f6688c" by "delete_volume" {{(pid=84538) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 19:04:30 devstack cinder-volume[84538]: DEBUG cinder.coordination [None req-399dc4b9-920e-451d-9815-e1915bfb8b80 tempest-VolumesNegativeTest-977478995 None] Lock "cinder-quobyte-91c56b82-361f-4d22-a978-1b0e33f6688c" acquired by "delete_volume" :: waited 0.027s {{(pid=84538) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 19:04:30 devstack cinder-volume[84538]: DEBUG oslo.privsep.daemon [-] privsep: reply[ea32b807-c9cb-4a32-a659-3d89e0494a68]: (4, 'qcow2') {{(pid=85803) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 19:04:30 devstack cinder-volume[84538]: DEBUG oslo_concurrency.processutils [None req-399dc4b9-920e-451d-9815-e1915bfb8b80 tempest-VolumesNegativeTest-977478995 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-91c56b82-361f-4d22-a978-1b0e33f6688c {{(pid=84538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 19:04:30 devstack sudo[91836]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-91c56b82-361f-4d22-a978-1b0e33f6688c Apr 29 19:04:30 devstack sudo[91836]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 19:04:31 devstack sudo[91836]: pam_unix(sudo:session): session closed for user root Apr 29 19:04:31 devstack cinder-volume[84538]: DEBUG oslo_concurrency.processutils [None req-399dc4b9-920e-451d-9815-e1915bfb8b80 tempest-VolumesNegativeTest-977478995 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-91c56b82-361f-4d22-a978-1b0e33f6688c" returned: 0 in 0.761s {{(pid=84538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 19:04:31 devstack cinder-volume[84538]: DEBUG oslo_concurrency.processutils [None req-399dc4b9-920e-451d-9815-e1915bfb8b80 tempest-VolumesNegativeTest-977478995 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-91c56b82-361f-4d22-a978-1b0e33f6688c {{(pid=84538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 19:04:31 devstack sudo[91841]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-91c56b82-361f-4d22-a978-1b0e33f6688c Apr 29 19:04:31 devstack sudo[91841]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 19:04:32 devstack sudo[91841]: pam_unix(sudo:session): session closed for user root Apr 29 19:04:32 devstack cinder-volume[84538]: DEBUG oslo_concurrency.processutils [None req-399dc4b9-920e-451d-9815-e1915bfb8b80 tempest-VolumesNegativeTest-977478995 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-91c56b82-361f-4d22-a978-1b0e33f6688c" returned: 0 in 0.607s {{(pid=84538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 19:04:32 devstack cinder-volume[84538]: DEBUG cinder.coordination [None req-399dc4b9-920e-451d-9815-e1915bfb8b80 tempest-VolumesNegativeTest-977478995 None] Lock "cinder-quobyte-91c56b82-361f-4d22-a978-1b0e33f6688c" released by "delete_volume" :: held 1.415s {{(pid=84538) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 19:04:32 devstack cinder-volume[84538]: DEBUG cinder.quota [None req-399dc4b9-920e-451d-9815-e1915bfb8b80 tempest-VolumesNegativeTest-977478995 None] Created reservations ['4d8484fc-0c99-42ac-97c7-835997e445c2', '777522b0-c589-4ff8-9c96-4029edc90615', 'e4b74538-50f2-49ad-b343-16e3f7f6b424', 'd953dd13-3898-43f5-9799-d1b174d37a15'] {{(pid=84538) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 29 19:04:32 devstack cinder-volume[84538]: DEBUG oslo_concurrency.lockutils [None req-399dc4b9-920e-451d-9815-e1915bfb8b80 tempest-VolumesNegativeTest-977478995 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 19:04:32 devstack cinder-volume[84538]: DEBUG oslo_concurrency.lockutils [None req-399dc4b9-920e-451d-9815-e1915bfb8b80 tempest-VolumesNegativeTest-977478995 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 19:04:32 devstack cinder-volume[84538]: DEBUG cinder.volume.drivers.quobyte [None req-399dc4b9-920e-451d-9815-e1915bfb8b80 tempest-VolumesNegativeTest-977478995 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-34312b00-dd6d-45bb-af98-75855cea8e48': None} {{(pid=84538) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 19:04:32 devstack cinder-volume[84538]: DEBUG cinder.volume.drivers.quobyte [None req-399dc4b9-920e-451d-9815-e1915bfb8b80 tempest-VolumesNegativeTest-977478995 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-34312b00-dd6d-45bb-af98-75855cea8e48'] {{(pid=84538) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 19:04:32 devstack cinder-volume[84538]: DEBUG oslo_concurrency.lockutils [None req-399dc4b9-920e-451d-9815-e1915bfb8b80 tempest-VolumesNegativeTest-977478995 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=84538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 19:04:32 devstack cinder-volume[84538]: DEBUG oslo_concurrency.processutils [None req-399dc4b9-920e-451d-9815-e1915bfb8b80 tempest-VolumesNegativeTest-977478995 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d {{(pid=84538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 19:04:32 devstack sudo[91844]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d Apr 29 19:04:32 devstack sudo[91844]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 19:04:32 devstack sudo[91844]: pam_unix(sudo:session): session closed for user root Apr 29 19:04:32 devstack cinder-volume[84538]: DEBUG oslo_concurrency.processutils [None req-399dc4b9-920e-451d-9815-e1915bfb8b80 tempest-VolumesNegativeTest-977478995 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d" returned: 0 in 0.667s {{(pid=84538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 19:04:32 devstack cinder-volume[84538]: DEBUG cinder.manager [None req-399dc4b9-920e-451d-9815-e1915bfb8b80 tempest-VolumesNegativeTest-977478995 None] Notifying Schedulers of capabilities ... {{(pid=84538) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 29 19:04:32 devstack cinder-volume[84538]: INFO cinder.volume.manager [None req-399dc4b9-920e-451d-9815-e1915bfb8b80 tempest-VolumesNegativeTest-977478995 None] Deleted volume successfully. Apr 29 19:04:33 devstack cinder-volume[84538]: DEBUG cinder.coordination [None req-399dc4b9-920e-451d-9815-e1915bfb8b80 tempest-VolumesNegativeTest-977478995 None] Lock "cinder-91c56b82-361f-4d22-a978-1b0e33f6688c-delete_volume" released by "delete_volume" :: held 2.377s {{(pid=84538) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 19:04:35 devstack cinder-volume[84538]: DEBUG dbcounter [-] [84538] Writing DB stats cinder:INSERT=22,cinder:SELECT=79,cinder:UPDATE=84,cinder:DELETE=10 {{(pid=84538) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Apr 29 19:04:35 devstack cinder-volume[84538]: DEBUG cinder.volume.flows.manager.create_volume [None req-475907fc-d7d5-4e13-9cae-23bcfbe4f307 tempest-CinderUnicodeTest-1144970881 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84538) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Apr 29 19:04:35 devstack cinder-volume[84538]: DEBUG cinder.volume.manager [None req-475907fc-d7d5-4e13-9cae-23bcfbe4f307 tempest-CinderUnicodeTest-1144970881 None] Flow 'volume_create_manager' (b4e17c26-f0aa-49db-ae4a-d3853d742d94) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84538) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 19:04:35 devstack cinder-volume[84538]: DEBUG cinder.volume.manager [None req-475907fc-d7d5-4e13-9cae-23bcfbe4f307 tempest-CinderUnicodeTest-1144970881 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6e7e0871-193e-4d17-857d-3523728193ab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 19:04:35 devstack cinder-volume[84538]: DEBUG cinder.volume.manager [None req-475907fc-d7d5-4e13-9cae-23bcfbe4f307 tempest-CinderUnicodeTest-1144970881 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6e7e0871-193e-4d17-857d-3523728193ab) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-29T17:04:35Z,deleted=False,deleted_at=None,display_description=None,display_name='CinderUnicodeTest塵㼗‽',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=08c63ba4-25bf-4e74-b3fc-cbd11bca14ce,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='db780ad6ce764618aa4b3861b448fe17',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T17:04:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T17:04:36Z,use_quota=True,user_id='d4c1e6e150af4dca9a679db078e1b16e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(62b05900-93e3-4190-a88f-1d87324303d1),volume_type_id=62b05900-93e3-4190-a88f-1d87324303d1)' {{(pid=84538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 19:04:35 devstack cinder-volume[84538]: DEBUG cinder.volume.manager [None req-475907fc-d7d5-4e13-9cae-23bcfbe4f307 tempest-CinderUnicodeTest-1144970881 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (aad6a343-0b3b-47da-9468-79b08c820cee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 19:04:35 devstack cinder-volume[84538]: DEBUG cinder.volume.manager [None req-475907fc-d7d5-4e13-9cae-23bcfbe4f307 tempest-CinderUnicodeTest-1144970881 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (aad6a343-0b3b-47da-9468-79b08c820cee) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 19:04:35 devstack cinder-volume[84538]: DEBUG cinder.volume.manager [None req-475907fc-d7d5-4e13-9cae-23bcfbe4f307 tempest-CinderUnicodeTest-1144970881 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9114a0fe-e041-4af5-96bb-2da740b6ae5a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 19:04:35 devstack cinder-volume[84538]: DEBUG cinder.volume.manager [None req-475907fc-d7d5-4e13-9cae-23bcfbe4f307 tempest-CinderUnicodeTest-1144970881 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9114a0fe-e041-4af5-96bb-2da740b6ae5a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '08c63ba4-25bf-4e74-b3fc-cbd11bca14ce', 'volume_name': 'volume-08c63ba4-25bf-4e74-b3fc-cbd11bca14ce', 'volume_size': 1}' {{(pid=84538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 19:04:35 devstack cinder-volume[84538]: DEBUG cinder.volume.manager [None req-475907fc-d7d5-4e13-9cae-23bcfbe4f307 tempest-CinderUnicodeTest-1144970881 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3183df95-0b78-4d09-b786-2e9fd0a5fe44) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 19:04:35 devstack cinder-volume[84538]: DEBUG cinder.volume.manager [None req-475907fc-d7d5-4e13-9cae-23bcfbe4f307 tempest-CinderUnicodeTest-1144970881 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3183df95-0b78-4d09-b786-2e9fd0a5fe44) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 19:04:35 devstack cinder-volume[84538]: DEBUG cinder.volume.manager [None req-475907fc-d7d5-4e13-9cae-23bcfbe4f307 tempest-CinderUnicodeTest-1144970881 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6075a020-3af9-4a3f-9654-4e3b04841fb4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 19:04:35 devstack cinder-volume[84538]: INFO cinder.volume.flows.manager.create_volume [None req-475907fc-d7d5-4e13-9cae-23bcfbe4f307 tempest-CinderUnicodeTest-1144970881 None] Volume 08c63ba4-25bf-4e74-b3fc-cbd11bca14ce: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-08c63ba4-25bf-4e74-b3fc-cbd11bca14ce', 'volume_size': 1} Apr 29 19:04:35 devstack cinder-volume[84538]: DEBUG oslo_concurrency.lockutils [None req-475907fc-d7d5-4e13-9cae-23bcfbe4f307 tempest-CinderUnicodeTest-1144970881 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 19:04:45 devstack cinder-volume[84538]: DEBUG dbcounter [-] [84538] Writing DB stats cinder:UPDATE=75,cinder:INSERT=18,cinder:SELECT=62,cinder:DELETE=3 {{(pid=84538) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Apr 29 19:04:45 devstack cinder-volume[84538]: DEBUG oslo_concurrency.lockutils [None req-ce1579a2-bed4-45eb-b6ed-9187e5e886b8 tempest-VolumesActionsTest-1839563461 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: held 28.697s {{(pid=84538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 19:04:45 devstack cinder-volume[84538]: DEBUG cinder.volume.manager [None req-ce1579a2-bed4-45eb-b6ed-9187e5e886b8 tempest-VolumesActionsTest-1839563461 None] Uploaded volume to glance image-id: 74d595d7-fda8-47e0-8358-bb17480705a2. {{(pid=84538) copy_volume_to_image /opt/stack/cinder/cinder/volume/manager.py:1781}} Apr 29 19:04:45 devstack cinder-volume[84538]: DEBUG oslo_concurrency.lockutils [None req-7b4dda2d-ee01-4355-895a-b453361715df tempest-VolumesListTestJSON-1695505021 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 28.939s {{(pid=84538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 19:04:45 devstack cinder-volume[84538]: DEBUG cinder.volume.drivers.quobyte [None req-7b4dda2d-ee01-4355-895a-b453361715df tempest-VolumesListTestJSON-1695505021 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-29T17:04:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-539320422',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f710366c-9c8d-4ce5-82ec-661e3abbfbd0,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='ec2a7decc4f54bab96570e941c207171',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T17:04:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T17:04:17Z,use_quota=True,user_id='d06c72522a3c4026ac17a414ac13121f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(62b05900-93e3-4190-a88f-1d87324303d1),volume_type_id=62b05900-93e3-4190-a88f-1d87324303d1)}" {{(pid=84538) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 29 19:04:45 devstack cinder-volume[84538]: DEBUG cinder.volume.drivers.remotefs [None req-7b4dda2d-ee01-4355-895a-b453361715df tempest-VolumesListTestJSON-1695505021 None] Creating volume f710366c-9c8d-4ce5-82ec-661e3abbfbd0 {{(pid=84538) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 29 19:04:45 devstack cinder-volume[84538]: DEBUG oslo_concurrency.lockutils [None req-7b4dda2d-ee01-4355-895a-b453361715df tempest-VolumesListTestJSON-1695505021 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 19:04:45 devstack cinder-volume[84538]: DEBUG oslo_concurrency.lockutils [None req-7b4dda2d-ee01-4355-895a-b453361715df tempest-VolumesListTestJSON-1695505021 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=84538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 19:04:45 devstack cinder-volume[84538]: DEBUG cinder.volume.drivers.quobyte [None req-7b4dda2d-ee01-4355-895a-b453361715df tempest-VolumesListTestJSON-1695505021 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-34312b00-dd6d-45bb-af98-75855cea8e48': None} {{(pid=84538) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 19:04:45 devstack cinder-volume[84538]: DEBUG cinder.volume.drivers.quobyte [None req-7b4dda2d-ee01-4355-895a-b453361715df tempest-VolumesListTestJSON-1695505021 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-34312b00-dd6d-45bb-af98-75855cea8e48'] {{(pid=84538) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 19:04:45 devstack cinder-volume[84538]: DEBUG oslo_concurrency.lockutils [None req-7b4dda2d-ee01-4355-895a-b453361715df tempest-VolumesListTestJSON-1695505021 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=84538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 19:04:45 devstack cinder-volume[84538]: DEBUG cinder.volume.drivers.quobyte [None req-7b4dda2d-ee01-4355-895a-b453361715df tempest-VolumesListTestJSON-1695505021 None] Selected osci02.corp.quobyte.com/cinder-vol-34312b00-dd6d-45bb-af98-75855cea8e48 as target Quobyte volume. {{(pid=84538) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 29 19:04:45 devstack cinder-volume[84538]: INFO cinder.volume.drivers.remotefs [None req-7b4dda2d-ee01-4355-895a-b453361715df tempest-VolumesListTestJSON-1695505021 None] casted to osci02.corp.quobyte.com/cinder-vol-34312b00-dd6d-45bb-af98-75855cea8e48 Apr 29 19:04:45 devstack cinder-volume[84538]: DEBUG oslo_concurrency.processutils [None req-7b4dda2d-ee01-4355-895a-b453361715df tempest-VolumesListTestJSON-1695505021 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-f710366c-9c8d-4ce5-82ec-661e3abbfbd0 1073741824 {{(pid=84538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 19:04:45 devstack sudo[91852]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-f710366c-9c8d-4ce5-82ec-661e3abbfbd0 1073741824 Apr 29 19:04:45 devstack sudo[91852]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 19:04:46 devstack cinder-volume[84538]: INFO cinder.volume.manager [None req-ce1579a2-bed4-45eb-b6ed-9187e5e886b8 tempest-VolumesActionsTest-1839563461 None] Copy volume to image completed successfully. Apr 29 19:04:46 devstack sudo[91852]: pam_unix(sudo:session): session closed for user root Apr 29 19:04:46 devstack cinder-volume[84538]: DEBUG oslo_concurrency.processutils [None req-7b4dda2d-ee01-4355-895a-b453361715df tempest-VolumesListTestJSON-1695505021 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-f710366c-9c8d-4ce5-82ec-661e3abbfbd0 1073741824" returned: 0 in 0.871s {{(pid=84538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 19:04:46 devstack cinder-volume[84538]: DEBUG oslo_concurrency.processutils [None req-7b4dda2d-ee01-4355-895a-b453361715df tempest-VolumesListTestJSON-1695505021 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-f710366c-9c8d-4ce5-82ec-661e3abbfbd0 {{(pid=84538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 19:04:46 devstack sudo[91893]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-f710366c-9c8d-4ce5-82ec-661e3abbfbd0 Apr 29 19:04:46 devstack sudo[91893]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 19:04:47 devstack cinder-volume[84538]: DEBUG oslo_concurrency.lockutils [None req-cf4ba444-aa4c-472b-8fc6-c4f5efa89f2d tempest-VolumesActionsTest-1839563461 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" {{(pid=84538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 19:04:47 devstack sudo[91893]: pam_unix(sudo:session): session closed for user root Apr 29 19:04:47 devstack cinder-volume[84538]: DEBUG oslo_concurrency.processutils [None req-7b4dda2d-ee01-4355-895a-b453361715df tempest-VolumesListTestJSON-1695505021 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-f710366c-9c8d-4ce5-82ec-661e3abbfbd0" returned: 0 in 0.622s {{(pid=84538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 19:04:47 devstack cinder-volume[84538]: DEBUG cinder.volume.drivers.quobyte [None req-7b4dda2d-ee01-4355-895a-b453361715df tempest-VolumesListTestJSON-1695505021 None] <== create_volume: return (1534ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-34312b00-dd6d-45bb-af98-75855cea8e48'} {{(pid=84538) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 29 19:04:47 devstack cinder-volume[84538]: DEBUG oslo_concurrency.lockutils [None req-7b4dda2d-ee01-4355-895a-b453361715df tempest-VolumesListTestJSON-1695505021 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.538s {{(pid=84538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 19:04:47 devstack cinder-volume[84538]: DEBUG oslo_concurrency.lockutils [None req-046af1f7-b1fa-437a-a6cc-804f03e46ef6 tempest-VolumesSnapshotTestJSON-1345007867 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 16.951s {{(pid=84538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 19:04:47 devstack cinder-volume[84538]: DEBUG cinder.volume.drivers.quobyte [None req-046af1f7-b1fa-437a-a6cc-804f03e46ef6 tempest-VolumesSnapshotTestJSON-1345007867 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-29T17:04:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-965883433',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8ffdf26a-b64d-43d0-8e13-5805979ca936,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cb1bf99b4f1a451dbdf762aff4ec180c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T17:04:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T17:04:30Z,use_quota=True,user_id='987ad9d695504aeba3196f9a11cdf3cf',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(62b05900-93e3-4190-a88f-1d87324303d1),volume_type_id=62b05900-93e3-4190-a88f-1d87324303d1)}" {{(pid=84538) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 29 19:04:47 devstack cinder-volume[84538]: DEBUG cinder.volume.drivers.remotefs [None req-046af1f7-b1fa-437a-a6cc-804f03e46ef6 tempest-VolumesSnapshotTestJSON-1345007867 None] Creating volume 8ffdf26a-b64d-43d0-8e13-5805979ca936 {{(pid=84538) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 29 19:04:47 devstack cinder-volume[84538]: DEBUG oslo_concurrency.lockutils [None req-046af1f7-b1fa-437a-a6cc-804f03e46ef6 tempest-VolumesSnapshotTestJSON-1345007867 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 19:04:47 devstack cinder-volume[84538]: DEBUG oslo_concurrency.lockutils [None req-046af1f7-b1fa-437a-a6cc-804f03e46ef6 tempest-VolumesSnapshotTestJSON-1345007867 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=84538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 19:04:47 devstack cinder-volume[84538]: DEBUG cinder.volume.drivers.quobyte [None req-046af1f7-b1fa-437a-a6cc-804f03e46ef6 tempest-VolumesSnapshotTestJSON-1345007867 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-34312b00-dd6d-45bb-af98-75855cea8e48': None} {{(pid=84538) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 19:04:47 devstack cinder-volume[84538]: DEBUG cinder.volume.drivers.quobyte [None req-046af1f7-b1fa-437a-a6cc-804f03e46ef6 tempest-VolumesSnapshotTestJSON-1345007867 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-34312b00-dd6d-45bb-af98-75855cea8e48'] {{(pid=84538) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 19:04:47 devstack cinder-volume[84538]: DEBUG oslo_concurrency.lockutils [None req-046af1f7-b1fa-437a-a6cc-804f03e46ef6 tempest-VolumesSnapshotTestJSON-1345007867 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=84538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 19:04:47 devstack cinder-volume[84538]: DEBUG cinder.volume.drivers.quobyte [None req-046af1f7-b1fa-437a-a6cc-804f03e46ef6 tempest-VolumesSnapshotTestJSON-1345007867 None] Selected osci02.corp.quobyte.com/cinder-vol-34312b00-dd6d-45bb-af98-75855cea8e48 as target Quobyte volume. {{(pid=84538) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 29 19:04:47 devstack cinder-volume[84538]: INFO cinder.volume.drivers.remotefs [None req-046af1f7-b1fa-437a-a6cc-804f03e46ef6 tempest-VolumesSnapshotTestJSON-1345007867 None] casted to osci02.corp.quobyte.com/cinder-vol-34312b00-dd6d-45bb-af98-75855cea8e48 Apr 29 19:04:47 devstack cinder-volume[84538]: DEBUG oslo_concurrency.processutils [None req-046af1f7-b1fa-437a-a6cc-804f03e46ef6 tempest-VolumesSnapshotTestJSON-1345007867 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-8ffdf26a-b64d-43d0-8e13-5805979ca936 1073741824 {{(pid=84538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 19:04:47 devstack sudo[91896]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-8ffdf26a-b64d-43d0-8e13-5805979ca936 1073741824 Apr 29 19:04:47 devstack cinder-volume[84538]: DEBUG cinder.volume.manager [None req-7b4dda2d-ee01-4355-895a-b453361715df tempest-VolumesListTestJSON-1695505021 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f2aec2fe-94d2-4dc0-a138-85a90dba1fc9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f710366c-9c8d-4ce5-82ec-661e3abbfbd0', 'volume_size': 1}' {{(pid=84538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 19:04:47 devstack sudo[91896]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 19:04:47 devstack cinder-volume[84538]: DEBUG cinder.volume.manager [None req-7b4dda2d-ee01-4355-895a-b453361715df tempest-VolumesListTestJSON-1695505021 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0385ffea-e8ba-4df7-b052-eae00ad4c76e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 19:04:47 devstack cinder-volume[84538]: INFO cinder.volume.flows.manager.create_volume [None req-7b4dda2d-ee01-4355-895a-b453361715df tempest-VolumesListTestJSON-1695505021 None] Volume volume-f710366c-9c8d-4ce5-82ec-661e3abbfbd0 (f710366c-9c8d-4ce5-82ec-661e3abbfbd0): created successfully Apr 29 19:04:47 devstack cinder-volume[84538]: DEBUG cinder.volume.manager [None req-7b4dda2d-ee01-4355-895a-b453361715df tempest-VolumesListTestJSON-1695505021 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0385ffea-e8ba-4df7-b052-eae00ad4c76e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 19:04:47 devstack cinder-volume[84538]: DEBUG cinder.volume.manager [None req-7b4dda2d-ee01-4355-895a-b453361715df tempest-VolumesListTestJSON-1695505021 None] Flow 'volume_create_manager' (9165497e-2f79-461c-864a-22b43d3c1f29) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84538) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 19:04:47 devstack cinder-volume[84538]: INFO cinder.volume.manager [None req-7b4dda2d-ee01-4355-895a-b453361715df tempest-VolumesListTestJSON-1695505021 None] Created volume successfully. Apr 29 19:04:48 devstack sudo[91896]: pam_unix(sudo:session): session closed for user root Apr 29 19:04:48 devstack cinder-volume[84538]: DEBUG oslo_concurrency.processutils [None req-046af1f7-b1fa-437a-a6cc-804f03e46ef6 tempest-VolumesSnapshotTestJSON-1345007867 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-8ffdf26a-b64d-43d0-8e13-5805979ca936 1073741824" returned: 0 in 0.760s {{(pid=84538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 19:04:48 devstack cinder-volume[84538]: DEBUG oslo_concurrency.processutils [None req-046af1f7-b1fa-437a-a6cc-804f03e46ef6 tempest-VolumesSnapshotTestJSON-1345007867 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-8ffdf26a-b64d-43d0-8e13-5805979ca936 {{(pid=84538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 19:04:48 devstack sudo[91901]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-8ffdf26a-b64d-43d0-8e13-5805979ca936 Apr 29 19:04:48 devstack sudo[91901]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 19:04:48 devstack cinder-volume[84538]: DEBUG cinder.volume.flows.manager.create_volume [None req-b65fb8dc-9bba-4b8c-a763-60eafe6d9390 tempest-VolumesListTestJSON-1695505021 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84538) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Apr 29 19:04:48 devstack cinder-volume[84538]: DEBUG cinder.volume.manager [None req-b65fb8dc-9bba-4b8c-a763-60eafe6d9390 tempest-VolumesListTestJSON-1695505021 None] Flow 'volume_create_manager' (174343c6-49b0-463c-93b4-d59f238d4c4b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84538) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 19:04:48 devstack cinder-volume[84538]: DEBUG cinder.volume.manager [None req-b65fb8dc-9bba-4b8c-a763-60eafe6d9390 tempest-VolumesListTestJSON-1695505021 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b381f6a2-3d38-412e-b8fc-abe2bb9f8a0f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 19:04:48 devstack cinder-volume[84538]: DEBUG cinder.volume.manager [None req-b65fb8dc-9bba-4b8c-a763-60eafe6d9390 tempest-VolumesListTestJSON-1695505021 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b381f6a2-3d38-412e-b8fc-abe2bb9f8a0f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-29T17:04:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-1276085500',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=da8c4537-b5c7-46e5-b7a0-d0379e4105bf,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='ec2a7decc4f54bab96570e941c207171',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T17:04:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T17:04:49Z,use_quota=True,user_id='d06c72522a3c4026ac17a414ac13121f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(62b05900-93e3-4190-a88f-1d87324303d1),volume_type_id=62b05900-93e3-4190-a88f-1d87324303d1)' {{(pid=84538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 19:04:48 devstack cinder-volume[84538]: DEBUG cinder.volume.manager [None req-b65fb8dc-9bba-4b8c-a763-60eafe6d9390 tempest-VolumesListTestJSON-1695505021 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9e0133eb-50de-4ab7-9056-9b8ee4d67f56) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 19:04:48 devstack cinder-volume[84538]: DEBUG cinder.volume.manager [None req-b65fb8dc-9bba-4b8c-a763-60eafe6d9390 tempest-VolumesListTestJSON-1695505021 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9e0133eb-50de-4ab7-9056-9b8ee4d67f56) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 19:04:48 devstack cinder-volume[84538]: DEBUG cinder.volume.manager [None req-b65fb8dc-9bba-4b8c-a763-60eafe6d9390 tempest-VolumesListTestJSON-1695505021 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e328e082-e5d2-4b1a-adda-22b36ce163f6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 19:04:48 devstack cinder-volume[84538]: DEBUG cinder.volume.manager [None req-b65fb8dc-9bba-4b8c-a763-60eafe6d9390 tempest-VolumesListTestJSON-1695505021 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e328e082-e5d2-4b1a-adda-22b36ce163f6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'da8c4537-b5c7-46e5-b7a0-d0379e4105bf', 'volume_name': 'volume-da8c4537-b5c7-46e5-b7a0-d0379e4105bf', 'volume_size': 1}' {{(pid=84538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 19:04:48 devstack cinder-volume[84538]: DEBUG cinder.volume.manager [None req-b65fb8dc-9bba-4b8c-a763-60eafe6d9390 tempest-VolumesListTestJSON-1695505021 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (df73934a-1af5-4c27-90bf-445d05fd2d68) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 19:04:48 devstack cinder-volume[84538]: DEBUG cinder.volume.manager [None req-b65fb8dc-9bba-4b8c-a763-60eafe6d9390 tempest-VolumesListTestJSON-1695505021 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (df73934a-1af5-4c27-90bf-445d05fd2d68) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 19:04:48 devstack cinder-volume[84538]: DEBUG cinder.volume.manager [None req-b65fb8dc-9bba-4b8c-a763-60eafe6d9390 tempest-VolumesListTestJSON-1695505021 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8da82b5f-5400-4ad1-b6e6-70f0e42c0ba5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 19:04:48 devstack cinder-volume[84538]: INFO cinder.volume.flows.manager.create_volume [None req-b65fb8dc-9bba-4b8c-a763-60eafe6d9390 tempest-VolumesListTestJSON-1695505021 None] Volume da8c4537-b5c7-46e5-b7a0-d0379e4105bf: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-da8c4537-b5c7-46e5-b7a0-d0379e4105bf', 'volume_size': 1} Apr 29 19:04:48 devstack cinder-volume[84538]: DEBUG oslo_concurrency.lockutils [None req-b65fb8dc-9bba-4b8c-a763-60eafe6d9390 tempest-VolumesListTestJSON-1695505021 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 19:04:48 devstack sudo[91901]: pam_unix(sudo:session): session closed for user root Apr 29 19:04:48 devstack cinder-volume[84538]: DEBUG oslo_concurrency.processutils [None req-046af1f7-b1fa-437a-a6cc-804f03e46ef6 tempest-VolumesSnapshotTestJSON-1345007867 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-8ffdf26a-b64d-43d0-8e13-5805979ca936" returned: 0 in 0.624s {{(pid=84538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 19:04:48 devstack cinder-volume[84538]: DEBUG cinder.volume.drivers.quobyte [None req-046af1f7-b1fa-437a-a6cc-804f03e46ef6 tempest-VolumesSnapshotTestJSON-1345007867 None] <== create_volume: return (1423ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-34312b00-dd6d-45bb-af98-75855cea8e48'} {{(pid=84538) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 29 19:04:48 devstack cinder-volume[84538]: DEBUG oslo_concurrency.lockutils [None req-046af1f7-b1fa-437a-a6cc-804f03e46ef6 tempest-VolumesSnapshotTestJSON-1345007867 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.426s {{(pid=84538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 19:04:48 devstack cinder-volume[84538]: DEBUG oslo_concurrency.lockutils [None req-475907fc-d7d5-4e13-9cae-23bcfbe4f307 tempest-CinderUnicodeTest-1144970881 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 13.261s {{(pid=84538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 19:04:48 devstack cinder-volume[84538]: DEBUG cinder.volume.drivers.quobyte [None req-475907fc-d7d5-4e13-9cae-23bcfbe4f307 tempest-CinderUnicodeTest-1144970881 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-29T17:04:35Z,deleted=False,deleted_at=None,display_description=None,display_name='CinderUnicodeTest塵㼗‽',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=08c63ba4-25bf-4e74-b3fc-cbd11bca14ce,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='db780ad6ce764618aa4b3861b448fe17',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T17:04:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T17:04:36Z,use_quota=True,user_id='d4c1e6e150af4dca9a679db078e1b16e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(62b05900-93e3-4190-a88f-1d87324303d1),volume_type_id=62b05900-93e3-4190-a88f-1d87324303d1)}" {{(pid=84538) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 29 19:04:48 devstack cinder-volume[84538]: DEBUG cinder.volume.drivers.remotefs [None req-475907fc-d7d5-4e13-9cae-23bcfbe4f307 tempest-CinderUnicodeTest-1144970881 None] Creating volume 08c63ba4-25bf-4e74-b3fc-cbd11bca14ce {{(pid=84538) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 29 19:04:48 devstack cinder-volume[84538]: DEBUG oslo_concurrency.lockutils [None req-475907fc-d7d5-4e13-9cae-23bcfbe4f307 tempest-CinderUnicodeTest-1144970881 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 19:04:48 devstack cinder-volume[84538]: DEBUG oslo_concurrency.lockutils [None req-475907fc-d7d5-4e13-9cae-23bcfbe4f307 tempest-CinderUnicodeTest-1144970881 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=84538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 19:04:48 devstack cinder-volume[84538]: DEBUG cinder.volume.drivers.quobyte [None req-475907fc-d7d5-4e13-9cae-23bcfbe4f307 tempest-CinderUnicodeTest-1144970881 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-34312b00-dd6d-45bb-af98-75855cea8e48': None} {{(pid=84538) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 19:04:48 devstack cinder-volume[84538]: DEBUG cinder.volume.drivers.quobyte [None req-475907fc-d7d5-4e13-9cae-23bcfbe4f307 tempest-CinderUnicodeTest-1144970881 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-34312b00-dd6d-45bb-af98-75855cea8e48'] {{(pid=84538) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 19:04:48 devstack cinder-volume[84538]: DEBUG oslo_concurrency.lockutils [None req-475907fc-d7d5-4e13-9cae-23bcfbe4f307 tempest-CinderUnicodeTest-1144970881 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=84538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 19:04:48 devstack cinder-volume[84538]: DEBUG cinder.volume.drivers.quobyte [None req-475907fc-d7d5-4e13-9cae-23bcfbe4f307 tempest-CinderUnicodeTest-1144970881 None] Selected osci02.corp.quobyte.com/cinder-vol-34312b00-dd6d-45bb-af98-75855cea8e48 as target Quobyte volume. {{(pid=84538) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 29 19:04:48 devstack cinder-volume[84538]: INFO cinder.volume.drivers.remotefs [None req-475907fc-d7d5-4e13-9cae-23bcfbe4f307 tempest-CinderUnicodeTest-1144970881 None] casted to osci02.corp.quobyte.com/cinder-vol-34312b00-dd6d-45bb-af98-75855cea8e48 Apr 29 19:04:48 devstack cinder-volume[84538]: DEBUG oslo_concurrency.processutils [None req-475907fc-d7d5-4e13-9cae-23bcfbe4f307 tempest-CinderUnicodeTest-1144970881 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-08c63ba4-25bf-4e74-b3fc-cbd11bca14ce 1073741824 {{(pid=84538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 19:04:48 devstack cinder-volume[84538]: DEBUG cinder.volume.manager [None req-046af1f7-b1fa-437a-a6cc-804f03e46ef6 tempest-VolumesSnapshotTestJSON-1345007867 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4341a5b9-031d-407d-9b35-94dab495ea22) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8ffdf26a-b64d-43d0-8e13-5805979ca936', 'volume_size': 1}' {{(pid=84538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 19:04:48 devstack sudo[91905]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-08c63ba4-25bf-4e74-b3fc-cbd11bca14ce 1073741824 Apr 29 19:04:48 devstack sudo[91905]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 19:04:48 devstack cinder-volume[84538]: DEBUG cinder.volume.manager [None req-046af1f7-b1fa-437a-a6cc-804f03e46ef6 tempest-VolumesSnapshotTestJSON-1345007867 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6f17c9f2-2a0d-43ad-8296-19d46d4f0156) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 19:04:48 devstack cinder-volume[84538]: INFO cinder.volume.flows.manager.create_volume [None req-046af1f7-b1fa-437a-a6cc-804f03e46ef6 tempest-VolumesSnapshotTestJSON-1345007867 None] Volume volume-8ffdf26a-b64d-43d0-8e13-5805979ca936 (8ffdf26a-b64d-43d0-8e13-5805979ca936): created successfully Apr 29 19:04:48 devstack cinder-volume[84538]: DEBUG cinder.volume.manager [None req-046af1f7-b1fa-437a-a6cc-804f03e46ef6 tempest-VolumesSnapshotTestJSON-1345007867 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6f17c9f2-2a0d-43ad-8296-19d46d4f0156) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 19:04:48 devstack cinder-volume[84538]: DEBUG cinder.volume.manager [None req-046af1f7-b1fa-437a-a6cc-804f03e46ef6 tempest-VolumesSnapshotTestJSON-1345007867 None] Flow 'volume_create_manager' (abb6d996-d9e1-4e3e-85f3-c4e98e99893d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84538) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 19:04:49 devstack cinder-volume[84538]: INFO cinder.volume.manager [None req-046af1f7-b1fa-437a-a6cc-804f03e46ef6 tempest-VolumesSnapshotTestJSON-1345007867 None] Created volume successfully. Apr 29 19:04:49 devstack sudo[91905]: pam_unix(sudo:session): session closed for user root Apr 29 19:04:49 devstack cinder-volume[84538]: DEBUG oslo_concurrency.processutils [None req-475907fc-d7d5-4e13-9cae-23bcfbe4f307 tempest-CinderUnicodeTest-1144970881 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-08c63ba4-25bf-4e74-b3fc-cbd11bca14ce 1073741824" returned: 0 in 0.778s {{(pid=84538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 19:04:49 devstack cinder-volume[84538]: DEBUG oslo_concurrency.processutils [None req-475907fc-d7d5-4e13-9cae-23bcfbe4f307 tempest-CinderUnicodeTest-1144970881 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-08c63ba4-25bf-4e74-b3fc-cbd11bca14ce {{(pid=84538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 19:04:49 devstack sudo[91911]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-08c63ba4-25bf-4e74-b3fc-cbd11bca14ce Apr 29 19:04:49 devstack sudo[91911]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 19:04:49 devstack cinder-volume[84538]: DEBUG oslo_concurrency.lockutils [None req-0d0f202a-1a0d-445d-b792-b7d42829afd2 tempest-VolumesSnapshotTestJSON-1345007867 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=84538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 19:04:50 devstack sudo[91911]: pam_unix(sudo:session): session closed for user root Apr 29 19:04:50 devstack cinder-volume[84538]: DEBUG oslo_concurrency.processutils [None req-475907fc-d7d5-4e13-9cae-23bcfbe4f307 tempest-CinderUnicodeTest-1144970881 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-08c63ba4-25bf-4e74-b3fc-cbd11bca14ce" returned: 0 in 0.609s {{(pid=84538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 19:04:50 devstack cinder-volume[84538]: DEBUG cinder.volume.drivers.quobyte [None req-475907fc-d7d5-4e13-9cae-23bcfbe4f307 tempest-CinderUnicodeTest-1144970881 None] <== create_volume: return (1430ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-34312b00-dd6d-45bb-af98-75855cea8e48'} {{(pid=84538) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 29 19:04:50 devstack cinder-volume[84538]: DEBUG oslo_concurrency.lockutils [None req-475907fc-d7d5-4e13-9cae-23bcfbe4f307 tempest-CinderUnicodeTest-1144970881 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.434s {{(pid=84538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 19:04:50 devstack cinder-volume[84538]: DEBUG oslo_concurrency.lockutils [None req-cf4ba444-aa4c-472b-8fc6-c4f5efa89f2d tempest-VolumesActionsTest-1839563461 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: waited 3.162s {{(pid=84538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 19:04:50 devstack cinder-volume[84538]: DEBUG cinder.volume.manager [None req-475907fc-d7d5-4e13-9cae-23bcfbe4f307 tempest-CinderUnicodeTest-1144970881 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6075a020-3af9-4a3f-9654-4e3b04841fb4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-08c63ba4-25bf-4e74-b3fc-cbd11bca14ce', 'volume_size': 1}' {{(pid=84538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 19:04:50 devstack cinder-volume[84538]: DEBUG cinder.volume.manager [None req-475907fc-d7d5-4e13-9cae-23bcfbe4f307 tempest-CinderUnicodeTest-1144970881 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (37fbfe95-c23c-4536-abab-4a7b12501981) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 19:04:50 devstack cinder-volume[84538]: DEBUG oslo.privsep.daemon [-] privsep: reply[3a23d7a7-4408-4f7e-b8a4-0ee9f3a82166]: (4, 'qcow2') {{(pid=85803) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 19:04:50 devstack cinder-volume[84538]: DEBUG oslo_concurrency.processutils [None req-cf4ba444-aa4c-472b-8fc6-c4f5efa89f2d tempest-VolumesActionsTest-1839563461 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-c66b0dde-dec4-44cc-b0fe-7b7f63fa3d6a {{(pid=84538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 19:04:50 devstack cinder-volume[84538]: INFO cinder.volume.flows.manager.create_volume [None req-475907fc-d7d5-4e13-9cae-23bcfbe4f307 tempest-CinderUnicodeTest-1144970881 None] Volume volume-08c63ba4-25bf-4e74-b3fc-cbd11bca14ce (08c63ba4-25bf-4e74-b3fc-cbd11bca14ce): created successfully Apr 29 19:04:50 devstack cinder-volume[84538]: DEBUG cinder.volume.manager [None req-475907fc-d7d5-4e13-9cae-23bcfbe4f307 tempest-CinderUnicodeTest-1144970881 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (37fbfe95-c23c-4536-abab-4a7b12501981) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 19:04:50 devstack cinder-volume[84538]: DEBUG cinder.volume.manager [None req-475907fc-d7d5-4e13-9cae-23bcfbe4f307 tempest-CinderUnicodeTest-1144970881 None] Flow 'volume_create_manager' (b4e17c26-f0aa-49db-ae4a-d3853d742d94) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84538) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 19:04:50 devstack cinder-volume[84538]: INFO cinder.volume.manager [None req-475907fc-d7d5-4e13-9cae-23bcfbe4f307 tempest-CinderUnicodeTest-1144970881 None] Created volume successfully. Apr 29 19:04:50 devstack sudo[91914]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-c66b0dde-dec4-44cc-b0fe-7b7f63fa3d6a Apr 29 19:04:50 devstack sudo[91914]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 19:04:51 devstack sudo[91914]: pam_unix(sudo:session): session closed for user root Apr 29 19:04:51 devstack cinder-volume[84538]: DEBUG oslo_concurrency.processutils [None req-cf4ba444-aa4c-472b-8fc6-c4f5efa89f2d tempest-VolumesActionsTest-1839563461 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-c66b0dde-dec4-44cc-b0fe-7b7f63fa3d6a" returned: 0 in 0.745s {{(pid=84538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 19:04:51 devstack cinder-volume[84538]: DEBUG oslo.privsep.daemon [-] privsep: reply[1bd71f2b-a839-4d70-a158-639d35ae40a9]: (4, 'qcow2') {{(pid=85803) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 19:04:51 devstack cinder-volume[84538]: DEBUG oslo_concurrency.processutils [None req-cf4ba444-aa4c-472b-8fc6-c4f5efa89f2d tempest-VolumesActionsTest-1839563461 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-c66b0dde-dec4-44cc-b0fe-7b7f63fa3d6a {{(pid=84538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 19:04:51 devstack sudo[91919]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-c66b0dde-dec4-44cc-b0fe-7b7f63fa3d6a Apr 29 19:04:51 devstack sudo[91919]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 19:04:51 devstack sudo[91919]: pam_unix(sudo:session): session closed for user root Apr 29 19:04:51 devstack cinder-volume[84538]: DEBUG oslo_concurrency.processutils [None req-cf4ba444-aa4c-472b-8fc6-c4f5efa89f2d tempest-VolumesActionsTest-1839563461 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-c66b0dde-dec4-44cc-b0fe-7b7f63fa3d6a" returned: 0 in 0.766s {{(pid=84538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 19:04:51 devstack cinder-volume[84538]: DEBUG oslo_concurrency.processutils [None req-cf4ba444-aa4c-472b-8fc6-c4f5efa89f2d tempest-VolumesActionsTest-1839563461 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-c66b0dde-dec4-44cc-b0fe-7b7f63fa3d6a /opt/stack/data/cinder/conversion/c66b0dde-dec4-44cc-b0fe-7b7f63fa3d6a.temp_image.72bd5743-c5aa-4003-aac3-cb2ca2d933b5z8211fz5.img {{(pid=84538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 19:04:51 devstack sudo[91925]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-c66b0dde-dec4-44cc-b0fe-7b7f63fa3d6a /opt/stack/data/cinder/conversion/c66b0dde-dec4-44cc-b0fe-7b7f63fa3d6a.temp_image.72bd5743-c5aa-4003-aac3-cb2ca2d933b5z8211fz5.img Apr 29 19:04:51 devstack sudo[91925]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 19:04:51 devstack cinder-volume[84538]: DEBUG cinder.volume.flows.manager.create_volume [None req-9f905043-ef39-4c4e-b477-727887c4cc6b tempest-CinderUnicodeTest-1144970881 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84538) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Apr 29 19:04:51 devstack cinder-volume[84538]: DEBUG cinder.volume.manager [None req-9f905043-ef39-4c4e-b477-727887c4cc6b tempest-CinderUnicodeTest-1144970881 None] Flow 'volume_create_manager' (826f3da3-c597-4975-b73f-4ace0adc86fe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84538) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 19:04:52 devstack cinder-volume[84538]: DEBUG cinder.volume.manager [None req-9f905043-ef39-4c4e-b477-727887c4cc6b tempest-CinderUnicodeTest-1144970881 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a139f9ee-2e0d-43e8-ae67-2bd4c932e8af) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 19:04:52 devstack cinder-volume[84538]: DEBUG cinder.volume.manager [None req-9f905043-ef39-4c4e-b477-727887c4cc6b tempest-CinderUnicodeTest-1144970881 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a139f9ee-2e0d-43e8-ae67-2bd4c932e8af) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-29T17:04:52Z,deleted=False,deleted_at=None,display_description='קייפש',display_name='tempest-CinderUnicodeTest-Volume-951760118',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=723bbfbf-d981-4a0e-8a8c-2bbf66f2115e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='db780ad6ce764618aa4b3861b448fe17',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T17:04:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T17:04:52Z,use_quota=True,user_id='d4c1e6e150af4dca9a679db078e1b16e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(62b05900-93e3-4190-a88f-1d87324303d1),volume_type_id=62b05900-93e3-4190-a88f-1d87324303d1)' {{(pid=84538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 19:04:52 devstack cinder-volume[84538]: DEBUG cinder.volume.manager [None req-9f905043-ef39-4c4e-b477-727887c4cc6b tempest-CinderUnicodeTest-1144970881 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (32bc7d06-695e-43db-a42b-dbb4e3fd5628) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 19:04:52 devstack cinder-volume[84538]: DEBUG cinder.volume.manager [None req-9f905043-ef39-4c4e-b477-727887c4cc6b tempest-CinderUnicodeTest-1144970881 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (32bc7d06-695e-43db-a42b-dbb4e3fd5628) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 19:04:52 devstack cinder-volume[84538]: DEBUG cinder.volume.manager [None req-9f905043-ef39-4c4e-b477-727887c4cc6b tempest-CinderUnicodeTest-1144970881 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a2a32cc3-9ffd-48ed-b864-7a0cfb7948ed) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 19:04:52 devstack cinder-volume[84538]: DEBUG cinder.volume.manager [None req-9f905043-ef39-4c4e-b477-727887c4cc6b tempest-CinderUnicodeTest-1144970881 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a2a32cc3-9ffd-48ed-b864-7a0cfb7948ed) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '723bbfbf-d981-4a0e-8a8c-2bbf66f2115e', 'volume_name': 'volume-723bbfbf-d981-4a0e-8a8c-2bbf66f2115e', 'volume_size': 1}' {{(pid=84538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 19:04:52 devstack cinder-volume[84538]: DEBUG cinder.volume.manager [None req-9f905043-ef39-4c4e-b477-727887c4cc6b tempest-CinderUnicodeTest-1144970881 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3a440d74-664f-4597-b1f4-7b75c82d0dd6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 19:04:52 devstack cinder-volume[84538]: DEBUG cinder.volume.manager [None req-9f905043-ef39-4c4e-b477-727887c4cc6b tempest-CinderUnicodeTest-1144970881 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3a440d74-664f-4597-b1f4-7b75c82d0dd6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 19:04:52 devstack cinder-volume[84538]: DEBUG cinder.volume.manager [None req-9f905043-ef39-4c4e-b477-727887c4cc6b tempest-CinderUnicodeTest-1144970881 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (29f59337-51e7-455a-b4fe-1adc2c8da493) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 19:04:52 devstack cinder-volume[84538]: INFO cinder.volume.flows.manager.create_volume [None req-9f905043-ef39-4c4e-b477-727887c4cc6b tempest-CinderUnicodeTest-1144970881 None] Volume 723bbfbf-d981-4a0e-8a8c-2bbf66f2115e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-723bbfbf-d981-4a0e-8a8c-2bbf66f2115e', 'volume_size': 1} Apr 29 19:04:52 devstack cinder-volume[84538]: DEBUG oslo_concurrency.lockutils [None req-9f905043-ef39-4c4e-b477-727887c4cc6b tempest-CinderUnicodeTest-1144970881 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 19:04:56 devstack sudo[91925]: pam_unix(sudo:session): session closed for user root Apr 29 19:04:56 devstack cinder-volume[84538]: DEBUG oslo_concurrency.processutils [None req-cf4ba444-aa4c-472b-8fc6-c4f5efa89f2d tempest-VolumesActionsTest-1839563461 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-c66b0dde-dec4-44cc-b0fe-7b7f63fa3d6a /opt/stack/data/cinder/conversion/c66b0dde-dec4-44cc-b0fe-7b7f63fa3d6a.temp_image.72bd5743-c5aa-4003-aac3-cb2ca2d933b5z8211fz5.img" returned: 0 in 4.375s {{(pid=84538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 19:04:56 devstack cinder-volume[84538]: DEBUG oslo.privsep.daemon [-] privsep: reply[99d98aeb-ad46-495e-bf52-29315ba74318]: (4, 'qcow2') {{(pid=85803) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 19:04:56 devstack cinder-volume[84538]: DEBUG oslo_concurrency.processutils [None req-cf4ba444-aa4c-472b-8fc6-c4f5efa89f2d tempest-VolumesActionsTest-1839563461 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-c66b0dde-dec4-44cc-b0fe-7b7f63fa3d6a {{(pid=84538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 19:04:56 devstack sudo[91944]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-c66b0dde-dec4-44cc-b0fe-7b7f63fa3d6a Apr 29 19:04:56 devstack sudo[91944]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 19:04:57 devstack sudo[91944]: pam_unix(sudo:session): session closed for user root Apr 29 19:04:57 devstack cinder-volume[84538]: DEBUG oslo_concurrency.processutils [None req-cf4ba444-aa4c-472b-8fc6-c4f5efa89f2d tempest-VolumesActionsTest-1839563461 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-c66b0dde-dec4-44cc-b0fe-7b7f63fa3d6a" returned: 0 in 0.820s {{(pid=84538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 19:04:57 devstack cinder-volume[84538]: DEBUG cinder.image.image_utils [None req-cf4ba444-aa4c-472b-8fc6-c4f5efa89f2d tempest-VolumesActionsTest-1839563461 None] Image conversion details: src /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-c66b0dde-dec4-44cc-b0fe-7b7f63fa3d6a, size 1024.00 MB, duration 4.38 sec, destination /opt/stack/data/cinder/conversion/c66b0dde-dec4-44cc-b0fe-7b7f63fa3d6a.temp_image.72bd5743-c5aa-4003-aac3-cb2ca2d933b5z8211fz5.img {{(pid=84538) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}} Apr 29 19:04:57 devstack cinder-volume[84538]: INFO cinder.image.image_utils [None req-cf4ba444-aa4c-472b-8fc6-c4f5efa89f2d tempest-VolumesActionsTest-1839563461 None] Converted 1024.00 MB image at 234.00 MB/s Apr 29 19:04:57 devstack cinder-volume[84538]: DEBUG cinder.image.image_utils [None req-cf4ba444-aa4c-472b-8fc6-c4f5efa89f2d tempest-VolumesActionsTest-1839563461 None] 72bd5743-c5aa-4003-aac3-cb2ca2d933b5 was raw, converting to qcow2 {{(pid=84538) upload_volume /opt/stack/cinder/cinder/image/image_utils.py:1176}} Apr 29 19:04:57 devstack cinder-volume[84538]: DEBUG oslo.privsep.daemon [-] privsep: reply[57bde8c8-18bf-4afe-a64a-df70176c940a]: (4, 'raw') {{(pid=85803) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 19:04:57 devstack cinder-volume[84538]: DEBUG oslo_concurrency.processutils [None req-cf4ba444-aa4c-472b-8fc6-c4f5efa89f2d tempest-VolumesActionsTest-1839563461 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/c66b0dde-dec4-44cc-b0fe-7b7f63fa3d6a.temp_image.72bd5743-c5aa-4003-aac3-cb2ca2d933b5z8211fz5.img {{(pid=84538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 19:04:57 devstack sudo[91949]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/c66b0dde-dec4-44cc-b0fe-7b7f63fa3d6a.temp_image.72bd5743-c5aa-4003-aac3-cb2ca2d933b5z8211fz5.img Apr 29 19:04:57 devstack sudo[91949]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 19:04:57 devstack sudo[91949]: pam_unix(sudo:session): session closed for user root Apr 29 19:04:57 devstack cinder-volume[84538]: DEBUG oslo_concurrency.processutils [None req-cf4ba444-aa4c-472b-8fc6-c4f5efa89f2d tempest-VolumesActionsTest-1839563461 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/c66b0dde-dec4-44cc-b0fe-7b7f63fa3d6a.temp_image.72bd5743-c5aa-4003-aac3-cb2ca2d933b5z8211fz5.img" returned: 0 in 0.667s {{(pid=84538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 19:04:57 devstack cinder-volume[84538]: DEBUG oslo_concurrency.processutils [None req-cf4ba444-aa4c-472b-8fc6-c4f5efa89f2d tempest-VolumesActionsTest-1839563461 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/c66b0dde-dec4-44cc-b0fe-7b7f63fa3d6a.temp_image.72bd5743-c5aa-4003-aac3-cb2ca2d933b5z8211fz5.img {{(pid=84538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 19:04:57 devstack sudo[91953]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/c66b0dde-dec4-44cc-b0fe-7b7f63fa3d6a.temp_image.72bd5743-c5aa-4003-aac3-cb2ca2d933b5z8211fz5.img Apr 29 19:04:57 devstack sudo[91953]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 19:04:58 devstack sudo[91953]: pam_unix(sudo:session): session closed for user root Apr 29 19:04:58 devstack cinder-volume[84538]: DEBUG oslo_concurrency.processutils [None req-cf4ba444-aa4c-472b-8fc6-c4f5efa89f2d tempest-VolumesActionsTest-1839563461 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/c66b0dde-dec4-44cc-b0fe-7b7f63fa3d6a.temp_image.72bd5743-c5aa-4003-aac3-cb2ca2d933b5z8211fz5.img" returned: 1 in 0.674s {{(pid=84538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 19:04:58 devstack cinder-volume[84538]: DEBUG oslo_concurrency.processutils [None req-cf4ba444-aa4c-472b-8fc6-c4f5efa89f2d tempest-VolumesActionsTest-1839563461 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/c66b0dde-dec4-44cc-b0fe-7b7f63fa3d6a.temp_image.72bd5743-c5aa-4003-aac3-cb2ca2d933b5z8211fz5.img' failed. Not Retrying. {{(pid=84538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Apr 29 19:04:58 devstack cinder-volume[84538]: DEBUG oslo_concurrency.processutils [None req-cf4ba444-aa4c-472b-8fc6-c4f5efa89f2d tempest-VolumesActionsTest-1839563461 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -c /opt/stack/data/cinder/conversion/c66b0dde-dec4-44cc-b0fe-7b7f63fa3d6a.temp_image.72bd5743-c5aa-4003-aac3-cb2ca2d933b5z8211fz5.img /opt/stack/data/cinder/conversion/vol_upload_dng61wq6 {{(pid=84538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 19:04:58 devstack sudo[91959]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -c /opt/stack/data/cinder/conversion/c66b0dde-dec4-44cc-b0fe-7b7f63fa3d6a.temp_image.72bd5743-c5aa-4003-aac3-cb2ca2d933b5z8211fz5.img /opt/stack/data/cinder/conversion/vol_upload_dng61wq6 Apr 29 19:04:58 devstack sudo[91959]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 19:04:59 devstack sudo[91959]: pam_unix(sudo:session): session closed for user root Apr 29 19:04:59 devstack cinder-volume[84538]: DEBUG oslo_concurrency.processutils [None req-cf4ba444-aa4c-472b-8fc6-c4f5efa89f2d tempest-VolumesActionsTest-1839563461 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -c /opt/stack/data/cinder/conversion/c66b0dde-dec4-44cc-b0fe-7b7f63fa3d6a.temp_image.72bd5743-c5aa-4003-aac3-cb2ca2d933b5z8211fz5.img /opt/stack/data/cinder/conversion/vol_upload_dng61wq6" returned: 0 in 0.609s {{(pid=84538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 19:04:59 devstack cinder-volume[84538]: DEBUG cinder.image.image_utils [None req-cf4ba444-aa4c-472b-8fc6-c4f5efa89f2d tempest-VolumesActionsTest-1839563461 None] Image conversion details: src /opt/stack/data/cinder/conversion/c66b0dde-dec4-44cc-b0fe-7b7f63fa3d6a.temp_image.72bd5743-c5aa-4003-aac3-cb2ca2d933b5z8211fz5.img, size 1024.00 MB, duration 1.00 sec, destination /opt/stack/data/cinder/conversion/vol_upload_dng61wq6 {{(pid=84538) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}} Apr 29 19:04:59 devstack cinder-volume[84538]: INFO cinder.image.image_utils [None req-cf4ba444-aa4c-472b-8fc6-c4f5efa89f2d tempest-VolumesActionsTest-1839563461 None] Converted 1024.00 MB image at 1024.00 MB/s Apr 29 19:04:59 devstack cinder-volume[84538]: DEBUG oslo.privsep.daemon [-] privsep: reply[d735e877-50a4-47f0-b6c4-a91ea5e88d93]: (4, 'qcow2') {{(pid=85803) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 19:04:59 devstack cinder-volume[84538]: DEBUG oslo_concurrency.processutils [None req-cf4ba444-aa4c-472b-8fc6-c4f5efa89f2d tempest-VolumesActionsTest-1839563461 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/vol_upload_dng61wq6 {{(pid=84538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 19:04:59 devstack sudo[91964]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/vol_upload_dng61wq6 Apr 29 19:04:59 devstack sudo[91964]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 19:04:59 devstack sudo[91964]: pam_unix(sudo:session): session closed for user root Apr 29 19:04:59 devstack cinder-volume[84538]: DEBUG oslo_concurrency.processutils [None req-cf4ba444-aa4c-472b-8fc6-c4f5efa89f2d tempest-VolumesActionsTest-1839563461 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/vol_upload_dng61wq6" returned: 0 in 0.700s {{(pid=84538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 19:05:00 devstack cinder-volume[84538]: DEBUG oslo_concurrency.lockutils [None req-cf4ba444-aa4c-472b-8fc6-c4f5efa89f2d tempest-VolumesActionsTest-1839563461 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: held 10.593s {{(pid=84538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 19:05:00 devstack cinder-volume[84538]: DEBUG cinder.volume.manager [None req-cf4ba444-aa4c-472b-8fc6-c4f5efa89f2d tempest-VolumesActionsTest-1839563461 None] Uploaded volume to glance image-id: 72bd5743-c5aa-4003-aac3-cb2ca2d933b5. {{(pid=84538) copy_volume_to_image /opt/stack/cinder/cinder/volume/manager.py:1781}} Apr 29 19:05:00 devstack cinder-volume[84538]: DEBUG oslo_concurrency.lockutils [None req-b65fb8dc-9bba-4b8c-a763-60eafe6d9390 tempest-VolumesListTestJSON-1695505021 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 12.222s {{(pid=84538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 19:05:00 devstack cinder-volume[84538]: DEBUG cinder.volume.drivers.quobyte [None req-b65fb8dc-9bba-4b8c-a763-60eafe6d9390 tempest-VolumesListTestJSON-1695505021 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-29T17:04:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-1276085500',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=da8c4537-b5c7-46e5-b7a0-d0379e4105bf,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='ec2a7decc4f54bab96570e941c207171',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T17:04:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T17:04:49Z,use_quota=True,user_id='d06c72522a3c4026ac17a414ac13121f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(62b05900-93e3-4190-a88f-1d87324303d1),volume_type_id=62b05900-93e3-4190-a88f-1d87324303d1)}" {{(pid=84538) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 29 19:05:00 devstack cinder-volume[84538]: DEBUG cinder.volume.drivers.remotefs [None req-b65fb8dc-9bba-4b8c-a763-60eafe6d9390 tempest-VolumesListTestJSON-1695505021 None] Creating volume da8c4537-b5c7-46e5-b7a0-d0379e4105bf {{(pid=84538) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 29 19:05:00 devstack cinder-volume[84538]: DEBUG oslo_concurrency.lockutils [None req-b65fb8dc-9bba-4b8c-a763-60eafe6d9390 tempest-VolumesListTestJSON-1695505021 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 19:05:00 devstack cinder-volume[84538]: DEBUG oslo_concurrency.lockutils [None req-b65fb8dc-9bba-4b8c-a763-60eafe6d9390 tempest-VolumesListTestJSON-1695505021 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 19:05:00 devstack cinder-volume[84538]: DEBUG cinder.volume.drivers.quobyte [None req-b65fb8dc-9bba-4b8c-a763-60eafe6d9390 tempest-VolumesListTestJSON-1695505021 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-34312b00-dd6d-45bb-af98-75855cea8e48': None} {{(pid=84538) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 19:05:01 devstack cinder-volume[84538]: DEBUG cinder.volume.drivers.quobyte [None req-b65fb8dc-9bba-4b8c-a763-60eafe6d9390 tempest-VolumesListTestJSON-1695505021 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-34312b00-dd6d-45bb-af98-75855cea8e48'] {{(pid=84538) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 19:05:01 devstack cinder-volume[84538]: DEBUG oslo_concurrency.lockutils [None req-b65fb8dc-9bba-4b8c-a763-60eafe6d9390 tempest-VolumesListTestJSON-1695505021 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=84538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 19:05:01 devstack cinder-volume[84538]: DEBUG cinder.volume.drivers.quobyte [None req-b65fb8dc-9bba-4b8c-a763-60eafe6d9390 tempest-VolumesListTestJSON-1695505021 None] Selected osci02.corp.quobyte.com/cinder-vol-34312b00-dd6d-45bb-af98-75855cea8e48 as target Quobyte volume. {{(pid=84538) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 29 19:05:01 devstack cinder-volume[84538]: INFO cinder.volume.drivers.remotefs [None req-b65fb8dc-9bba-4b8c-a763-60eafe6d9390 tempest-VolumesListTestJSON-1695505021 None] casted to osci02.corp.quobyte.com/cinder-vol-34312b00-dd6d-45bb-af98-75855cea8e48 Apr 29 19:05:01 devstack cinder-volume[84538]: DEBUG oslo_concurrency.processutils [None req-b65fb8dc-9bba-4b8c-a763-60eafe6d9390 tempest-VolumesListTestJSON-1695505021 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-da8c4537-b5c7-46e5-b7a0-d0379e4105bf 1073741824 {{(pid=84538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 19:05:01 devstack sudo[91969]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-da8c4537-b5c7-46e5-b7a0-d0379e4105bf 1073741824 Apr 29 19:05:01 devstack sudo[91969]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 19:05:01 devstack cinder-volume[84538]: INFO cinder.volume.manager [None req-cf4ba444-aa4c-472b-8fc6-c4f5efa89f2d tempest-VolumesActionsTest-1839563461 None] Copy volume to image completed successfully. Apr 29 19:05:01 devstack sudo[91969]: pam_unix(sudo:session): session closed for user root Apr 29 19:05:01 devstack cinder-volume[84538]: DEBUG oslo_concurrency.processutils [None req-b65fb8dc-9bba-4b8c-a763-60eafe6d9390 tempest-VolumesListTestJSON-1695505021 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-da8c4537-b5c7-46e5-b7a0-d0379e4105bf 1073741824" returned: 0 in 0.776s {{(pid=84538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 19:05:01 devstack cinder-volume[84538]: DEBUG oslo_concurrency.processutils [None req-b65fb8dc-9bba-4b8c-a763-60eafe6d9390 tempest-VolumesListTestJSON-1695505021 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-da8c4537-b5c7-46e5-b7a0-d0379e4105bf {{(pid=84538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 19:05:01 devstack sudo[91978]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-da8c4537-b5c7-46e5-b7a0-d0379e4105bf Apr 29 19:05:01 devstack sudo[91978]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 19:05:02 devstack cinder-volume[84538]: DEBUG cinder.coordination [None req-9e4a64e0-259b-4bb2-b58a-5bb0a2fb0d85 tempest-VolumesActionsTest-1839563461 None] Acquiring lock "cinder-c66b0dde-dec4-44cc-b0fe-7b7f63fa3d6a-delete_volume" by "delete_volume" {{(pid=84538) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 19:05:02 devstack cinder-volume[84538]: DEBUG cinder.coordination [None req-9e4a64e0-259b-4bb2-b58a-5bb0a2fb0d85 tempest-VolumesActionsTest-1839563461 None] Lock "cinder-c66b0dde-dec4-44cc-b0fe-7b7f63fa3d6a-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=84538) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 19:05:02 devstack cinder-volume[84538]: DEBUG cinder.coordination [None req-9e4a64e0-259b-4bb2-b58a-5bb0a2fb0d85 tempest-VolumesActionsTest-1839563461 None] Acquiring lock "cinder-quobyte-c66b0dde-dec4-44cc-b0fe-7b7f63fa3d6a" by "delete_volume" {{(pid=84538) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 19:05:02 devstack cinder-volume[84538]: DEBUG cinder.coordination [None req-9e4a64e0-259b-4bb2-b58a-5bb0a2fb0d85 tempest-VolumesActionsTest-1839563461 None] Lock "cinder-quobyte-c66b0dde-dec4-44cc-b0fe-7b7f63fa3d6a" acquired by "delete_volume" :: waited 0.018s {{(pid=84538) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 19:05:02 devstack cinder-volume[84538]: DEBUG oslo.privsep.daemon [-] privsep: reply[56a1c225-3f01-4863-955d-4c709ad40b6f]: (4, 'qcow2') {{(pid=85803) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 19:05:02 devstack sudo[91978]: pam_unix(sudo:session): session closed for user root Apr 29 19:05:02 devstack cinder-volume[84538]: DEBUG oslo_concurrency.processutils [None req-9e4a64e0-259b-4bb2-b58a-5bb0a2fb0d85 tempest-VolumesActionsTest-1839563461 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-c66b0dde-dec4-44cc-b0fe-7b7f63fa3d6a {{(pid=84538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 19:05:02 devstack cinder-volume[84538]: DEBUG oslo_concurrency.processutils [None req-b65fb8dc-9bba-4b8c-a763-60eafe6d9390 tempest-VolumesListTestJSON-1695505021 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-da8c4537-b5c7-46e5-b7a0-d0379e4105bf" returned: 0 in 0.658s {{(pid=84538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 19:05:02 devstack cinder-volume[84538]: DEBUG cinder.volume.drivers.quobyte [None req-b65fb8dc-9bba-4b8c-a763-60eafe6d9390 tempest-VolumesListTestJSON-1695505021 None] <== create_volume: return (1478ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-34312b00-dd6d-45bb-af98-75855cea8e48'} {{(pid=84538) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 29 19:05:02 devstack cinder-volume[84538]: DEBUG oslo_concurrency.lockutils [None req-b65fb8dc-9bba-4b8c-a763-60eafe6d9390 tempest-VolumesListTestJSON-1695505021 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.481s {{(pid=84538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 19:05:02 devstack cinder-volume[84538]: DEBUG oslo_concurrency.lockutils [None req-0d0f202a-1a0d-445d-b792-b7d42829afd2 tempest-VolumesSnapshotTestJSON-1345007867 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 12.669s {{(pid=84538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 19:05:02 devstack cinder-volume[84538]: DEBUG cinder.volume.manager [None req-b65fb8dc-9bba-4b8c-a763-60eafe6d9390 tempest-VolumesListTestJSON-1695505021 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8da82b5f-5400-4ad1-b6e6-70f0e42c0ba5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-da8c4537-b5c7-46e5-b7a0-d0379e4105bf', 'volume_size': 1}' {{(pid=84538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 19:05:02 devstack cinder-volume[84538]: DEBUG cinder.volume.manager [None req-b65fb8dc-9bba-4b8c-a763-60eafe6d9390 tempest-VolumesListTestJSON-1695505021 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (446b5144-73b4-4552-b5fa-7a65daa623d1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 19:05:02 devstack cinder-volume[84538]: DEBUG cinder.volume.drivers.remotefs [None req-0d0f202a-1a0d-445d-b792-b7d42829afd2 tempest-VolumesSnapshotTestJSON-1345007867 None] Creating offline snapshot 497d286e-63eb-4892-9655-520934c8cc0a of volume 8ffdf26a-b64d-43d0-8e13-5805979ca936 {{(pid=84538) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}} Apr 29 19:05:02 devstack cinder-volume[84538]: INFO cinder.volume.flows.manager.create_volume [None req-b65fb8dc-9bba-4b8c-a763-60eafe6d9390 tempest-VolumesListTestJSON-1695505021 None] Volume volume-da8c4537-b5c7-46e5-b7a0-d0379e4105bf (da8c4537-b5c7-46e5-b7a0-d0379e4105bf): created successfully Apr 29 19:05:02 devstack cinder-volume[84538]: DEBUG cinder.volume.manager [None req-b65fb8dc-9bba-4b8c-a763-60eafe6d9390 tempest-VolumesListTestJSON-1695505021 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (446b5144-73b4-4552-b5fa-7a65daa623d1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 19:05:02 devstack cinder-volume[84538]: DEBUG cinder.volume.manager [None req-b65fb8dc-9bba-4b8c-a763-60eafe6d9390 tempest-VolumesListTestJSON-1695505021 None] Flow 'volume_create_manager' (174343c6-49b0-463c-93b4-d59f238d4c4b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84538) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 19:05:02 devstack cinder-volume[84538]: DEBUG oslo.privsep.daemon [-] privsep: reply[b9a86cb5-9433-47d0-8dd6-81a82612791a]: (4, 'qcow2') {{(pid=85803) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 19:05:02 devstack cinder-volume[84538]: DEBUG oslo_concurrency.processutils [None req-0d0f202a-1a0d-445d-b792-b7d42829afd2 tempest-VolumesSnapshotTestJSON-1345007867 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-8ffdf26a-b64d-43d0-8e13-5805979ca936 {{(pid=84538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 19:05:02 devstack cinder-volume[84538]: INFO cinder.volume.manager [None req-b65fb8dc-9bba-4b8c-a763-60eafe6d9390 tempest-VolumesListTestJSON-1695505021 None] Created volume successfully. Apr 29 19:05:02 devstack sudo[91981]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-c66b0dde-dec4-44cc-b0fe-7b7f63fa3d6a Apr 29 19:05:02 devstack sudo[91981]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 19:05:02 devstack sudo[91982]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-8ffdf26a-b64d-43d0-8e13-5805979ca936 Apr 29 19:05:02 devstack sudo[91982]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 19:05:03 devstack sudo[91981]: pam_unix(sudo:session): session closed for user root Apr 29 19:05:03 devstack cinder-volume[84538]: DEBUG oslo_concurrency.processutils [None req-9e4a64e0-259b-4bb2-b58a-5bb0a2fb0d85 tempest-VolumesActionsTest-1839563461 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-c66b0dde-dec4-44cc-b0fe-7b7f63fa3d6a" returned: 0 in 0.780s {{(pid=84538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 19:05:03 devstack cinder-volume[84538]: DEBUG oslo_concurrency.processutils [None req-9e4a64e0-259b-4bb2-b58a-5bb0a2fb0d85 tempest-VolumesActionsTest-1839563461 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-c66b0dde-dec4-44cc-b0fe-7b7f63fa3d6a {{(pid=84538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 19:05:03 devstack sudo[91992]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-c66b0dde-dec4-44cc-b0fe-7b7f63fa3d6a Apr 29 19:05:03 devstack sudo[91992]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 19:05:03 devstack cinder-volume[84538]: DEBUG cinder.volume.flows.manager.create_volume [None req-4789f167-62e4-4ee6-9855-74aa53aa96e2 tempest-VolumesListTestJSON-1695505021 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84538) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Apr 29 19:05:03 devstack cinder-volume[84538]: DEBUG cinder.volume.manager [None req-4789f167-62e4-4ee6-9855-74aa53aa96e2 tempest-VolumesListTestJSON-1695505021 None] Flow 'volume_create_manager' (ed5f9263-5728-4e7d-9e01-f3bf3e905476) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84538) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 19:05:03 devstack cinder-volume[84538]: DEBUG cinder.volume.manager [None req-4789f167-62e4-4ee6-9855-74aa53aa96e2 tempest-VolumesListTestJSON-1695505021 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e9739db0-ff51-47b4-9592-7dfcb8567f1a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 19:05:03 devstack sudo[91982]: pam_unix(sudo:session): session closed for user root Apr 29 19:05:03 devstack cinder-volume[84538]: DEBUG oslo_concurrency.processutils [None req-0d0f202a-1a0d-445d-b792-b7d42829afd2 tempest-VolumesSnapshotTestJSON-1345007867 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-8ffdf26a-b64d-43d0-8e13-5805979ca936" returned: 0 in 0.810s {{(pid=84538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 19:05:03 devstack cinder-volume[84538]: DEBUG oslo_concurrency.processutils [None req-0d0f202a-1a0d-445d-b792-b7d42829afd2 tempest-VolumesSnapshotTestJSON-1345007867 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-8ffdf26a-b64d-43d0-8e13-5805979ca936,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-8ffdf26a-b64d-43d0-8e13-5805979ca936.497d286e-63eb-4892-9655-520934c8cc0a 1G {{(pid=84538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 19:05:03 devstack cinder-volume[84538]: DEBUG cinder.volume.manager [None req-4789f167-62e4-4ee6-9855-74aa53aa96e2 tempest-VolumesListTestJSON-1695505021 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e9739db0-ff51-47b4-9592-7dfcb8567f1a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-29T17:05:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-961655784',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3f986dd2-41fd-405e-bc8a-d317bf3bbbf8,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='ec2a7decc4f54bab96570e941c207171',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T17:05:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T17:05:03Z,use_quota=True,user_id='d06c72522a3c4026ac17a414ac13121f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(62b05900-93e3-4190-a88f-1d87324303d1),volume_type_id=62b05900-93e3-4190-a88f-1d87324303d1)' {{(pid=84538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 19:05:03 devstack cinder-volume[84538]: DEBUG cinder.volume.manager [None req-4789f167-62e4-4ee6-9855-74aa53aa96e2 tempest-VolumesListTestJSON-1695505021 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3e86b52b-2541-4caf-ba64-234d80201146) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 19:05:03 devstack sudo[91994]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-8ffdf26a-b64d-43d0-8e13-5805979ca936,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-8ffdf26a-b64d-43d0-8e13-5805979ca936.497d286e-63eb-4892-9655-520934c8cc0a 1G Apr 29 19:05:03 devstack cinder-volume[84538]: DEBUG cinder.volume.manager [None req-4789f167-62e4-4ee6-9855-74aa53aa96e2 tempest-VolumesListTestJSON-1695505021 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3e86b52b-2541-4caf-ba64-234d80201146) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 19:05:03 devstack sudo[91994]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 19:05:03 devstack cinder-volume[84538]: DEBUG cinder.volume.manager [None req-4789f167-62e4-4ee6-9855-74aa53aa96e2 tempest-VolumesListTestJSON-1695505021 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (38f592c4-7a69-4c75-a19c-8f36dfd53fe4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 19:05:03 devstack cinder-volume[84538]: DEBUG cinder.volume.manager [None req-4789f167-62e4-4ee6-9855-74aa53aa96e2 tempest-VolumesListTestJSON-1695505021 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (38f592c4-7a69-4c75-a19c-8f36dfd53fe4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3f986dd2-41fd-405e-bc8a-d317bf3bbbf8', 'volume_name': 'volume-3f986dd2-41fd-405e-bc8a-d317bf3bbbf8', 'volume_size': 1}' {{(pid=84538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 19:05:03 devstack cinder-volume[84538]: DEBUG cinder.volume.manager [None req-4789f167-62e4-4ee6-9855-74aa53aa96e2 tempest-VolumesListTestJSON-1695505021 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a4f8fa1c-07db-4949-b84a-504fa811460f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 19:05:03 devstack cinder-volume[84538]: DEBUG cinder.volume.manager [None req-4789f167-62e4-4ee6-9855-74aa53aa96e2 tempest-VolumesListTestJSON-1695505021 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a4f8fa1c-07db-4949-b84a-504fa811460f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 19:05:03 devstack cinder-volume[84538]: DEBUG cinder.volume.manager [None req-4789f167-62e4-4ee6-9855-74aa53aa96e2 tempest-VolumesListTestJSON-1695505021 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (edcf51f9-8ba2-45cc-a6ab-2d462f283a6c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 19:05:03 devstack cinder-volume[84538]: INFO cinder.volume.flows.manager.create_volume [None req-4789f167-62e4-4ee6-9855-74aa53aa96e2 tempest-VolumesListTestJSON-1695505021 None] Volume 3f986dd2-41fd-405e-bc8a-d317bf3bbbf8: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3f986dd2-41fd-405e-bc8a-d317bf3bbbf8', 'volume_size': 1} Apr 29 19:05:03 devstack cinder-volume[84538]: DEBUG oslo_concurrency.lockutils [None req-4789f167-62e4-4ee6-9855-74aa53aa96e2 tempest-VolumesListTestJSON-1695505021 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 19:05:03 devstack sudo[91992]: pam_unix(sudo:session): session closed for user root Apr 29 19:05:03 devstack cinder-volume[84538]: DEBUG oslo_concurrency.processutils [None req-9e4a64e0-259b-4bb2-b58a-5bb0a2fb0d85 tempest-VolumesActionsTest-1839563461 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-c66b0dde-dec4-44cc-b0fe-7b7f63fa3d6a" returned: 0 in 0.616s {{(pid=84538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 19:05:03 devstack cinder-volume[84538]: DEBUG cinder.coordination [None req-9e4a64e0-259b-4bb2-b58a-5bb0a2fb0d85 tempest-VolumesActionsTest-1839563461 None] Lock "cinder-quobyte-c66b0dde-dec4-44cc-b0fe-7b7f63fa3d6a" released by "delete_volume" :: held 1.435s {{(pid=84538) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 19:05:03 devstack cinder-volume[84538]: DEBUG cinder.quota [None req-9e4a64e0-259b-4bb2-b58a-5bb0a2fb0d85 tempest-VolumesActionsTest-1839563461 None] Created reservations ['b2bd8372-dc8c-464c-b727-8034c5358620', 'c97568fc-4392-4cea-a499-5a5e8f703ad3', 'c8776262-9ba3-4195-8485-c9dffcf2d8c2', '95f77de9-d4b1-4ca8-8d16-894517d30900'] {{(pid=84538) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 29 19:05:03 devstack cinder-volume[84538]: DEBUG oslo_concurrency.lockutils [None req-9e4a64e0-259b-4bb2-b58a-5bb0a2fb0d85 tempest-VolumesActionsTest-1839563461 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 19:05:03 devstack cinder-volume[84538]: DEBUG oslo_concurrency.lockutils [None req-9e4a64e0-259b-4bb2-b58a-5bb0a2fb0d85 tempest-VolumesActionsTest-1839563461 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 19:05:03 devstack cinder-volume[84538]: DEBUG cinder.volume.drivers.quobyte [None req-9e4a64e0-259b-4bb2-b58a-5bb0a2fb0d85 tempest-VolumesActionsTest-1839563461 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-34312b00-dd6d-45bb-af98-75855cea8e48': None} {{(pid=84538) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 19:05:03 devstack cinder-volume[84538]: DEBUG cinder.volume.drivers.quobyte [None req-9e4a64e0-259b-4bb2-b58a-5bb0a2fb0d85 tempest-VolumesActionsTest-1839563461 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-34312b00-dd6d-45bb-af98-75855cea8e48'] {{(pid=84538) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 19:05:03 devstack cinder-volume[84538]: DEBUG oslo_concurrency.lockutils [None req-9e4a64e0-259b-4bb2-b58a-5bb0a2fb0d85 tempest-VolumesActionsTest-1839563461 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=84538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 19:05:03 devstack cinder-volume[84538]: DEBUG oslo_concurrency.processutils [None req-9e4a64e0-259b-4bb2-b58a-5bb0a2fb0d85 tempest-VolumesActionsTest-1839563461 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d {{(pid=84538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 19:05:04 devstack sudo[92000]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d Apr 29 19:05:04 devstack sudo[92000]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 19:05:04 devstack sudo[91994]: pam_unix(sudo:session): session closed for user root Apr 29 19:05:04 devstack cinder-volume[84538]: DEBUG oslo_concurrency.processutils [None req-0d0f202a-1a0d-445d-b792-b7d42829afd2 tempest-VolumesSnapshotTestJSON-1345007867 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-8ffdf26a-b64d-43d0-8e13-5805979ca936,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-8ffdf26a-b64d-43d0-8e13-5805979ca936.497d286e-63eb-4892-9655-520934c8cc0a 1G" returned: 0 in 0.771s {{(pid=84538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 19:05:04 devstack cinder-volume[84538]: DEBUG oslo_concurrency.processutils [None req-0d0f202a-1a0d-445d-b792-b7d42829afd2 tempest-VolumesSnapshotTestJSON-1345007867 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-8ffdf26a-b64d-43d0-8e13-5805979ca936 -F qcow2 /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-8ffdf26a-b64d-43d0-8e13-5805979ca936.497d286e-63eb-4892-9655-520934c8cc0a {{(pid=84538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 19:05:04 devstack sudo[92003]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-8ffdf26a-b64d-43d0-8e13-5805979ca936 -F qcow2 /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-8ffdf26a-b64d-43d0-8e13-5805979ca936.497d286e-63eb-4892-9655-520934c8cc0a Apr 29 19:05:04 devstack sudo[92003]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 19:05:04 devstack sudo[92000]: pam_unix(sudo:session): session closed for user root Apr 29 19:05:04 devstack cinder-volume[84538]: DEBUG oslo_concurrency.processutils [None req-9e4a64e0-259b-4bb2-b58a-5bb0a2fb0d85 tempest-VolumesActionsTest-1839563461 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d" returned: 0 in 0.643s {{(pid=84538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 19:05:04 devstack cinder-volume[84538]: DEBUG cinder.manager [None req-9e4a64e0-259b-4bb2-b58a-5bb0a2fb0d85 tempest-VolumesActionsTest-1839563461 None] Notifying Schedulers of capabilities ... {{(pid=84538) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 29 19:05:04 devstack cinder-volume[84538]: INFO cinder.volume.manager [None req-9e4a64e0-259b-4bb2-b58a-5bb0a2fb0d85 tempest-VolumesActionsTest-1839563461 None] Deleted volume successfully. Apr 29 19:05:04 devstack cinder-volume[84538]: DEBUG cinder.coordination [None req-9e4a64e0-259b-4bb2-b58a-5bb0a2fb0d85 tempest-VolumesActionsTest-1839563461 None] Lock "cinder-c66b0dde-dec4-44cc-b0fe-7b7f63fa3d6a-delete_volume" released by "delete_volume" :: held 2.283s {{(pid=84538) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 19:05:04 devstack sudo[92003]: pam_unix(sudo:session): session closed for user root Apr 29 19:05:04 devstack cinder-volume[84538]: DEBUG oslo_concurrency.processutils [None req-0d0f202a-1a0d-445d-b792-b7d42829afd2 tempest-VolumesSnapshotTestJSON-1345007867 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-8ffdf26a-b64d-43d0-8e13-5805979ca936 -F qcow2 /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-8ffdf26a-b64d-43d0-8e13-5805979ca936.497d286e-63eb-4892-9655-520934c8cc0a" returned: 0 in 0.668s {{(pid=84538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 19:05:04 devstack cinder-volume[84538]: WARNING cinder.volume.drivers.remotefs [None req-0d0f202a-1a0d-445d-b792-b7d42829afd2 tempest-VolumesSnapshotTestJSON-1345007867 None] /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-8ffdf26a-b64d-43d0-8e13-5805979ca936.497d286e-63eb-4892-9655-520934c8cc0a is being set with open permissions: ugo+rw Apr 29 19:05:04 devstack cinder-volume[84538]: DEBUG oslo_concurrency.processutils [None req-0d0f202a-1a0d-445d-b792-b7d42829afd2 tempest-VolumesSnapshotTestJSON-1345007867 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-8ffdf26a-b64d-43d0-8e13-5805979ca936.497d286e-63eb-4892-9655-520934c8cc0a {{(pid=84538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 19:05:04 devstack sudo[92009]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-8ffdf26a-b64d-43d0-8e13-5805979ca936.497d286e-63eb-4892-9655-520934c8cc0a Apr 29 19:05:04 devstack sudo[92009]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 19:05:05 devstack sudo[92009]: pam_unix(sudo:session): session closed for user root Apr 29 19:05:05 devstack cinder-volume[84538]: DEBUG oslo_concurrency.processutils [None req-0d0f202a-1a0d-445d-b792-b7d42829afd2 tempest-VolumesSnapshotTestJSON-1345007867 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-8ffdf26a-b64d-43d0-8e13-5805979ca936.497d286e-63eb-4892-9655-520934c8cc0a" returned: 0 in 0.641s {{(pid=84538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 19:05:05 devstack cinder-volume[84538]: DEBUG oslo_concurrency.processutils [None req-0d0f202a-1a0d-445d-b792-b7d42829afd2 tempest-VolumesSnapshotTestJSON-1345007867 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-8ffdf26a-b64d-43d0-8e13-5805979ca936.info {{(pid=84538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 19:05:05 devstack sudo[92013]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-8ffdf26a-b64d-43d0-8e13-5805979ca936.info Apr 29 19:05:05 devstack sudo[92013]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 19:05:06 devstack sudo[92013]: pam_unix(sudo:session): session closed for user root Apr 29 19:05:06 devstack cinder-volume[84538]: DEBUG oslo_concurrency.processutils [None req-0d0f202a-1a0d-445d-b792-b7d42829afd2 tempest-VolumesSnapshotTestJSON-1345007867 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-8ffdf26a-b64d-43d0-8e13-5805979ca936.info" returned: 0 in 0.612s {{(pid=84538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 19:05:06 devstack cinder-volume[84538]: WARNING cinder.volume.drivers.remotefs [None req-0d0f202a-1a0d-445d-b792-b7d42829afd2 tempest-VolumesSnapshotTestJSON-1345007867 None] /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-8ffdf26a-b64d-43d0-8e13-5805979ca936.info is being set with open permissions: ugo+rw Apr 29 19:05:06 devstack cinder-volume[84538]: DEBUG oslo_concurrency.processutils [None req-0d0f202a-1a0d-445d-b792-b7d42829afd2 tempest-VolumesSnapshotTestJSON-1345007867 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-8ffdf26a-b64d-43d0-8e13-5805979ca936.info {{(pid=84538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 19:05:06 devstack sudo[92017]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-8ffdf26a-b64d-43d0-8e13-5805979ca936.info Apr 29 19:05:06 devstack sudo[92017]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 19:05:06 devstack sudo[92017]: pam_unix(sudo:session): session closed for user root Apr 29 19:05:06 devstack cinder-volume[84538]: DEBUG oslo_concurrency.processutils [None req-0d0f202a-1a0d-445d-b792-b7d42829afd2 tempest-VolumesSnapshotTestJSON-1345007867 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-8ffdf26a-b64d-43d0-8e13-5805979ca936.info" returned: 0 in 0.614s {{(pid=84538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 19:05:06 devstack cinder-volume[84538]: DEBUG oslo_concurrency.lockutils [None req-0d0f202a-1a0d-445d-b792-b7d42829afd2 tempest-VolumesSnapshotTestJSON-1345007867 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.245s {{(pid=84538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 19:05:06 devstack cinder-volume[84538]: DEBUG oslo_concurrency.lockutils [None req-9f905043-ef39-4c4e-b477-727887c4cc6b tempest-CinderUnicodeTest-1144970881 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 14.682s {{(pid=84538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 19:05:06 devstack cinder-volume[84538]: DEBUG cinder.volume.drivers.quobyte [None req-9f905043-ef39-4c4e-b477-727887c4cc6b tempest-CinderUnicodeTest-1144970881 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-29T17:04:52Z,deleted=False,deleted_at=None,display_description='קייפש',display_name='tempest-CinderUnicodeTest-Volume-951760118',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=723bbfbf-d981-4a0e-8a8c-2bbf66f2115e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='db780ad6ce764618aa4b3861b448fe17',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T17:04:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T17:04:52Z,use_quota=True,user_id='d4c1e6e150af4dca9a679db078e1b16e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(62b05900-93e3-4190-a88f-1d87324303d1),volume_type_id=62b05900-93e3-4190-a88f-1d87324303d1)}" {{(pid=84538) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 29 19:05:06 devstack cinder-volume[84538]: DEBUG cinder.volume.drivers.remotefs [None req-9f905043-ef39-4c4e-b477-727887c4cc6b tempest-CinderUnicodeTest-1144970881 None] Creating volume 723bbfbf-d981-4a0e-8a8c-2bbf66f2115e {{(pid=84538) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 29 19:05:06 devstack cinder-volume[84538]: DEBUG oslo_concurrency.lockutils [None req-9f905043-ef39-4c4e-b477-727887c4cc6b tempest-CinderUnicodeTest-1144970881 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 19:05:06 devstack cinder-volume[84538]: DEBUG oslo_concurrency.lockutils [None req-9f905043-ef39-4c4e-b477-727887c4cc6b tempest-CinderUnicodeTest-1144970881 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 19:05:06 devstack cinder-volume[84538]: DEBUG cinder.volume.drivers.quobyte [None req-9f905043-ef39-4c4e-b477-727887c4cc6b tempest-CinderUnicodeTest-1144970881 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-34312b00-dd6d-45bb-af98-75855cea8e48': None} {{(pid=84538) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 19:05:06 devstack cinder-volume[84538]: DEBUG cinder.volume.drivers.quobyte [None req-9f905043-ef39-4c4e-b477-727887c4cc6b tempest-CinderUnicodeTest-1144970881 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-34312b00-dd6d-45bb-af98-75855cea8e48'] {{(pid=84538) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 19:05:06 devstack cinder-volume[84538]: DEBUG oslo_concurrency.lockutils [None req-9f905043-ef39-4c4e-b477-727887c4cc6b tempest-CinderUnicodeTest-1144970881 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=84538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 19:05:06 devstack cinder-volume[84538]: DEBUG cinder.volume.drivers.quobyte [None req-9f905043-ef39-4c4e-b477-727887c4cc6b tempest-CinderUnicodeTest-1144970881 None] Selected osci02.corp.quobyte.com/cinder-vol-34312b00-dd6d-45bb-af98-75855cea8e48 as target Quobyte volume. {{(pid=84538) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 29 19:05:06 devstack cinder-volume[84538]: INFO cinder.volume.drivers.remotefs [None req-9f905043-ef39-4c4e-b477-727887c4cc6b tempest-CinderUnicodeTest-1144970881 None] casted to osci02.corp.quobyte.com/cinder-vol-34312b00-dd6d-45bb-af98-75855cea8e48 Apr 29 19:05:06 devstack cinder-volume[84538]: DEBUG oslo_concurrency.processutils [None req-9f905043-ef39-4c4e-b477-727887c4cc6b tempest-CinderUnicodeTest-1144970881 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-723bbfbf-d981-4a0e-8a8c-2bbf66f2115e 1073741824 {{(pid=84538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 19:05:06 devstack sudo[92020]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-723bbfbf-d981-4a0e-8a8c-2bbf66f2115e 1073741824 Apr 29 19:05:06 devstack sudo[92020]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 19:05:06 devstack cinder-volume[84538]: INFO cinder.volume.manager [None req-0d0f202a-1a0d-445d-b792-b7d42829afd2 tempest-VolumesSnapshotTestJSON-1345007867 None] Create snapshot completed successfully Apr 29 19:05:07 devstack sudo[92020]: pam_unix(sudo:session): session closed for user root Apr 29 19:05:07 devstack cinder-volume[84538]: DEBUG oslo_concurrency.processutils [None req-9f905043-ef39-4c4e-b477-727887c4cc6b tempest-CinderUnicodeTest-1144970881 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-723bbfbf-d981-4a0e-8a8c-2bbf66f2115e 1073741824" returned: 0 in 0.913s {{(pid=84538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 19:05:07 devstack cinder-volume[84538]: DEBUG oslo_concurrency.processutils [None req-9f905043-ef39-4c4e-b477-727887c4cc6b tempest-CinderUnicodeTest-1144970881 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-723bbfbf-d981-4a0e-8a8c-2bbf66f2115e {{(pid=84538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 19:05:07 devstack sudo[92026]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-723bbfbf-d981-4a0e-8a8c-2bbf66f2115e Apr 29 19:05:07 devstack sudo[92026]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 19:05:08 devstack cinder-volume[84538]: DEBUG cinder.volume.flows.manager.create_volume [None req-63fd04bb-50de-49d0-abf8-48188c72f7f3 tempest-VolumesSnapshotTestJSON-1345007867 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84538) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Apr 29 19:05:08 devstack cinder-volume[84538]: DEBUG cinder.volume.manager [None req-63fd04bb-50de-49d0-abf8-48188c72f7f3 tempest-VolumesSnapshotTestJSON-1345007867 None] Flow 'volume_create_manager' (f80ebeb8-ec3d-4228-b529-0561414149ed) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84538) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 19:05:08 devstack cinder-volume[84538]: DEBUG cinder.volume.manager [None req-63fd04bb-50de-49d0-abf8-48188c72f7f3 tempest-VolumesSnapshotTestJSON-1345007867 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (db2d7e17-382e-46fa-9375-38510416636d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 19:05:08 devstack cinder-volume[84538]: DEBUG cinder.volume.manager [None req-63fd04bb-50de-49d0-abf8-48188c72f7f3 tempest-VolumesSnapshotTestJSON-1345007867 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (db2d7e17-382e-46fa-9375-38510416636d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-29T17:05:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-1247808831',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=937f22e8-a48b-48ba-a1f4-be84561e4f52,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cb1bf99b4f1a451dbdf762aff4ec180c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T17:05:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=497d286e-63eb-4892-9655-520934c8cc0a,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T17:05:08Z,use_quota=True,user_id='987ad9d695504aeba3196f9a11cdf3cf',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(62b05900-93e3-4190-a88f-1d87324303d1),volume_type_id=62b05900-93e3-4190-a88f-1d87324303d1)' {{(pid=84538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 19:05:08 devstack cinder-volume[84538]: DEBUG cinder.volume.manager [None req-63fd04bb-50de-49d0-abf8-48188c72f7f3 tempest-VolumesSnapshotTestJSON-1345007867 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5d011da5-e35a-4800-ab48-2fc8083b8a9f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 19:05:08 devstack cinder-volume[84538]: DEBUG cinder.volume.manager [None req-63fd04bb-50de-49d0-abf8-48188c72f7f3 tempest-VolumesSnapshotTestJSON-1345007867 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5d011da5-e35a-4800-ab48-2fc8083b8a9f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 19:05:08 devstack cinder-volume[84538]: DEBUG cinder.volume.manager [None req-63fd04bb-50de-49d0-abf8-48188c72f7f3 tempest-VolumesSnapshotTestJSON-1345007867 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0233652b-8414-42e6-8ab6-08000920c893) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 19:05:08 devstack cinder-volume[84538]: DEBUG cinder.volume.manager [None req-63fd04bb-50de-49d0-abf8-48188c72f7f3 tempest-VolumesSnapshotTestJSON-1345007867 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0233652b-8414-42e6-8ab6-08000920c893) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '937f22e8-a48b-48ba-a1f4-be84561e4f52', 'volume_name': 'volume-937f22e8-a48b-48ba-a1f4-be84561e4f52', 'volume_size': 1, 'snapshot_id': '497d286e-63eb-4892-9655-520934c8cc0a'}' {{(pid=84538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 19:05:08 devstack cinder-volume[84538]: DEBUG cinder.volume.manager [None req-63fd04bb-50de-49d0-abf8-48188c72f7f3 tempest-VolumesSnapshotTestJSON-1345007867 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (74cfad31-aec9-4684-b90b-99d69481ff7d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 19:05:08 devstack cinder-volume[84538]: DEBUG cinder.volume.manager [None req-63fd04bb-50de-49d0-abf8-48188c72f7f3 tempest-VolumesSnapshotTestJSON-1345007867 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (74cfad31-aec9-4684-b90b-99d69481ff7d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 19:05:08 devstack cinder-volume[84538]: DEBUG cinder.volume.manager [None req-63fd04bb-50de-49d0-abf8-48188c72f7f3 tempest-VolumesSnapshotTestJSON-1345007867 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (160dbf84-c58c-4a04-b1f0-7a20a1e672b9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 19:05:08 devstack cinder-volume[84538]: INFO cinder.volume.flows.manager.create_volume [None req-63fd04bb-50de-49d0-abf8-48188c72f7f3 tempest-VolumesSnapshotTestJSON-1345007867 None] Volume 937f22e8-a48b-48ba-a1f4-be84561e4f52: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-937f22e8-a48b-48ba-a1f4-be84561e4f52', 'volume_size': 1, 'snapshot_id': '497d286e-63eb-4892-9655-520934c8cc0a'} Apr 29 19:05:08 devstack cinder-volume[84538]: DEBUG oslo_concurrency.lockutils [None req-63fd04bb-50de-49d0-abf8-48188c72f7f3 tempest-VolumesSnapshotTestJSON-1345007867 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=84538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 19:05:08 devstack sudo[92026]: pam_unix(sudo:session): session closed for user root Apr 29 19:05:08 devstack cinder-volume[84538]: DEBUG oslo_concurrency.processutils [None req-9f905043-ef39-4c4e-b477-727887c4cc6b tempest-CinderUnicodeTest-1144970881 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-723bbfbf-d981-4a0e-8a8c-2bbf66f2115e" returned: 0 in 0.713s {{(pid=84538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 19:05:08 devstack cinder-volume[84538]: DEBUG cinder.volume.drivers.quobyte [None req-9f905043-ef39-4c4e-b477-727887c4cc6b tempest-CinderUnicodeTest-1144970881 None] <== create_volume: return (1676ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-34312b00-dd6d-45bb-af98-75855cea8e48'} {{(pid=84538) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 29 19:05:08 devstack cinder-volume[84538]: DEBUG oslo_concurrency.lockutils [None req-9f905043-ef39-4c4e-b477-727887c4cc6b tempest-CinderUnicodeTest-1144970881 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.680s {{(pid=84538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 19:05:08 devstack cinder-volume[84538]: DEBUG oslo_concurrency.lockutils [None req-4789f167-62e4-4ee6-9855-74aa53aa96e2 tempest-VolumesListTestJSON-1695505021 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 5.000s {{(pid=84538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 19:05:08 devstack cinder-volume[84538]: DEBUG cinder.volume.drivers.quobyte [None req-4789f167-62e4-4ee6-9855-74aa53aa96e2 tempest-VolumesListTestJSON-1695505021 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-29T17:05:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-961655784',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3f986dd2-41fd-405e-bc8a-d317bf3bbbf8,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='ec2a7decc4f54bab96570e941c207171',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T17:05:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T17:05:03Z,use_quota=True,user_id='d06c72522a3c4026ac17a414ac13121f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(62b05900-93e3-4190-a88f-1d87324303d1),volume_type_id=62b05900-93e3-4190-a88f-1d87324303d1)}" {{(pid=84538) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 29 19:05:08 devstack cinder-volume[84538]: DEBUG cinder.volume.drivers.remotefs [None req-4789f167-62e4-4ee6-9855-74aa53aa96e2 tempest-VolumesListTestJSON-1695505021 None] Creating volume 3f986dd2-41fd-405e-bc8a-d317bf3bbbf8 {{(pid=84538) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 29 19:05:08 devstack cinder-volume[84538]: DEBUG oslo_concurrency.lockutils [None req-4789f167-62e4-4ee6-9855-74aa53aa96e2 tempest-VolumesListTestJSON-1695505021 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 19:05:08 devstack cinder-volume[84538]: DEBUG oslo_concurrency.lockutils [None req-4789f167-62e4-4ee6-9855-74aa53aa96e2 tempest-VolumesListTestJSON-1695505021 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 19:05:08 devstack cinder-volume[84538]: DEBUG cinder.volume.drivers.quobyte [None req-4789f167-62e4-4ee6-9855-74aa53aa96e2 tempest-VolumesListTestJSON-1695505021 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-34312b00-dd6d-45bb-af98-75855cea8e48': None} {{(pid=84538) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 19:05:08 devstack cinder-volume[84538]: DEBUG cinder.volume.drivers.quobyte [None req-4789f167-62e4-4ee6-9855-74aa53aa96e2 tempest-VolumesListTestJSON-1695505021 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-34312b00-dd6d-45bb-af98-75855cea8e48'] {{(pid=84538) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 19:05:08 devstack cinder-volume[84538]: DEBUG oslo_concurrency.lockutils [None req-4789f167-62e4-4ee6-9855-74aa53aa96e2 tempest-VolumesListTestJSON-1695505021 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=84538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 19:05:08 devstack cinder-volume[84538]: DEBUG cinder.volume.drivers.quobyte [None req-4789f167-62e4-4ee6-9855-74aa53aa96e2 tempest-VolumesListTestJSON-1695505021 None] Selected osci02.corp.quobyte.com/cinder-vol-34312b00-dd6d-45bb-af98-75855cea8e48 as target Quobyte volume. {{(pid=84538) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 29 19:05:08 devstack cinder-volume[84538]: INFO cinder.volume.drivers.remotefs [None req-4789f167-62e4-4ee6-9855-74aa53aa96e2 tempest-VolumesListTestJSON-1695505021 None] casted to osci02.corp.quobyte.com/cinder-vol-34312b00-dd6d-45bb-af98-75855cea8e48 Apr 29 19:05:08 devstack cinder-volume[84538]: DEBUG oslo_concurrency.processutils [None req-4789f167-62e4-4ee6-9855-74aa53aa96e2 tempest-VolumesListTestJSON-1695505021 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-3f986dd2-41fd-405e-bc8a-d317bf3bbbf8 1073741824 {{(pid=84538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 19:05:08 devstack cinder-volume[84538]: DEBUG cinder.volume.manager [None req-9f905043-ef39-4c4e-b477-727887c4cc6b tempest-CinderUnicodeTest-1144970881 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (29f59337-51e7-455a-b4fe-1adc2c8da493) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-723bbfbf-d981-4a0e-8a8c-2bbf66f2115e', 'volume_size': 1}' {{(pid=84538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 19:05:08 devstack sudo[92031]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-3f986dd2-41fd-405e-bc8a-d317bf3bbbf8 1073741824 Apr 29 19:05:08 devstack sudo[92031]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 19:05:08 devstack cinder-volume[84538]: DEBUG cinder.volume.manager [None req-9f905043-ef39-4c4e-b477-727887c4cc6b tempest-CinderUnicodeTest-1144970881 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c2a00674-5464-40b8-ae76-0735d47b6a7c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 19:05:08 devstack cinder-volume[84538]: INFO cinder.volume.flows.manager.create_volume [None req-9f905043-ef39-4c4e-b477-727887c4cc6b tempest-CinderUnicodeTest-1144970881 None] Volume volume-723bbfbf-d981-4a0e-8a8c-2bbf66f2115e (723bbfbf-d981-4a0e-8a8c-2bbf66f2115e): created successfully Apr 29 19:05:08 devstack cinder-volume[84538]: DEBUG cinder.volume.manager [None req-9f905043-ef39-4c4e-b477-727887c4cc6b tempest-CinderUnicodeTest-1144970881 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c2a00674-5464-40b8-ae76-0735d47b6a7c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 19:05:08 devstack cinder-volume[84538]: DEBUG cinder.volume.manager [None req-9f905043-ef39-4c4e-b477-727887c4cc6b tempest-CinderUnicodeTest-1144970881 None] Flow 'volume_create_manager' (826f3da3-c597-4975-b73f-4ace0adc86fe) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84538) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 19:05:08 devstack cinder-volume[84538]: INFO cinder.volume.manager [None req-9f905043-ef39-4c4e-b477-727887c4cc6b tempest-CinderUnicodeTest-1144970881 None] Created volume successfully. Apr 29 19:05:09 devstack sudo[92031]: pam_unix(sudo:session): session closed for user root Apr 29 19:05:09 devstack cinder-volume[84538]: DEBUG oslo_concurrency.processutils [None req-4789f167-62e4-4ee6-9855-74aa53aa96e2 tempest-VolumesListTestJSON-1695505021 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-3f986dd2-41fd-405e-bc8a-d317bf3bbbf8 1073741824" returned: 0 in 0.855s {{(pid=84538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 19:05:09 devstack cinder-volume[84538]: DEBUG oslo_concurrency.processutils [None req-4789f167-62e4-4ee6-9855-74aa53aa96e2 tempest-VolumesListTestJSON-1695505021 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-3f986dd2-41fd-405e-bc8a-d317bf3bbbf8 {{(pid=84538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 19:05:09 devstack sudo[92037]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-3f986dd2-41fd-405e-bc8a-d317bf3bbbf8 Apr 29 19:05:09 devstack sudo[92037]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 19:05:09 devstack cinder-volume[84538]: DEBUG oslo_concurrency.lockutils [None req-5a08b2a9-32ab-4f56-8d35-027b4b06a64f tempest-CinderUnicodeTest-1144970881 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=84538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 19:05:09 devstack sudo[92037]: pam_unix(sudo:session): session closed for user root Apr 29 19:05:09 devstack cinder-volume[84538]: DEBUG oslo_concurrency.processutils [None req-4789f167-62e4-4ee6-9855-74aa53aa96e2 tempest-VolumesListTestJSON-1695505021 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-3f986dd2-41fd-405e-bc8a-d317bf3bbbf8" returned: 0 in 0.658s {{(pid=84538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 19:05:09 devstack cinder-volume[84538]: DEBUG cinder.volume.drivers.quobyte [None req-4789f167-62e4-4ee6-9855-74aa53aa96e2 tempest-VolumesListTestJSON-1695505021 None] <== create_volume: return (1564ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-34312b00-dd6d-45bb-af98-75855cea8e48'} {{(pid=84538) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 29 19:05:09 devstack cinder-volume[84538]: DEBUG oslo_concurrency.lockutils [None req-4789f167-62e4-4ee6-9855-74aa53aa96e2 tempest-VolumesListTestJSON-1695505021 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.567s {{(pid=84538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 19:05:09 devstack cinder-volume[84538]: DEBUG oslo_concurrency.lockutils [None req-63fd04bb-50de-49d0-abf8-48188c72f7f3 tempest-VolumesSnapshotTestJSON-1345007867 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 1.716s {{(pid=84538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 19:05:09 devstack cinder-volume[84538]: DEBUG cinder.coordination [None req-63fd04bb-50de-49d0-abf8-48188c72f7f3 tempest-VolumesSnapshotTestJSON-1345007867 None] Acquiring lock "cinder-quobyte-497d286e-63eb-4892-9655-520934c8cc0a-937f22e8-a48b-48ba-a1f4-be84561e4f52" by "_create_volume_from_snapshot" {{(pid=84538) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 19:05:10 devstack cinder-volume[84538]: DEBUG cinder.volume.manager [None req-4789f167-62e4-4ee6-9855-74aa53aa96e2 tempest-VolumesListTestJSON-1695505021 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (edcf51f9-8ba2-45cc-a6ab-2d462f283a6c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3f986dd2-41fd-405e-bc8a-d317bf3bbbf8', 'volume_size': 1}' {{(pid=84538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 19:05:10 devstack cinder-volume[84538]: DEBUG cinder.volume.manager [None req-4789f167-62e4-4ee6-9855-74aa53aa96e2 tempest-VolumesListTestJSON-1695505021 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (74e8777c-32d7-4f32-aec0-dc1aea0215f9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 19:05:10 devstack cinder-volume[84538]: DEBUG cinder.coordination [None req-63fd04bb-50de-49d0-abf8-48188c72f7f3 tempest-VolumesSnapshotTestJSON-1345007867 None] Lock "cinder-quobyte-497d286e-63eb-4892-9655-520934c8cc0a-937f22e8-a48b-48ba-a1f4-be84561e4f52" acquired by "_create_volume_from_snapshot" :: waited 0.036s {{(pid=84538) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 19:05:10 devstack cinder-volume[84538]: DEBUG cinder.volume.drivers.quobyte [None req-63fd04bb-50de-49d0-abf8-48188c72f7f3 tempest-VolumesSnapshotTestJSON-1345007867 None] Creating volume 937f22e8-a48b-48ba-a1f4-be84561e4f52 from snapshot 497d286e-63eb-4892-9655-520934c8cc0a {{(pid=84538) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:356}} Apr 29 19:05:10 devstack cinder-volume[84538]: DEBUG oslo_concurrency.lockutils [None req-63fd04bb-50de-49d0-abf8-48188c72f7f3 tempest-VolumesSnapshotTestJSON-1345007867 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 19:05:10 devstack cinder-volume[84538]: DEBUG oslo_concurrency.lockutils [None req-63fd04bb-50de-49d0-abf8-48188c72f7f3 tempest-VolumesSnapshotTestJSON-1345007867 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 19:05:10 devstack cinder-volume[84538]: DEBUG cinder.volume.drivers.quobyte [None req-63fd04bb-50de-49d0-abf8-48188c72f7f3 tempest-VolumesSnapshotTestJSON-1345007867 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-34312b00-dd6d-45bb-af98-75855cea8e48': None} {{(pid=84538) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 19:05:10 devstack cinder-volume[84538]: DEBUG cinder.volume.drivers.quobyte [None req-63fd04bb-50de-49d0-abf8-48188c72f7f3 tempest-VolumesSnapshotTestJSON-1345007867 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-34312b00-dd6d-45bb-af98-75855cea8e48'] {{(pid=84538) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 19:05:10 devstack cinder-volume[84538]: DEBUG oslo_concurrency.lockutils [None req-63fd04bb-50de-49d0-abf8-48188c72f7f3 tempest-VolumesSnapshotTestJSON-1345007867 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=84538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 19:05:10 devstack cinder-volume[84538]: DEBUG cinder.volume.drivers.quobyte [None req-63fd04bb-50de-49d0-abf8-48188c72f7f3 tempest-VolumesSnapshotTestJSON-1345007867 None] Selected osci02.corp.quobyte.com/cinder-vol-34312b00-dd6d-45bb-af98-75855cea8e48 as target Quobyte volume. {{(pid=84538) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 29 19:05:10 devstack cinder-volume[84538]: DEBUG cinder.coordination [None req-63fd04bb-50de-49d0-abf8-48188c72f7f3 tempest-VolumesSnapshotTestJSON-1345007867 None] Acquiring lock "cinder-quobyte-937f22e8-a48b-48ba-a1f4-be84561e4f52" by "_copy_volume_from_snapshot" {{(pid=84538) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 19:05:10 devstack cinder-volume[84538]: INFO cinder.volume.flows.manager.create_volume [None req-4789f167-62e4-4ee6-9855-74aa53aa96e2 tempest-VolumesListTestJSON-1695505021 None] Volume volume-3f986dd2-41fd-405e-bc8a-d317bf3bbbf8 (3f986dd2-41fd-405e-bc8a-d317bf3bbbf8): created successfully Apr 29 19:05:10 devstack cinder-volume[84538]: DEBUG cinder.volume.manager [None req-4789f167-62e4-4ee6-9855-74aa53aa96e2 tempest-VolumesListTestJSON-1695505021 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (74e8777c-32d7-4f32-aec0-dc1aea0215f9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 19:05:10 devstack cinder-volume[84538]: DEBUG cinder.volume.manager [None req-4789f167-62e4-4ee6-9855-74aa53aa96e2 tempest-VolumesListTestJSON-1695505021 None] Flow 'volume_create_manager' (ed5f9263-5728-4e7d-9e01-f3bf3e905476) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84538) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 19:05:10 devstack cinder-volume[84538]: DEBUG cinder.coordination [None req-63fd04bb-50de-49d0-abf8-48188c72f7f3 tempest-VolumesSnapshotTestJSON-1345007867 None] Lock "cinder-quobyte-937f22e8-a48b-48ba-a1f4-be84561e4f52" acquired by "_copy_volume_from_snapshot" :: waited 0.037s {{(pid=84538) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 19:05:10 devstack cinder-volume[84538]: DEBUG cinder.volume.drivers.quobyte [None req-63fd04bb-50de-49d0-abf8-48188c72f7f3 tempest-VolumesSnapshotTestJSON-1345007867 None] snapshot: 497d286e-63eb-4892-9655-520934c8cc0a, volume: 937f22e8-a48b-48ba-a1f4-be84561e4f52, {{(pid=84538) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Apr 29 19:05:10 devstack cinder-volume[84538]: DEBUG oslo_concurrency.lockutils [None req-63fd04bb-50de-49d0-abf8-48188c72f7f3 tempest-VolumesSnapshotTestJSON-1345007867 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 19:05:10 devstack cinder-volume[84538]: DEBUG oslo_concurrency.lockutils [None req-63fd04bb-50de-49d0-abf8-48188c72f7f3 tempest-VolumesSnapshotTestJSON-1345007867 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 19:05:10 devstack cinder-volume[84538]: DEBUG cinder.volume.drivers.quobyte [None req-63fd04bb-50de-49d0-abf8-48188c72f7f3 tempest-VolumesSnapshotTestJSON-1345007867 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-34312b00-dd6d-45bb-af98-75855cea8e48': None} {{(pid=84538) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 19:05:10 devstack cinder-volume[84538]: DEBUG cinder.volume.drivers.quobyte [None req-63fd04bb-50de-49d0-abf8-48188c72f7f3 tempest-VolumesSnapshotTestJSON-1345007867 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-34312b00-dd6d-45bb-af98-75855cea8e48'] {{(pid=84538) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 19:05:10 devstack cinder-volume[84538]: DEBUG oslo_concurrency.lockutils [None req-63fd04bb-50de-49d0-abf8-48188c72f7f3 tempest-VolumesSnapshotTestJSON-1345007867 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=84538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 19:05:10 devstack cinder-volume[84538]: INFO cinder.volume.manager [None req-4789f167-62e4-4ee6-9855-74aa53aa96e2 tempest-VolumesListTestJSON-1695505021 None] Created volume successfully. Apr 29 19:05:10 devstack cinder-volume[84538]: DEBUG oslo.privsep.daemon [-] privsep: reply[133c7a39-f710-4456-8017-52b07f8dc766]: (4, 'qcow2') {{(pid=85803) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 19:05:10 devstack cinder-volume[84538]: DEBUG oslo_concurrency.processutils [None req-63fd04bb-50de-49d0-abf8-48188c72f7f3 tempest-VolumesSnapshotTestJSON-1345007867 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-8ffdf26a-b64d-43d0-8e13-5805979ca936.497d286e-63eb-4892-9655-520934c8cc0a {{(pid=84538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 19:05:10 devstack sudo[92040]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-8ffdf26a-b64d-43d0-8e13-5805979ca936.497d286e-63eb-4892-9655-520934c8cc0a Apr 29 19:05:10 devstack sudo[92040]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 19:05:10 devstack sudo[92040]: pam_unix(sudo:session): session closed for user root Apr 29 19:05:10 devstack cinder-volume[84538]: DEBUG oslo_concurrency.processutils [None req-63fd04bb-50de-49d0-abf8-48188c72f7f3 tempest-VolumesSnapshotTestJSON-1345007867 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-8ffdf26a-b64d-43d0-8e13-5805979ca936.497d286e-63eb-4892-9655-520934c8cc0a" returned: 0 in 0.779s {{(pid=84538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 19:05:10 devstack cinder-volume[84538]: DEBUG cinder.volume.drivers.remotefs [None req-63fd04bb-50de-49d0-abf8-48188c72f7f3 tempest-VolumesSnapshotTestJSON-1345007867 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-8ffdf26a-b64d-43d0-8e13-5805979ca936(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=84538) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 29 19:05:10 devstack cinder-volume[84538]: DEBUG cinder.volume.drivers.quobyte [None req-63fd04bb-50de-49d0-abf8-48188c72f7f3 tempest-VolumesSnapshotTestJSON-1345007867 None] will copy from snapshot at /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-8ffdf26a-b64d-43d0-8e13-5805979ca936 {{(pid=84538) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Apr 29 19:05:10 devstack cinder-volume[84538]: DEBUG cinder.volume.drivers.quobyte [None req-63fd04bb-50de-49d0-abf8-48188c72f7f3 tempest-VolumesSnapshotTestJSON-1345007867 None] Creating direct copy from snapshot {{(pid=84538) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Apr 29 19:05:10 devstack cinder-volume[84538]: DEBUG oslo.privsep.daemon [-] privsep: reply[ef058341-0c5c-477c-8126-94c18a97df76]: (4, 'qcow2') {{(pid=85803) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 19:05:10 devstack cinder-volume[84538]: DEBUG oslo_concurrency.processutils [None req-63fd04bb-50de-49d0-abf8-48188c72f7f3 tempest-VolumesSnapshotTestJSON-1345007867 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-8ffdf26a-b64d-43d0-8e13-5805979ca936 {{(pid=84538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 19:05:11 devstack cinder-volume[84538]: DEBUG cinder.volume.flows.manager.create_volume [None req-7a7a6f61-2f2f-4a54-90e6-3f15be0738d2 tempest-VolumesExtendTest-451302124 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84538) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Apr 29 19:05:11 devstack cinder-volume[84538]: DEBUG cinder.volume.manager [None req-7a7a6f61-2f2f-4a54-90e6-3f15be0738d2 tempest-VolumesExtendTest-451302124 None] Flow 'volume_create_manager' (e34da31b-af6f-4151-9e9a-be845bbac186) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84538) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 19:05:11 devstack cinder-volume[84538]: DEBUG cinder.volume.manager [None req-7a7a6f61-2f2f-4a54-90e6-3f15be0738d2 tempest-VolumesExtendTest-451302124 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (56436530-9c72-4638-b745-7b35c52bd656) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 19:05:11 devstack cinder-volume[84538]: DEBUG cinder.volume.manager [None req-7a7a6f61-2f2f-4a54-90e6-3f15be0738d2 tempest-VolumesExtendTest-451302124 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (56436530-9c72-4638-b745-7b35c52bd656) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-29T17:05:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-1923145982',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6b9ca0e6-2b0f-40a7-908b-ee6d4f7f7489,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e75c2db35d914882a975b826675987e5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T17:05:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T17:05:11Z,use_quota=True,user_id='865814330ca6407a83ca3897a4368e2b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(62b05900-93e3-4190-a88f-1d87324303d1),volume_type_id=62b05900-93e3-4190-a88f-1d87324303d1)' {{(pid=84538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 19:05:11 devstack cinder-volume[84538]: DEBUG cinder.volume.manager [None req-7a7a6f61-2f2f-4a54-90e6-3f15be0738d2 tempest-VolumesExtendTest-451302124 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c5dcb2ea-6f01-402a-9b76-8aa5a89a2fd1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 19:05:11 devstack cinder-volume[84538]: DEBUG cinder.volume.manager [None req-7a7a6f61-2f2f-4a54-90e6-3f15be0738d2 tempest-VolumesExtendTest-451302124 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c5dcb2ea-6f01-402a-9b76-8aa5a89a2fd1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 19:05:11 devstack cinder-volume[84538]: DEBUG cinder.volume.manager [None req-7a7a6f61-2f2f-4a54-90e6-3f15be0738d2 tempest-VolumesExtendTest-451302124 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (08d4d7c4-fb57-48e6-9f5e-d1703ed5ae68) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 19:05:11 devstack cinder-volume[84538]: DEBUG cinder.image.glance [None req-7a7a6f61-2f2f-4a54-90e6-3f15be0738d2 tempest-VolumesExtendTest-451302124 None] Creating Keystone auth plugin from conf {{(pid=84538) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Apr 29 19:05:11 devstack sudo[92045]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-8ffdf26a-b64d-43d0-8e13-5805979ca936 Apr 29 19:05:11 devstack sudo[92045]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 19:05:11 devstack cinder-volume[84538]: DEBUG cinder.volume.manager [None req-7a7a6f61-2f2f-4a54-90e6-3f15be0738d2 tempest-VolumesExtendTest-451302124 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (08d4d7c4-fb57-48e6-9f5e-d1703ed5ae68) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '6b9ca0e6-2b0f-40a7-908b-ee6d4f7f7489', 'volume_name': 'volume-6b9ca0e6-2b0f-40a7-908b-ee6d4f7f7489', 'volume_size': 1, 'image_id': '11605644-0a6a-4a0a-b123-c09ab01cd4db', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/11605644-0a6a-4a0a-b123-c09ab01cd4db', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '853afc5ea27148009f8c02d351cf4d80', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '11605644-0a6a-4a0a-b123-c09ab01cd4db', 'created_at': datetime.datetime(2026, 4, 29, 16, 52, 8, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 4, 29, 16, 52, 10, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/11605644-0a6a-4a0a-b123-c09ab01cd4db/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=84538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 19:05:11 devstack cinder-volume[84538]: DEBUG cinder.volume.manager [None req-7a7a6f61-2f2f-4a54-90e6-3f15be0738d2 tempest-VolumesExtendTest-451302124 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e8b858a9-fe80-4395-b8b0-e2e479a181e3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 19:05:11 devstack cinder-volume[84538]: DEBUG cinder.volume.manager [None req-7a7a6f61-2f2f-4a54-90e6-3f15be0738d2 tempest-VolumesExtendTest-451302124 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e8b858a9-fe80-4395-b8b0-e2e479a181e3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 19:05:11 devstack cinder-volume[84538]: DEBUG cinder.volume.manager [None req-7a7a6f61-2f2f-4a54-90e6-3f15be0738d2 tempest-VolumesExtendTest-451302124 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a8383725-773f-4c16-aa9a-16571cf204f9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 19:05:11 devstack cinder-volume[84538]: INFO cinder.volume.flows.manager.create_volume [None req-7a7a6f61-2f2f-4a54-90e6-3f15be0738d2 tempest-VolumesExtendTest-451302124 None] Volume 6b9ca0e6-2b0f-40a7-908b-ee6d4f7f7489: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-6b9ca0e6-2b0f-40a7-908b-ee6d4f7f7489', 'volume_size': 1, 'image_id': '11605644-0a6a-4a0a-b123-c09ab01cd4db', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/11605644-0a6a-4a0a-b123-c09ab01cd4db', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '853afc5ea27148009f8c02d351cf4d80', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '11605644-0a6a-4a0a-b123-c09ab01cd4db', 'created_at': datetime.datetime(2026, 4, 29, 16, 52, 8, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 4, 29, 16, 52, 10, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/11605644-0a6a-4a0a-b123-c09ab01cd4db/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': } Apr 29 19:05:11 devstack cinder-volume[84538]: DEBUG cinder.volume.flows.manager.create_volume [None req-7a7a6f61-2f2f-4a54-90e6-3f15be0738d2 tempest-VolumesExtendTest-451302124 None] Trying to clone 6b9ca0e6-2b0f-40a7-908b-ee6d4f7f7489 from image 11605644-0a6a-4a0a-b123-c09ab01cd4db at location (None, [{'url': 'file:///opt/stack/data/glance/images/11605644-0a6a-4a0a-b123-c09ab01cd4db', 'metadata': {}}]). {{(pid=84538) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1082}} Apr 29 19:05:11 devstack sudo[92045]: pam_unix(sudo:session): session closed for user root Apr 29 19:05:11 devstack cinder-volume[84538]: DEBUG cinder.image.image_utils [None req-7a7a6f61-2f2f-4a54-90e6-3f15be0738d2 tempest-VolumesExtendTest-451302124 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_11605644-0a6a-4a0a-b123-c09ab01cd4db_mj2_bw19devstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=84538) fetch /opt/stack/cinder/cinder/image/image_utils.py:732}} Apr 29 19:05:11 devstack cinder-volume[84538]: INFO cinder.image.image_utils [None req-7a7a6f61-2f2f-4a54-90e6-3f15be0738d2 tempest-VolumesExtendTest-451302124 None] Image download 20.69 MB at 20.69 MB/s Apr 29 19:05:11 devstack cinder-volume[84538]: DEBUG oslo_concurrency.processutils [None req-63fd04bb-50de-49d0-abf8-48188c72f7f3 tempest-VolumesSnapshotTestJSON-1345007867 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-8ffdf26a-b64d-43d0-8e13-5805979ca936" returned: 0 in 0.885s {{(pid=84538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 19:05:11 devstack cinder-volume[84538]: DEBUG cinder.utils [None req-63fd04bb-50de-49d0-abf8-48188c72f7f3 tempest-VolumesSnapshotTestJSON-1345007867 None] Path /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-937f22e8-a48b-48ba-a1f4-be84561e4f52 not found in is_blk_device check {{(pid=84538) is_blk_device /opt/stack/cinder/cinder/utils.py:602}} Apr 29 19:05:11 devstack cinder-volume[84538]: DEBUG oslo_concurrency.processutils [None req-63fd04bb-50de-49d0-abf8-48188c72f7f3 tempest-VolumesSnapshotTestJSON-1345007867 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-8ffdf26a-b64d-43d0-8e13-5805979ca936 /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-937f22e8-a48b-48ba-a1f4-be84561e4f52 {{(pid=84538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 19:05:11 devstack sudo[92051]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-8ffdf26a-b64d-43d0-8e13-5805979ca936 /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-937f22e8-a48b-48ba-a1f4-be84561e4f52 Apr 29 19:05:11 devstack sudo[92051]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 19:05:11 devstack cinder-volume[84538]: DEBUG oslo.privsep.daemon [-] privsep: reply[e5b7c5f2-6450-4509-afa8-bd948a9b67ef]: (4, 'qcow2') {{(pid=85803) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 19:05:11 devstack cinder-volume[84538]: DEBUG oslo_concurrency.processutils [None req-7a7a6f61-2f2f-4a54-90e6-3f15be0738d2 tempest-VolumesExtendTest-451302124 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_11605644-0a6a-4a0a-b123-c09ab01cd4db_mj2_bw19devstack@QuobyteHD {{(pid=84538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 19:05:11 devstack sudo[92053]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_11605644-0a6a-4a0a-b123-c09ab01cd4db_mj2_bw19devstack@QuobyteHD Apr 29 19:05:11 devstack sudo[92053]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 19:05:12 devstack sudo[92053]: pam_unix(sudo:session): session closed for user root Apr 29 19:05:12 devstack cinder-volume[84538]: DEBUG oslo_concurrency.processutils [None req-7a7a6f61-2f2f-4a54-90e6-3f15be0738d2 tempest-VolumesExtendTest-451302124 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_11605644-0a6a-4a0a-b123-c09ab01cd4db_mj2_bw19devstack@QuobyteHD" returned: 0 in 0.729s {{(pid=84538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 19:05:12 devstack cinder-volume[84538]: DEBUG cinder.image.image_utils [None req-7a7a6f61-2f2f-4a54-90e6-3f15be0738d2 tempest-VolumesExtendTest-451302124 None] Temporary image 11605644-0a6a-4a0a-b123-c09ab01cd4db is fetched for user 865814330ca6407a83ca3897a4368e2b. {{(pid=84538) fetch /opt/stack/cinder/cinder/image/image_utils.py:1431}} Apr 29 19:05:12 devstack cinder-volume[84538]: DEBUG oslo.privsep.daemon [-] privsep: reply[1558a80c-83b0-43b9-bd90-55b459829495]: (4, 'qcow2') {{(pid=85803) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 19:05:12 devstack cinder-volume[84538]: DEBUG oslo_concurrency.processutils [None req-7a7a6f61-2f2f-4a54-90e6-3f15be0738d2 tempest-VolumesExtendTest-451302124 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_11605644-0a6a-4a0a-b123-c09ab01cd4db_mj2_bw19devstack@QuobyteHD {{(pid=84538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 19:05:13 devstack sudo[92068]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_11605644-0a6a-4a0a-b123-c09ab01cd4db_mj2_bw19devstack@QuobyteHD Apr 29 19:05:13 devstack sudo[92068]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 19:05:14 devstack sudo[92068]: pam_unix(sudo:session): session closed for user root Apr 29 19:05:14 devstack cinder-volume[84538]: DEBUG oslo_concurrency.processutils [None req-7a7a6f61-2f2f-4a54-90e6-3f15be0738d2 tempest-VolumesExtendTest-451302124 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_11605644-0a6a-4a0a-b123-c09ab01cd4db_mj2_bw19devstack@QuobyteHD" returned: 0 in 1.608s {{(pid=84538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 19:05:14 devstack cinder-volume[84538]: DEBUG oslo_concurrency.lockutils [None req-7a7a6f61-2f2f-4a54-90e6-3f15be0738d2 tempest-VolumesExtendTest-451302124 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 19:05:14 devstack cinder-volume[84538]: DEBUG cinder.coordination [None req-36fc35f0-e250-475b-9e17-6807cebe4c59 tempest-VolumesListTestJSON-1695505021 None] Acquiring lock "cinder-3f986dd2-41fd-405e-bc8a-d317bf3bbbf8-delete_volume" by "delete_volume" {{(pid=84538) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 19:05:14 devstack cinder-volume[84538]: DEBUG cinder.coordination [None req-36fc35f0-e250-475b-9e17-6807cebe4c59 tempest-VolumesListTestJSON-1695505021 None] Lock "cinder-3f986dd2-41fd-405e-bc8a-d317bf3bbbf8-delete_volume" acquired by "delete_volume" :: waited 0.061s {{(pid=84538) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 19:05:14 devstack cinder-volume[84538]: DEBUG cinder.coordination [None req-36fc35f0-e250-475b-9e17-6807cebe4c59 tempest-VolumesListTestJSON-1695505021 None] Acquiring lock "cinder-quobyte-3f986dd2-41fd-405e-bc8a-d317bf3bbbf8" by "delete_volume" {{(pid=84538) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 19:05:14 devstack cinder-volume[84538]: DEBUG cinder.coordination [None req-36fc35f0-e250-475b-9e17-6807cebe4c59 tempest-VolumesListTestJSON-1695505021 None] Lock "cinder-quobyte-3f986dd2-41fd-405e-bc8a-d317bf3bbbf8" acquired by "delete_volume" :: waited 0.025s {{(pid=84538) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 19:05:14 devstack cinder-volume[84538]: DEBUG oslo.privsep.daemon [-] privsep: reply[f6696950-29c1-43cf-bc7a-65c9aadf73c5]: (4, 'qcow2') {{(pid=85803) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 19:05:14 devstack cinder-volume[84538]: DEBUG oslo_concurrency.processutils [None req-36fc35f0-e250-475b-9e17-6807cebe4c59 tempest-VolumesListTestJSON-1695505021 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-3f986dd2-41fd-405e-bc8a-d317bf3bbbf8 {{(pid=84538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 19:05:15 devstack sudo[92074]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-3f986dd2-41fd-405e-bc8a-d317bf3bbbf8 Apr 29 19:05:15 devstack sudo[92074]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 19:05:16 devstack sudo[92074]: pam_unix(sudo:session): session closed for user root Apr 29 19:05:16 devstack cinder-volume[84538]: DEBUG oslo_concurrency.processutils [None req-36fc35f0-e250-475b-9e17-6807cebe4c59 tempest-VolumesListTestJSON-1695505021 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-3f986dd2-41fd-405e-bc8a-d317bf3bbbf8" returned: 0 in 1.769s {{(pid=84538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 19:05:16 devstack cinder-volume[84538]: DEBUG oslo_concurrency.processutils [None req-36fc35f0-e250-475b-9e17-6807cebe4c59 tempest-VolumesListTestJSON-1695505021 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-3f986dd2-41fd-405e-bc8a-d317bf3bbbf8 {{(pid=84538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 19:05:16 devstack sudo[92079]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-3f986dd2-41fd-405e-bc8a-d317bf3bbbf8 Apr 29 19:05:16 devstack sudo[92079]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 19:05:17 devstack sudo[92051]: pam_unix(sudo:session): session closed for user root Apr 29 19:05:17 devstack cinder-volume[84538]: DEBUG oslo_concurrency.processutils [None req-63fd04bb-50de-49d0-abf8-48188c72f7f3 tempest-VolumesSnapshotTestJSON-1345007867 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-8ffdf26a-b64d-43d0-8e13-5805979ca936 /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-937f22e8-a48b-48ba-a1f4-be84561e4f52" returned: 0 in 5.652s {{(pid=84538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 19:05:17 devstack cinder-volume[84538]: DEBUG oslo.privsep.daemon [-] privsep: reply[5b9038e7-f5a7-4615-bd58-d631a3a500ea]: (4, 'qcow2') {{(pid=85803) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 19:05:17 devstack cinder-volume[84538]: DEBUG oslo_concurrency.processutils [None req-63fd04bb-50de-49d0-abf8-48188c72f7f3 tempest-VolumesSnapshotTestJSON-1345007867 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-8ffdf26a-b64d-43d0-8e13-5805979ca936 {{(pid=84538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 19:05:17 devstack sudo[92081]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-8ffdf26a-b64d-43d0-8e13-5805979ca936 Apr 29 19:05:17 devstack sudo[92081]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 19:05:17 devstack sudo[92079]: pam_unix(sudo:session): session closed for user root Apr 29 19:05:17 devstack cinder-volume[84538]: DEBUG oslo_concurrency.processutils [None req-36fc35f0-e250-475b-9e17-6807cebe4c59 tempest-VolumesListTestJSON-1695505021 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-3f986dd2-41fd-405e-bc8a-d317bf3bbbf8" returned: 0 in 0.978s {{(pid=84538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 19:05:17 devstack cinder-volume[84538]: DEBUG cinder.coordination [None req-36fc35f0-e250-475b-9e17-6807cebe4c59 tempest-VolumesListTestJSON-1695505021 None] Lock "cinder-quobyte-3f986dd2-41fd-405e-bc8a-d317bf3bbbf8" released by "delete_volume" :: held 2.827s {{(pid=84538) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 19:05:17 devstack cinder-volume[84538]: DEBUG cinder.quota [None req-36fc35f0-e250-475b-9e17-6807cebe4c59 tempest-VolumesListTestJSON-1695505021 None] Created reservations ['86e62848-5f61-4ee9-8aaf-5d20ec66fab3', '7cc9b6b6-9fbe-4fef-8448-948b1a9fa5ab', 'b527bb68-4833-4c38-8a0d-e86f384bc319', '86fba711-184c-474a-9fe9-ddf19bcc9e69'] {{(pid=84538) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 29 19:05:17 devstack cinder-volume[84538]: DEBUG oslo_concurrency.lockutils [None req-36fc35f0-e250-475b-9e17-6807cebe4c59 tempest-VolumesListTestJSON-1695505021 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 19:05:17 devstack cinder-volume[84538]: DEBUG oslo_concurrency.lockutils [None req-36fc35f0-e250-475b-9e17-6807cebe4c59 tempest-VolumesListTestJSON-1695505021 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 19:05:17 devstack cinder-volume[84538]: DEBUG cinder.volume.drivers.quobyte [None req-36fc35f0-e250-475b-9e17-6807cebe4c59 tempest-VolumesListTestJSON-1695505021 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-34312b00-dd6d-45bb-af98-75855cea8e48': None} {{(pid=84538) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 19:05:17 devstack cinder-volume[84538]: DEBUG cinder.volume.drivers.quobyte [None req-36fc35f0-e250-475b-9e17-6807cebe4c59 tempest-VolumesListTestJSON-1695505021 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-34312b00-dd6d-45bb-af98-75855cea8e48'] {{(pid=84538) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 19:05:17 devstack cinder-volume[84538]: DEBUG oslo_concurrency.lockutils [None req-36fc35f0-e250-475b-9e17-6807cebe4c59 tempest-VolumesListTestJSON-1695505021 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=84538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 19:05:17 devstack cinder-volume[84538]: DEBUG oslo_concurrency.processutils [None req-36fc35f0-e250-475b-9e17-6807cebe4c59 tempest-VolumesListTestJSON-1695505021 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d {{(pid=84538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 19:05:17 devstack sudo[92084]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d Apr 29 19:05:17 devstack sudo[92084]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 19:05:18 devstack cinder-volume[84538]: DEBUG cinder.coordination [None req-b0c230e8-4d46-42bc-8caa-d5df64bbb42c tempest-VolumesListTestJSON-1695505021 None] Acquiring lock "cinder-da8c4537-b5c7-46e5-b7a0-d0379e4105bf-delete_volume" by "delete_volume" {{(pid=84538) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 19:05:18 devstack cinder-volume[84538]: DEBUG cinder.coordination [None req-b0c230e8-4d46-42bc-8caa-d5df64bbb42c tempest-VolumesListTestJSON-1695505021 None] Lock "cinder-da8c4537-b5c7-46e5-b7a0-d0379e4105bf-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=84538) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 19:05:18 devstack cinder-volume[84538]: DEBUG cinder.coordination [None req-b0c230e8-4d46-42bc-8caa-d5df64bbb42c tempest-VolumesListTestJSON-1695505021 None] Acquiring lock "cinder-quobyte-da8c4537-b5c7-46e5-b7a0-d0379e4105bf" by "delete_volume" {{(pid=84538) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 19:05:18 devstack sudo[92081]: pam_unix(sudo:session): session closed for user root Apr 29 19:05:18 devstack cinder-volume[84538]: DEBUG oslo_concurrency.processutils [None req-63fd04bb-50de-49d0-abf8-48188c72f7f3 tempest-VolumesSnapshotTestJSON-1345007867 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-8ffdf26a-b64d-43d0-8e13-5805979ca936" returned: 0 in 0.897s {{(pid=84538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 19:05:18 devstack cinder-volume[84538]: DEBUG cinder.image.image_utils [None req-63fd04bb-50de-49d0-abf8-48188c72f7f3 tempest-VolumesSnapshotTestJSON-1345007867 None] Image conversion details: src /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-8ffdf26a-b64d-43d0-8e13-5805979ca936, size 1024.00 MB, duration 5.65 sec, destination /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-937f22e8-a48b-48ba-a1f4-be84561e4f52 {{(pid=84538) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}} Apr 29 19:05:18 devstack cinder-volume[84538]: INFO cinder.image.image_utils [None req-63fd04bb-50de-49d0-abf8-48188c72f7f3 tempest-VolumesSnapshotTestJSON-1345007867 None] Converted 1024.00 MB image at 181.14 MB/s Apr 29 19:05:18 devstack cinder-volume[84538]: WARNING cinder.volume.drivers.remotefs [None req-63fd04bb-50de-49d0-abf8-48188c72f7f3 tempest-VolumesSnapshotTestJSON-1345007867 None] /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-937f22e8-a48b-48ba-a1f4-be84561e4f52 is being set with open permissions: ugo+rw Apr 29 19:05:18 devstack cinder-volume[84538]: DEBUG oslo_concurrency.processutils [None req-63fd04bb-50de-49d0-abf8-48188c72f7f3 tempest-VolumesSnapshotTestJSON-1345007867 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-937f22e8-a48b-48ba-a1f4-be84561e4f52 {{(pid=84538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 19:05:18 devstack cinder-volume[84538]: DEBUG cinder.coordination [None req-b0c230e8-4d46-42bc-8caa-d5df64bbb42c tempest-VolumesListTestJSON-1695505021 None] Lock "cinder-quobyte-da8c4537-b5c7-46e5-b7a0-d0379e4105bf" acquired by "delete_volume" :: waited 0.029s {{(pid=84538) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 19:05:18 devstack sudo[92084]: pam_unix(sudo:session): session closed for user root Apr 29 19:05:18 devstack cinder-volume[84538]: DEBUG oslo_concurrency.processutils [None req-36fc35f0-e250-475b-9e17-6807cebe4c59 tempest-VolumesListTestJSON-1695505021 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d" returned: 0 in 0.630s {{(pid=84538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 19:05:18 devstack cinder-volume[84538]: DEBUG cinder.manager [None req-36fc35f0-e250-475b-9e17-6807cebe4c59 tempest-VolumesListTestJSON-1695505021 None] Notifying Schedulers of capabilities ... {{(pid=84538) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 29 19:05:18 devstack sudo[92091]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-937f22e8-a48b-48ba-a1f4-be84561e4f52 Apr 29 19:05:18 devstack sudo[92091]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 19:05:18 devstack cinder-volume[84538]: INFO cinder.volume.manager [None req-36fc35f0-e250-475b-9e17-6807cebe4c59 tempest-VolumesListTestJSON-1695505021 None] Deleted volume successfully. Apr 29 19:05:18 devstack cinder-volume[84538]: DEBUG oslo.privsep.daemon [-] privsep: reply[6fe90a80-2db7-4b14-a640-a6643b024b05]: (4, 'qcow2') {{(pid=85803) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 19:05:18 devstack cinder-volume[84538]: DEBUG oslo_concurrency.processutils [None req-b0c230e8-4d46-42bc-8caa-d5df64bbb42c tempest-VolumesListTestJSON-1695505021 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-da8c4537-b5c7-46e5-b7a0-d0379e4105bf {{(pid=84538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 19:05:18 devstack cinder-volume[84538]: DEBUG cinder.coordination [None req-36fc35f0-e250-475b-9e17-6807cebe4c59 tempest-VolumesListTestJSON-1695505021 None] Lock "cinder-3f986dd2-41fd-405e-bc8a-d317bf3bbbf8-delete_volume" released by "delete_volume" :: held 3.754s {{(pid=84538) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 19:05:18 devstack sudo[92093]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-da8c4537-b5c7-46e5-b7a0-d0379e4105bf Apr 29 19:05:18 devstack sudo[92093]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 19:05:18 devstack sudo[92091]: pam_unix(sudo:session): session closed for user root Apr 29 19:05:18 devstack cinder-volume[84538]: DEBUG oslo_concurrency.processutils [None req-63fd04bb-50de-49d0-abf8-48188c72f7f3 tempest-VolumesSnapshotTestJSON-1345007867 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-937f22e8-a48b-48ba-a1f4-be84561e4f52" returned: 0 in 0.601s {{(pid=84538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 19:05:19 devstack cinder-volume[84538]: DEBUG cinder.coordination [None req-63fd04bb-50de-49d0-abf8-48188c72f7f3 tempest-VolumesSnapshotTestJSON-1345007867 None] Lock "cinder-quobyte-937f22e8-a48b-48ba-a1f4-be84561e4f52" released by "_copy_volume_from_snapshot" :: held 8.935s {{(pid=84538) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 19:05:19 devstack cinder-volume[84538]: DEBUG cinder.coordination [None req-63fd04bb-50de-49d0-abf8-48188c72f7f3 tempest-VolumesSnapshotTestJSON-1345007867 None] Lock "cinder-quobyte-497d286e-63eb-4892-9655-520934c8cc0a-937f22e8-a48b-48ba-a1f4-be84561e4f52" released by "_create_volume_from_snapshot" :: held 8.990s {{(pid=84538) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 19:05:19 devstack cinder-volume[84538]: DEBUG oslo_concurrency.lockutils [None req-63fd04bb-50de-49d0-abf8-48188c72f7f3 tempest-VolumesSnapshotTestJSON-1345007867 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 9.027s {{(pid=84538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 19:05:19 devstack cinder-volume[84538]: DEBUG oslo_concurrency.lockutils [None req-5a08b2a9-32ab-4f56-8d35-027b4b06a64f tempest-CinderUnicodeTest-1144970881 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 9.431s {{(pid=84538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 19:05:19 devstack cinder-volume[84538]: DEBUG cinder.volume.drivers.remotefs [None req-5a08b2a9-32ab-4f56-8d35-027b4b06a64f tempest-CinderUnicodeTest-1144970881 None] Creating offline snapshot a767e3d2-1842-41db-9300-1163b2d910d0 of volume 723bbfbf-d981-4a0e-8a8c-2bbf66f2115e {{(pid=84538) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}} Apr 29 19:05:19 devstack cinder-volume[84538]: DEBUG oslo.privsep.daemon [-] privsep: reply[2f66ddbc-379c-4cea-8d75-8ec3faa13a36]: (4, 'qcow2') {{(pid=85803) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 19:05:19 devstack cinder-volume[84538]: DEBUG oslo_concurrency.processutils [None req-5a08b2a9-32ab-4f56-8d35-027b4b06a64f tempest-CinderUnicodeTest-1144970881 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-723bbfbf-d981-4a0e-8a8c-2bbf66f2115e {{(pid=84538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 19:05:19 devstack cinder-volume[84538]: DEBUG cinder.volume.manager [None req-63fd04bb-50de-49d0-abf8-48188c72f7f3 tempest-VolumesSnapshotTestJSON-1345007867 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (160dbf84-c58c-4a04-b1f0-7a20a1e672b9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-937f22e8-a48b-48ba-a1f4-be84561e4f52', 'volume_size': 1, 'snapshot_id': '497d286e-63eb-4892-9655-520934c8cc0a'}' {{(pid=84538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 19:05:19 devstack cinder-volume[84538]: DEBUG cinder.volume.manager [None req-63fd04bb-50de-49d0-abf8-48188c72f7f3 tempest-VolumesSnapshotTestJSON-1345007867 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (459f6293-b830-4a75-99f2-970fd27ce62b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 19:05:19 devstack cinder-volume[84538]: INFO cinder.volume.flows.manager.create_volume [None req-63fd04bb-50de-49d0-abf8-48188c72f7f3 tempest-VolumesSnapshotTestJSON-1345007867 None] Volume volume-937f22e8-a48b-48ba-a1f4-be84561e4f52 (937f22e8-a48b-48ba-a1f4-be84561e4f52): created successfully Apr 29 19:05:19 devstack cinder-volume[84538]: DEBUG cinder.volume.manager [None req-63fd04bb-50de-49d0-abf8-48188c72f7f3 tempest-VolumesSnapshotTestJSON-1345007867 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (459f6293-b830-4a75-99f2-970fd27ce62b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 19:05:19 devstack cinder-volume[84538]: DEBUG cinder.volume.manager [None req-63fd04bb-50de-49d0-abf8-48188c72f7f3 tempest-VolumesSnapshotTestJSON-1345007867 None] Flow 'volume_create_manager' (f80ebeb8-ec3d-4228-b529-0561414149ed) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84538) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 19:05:19 devstack cinder-volume[84538]: INFO cinder.volume.manager [None req-63fd04bb-50de-49d0-abf8-48188c72f7f3 tempest-VolumesSnapshotTestJSON-1345007867 None] Created volume successfully. Apr 29 19:05:19 devstack sudo[92098]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-723bbfbf-d981-4a0e-8a8c-2bbf66f2115e Apr 29 19:05:19 devstack sudo[92098]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 19:05:19 devstack sudo[92093]: pam_unix(sudo:session): session closed for user root Apr 29 19:05:19 devstack cinder-volume[84538]: DEBUG oslo_concurrency.processutils [None req-b0c230e8-4d46-42bc-8caa-d5df64bbb42c tempest-VolumesListTestJSON-1695505021 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-da8c4537-b5c7-46e5-b7a0-d0379e4105bf" returned: 0 in 0.774s {{(pid=84538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 19:05:19 devstack cinder-volume[84538]: DEBUG oslo_concurrency.processutils [None req-b0c230e8-4d46-42bc-8caa-d5df64bbb42c tempest-VolumesListTestJSON-1695505021 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-da8c4537-b5c7-46e5-b7a0-d0379e4105bf {{(pid=84538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 19:05:19 devstack sudo[92101]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-da8c4537-b5c7-46e5-b7a0-d0379e4105bf Apr 29 19:05:19 devstack sudo[92101]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 19:05:19 devstack cinder-volume[84538]: DEBUG cinder.coordination [None req-e35efa83-a0c1-4836-aaa0-f8317f1cc5a9 tempest-VolumesSnapshotTestJSON-1345007867 None] Acquiring lock "cinder-937f22e8-a48b-48ba-a1f4-be84561e4f52-delete_volume" by "delete_volume" {{(pid=84538) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 19:05:19 devstack cinder-volume[84538]: DEBUG cinder.coordination [None req-e35efa83-a0c1-4836-aaa0-f8317f1cc5a9 tempest-VolumesSnapshotTestJSON-1345007867 None] Lock "cinder-937f22e8-a48b-48ba-a1f4-be84561e4f52-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=84538) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 19:05:19 devstack cinder-volume[84538]: DEBUG cinder.coordination [None req-e35efa83-a0c1-4836-aaa0-f8317f1cc5a9 tempest-VolumesSnapshotTestJSON-1345007867 None] Acquiring lock "cinder-quobyte-937f22e8-a48b-48ba-a1f4-be84561e4f52" by "delete_volume" {{(pid=84538) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 19:05:19 devstack cinder-volume[84538]: DEBUG cinder.coordination [None req-e35efa83-a0c1-4836-aaa0-f8317f1cc5a9 tempest-VolumesSnapshotTestJSON-1345007867 None] Lock "cinder-quobyte-937f22e8-a48b-48ba-a1f4-be84561e4f52" acquired by "delete_volume" :: waited 0.014s {{(pid=84538) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 19:05:19 devstack cinder-volume[84538]: DEBUG oslo.privsep.daemon [-] privsep: reply[4e0196fb-51e5-4e33-b900-7984b4550367]: (4, 'qcow2') {{(pid=85803) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 19:05:19 devstack cinder-volume[84538]: DEBUG oslo_concurrency.processutils [None req-e35efa83-a0c1-4836-aaa0-f8317f1cc5a9 tempest-VolumesSnapshotTestJSON-1345007867 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-937f22e8-a48b-48ba-a1f4-be84561e4f52 {{(pid=84538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 19:05:19 devstack sudo[92103]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-937f22e8-a48b-48ba-a1f4-be84561e4f52 Apr 29 19:05:19 devstack sudo[92103]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 19:05:19 devstack sudo[92098]: pam_unix(sudo:session): session closed for user root Apr 29 19:05:19 devstack cinder-volume[84538]: DEBUG oslo_concurrency.processutils [None req-5a08b2a9-32ab-4f56-8d35-027b4b06a64f tempest-CinderUnicodeTest-1144970881 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-723bbfbf-d981-4a0e-8a8c-2bbf66f2115e" returned: 0 in 0.757s {{(pid=84538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 19:05:19 devstack cinder-volume[84538]: DEBUG oslo_concurrency.processutils [None req-5a08b2a9-32ab-4f56-8d35-027b4b06a64f tempest-CinderUnicodeTest-1144970881 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-723bbfbf-d981-4a0e-8a8c-2bbf66f2115e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-723bbfbf-d981-4a0e-8a8c-2bbf66f2115e.a767e3d2-1842-41db-9300-1163b2d910d0 1G {{(pid=84538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 19:05:19 devstack sudo[92109]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-723bbfbf-d981-4a0e-8a8c-2bbf66f2115e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-723bbfbf-d981-4a0e-8a8c-2bbf66f2115e.a767e3d2-1842-41db-9300-1163b2d910d0 1G Apr 29 19:05:19 devstack sudo[92109]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 19:05:19 devstack sudo[92101]: pam_unix(sudo:session): session closed for user root Apr 29 19:05:19 devstack cinder-volume[84538]: DEBUG oslo_concurrency.processutils [None req-b0c230e8-4d46-42bc-8caa-d5df64bbb42c tempest-VolumesListTestJSON-1695505021 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-da8c4537-b5c7-46e5-b7a0-d0379e4105bf" returned: 0 in 0.680s {{(pid=84538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 19:05:19 devstack cinder-volume[84538]: DEBUG cinder.coordination [None req-b0c230e8-4d46-42bc-8caa-d5df64bbb42c tempest-VolumesListTestJSON-1695505021 None] Lock "cinder-quobyte-da8c4537-b5c7-46e5-b7a0-d0379e4105bf" released by "delete_volume" :: held 1.503s {{(pid=84538) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 19:05:19 devstack cinder-volume[84538]: DEBUG cinder.quota [None req-b0c230e8-4d46-42bc-8caa-d5df64bbb42c tempest-VolumesListTestJSON-1695505021 None] Created reservations ['f3835dcf-414f-42c8-8bc6-ea1e3ffd62c9', 'fbbb3b93-e64b-4e01-b45f-f52b1a870c36', 'aec8dae5-c1bb-4326-9bd4-3410fa6c8aba', '9d2922a8-95c6-472e-afa3-d989bb44e02b'] {{(pid=84538) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 29 19:05:20 devstack cinder-volume[84538]: DEBUG oslo_concurrency.lockutils [None req-b0c230e8-4d46-42bc-8caa-d5df64bbb42c tempest-VolumesListTestJSON-1695505021 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 19:05:20 devstack cinder-volume[84538]: DEBUG oslo_concurrency.lockutils [None req-b0c230e8-4d46-42bc-8caa-d5df64bbb42c tempest-VolumesListTestJSON-1695505021 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 19:05:20 devstack cinder-volume[84538]: DEBUG cinder.volume.drivers.quobyte [None req-b0c230e8-4d46-42bc-8caa-d5df64bbb42c tempest-VolumesListTestJSON-1695505021 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-34312b00-dd6d-45bb-af98-75855cea8e48': None} {{(pid=84538) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 19:05:20 devstack cinder-volume[84538]: DEBUG cinder.volume.drivers.quobyte [None req-b0c230e8-4d46-42bc-8caa-d5df64bbb42c tempest-VolumesListTestJSON-1695505021 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-34312b00-dd6d-45bb-af98-75855cea8e48'] {{(pid=84538) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 19:05:20 devstack cinder-volume[84538]: DEBUG oslo_concurrency.lockutils [None req-b0c230e8-4d46-42bc-8caa-d5df64bbb42c tempest-VolumesListTestJSON-1695505021 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=84538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 19:05:20 devstack cinder-volume[84538]: DEBUG oslo_concurrency.processutils [None req-b0c230e8-4d46-42bc-8caa-d5df64bbb42c tempest-VolumesListTestJSON-1695505021 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d {{(pid=84538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 19:05:20 devstack sudo[92111]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d Apr 29 19:05:20 devstack sudo[92111]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 19:05:20 devstack sudo[92103]: pam_unix(sudo:session): session closed for user root Apr 29 19:05:20 devstack cinder-volume[84538]: DEBUG oslo_concurrency.processutils [None req-e35efa83-a0c1-4836-aaa0-f8317f1cc5a9 tempest-VolumesSnapshotTestJSON-1345007867 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-937f22e8-a48b-48ba-a1f4-be84561e4f52" returned: 0 in 0.752s {{(pid=84538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 19:05:20 devstack cinder-volume[84538]: DEBUG oslo_concurrency.processutils [None req-e35efa83-a0c1-4836-aaa0-f8317f1cc5a9 tempest-VolumesSnapshotTestJSON-1345007867 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-937f22e8-a48b-48ba-a1f4-be84561e4f52 {{(pid=84538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 19:05:20 devstack sudo[92116]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-937f22e8-a48b-48ba-a1f4-be84561e4f52 Apr 29 19:05:20 devstack sudo[92116]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 19:05:20 devstack cinder-volume[84538]: DEBUG cinder.coordination [None req-bb79f1b9-1f20-4a92-90ca-47fd32828a90 tempest-VolumesListTestJSON-1695505021 None] Acquiring lock "cinder-f710366c-9c8d-4ce5-82ec-661e3abbfbd0-delete_volume" by "delete_volume" {{(pid=84538) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 19:05:20 devstack cinder-volume[84538]: DEBUG cinder.coordination [None req-bb79f1b9-1f20-4a92-90ca-47fd32828a90 tempest-VolumesListTestJSON-1695505021 None] Lock "cinder-f710366c-9c8d-4ce5-82ec-661e3abbfbd0-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=84538) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 19:05:20 devstack sudo[92111]: pam_unix(sudo:session): session closed for user root Apr 29 19:05:20 devstack cinder-volume[84538]: DEBUG oslo_concurrency.processutils [None req-b0c230e8-4d46-42bc-8caa-d5df64bbb42c tempest-VolumesListTestJSON-1695505021 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d" returned: 0 in 0.661s {{(pid=84538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 19:05:20 devstack cinder-volume[84538]: DEBUG cinder.manager [None req-b0c230e8-4d46-42bc-8caa-d5df64bbb42c tempest-VolumesListTestJSON-1695505021 None] Notifying Schedulers of capabilities ... {{(pid=84538) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 29 19:05:20 devstack cinder-volume[84538]: INFO cinder.volume.manager [None req-b0c230e8-4d46-42bc-8caa-d5df64bbb42c tempest-VolumesListTestJSON-1695505021 None] Deleted volume successfully. Apr 29 19:05:20 devstack sudo[92109]: pam_unix(sudo:session): session closed for user root Apr 29 19:05:20 devstack cinder-volume[84538]: DEBUG cinder.coordination [None req-bb79f1b9-1f20-4a92-90ca-47fd32828a90 tempest-VolumesListTestJSON-1695505021 None] Acquiring lock "cinder-quobyte-f710366c-9c8d-4ce5-82ec-661e3abbfbd0" by "delete_volume" {{(pid=84538) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 19:05:20 devstack cinder-volume[84538]: DEBUG oslo_concurrency.processutils [None req-5a08b2a9-32ab-4f56-8d35-027b4b06a64f tempest-CinderUnicodeTest-1144970881 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-723bbfbf-d981-4a0e-8a8c-2bbf66f2115e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-723bbfbf-d981-4a0e-8a8c-2bbf66f2115e.a767e3d2-1842-41db-9300-1163b2d910d0 1G" returned: 0 in 0.913s {{(pid=84538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 19:05:20 devstack cinder-volume[84538]: DEBUG oslo_concurrency.processutils [None req-5a08b2a9-32ab-4f56-8d35-027b4b06a64f tempest-CinderUnicodeTest-1144970881 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-723bbfbf-d981-4a0e-8a8c-2bbf66f2115e -F qcow2 /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-723bbfbf-d981-4a0e-8a8c-2bbf66f2115e.a767e3d2-1842-41db-9300-1163b2d910d0 {{(pid=84538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 19:05:20 devstack cinder-volume[84538]: DEBUG cinder.coordination [None req-b0c230e8-4d46-42bc-8caa-d5df64bbb42c tempest-VolumesListTestJSON-1695505021 None] Lock "cinder-da8c4537-b5c7-46e5-b7a0-d0379e4105bf-delete_volume" released by "delete_volume" :: held 2.421s {{(pid=84538) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 19:05:20 devstack cinder-volume[84538]: DEBUG cinder.coordination [None req-bb79f1b9-1f20-4a92-90ca-47fd32828a90 tempest-VolumesListTestJSON-1695505021 None] Lock "cinder-quobyte-f710366c-9c8d-4ce5-82ec-661e3abbfbd0" acquired by "delete_volume" :: waited 0.035s {{(pid=84538) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 19:05:20 devstack sudo[92123]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-723bbfbf-d981-4a0e-8a8c-2bbf66f2115e -F qcow2 /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-723bbfbf-d981-4a0e-8a8c-2bbf66f2115e.a767e3d2-1842-41db-9300-1163b2d910d0 Apr 29 19:05:20 devstack sudo[92123]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 19:05:20 devstack cinder-volume[84538]: DEBUG oslo.privsep.daemon [-] privsep: reply[35d6b3a6-642a-45a6-819a-22f659761fa8]: (4, 'qcow2') {{(pid=85803) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 19:05:20 devstack cinder-volume[84538]: DEBUG oslo_concurrency.processutils [None req-bb79f1b9-1f20-4a92-90ca-47fd32828a90 tempest-VolumesListTestJSON-1695505021 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-f710366c-9c8d-4ce5-82ec-661e3abbfbd0 {{(pid=84538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 19:05:20 devstack sudo[92125]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-f710366c-9c8d-4ce5-82ec-661e3abbfbd0 Apr 29 19:05:20 devstack sudo[92125]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 19:05:21 devstack sudo[92116]: pam_unix(sudo:session): session closed for user root Apr 29 19:05:21 devstack cinder-volume[84538]: DEBUG oslo_concurrency.processutils [None req-e35efa83-a0c1-4836-aaa0-f8317f1cc5a9 tempest-VolumesSnapshotTestJSON-1345007867 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-937f22e8-a48b-48ba-a1f4-be84561e4f52" returned: 0 in 0.728s {{(pid=84538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 19:05:21 devstack cinder-volume[84538]: DEBUG cinder.coordination [None req-e35efa83-a0c1-4836-aaa0-f8317f1cc5a9 tempest-VolumesSnapshotTestJSON-1345007867 None] Lock "cinder-quobyte-937f22e8-a48b-48ba-a1f4-be84561e4f52" released by "delete_volume" :: held 1.525s {{(pid=84538) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 19:05:21 devstack cinder-volume[84538]: DEBUG cinder.quota [None req-e35efa83-a0c1-4836-aaa0-f8317f1cc5a9 tempest-VolumesSnapshotTestJSON-1345007867 None] Created reservations ['18938613-6b43-4f87-8ee2-d334b8ede5ef', 'd226e2ae-9204-4bd1-a354-5eed149a6321', 'b1cb058a-b72d-48e9-bc9f-433e4a23025c', '4eb64552-d4ca-4422-aecb-b430117f6ea8'] {{(pid=84538) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 29 19:05:21 devstack cinder-volume[84538]: DEBUG oslo_concurrency.lockutils [None req-e35efa83-a0c1-4836-aaa0-f8317f1cc5a9 tempest-VolumesSnapshotTestJSON-1345007867 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 19:05:21 devstack cinder-volume[84538]: DEBUG oslo_concurrency.lockutils [None req-e35efa83-a0c1-4836-aaa0-f8317f1cc5a9 tempest-VolumesSnapshotTestJSON-1345007867 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 19:05:21 devstack cinder-volume[84538]: DEBUG cinder.volume.drivers.quobyte [None req-e35efa83-a0c1-4836-aaa0-f8317f1cc5a9 tempest-VolumesSnapshotTestJSON-1345007867 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-34312b00-dd6d-45bb-af98-75855cea8e48': None} {{(pid=84538) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 19:05:21 devstack cinder-volume[84538]: DEBUG cinder.volume.drivers.quobyte [None req-e35efa83-a0c1-4836-aaa0-f8317f1cc5a9 tempest-VolumesSnapshotTestJSON-1345007867 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-34312b00-dd6d-45bb-af98-75855cea8e48'] {{(pid=84538) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 19:05:21 devstack cinder-volume[84538]: DEBUG oslo_concurrency.lockutils [None req-e35efa83-a0c1-4836-aaa0-f8317f1cc5a9 tempest-VolumesSnapshotTestJSON-1345007867 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=84538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 19:05:21 devstack cinder-volume[84538]: DEBUG oslo_concurrency.processutils [None req-e35efa83-a0c1-4836-aaa0-f8317f1cc5a9 tempest-VolumesSnapshotTestJSON-1345007867 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d {{(pid=84538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 19:05:21 devstack sudo[92128]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d Apr 29 19:05:21 devstack sudo[92128]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 19:05:21 devstack sudo[92123]: pam_unix(sudo:session): session closed for user root Apr 29 19:05:21 devstack cinder-volume[84538]: DEBUG oslo_concurrency.processutils [None req-5a08b2a9-32ab-4f56-8d35-027b4b06a64f tempest-CinderUnicodeTest-1144970881 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-723bbfbf-d981-4a0e-8a8c-2bbf66f2115e -F qcow2 /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-723bbfbf-d981-4a0e-8a8c-2bbf66f2115e.a767e3d2-1842-41db-9300-1163b2d910d0" returned: 0 in 0.692s {{(pid=84538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 19:05:21 devstack cinder-volume[84538]: WARNING cinder.volume.drivers.remotefs [None req-5a08b2a9-32ab-4f56-8d35-027b4b06a64f tempest-CinderUnicodeTest-1144970881 None] /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-723bbfbf-d981-4a0e-8a8c-2bbf66f2115e.a767e3d2-1842-41db-9300-1163b2d910d0 is being set with open permissions: ugo+rw Apr 29 19:05:21 devstack cinder-volume[84538]: DEBUG oslo_concurrency.processutils [None req-5a08b2a9-32ab-4f56-8d35-027b4b06a64f tempest-CinderUnicodeTest-1144970881 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-723bbfbf-d981-4a0e-8a8c-2bbf66f2115e.a767e3d2-1842-41db-9300-1163b2d910d0 {{(pid=84538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 19:05:21 devstack sudo[92134]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-723bbfbf-d981-4a0e-8a8c-2bbf66f2115e.a767e3d2-1842-41db-9300-1163b2d910d0 Apr 29 19:05:21 devstack sudo[92134]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 19:05:21 devstack sudo[92125]: pam_unix(sudo:session): session closed for user root Apr 29 19:05:21 devstack cinder-volume[84538]: DEBUG oslo_concurrency.processutils [None req-bb79f1b9-1f20-4a92-90ca-47fd32828a90 tempest-VolumesListTestJSON-1695505021 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-f710366c-9c8d-4ce5-82ec-661e3abbfbd0" returned: 0 in 0.769s {{(pid=84538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 19:05:21 devstack cinder-volume[84538]: DEBUG oslo_concurrency.processutils [None req-bb79f1b9-1f20-4a92-90ca-47fd32828a90 tempest-VolumesListTestJSON-1695505021 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-f710366c-9c8d-4ce5-82ec-661e3abbfbd0 {{(pid=84538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 19:05:21 devstack sudo[92138]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-f710366c-9c8d-4ce5-82ec-661e3abbfbd0 Apr 29 19:05:21 devstack sudo[92138]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 19:05:21 devstack cinder-volume[84538]: DEBUG cinder.coordination [None req-9712b075-b382-4d57-912d-80b5956719e8 tempest-VolumesSnapshotTestJSON-1345007867 None] Acquiring lock "cinder-497d286e-63eb-4892-9655-520934c8cc0a-delete_snapshot" by "delete_snapshot" {{(pid=84538) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 19:05:21 devstack cinder-volume[84538]: DEBUG cinder.coordination [None req-9712b075-b382-4d57-912d-80b5956719e8 tempest-VolumesSnapshotTestJSON-1345007867 None] Lock "cinder-497d286e-63eb-4892-9655-520934c8cc0a-delete_snapshot" acquired by "delete_snapshot" :: waited 0.041s {{(pid=84538) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 19:05:21 devstack cinder-volume[84538]: DEBUG cinder.coordination [None req-9712b075-b382-4d57-912d-80b5956719e8 tempest-VolumesSnapshotTestJSON-1345007867 None] Acquiring lock "cinder-quobyte-8ffdf26a-b64d-43d0-8e13-5805979ca936" by "delete_snapshot" {{(pid=84538) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 19:05:21 devstack cinder-volume[84538]: DEBUG cinder.coordination [None req-9712b075-b382-4d57-912d-80b5956719e8 tempest-VolumesSnapshotTestJSON-1345007867 None] Lock "cinder-quobyte-8ffdf26a-b64d-43d0-8e13-5805979ca936" acquired by "delete_snapshot" :: waited 0.029s {{(pid=84538) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 19:05:21 devstack cinder-volume[84538]: DEBUG cinder.coordination [None req-9712b075-b382-4d57-912d-80b5956719e8 tempest-VolumesSnapshotTestJSON-1345007867 None] Acquiring lock "cinder-quobyte-497d286e-63eb-4892-9655-520934c8cc0a" by "_delete_snapshot" {{(pid=84538) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 19:05:21 devstack cinder-volume[84538]: DEBUG cinder.coordination [None req-9712b075-b382-4d57-912d-80b5956719e8 tempest-VolumesSnapshotTestJSON-1345007867 None] Lock "cinder-quobyte-497d286e-63eb-4892-9655-520934c8cc0a" acquired by "_delete_snapshot" :: waited 0.022s {{(pid=84538) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 19:05:21 devstack cinder-volume[84538]: DEBUG cinder.volume.drivers.remotefs [None req-9712b075-b382-4d57-912d-80b5956719e8 tempest-VolumesSnapshotTestJSON-1345007867 None] Deleting offline snapshot 497d286e-63eb-4892-9655-520934c8cc0a of volume 8ffdf26a-b64d-43d0-8e13-5805979ca936 {{(pid=84538) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 29 19:05:21 devstack cinder-volume[84538]: DEBUG cinder.volume.drivers.remotefs [None req-9712b075-b382-4d57-912d-80b5956719e8 tempest-VolumesSnapshotTestJSON-1345007867 None] snapshot_file for this snap is: volume-8ffdf26a-b64d-43d0-8e13-5805979ca936.497d286e-63eb-4892-9655-520934c8cc0a {{(pid=84538) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 29 19:05:21 devstack cinder-volume[84538]: DEBUG oslo.privsep.daemon [-] privsep: reply[85ff5f37-3c1a-4a39-8457-44922bbef1fe]: (4, 'qcow2') {{(pid=85803) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 19:05:21 devstack cinder-volume[84538]: DEBUG oslo_concurrency.processutils [None req-9712b075-b382-4d57-912d-80b5956719e8 tempest-VolumesSnapshotTestJSON-1345007867 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-8ffdf26a-b64d-43d0-8e13-5805979ca936.497d286e-63eb-4892-9655-520934c8cc0a {{(pid=84538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 19:05:21 devstack sudo[92128]: pam_unix(sudo:session): session closed for user root Apr 29 19:05:21 devstack cinder-volume[84538]: DEBUG oslo_concurrency.processutils [None req-e35efa83-a0c1-4836-aaa0-f8317f1cc5a9 tempest-VolumesSnapshotTestJSON-1345007867 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d" returned: 0 in 0.709s {{(pid=84538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 19:05:21 devstack cinder-volume[84538]: DEBUG cinder.manager [None req-e35efa83-a0c1-4836-aaa0-f8317f1cc5a9 tempest-VolumesSnapshotTestJSON-1345007867 None] Notifying Schedulers of capabilities ... {{(pid=84538) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 29 19:05:21 devstack cinder-volume[84538]: INFO cinder.volume.manager [None req-e35efa83-a0c1-4836-aaa0-f8317f1cc5a9 tempest-VolumesSnapshotTestJSON-1345007867 None] Deleted volume successfully. Apr 29 19:05:21 devstack cinder-volume[84538]: DEBUG cinder.coordination [None req-e35efa83-a0c1-4836-aaa0-f8317f1cc5a9 tempest-VolumesSnapshotTestJSON-1345007867 None] Lock "cinder-937f22e8-a48b-48ba-a1f4-be84561e4f52-delete_volume" released by "delete_volume" :: held 2.483s {{(pid=84538) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 19:05:22 devstack sudo[92141]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-8ffdf26a-b64d-43d0-8e13-5805979ca936.497d286e-63eb-4892-9655-520934c8cc0a Apr 29 19:05:22 devstack sudo[92141]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 19:05:22 devstack sudo[92134]: pam_unix(sudo:session): session closed for user root Apr 29 19:05:22 devstack cinder-volume[84538]: DEBUG oslo_concurrency.processutils [None req-5a08b2a9-32ab-4f56-8d35-027b4b06a64f tempest-CinderUnicodeTest-1144970881 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-723bbfbf-d981-4a0e-8a8c-2bbf66f2115e.a767e3d2-1842-41db-9300-1163b2d910d0" returned: 0 in 0.650s {{(pid=84538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 19:05:22 devstack cinder-volume[84538]: DEBUG oslo_concurrency.processutils [None req-5a08b2a9-32ab-4f56-8d35-027b4b06a64f tempest-CinderUnicodeTest-1144970881 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-723bbfbf-d981-4a0e-8a8c-2bbf66f2115e.info {{(pid=84538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 19:05:22 devstack sudo[92144]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-723bbfbf-d981-4a0e-8a8c-2bbf66f2115e.info Apr 29 19:05:22 devstack sudo[92144]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 19:05:22 devstack sudo[92138]: pam_unix(sudo:session): session closed for user root Apr 29 19:05:22 devstack cinder-volume[84538]: DEBUG oslo_concurrency.processutils [None req-bb79f1b9-1f20-4a92-90ca-47fd32828a90 tempest-VolumesListTestJSON-1695505021 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-f710366c-9c8d-4ce5-82ec-661e3abbfbd0" returned: 0 in 0.693s {{(pid=84538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 19:05:22 devstack cinder-volume[84538]: DEBUG cinder.coordination [None req-bb79f1b9-1f20-4a92-90ca-47fd32828a90 tempest-VolumesListTestJSON-1695505021 None] Lock "cinder-quobyte-f710366c-9c8d-4ce5-82ec-661e3abbfbd0" released by "delete_volume" :: held 1.506s {{(pid=84538) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 19:05:22 devstack cinder-volume[84538]: DEBUG cinder.quota [None req-bb79f1b9-1f20-4a92-90ca-47fd32828a90 tempest-VolumesListTestJSON-1695505021 None] Created reservations ['9b007164-cadc-4ba4-a669-bfc5730b3839', '476a2f8b-f026-47c6-b839-595f4635bada', '32869ae0-15ab-487c-a909-d7ee0233ce8b', '70a05a21-29b0-42f4-abba-60f6f8eebe47'] {{(pid=84538) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 29 19:05:22 devstack cinder-volume[84538]: DEBUG oslo_concurrency.lockutils [None req-bb79f1b9-1f20-4a92-90ca-47fd32828a90 tempest-VolumesListTestJSON-1695505021 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 19:05:22 devstack cinder-volume[84538]: DEBUG oslo_concurrency.lockutils [None req-bb79f1b9-1f20-4a92-90ca-47fd32828a90 tempest-VolumesListTestJSON-1695505021 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 19:05:22 devstack cinder-volume[84538]: DEBUG cinder.volume.drivers.quobyte [None req-bb79f1b9-1f20-4a92-90ca-47fd32828a90 tempest-VolumesListTestJSON-1695505021 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-34312b00-dd6d-45bb-af98-75855cea8e48': None} {{(pid=84538) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 19:05:22 devstack cinder-volume[84538]: DEBUG cinder.volume.drivers.quobyte [None req-bb79f1b9-1f20-4a92-90ca-47fd32828a90 tempest-VolumesListTestJSON-1695505021 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-34312b00-dd6d-45bb-af98-75855cea8e48'] {{(pid=84538) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 19:05:22 devstack cinder-volume[84538]: DEBUG oslo_concurrency.lockutils [None req-bb79f1b9-1f20-4a92-90ca-47fd32828a90 tempest-VolumesListTestJSON-1695505021 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=84538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 19:05:22 devstack cinder-volume[84538]: DEBUG oslo_concurrency.processutils [None req-bb79f1b9-1f20-4a92-90ca-47fd32828a90 tempest-VolumesListTestJSON-1695505021 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d {{(pid=84538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 19:05:22 devstack sudo[92147]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d Apr 29 19:05:22 devstack sudo[92147]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 19:05:22 devstack sudo[92141]: pam_unix(sudo:session): session closed for user root Apr 29 19:05:22 devstack cinder-volume[84538]: DEBUG oslo_concurrency.processutils [None req-9712b075-b382-4d57-912d-80b5956719e8 tempest-VolumesSnapshotTestJSON-1345007867 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-8ffdf26a-b64d-43d0-8e13-5805979ca936.497d286e-63eb-4892-9655-520934c8cc0a" returned: 0 in 0.781s {{(pid=84538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 19:05:22 devstack cinder-volume[84538]: DEBUG cinder.volume.drivers.remotefs [None req-9712b075-b382-4d57-912d-80b5956719e8 tempest-VolumesSnapshotTestJSON-1345007867 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-8ffdf26a-b64d-43d0-8e13-5805979ca936(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=84538) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 29 19:05:22 devstack cinder-volume[84538]: DEBUG oslo.privsep.daemon [-] privsep: reply[b67a61d4-2cb1-4c4f-a306-427721c346ac]: (4, 'qcow2') {{(pid=85803) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 19:05:22 devstack cinder-volume[84538]: DEBUG oslo_concurrency.processutils [None req-9712b075-b382-4d57-912d-80b5956719e8 tempest-VolumesSnapshotTestJSON-1345007867 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-8ffdf26a-b64d-43d0-8e13-5805979ca936 {{(pid=84538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 19:05:22 devstack sudo[92144]: pam_unix(sudo:session): session closed for user root Apr 29 19:05:22 devstack cinder-volume[84538]: DEBUG oslo_concurrency.processutils [None req-5a08b2a9-32ab-4f56-8d35-027b4b06a64f tempest-CinderUnicodeTest-1144970881 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-723bbfbf-d981-4a0e-8a8c-2bbf66f2115e.info" returned: 0 in 0.612s {{(pid=84538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 19:05:22 devstack cinder-volume[84538]: WARNING cinder.volume.drivers.remotefs [None req-5a08b2a9-32ab-4f56-8d35-027b4b06a64f tempest-CinderUnicodeTest-1144970881 None] /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-723bbfbf-d981-4a0e-8a8c-2bbf66f2115e.info is being set with open permissions: ugo+rw Apr 29 19:05:22 devstack cinder-volume[84538]: DEBUG oslo_concurrency.processutils [None req-5a08b2a9-32ab-4f56-8d35-027b4b06a64f tempest-CinderUnicodeTest-1144970881 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-723bbfbf-d981-4a0e-8a8c-2bbf66f2115e.info {{(pid=84538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 19:05:22 devstack sudo[92154]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-723bbfbf-d981-4a0e-8a8c-2bbf66f2115e.info Apr 29 19:05:22 devstack sudo[92154]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 19:05:22 devstack sudo[92153]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-8ffdf26a-b64d-43d0-8e13-5805979ca936 Apr 29 19:05:22 devstack sudo[92153]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 19:05:23 devstack sudo[92147]: pam_unix(sudo:session): session closed for user root Apr 29 19:05:23 devstack cinder-volume[84538]: DEBUG oslo_concurrency.processutils [None req-bb79f1b9-1f20-4a92-90ca-47fd32828a90 tempest-VolumesListTestJSON-1695505021 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d" returned: 0 in 0.634s {{(pid=84538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 19:05:23 devstack cinder-volume[84538]: DEBUG cinder.manager [None req-bb79f1b9-1f20-4a92-90ca-47fd32828a90 tempest-VolumesListTestJSON-1695505021 None] Notifying Schedulers of capabilities ... {{(pid=84538) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 29 19:05:23 devstack cinder-volume[84538]: INFO cinder.volume.manager [None req-bb79f1b9-1f20-4a92-90ca-47fd32828a90 tempest-VolumesListTestJSON-1695505021 None] Deleted volume successfully. Apr 29 19:05:23 devstack cinder-volume[84538]: DEBUG cinder.coordination [None req-bb79f1b9-1f20-4a92-90ca-47fd32828a90 tempest-VolumesListTestJSON-1695505021 None] Lock "cinder-f710366c-9c8d-4ce5-82ec-661e3abbfbd0-delete_volume" released by "delete_volume" :: held 2.397s {{(pid=84538) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 19:05:23 devstack sudo[92154]: pam_unix(sudo:session): session closed for user root Apr 29 19:05:23 devstack cinder-volume[84538]: DEBUG oslo_concurrency.processutils [None req-5a08b2a9-32ab-4f56-8d35-027b4b06a64f tempest-CinderUnicodeTest-1144970881 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-723bbfbf-d981-4a0e-8a8c-2bbf66f2115e.info" returned: 0 in 0.627s {{(pid=84538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 19:05:23 devstack cinder-volume[84538]: DEBUG oslo_concurrency.lockutils [None req-5a08b2a9-32ab-4f56-8d35-027b4b06a64f tempest-CinderUnicodeTest-1144970881 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.344s {{(pid=84538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 19:05:23 devstack cinder-volume[84538]: DEBUG oslo_concurrency.lockutils [None req-7a7a6f61-2f2f-4a54-90e6-3f15be0738d2 tempest-VolumesExtendTest-451302124 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 8.941s {{(pid=84538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 19:05:23 devstack cinder-volume[84538]: DEBUG cinder.volume.drivers.quobyte [None req-7a7a6f61-2f2f-4a54-90e6-3f15be0738d2 tempest-VolumesExtendTest-451302124 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-29T17:05:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-1923145982',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6b9ca0e6-2b0f-40a7-908b-ee6d4f7f7489,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e75c2db35d914882a975b826675987e5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T17:05:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T17:05:11Z,use_quota=True,user_id='865814330ca6407a83ca3897a4368e2b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(62b05900-93e3-4190-a88f-1d87324303d1),volume_type_id=62b05900-93e3-4190-a88f-1d87324303d1)}" {{(pid=84538) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 29 19:05:23 devstack cinder-volume[84538]: DEBUG cinder.volume.drivers.remotefs [None req-7a7a6f61-2f2f-4a54-90e6-3f15be0738d2 tempest-VolumesExtendTest-451302124 None] Creating volume 6b9ca0e6-2b0f-40a7-908b-ee6d4f7f7489 {{(pid=84538) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 29 19:05:23 devstack cinder-volume[84538]: DEBUG oslo_concurrency.lockutils [None req-7a7a6f61-2f2f-4a54-90e6-3f15be0738d2 tempest-VolumesExtendTest-451302124 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 19:05:23 devstack cinder-volume[84538]: DEBUG oslo_concurrency.lockutils [None req-7a7a6f61-2f2f-4a54-90e6-3f15be0738d2 tempest-VolumesExtendTest-451302124 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 19:05:23 devstack cinder-volume[84538]: DEBUG cinder.volume.drivers.quobyte [None req-7a7a6f61-2f2f-4a54-90e6-3f15be0738d2 tempest-VolumesExtendTest-451302124 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-34312b00-dd6d-45bb-af98-75855cea8e48': None} {{(pid=84538) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 19:05:23 devstack cinder-volume[84538]: DEBUG cinder.volume.drivers.quobyte [None req-7a7a6f61-2f2f-4a54-90e6-3f15be0738d2 tempest-VolumesExtendTest-451302124 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-34312b00-dd6d-45bb-af98-75855cea8e48'] {{(pid=84538) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 19:05:23 devstack cinder-volume[84538]: DEBUG oslo_concurrency.lockutils [None req-7a7a6f61-2f2f-4a54-90e6-3f15be0738d2 tempest-VolumesExtendTest-451302124 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=84538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 19:05:23 devstack cinder-volume[84538]: DEBUG cinder.volume.drivers.quobyte [None req-7a7a6f61-2f2f-4a54-90e6-3f15be0738d2 tempest-VolumesExtendTest-451302124 None] Selected osci02.corp.quobyte.com/cinder-vol-34312b00-dd6d-45bb-af98-75855cea8e48 as target Quobyte volume. {{(pid=84538) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 29 19:05:23 devstack cinder-volume[84538]: INFO cinder.volume.drivers.remotefs [None req-7a7a6f61-2f2f-4a54-90e6-3f15be0738d2 tempest-VolumesExtendTest-451302124 None] casted to osci02.corp.quobyte.com/cinder-vol-34312b00-dd6d-45bb-af98-75855cea8e48 Apr 29 19:05:23 devstack cinder-volume[84538]: DEBUG oslo_concurrency.processutils [None req-7a7a6f61-2f2f-4a54-90e6-3f15be0738d2 tempest-VolumesExtendTest-451302124 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-6b9ca0e6-2b0f-40a7-908b-ee6d4f7f7489 1073741824 {{(pid=84538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 19:05:23 devstack sudo[92161]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-6b9ca0e6-2b0f-40a7-908b-ee6d4f7f7489 1073741824 Apr 29 19:05:23 devstack sudo[92161]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 19:05:23 devstack cinder-volume[84538]: INFO cinder.volume.manager [None req-5a08b2a9-32ab-4f56-8d35-027b4b06a64f tempest-CinderUnicodeTest-1144970881 None] Create snapshot completed successfully Apr 29 19:05:23 devstack sudo[92153]: pam_unix(sudo:session): session closed for user root Apr 29 19:05:23 devstack cinder-volume[84538]: DEBUG oslo_concurrency.processutils [None req-9712b075-b382-4d57-912d-80b5956719e8 tempest-VolumesSnapshotTestJSON-1345007867 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-8ffdf26a-b64d-43d0-8e13-5805979ca936" returned: 0 in 0.829s {{(pid=84538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 19:05:23 devstack cinder-volume[84538]: DEBUG oslo_concurrency.processutils [None req-9712b075-b382-4d57-912d-80b5956719e8 tempest-VolumesSnapshotTestJSON-1345007867 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-8ffdf26a-b64d-43d0-8e13-5805979ca936.497d286e-63eb-4892-9655-520934c8cc0a {{(pid=84538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 19:05:23 devstack sudo[92164]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-8ffdf26a-b64d-43d0-8e13-5805979ca936.497d286e-63eb-4892-9655-520934c8cc0a Apr 29 19:05:23 devstack sudo[92164]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 19:05:24 devstack sudo[92161]: pam_unix(sudo:session): session closed for user root Apr 29 19:05:24 devstack cinder-volume[84538]: DEBUG oslo_concurrency.processutils [None req-7a7a6f61-2f2f-4a54-90e6-3f15be0738d2 tempest-VolumesExtendTest-451302124 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-6b9ca0e6-2b0f-40a7-908b-ee6d4f7f7489 1073741824" returned: 0 in 0.944s {{(pid=84538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 19:05:24 devstack cinder-volume[84538]: DEBUG oslo_concurrency.processutils [None req-7a7a6f61-2f2f-4a54-90e6-3f15be0738d2 tempest-VolumesExtendTest-451302124 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-6b9ca0e6-2b0f-40a7-908b-ee6d4f7f7489 {{(pid=84538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 19:05:24 devstack sudo[92164]: pam_unix(sudo:session): session closed for user root Apr 29 19:05:24 devstack cinder-volume[84538]: DEBUG oslo_concurrency.processutils [None req-9712b075-b382-4d57-912d-80b5956719e8 tempest-VolumesSnapshotTestJSON-1345007867 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-8ffdf26a-b64d-43d0-8e13-5805979ca936.497d286e-63eb-4892-9655-520934c8cc0a" returned: 0 in 0.867s {{(pid=84538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 19:05:24 devstack cinder-volume[84538]: DEBUG oslo_concurrency.processutils [None req-9712b075-b382-4d57-912d-80b5956719e8 tempest-VolumesSnapshotTestJSON-1345007867 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-8ffdf26a-b64d-43d0-8e13-5805979ca936.497d286e-63eb-4892-9655-520934c8cc0a {{(pid=84538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 19:05:24 devstack sudo[92174]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-6b9ca0e6-2b0f-40a7-908b-ee6d4f7f7489 Apr 29 19:05:24 devstack sudo[92174]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 19:05:24 devstack sudo[92175]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-8ffdf26a-b64d-43d0-8e13-5805979ca936.497d286e-63eb-4892-9655-520934c8cc0a Apr 29 19:05:24 devstack sudo[92175]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 19:05:24 devstack cinder-volume[84538]: DEBUG cinder.coordination [None req-922713f8-3a39-4d4c-b388-875671fc60e0 tempest-CinderUnicodeTest-1144970881 None] Acquiring lock "cinder-a767e3d2-1842-41db-9300-1163b2d910d0-delete_snapshot" by "delete_snapshot" {{(pid=84538) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 19:05:24 devstack cinder-volume[84538]: DEBUG cinder.coordination [None req-922713f8-3a39-4d4c-b388-875671fc60e0 tempest-CinderUnicodeTest-1144970881 None] Lock "cinder-a767e3d2-1842-41db-9300-1163b2d910d0-delete_snapshot" acquired by "delete_snapshot" :: waited 0.037s {{(pid=84538) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 19:05:24 devstack cinder-volume[84538]: DEBUG cinder.coordination [None req-922713f8-3a39-4d4c-b388-875671fc60e0 tempest-CinderUnicodeTest-1144970881 None] Acquiring lock "cinder-quobyte-723bbfbf-d981-4a0e-8a8c-2bbf66f2115e" by "delete_snapshot" {{(pid=84538) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 19:05:24 devstack cinder-volume[84538]: DEBUG cinder.coordination [None req-922713f8-3a39-4d4c-b388-875671fc60e0 tempest-CinderUnicodeTest-1144970881 None] Lock "cinder-quobyte-723bbfbf-d981-4a0e-8a8c-2bbf66f2115e" acquired by "delete_snapshot" :: waited 0.018s {{(pid=84538) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 19:05:24 devstack cinder-volume[84538]: DEBUG cinder.coordination [None req-922713f8-3a39-4d4c-b388-875671fc60e0 tempest-CinderUnicodeTest-1144970881 None] Acquiring lock "cinder-quobyte-a767e3d2-1842-41db-9300-1163b2d910d0" by "_delete_snapshot" {{(pid=84538) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 19:05:24 devstack cinder-volume[84538]: DEBUG cinder.coordination [None req-922713f8-3a39-4d4c-b388-875671fc60e0 tempest-CinderUnicodeTest-1144970881 None] Lock "cinder-quobyte-a767e3d2-1842-41db-9300-1163b2d910d0" acquired by "_delete_snapshot" :: waited 0.023s {{(pid=84538) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 19:05:24 devstack cinder-volume[84538]: DEBUG cinder.volume.drivers.remotefs [None req-922713f8-3a39-4d4c-b388-875671fc60e0 tempest-CinderUnicodeTest-1144970881 None] Deleting offline snapshot a767e3d2-1842-41db-9300-1163b2d910d0 of volume 723bbfbf-d981-4a0e-8a8c-2bbf66f2115e {{(pid=84538) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 29 19:05:24 devstack cinder-volume[84538]: DEBUG cinder.volume.drivers.remotefs [None req-922713f8-3a39-4d4c-b388-875671fc60e0 tempest-CinderUnicodeTest-1144970881 None] snapshot_file for this snap is: volume-723bbfbf-d981-4a0e-8a8c-2bbf66f2115e.a767e3d2-1842-41db-9300-1163b2d910d0 {{(pid=84538) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 29 19:05:24 devstack cinder-volume[84538]: DEBUG oslo.privsep.daemon [-] privsep: reply[47e06d50-78a8-4615-aeca-040e6ad2b5e1]: (4, 'qcow2') {{(pid=85803) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 19:05:24 devstack cinder-volume[84538]: DEBUG oslo_concurrency.processutils [None req-922713f8-3a39-4d4c-b388-875671fc60e0 tempest-CinderUnicodeTest-1144970881 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-723bbfbf-d981-4a0e-8a8c-2bbf66f2115e.a767e3d2-1842-41db-9300-1163b2d910d0 {{(pid=84538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 19:05:24 devstack sudo[92178]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-723bbfbf-d981-4a0e-8a8c-2bbf66f2115e.a767e3d2-1842-41db-9300-1163b2d910d0 Apr 29 19:05:24 devstack sudo[92178]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 19:05:25 devstack sudo[92174]: pam_unix(sudo:session): session closed for user root Apr 29 19:05:25 devstack cinder-volume[84538]: DEBUG oslo_concurrency.processutils [None req-7a7a6f61-2f2f-4a54-90e6-3f15be0738d2 tempest-VolumesExtendTest-451302124 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-6b9ca0e6-2b0f-40a7-908b-ee6d4f7f7489" returned: 0 in 0.769s {{(pid=84538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 19:05:25 devstack cinder-volume[84538]: DEBUG cinder.volume.drivers.quobyte [None req-7a7a6f61-2f2f-4a54-90e6-3f15be0738d2 tempest-VolumesExtendTest-451302124 None] <== create_volume: return (1769ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-34312b00-dd6d-45bb-af98-75855cea8e48'} {{(pid=84538) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 29 19:05:25 devstack cinder-volume[84538]: DEBUG oslo_concurrency.lockutils [None req-7a7a6f61-2f2f-4a54-90e6-3f15be0738d2 tempest-VolumesExtendTest-451302124 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.773s {{(pid=84538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 19:05:25 devstack sudo[92175]: pam_unix(sudo:session): session closed for user root Apr 29 19:05:25 devstack cinder-volume[84538]: DEBUG oslo_concurrency.processutils [None req-9712b075-b382-4d57-912d-80b5956719e8 tempest-VolumesSnapshotTestJSON-1345007867 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-8ffdf26a-b64d-43d0-8e13-5805979ca936.497d286e-63eb-4892-9655-520934c8cc0a" returned: 0 in 0.798s {{(pid=84538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 19:05:25 devstack cinder-volume[84538]: DEBUG cinder.volume.volume_utils [None req-7a7a6f61-2f2f-4a54-90e6-3f15be0738d2 tempest-VolumesExtendTest-451302124 None] Attempting download of 11605644-0a6a-4a0a-b123-c09ab01cd4db ((None, [{'url': 'file:///opt/stack/data/glance/images/11605644-0a6a-4a0a-b123-c09ab01cd4db', 'metadata': {}}])) to volume 6b9ca0e6-2b0f-40a7-908b-ee6d4f7f7489. {{(pid=84538) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1189}} Apr 29 19:05:25 devstack cinder-volume[84538]: DEBUG cinder.coordination [None req-9712b075-b382-4d57-912d-80b5956719e8 tempest-VolumesSnapshotTestJSON-1345007867 None] Lock "cinder-quobyte-497d286e-63eb-4892-9655-520934c8cc0a" released by "_delete_snapshot" :: held 3.417s {{(pid=84538) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 19:05:25 devstack cinder-volume[84538]: DEBUG cinder.coordination [None req-9712b075-b382-4d57-912d-80b5956719e8 tempest-VolumesSnapshotTestJSON-1345007867 None] Lock "cinder-quobyte-8ffdf26a-b64d-43d0-8e13-5805979ca936" released by "delete_snapshot" :: held 3.452s {{(pid=84538) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 19:05:25 devstack cinder-volume[84538]: DEBUG oslo.privsep.daemon [-] privsep: reply[ef0a8cf3-512c-48ab-9a46-e233a0b65456]: (4, 'raw') {{(pid=85803) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 19:05:25 devstack cinder-volume[84538]: DEBUG oslo_concurrency.processutils [None req-7a7a6f61-2f2f-4a54-90e6-3f15be0738d2 tempest-VolumesExtendTest-451302124 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_11605644-0a6a-4a0a-b123-c09ab01cd4db_ddds8lcb {{(pid=84538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 19:05:25 devstack cinder-volume[84538]: DEBUG cinder.quota [None req-9712b075-b382-4d57-912d-80b5956719e8 tempest-VolumesSnapshotTestJSON-1345007867 None] Created reservations ['1822380d-0f62-48e2-ba8e-55594f7355eb', '8078a8db-1b8c-4d1c-827f-0afd0b9de150', '0f4481fb-a0c8-4b7a-8d64-7e1128f2a8fb', '8ddde14e-bbc2-4c1e-a3d0-b734e9871471'] {{(pid=84538) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 29 19:05:25 devstack cinder-volume[84538]: INFO cinder.volume.manager [None req-9712b075-b382-4d57-912d-80b5956719e8 tempest-VolumesSnapshotTestJSON-1345007867 None] Delete snapshot completed successfully. Apr 29 19:05:25 devstack cinder-volume[84538]: DEBUG cinder.coordination [None req-9712b075-b382-4d57-912d-80b5956719e8 tempest-VolumesSnapshotTestJSON-1345007867 None] Lock "cinder-497d286e-63eb-4892-9655-520934c8cc0a-delete_snapshot" released by "delete_snapshot" :: held 3.661s {{(pid=84538) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 19:05:25 devstack sudo[92182]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_11605644-0a6a-4a0a-b123-c09ab01cd4db_ddds8lcb Apr 29 19:05:25 devstack sudo[92182]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 19:05:25 devstack sudo[92178]: pam_unix(sudo:session): session closed for user root Apr 29 19:05:25 devstack cinder-volume[84538]: DEBUG oslo_concurrency.processutils [None req-922713f8-3a39-4d4c-b388-875671fc60e0 tempest-CinderUnicodeTest-1144970881 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-723bbfbf-d981-4a0e-8a8c-2bbf66f2115e.a767e3d2-1842-41db-9300-1163b2d910d0" returned: 0 in 0.992s {{(pid=84538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 19:05:25 devstack cinder-volume[84538]: DEBUG cinder.volume.drivers.remotefs [None req-922713f8-3a39-4d4c-b388-875671fc60e0 tempest-CinderUnicodeTest-1144970881 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-723bbfbf-d981-4a0e-8a8c-2bbf66f2115e(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=84538) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 29 19:05:25 devstack cinder-volume[84538]: DEBUG oslo.privsep.daemon [-] privsep: reply[5b1abf39-b4a4-4785-a681-ef7462320b97]: (4, 'qcow2') {{(pid=85803) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 19:05:25 devstack cinder-volume[84538]: DEBUG oslo_concurrency.processutils [None req-922713f8-3a39-4d4c-b388-875671fc60e0 tempest-CinderUnicodeTest-1144970881 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-723bbfbf-d981-4a0e-8a8c-2bbf66f2115e {{(pid=84538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 19:05:25 devstack sudo[92188]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-723bbfbf-d981-4a0e-8a8c-2bbf66f2115e Apr 29 19:05:25 devstack sudo[92188]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 19:05:26 devstack sudo[92182]: pam_unix(sudo:session): session closed for user root Apr 29 19:05:26 devstack cinder-volume[84538]: DEBUG oslo_concurrency.processutils [None req-7a7a6f61-2f2f-4a54-90e6-3f15be0738d2 tempest-VolumesExtendTest-451302124 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_11605644-0a6a-4a0a-b123-c09ab01cd4db_ddds8lcb" returned: 0 in 0.888s {{(pid=84538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 19:05:26 devstack cinder-volume[84538]: DEBUG oslo_concurrency.processutils [None req-7a7a6f61-2f2f-4a54-90e6-3f15be0738d2 tempest-VolumesExtendTest-451302124 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_11605644-0a6a-4a0a-b123-c09ab01cd4db_ddds8lcb {{(pid=84538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 19:05:26 devstack cinder-volume[84538]: DEBUG cinder.coordination [None req-b4597d12-61bf-4b7c-a6a2-b87ef6f5d5aa tempest-VolumesSnapshotTestJSON-1345007867 None] Acquiring lock "cinder-8ffdf26a-b64d-43d0-8e13-5805979ca936-delete_volume" by "delete_volume" {{(pid=84538) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 19:05:26 devstack cinder-volume[84538]: DEBUG cinder.coordination [None req-b4597d12-61bf-4b7c-a6a2-b87ef6f5d5aa tempest-VolumesSnapshotTestJSON-1345007867 None] Lock "cinder-8ffdf26a-b64d-43d0-8e13-5805979ca936-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=84538) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 19:05:26 devstack cinder-volume[84538]: DEBUG cinder.coordination [None req-b4597d12-61bf-4b7c-a6a2-b87ef6f5d5aa tempest-VolumesSnapshotTestJSON-1345007867 None] Acquiring lock "cinder-quobyte-8ffdf26a-b64d-43d0-8e13-5805979ca936" by "delete_volume" {{(pid=84538) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 19:05:26 devstack cinder-volume[84538]: DEBUG cinder.coordination [None req-b4597d12-61bf-4b7c-a6a2-b87ef6f5d5aa tempest-VolumesSnapshotTestJSON-1345007867 None] Lock "cinder-quobyte-8ffdf26a-b64d-43d0-8e13-5805979ca936" acquired by "delete_volume" :: waited 0.032s {{(pid=84538) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 19:05:26 devstack cinder-volume[84538]: DEBUG oslo.privsep.daemon [-] privsep: reply[15e8400e-1613-4dfb-b0b5-f6c62919e17f]: (4, 'qcow2') {{(pid=85803) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 19:05:26 devstack cinder-volume[84538]: DEBUG oslo_concurrency.processutils [None req-b4597d12-61bf-4b7c-a6a2-b87ef6f5d5aa tempest-VolumesSnapshotTestJSON-1345007867 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-8ffdf26a-b64d-43d0-8e13-5805979ca936 {{(pid=84538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 19:05:26 devstack sudo[92192]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_11605644-0a6a-4a0a-b123-c09ab01cd4db_ddds8lcb Apr 29 19:05:26 devstack sudo[92192]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 19:05:26 devstack cinder-volume[84538]: DEBUG cinder.volume.flows.manager.create_volume [None req-bfee77b3-3238-4527-a63e-800854a9e2c9 tempest-CreateVolumesFromImageTest-547880467 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84538) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Apr 29 19:05:26 devstack cinder-volume[84538]: DEBUG cinder.volume.manager [None req-bfee77b3-3238-4527-a63e-800854a9e2c9 tempest-CreateVolumesFromImageTest-547880467 None] Flow 'volume_create_manager' (b9d23493-a795-4e8a-93d6-780714383a17) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84538) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 19:05:26 devstack cinder-volume[84538]: DEBUG cinder.volume.manager [None req-bfee77b3-3238-4527-a63e-800854a9e2c9 tempest-CreateVolumesFromImageTest-547880467 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (28f84fe0-ce91-4cc8-aad6-066bf68782c9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 19:05:26 devstack sudo[92196]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-8ffdf26a-b64d-43d0-8e13-5805979ca936 Apr 29 19:05:26 devstack sudo[92196]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 19:05:26 devstack sudo[92188]: pam_unix(sudo:session): session closed for user root Apr 29 19:05:26 devstack cinder-volume[84538]: DEBUG cinder.volume.manager [None req-bfee77b3-3238-4527-a63e-800854a9e2c9 tempest-CreateVolumesFromImageTest-547880467 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (28f84fe0-ce91-4cc8-aad6-066bf68782c9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-29T17:05:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1078319338',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=758a3766-3e9b-45d1-9556-c48a7e8f5d1b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='70dfeacba8b84cb6a76d7485cd8e6064',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T17:05:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T17:05:26Z,use_quota=True,user_id='5071c3880ee24b13b02c963d4d421b66',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(62b05900-93e3-4190-a88f-1d87324303d1),volume_type_id=62b05900-93e3-4190-a88f-1d87324303d1)' {{(pid=84538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 19:05:26 devstack cinder-volume[84538]: DEBUG cinder.volume.manager [None req-bfee77b3-3238-4527-a63e-800854a9e2c9 tempest-CreateVolumesFromImageTest-547880467 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (632b2fdb-914d-41e8-b798-fd595485abed) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 19:05:26 devstack cinder-volume[84538]: DEBUG cinder.volume.manager [None req-bfee77b3-3238-4527-a63e-800854a9e2c9 tempest-CreateVolumesFromImageTest-547880467 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (632b2fdb-914d-41e8-b798-fd595485abed) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 19:05:26 devstack cinder-volume[84538]: DEBUG cinder.volume.manager [None req-bfee77b3-3238-4527-a63e-800854a9e2c9 tempest-CreateVolumesFromImageTest-547880467 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (08c61eaa-28f7-4a0e-bb24-6188476a387a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 19:05:26 devstack cinder-volume[84538]: DEBUG cinder.volume.manager [None req-bfee77b3-3238-4527-a63e-800854a9e2c9 tempest-CreateVolumesFromImageTest-547880467 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (08c61eaa-28f7-4a0e-bb24-6188476a387a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '758a3766-3e9b-45d1-9556-c48a7e8f5d1b', 'volume_name': 'volume-758a3766-3e9b-45d1-9556-c48a7e8f5d1b', 'volume_size': 1}' {{(pid=84538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 19:05:26 devstack cinder-volume[84538]: DEBUG cinder.volume.manager [None req-bfee77b3-3238-4527-a63e-800854a9e2c9 tempest-CreateVolumesFromImageTest-547880467 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4fbb463a-8dc6-49e4-a8c3-e222f2808776) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 19:05:26 devstack cinder-volume[84538]: DEBUG cinder.volume.manager [None req-bfee77b3-3238-4527-a63e-800854a9e2c9 tempest-CreateVolumesFromImageTest-547880467 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4fbb463a-8dc6-49e4-a8c3-e222f2808776) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 19:05:26 devstack cinder-volume[84538]: DEBUG cinder.volume.manager [None req-bfee77b3-3238-4527-a63e-800854a9e2c9 tempest-CreateVolumesFromImageTest-547880467 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4344b130-ae0f-4928-a6f8-a4f67c5de8e7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 19:05:26 devstack cinder-volume[84538]: INFO cinder.volume.flows.manager.create_volume [None req-bfee77b3-3238-4527-a63e-800854a9e2c9 tempest-CreateVolumesFromImageTest-547880467 None] Volume 758a3766-3e9b-45d1-9556-c48a7e8f5d1b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-758a3766-3e9b-45d1-9556-c48a7e8f5d1b', 'volume_size': 1} Apr 29 19:05:26 devstack cinder-volume[84538]: DEBUG oslo_concurrency.lockutils [None req-bfee77b3-3238-4527-a63e-800854a9e2c9 tempest-CreateVolumesFromImageTest-547880467 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 19:05:26 devstack cinder-volume[84538]: DEBUG oslo_concurrency.lockutils [None req-bfee77b3-3238-4527-a63e-800854a9e2c9 tempest-CreateVolumesFromImageTest-547880467 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.002s {{(pid=84538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 19:05:26 devstack cinder-volume[84538]: DEBUG cinder.volume.drivers.quobyte [None req-bfee77b3-3238-4527-a63e-800854a9e2c9 tempest-CreateVolumesFromImageTest-547880467 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-29T17:05:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1078319338',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=758a3766-3e9b-45d1-9556-c48a7e8f5d1b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='70dfeacba8b84cb6a76d7485cd8e6064',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T17:05:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T17:05:26Z,use_quota=True,user_id='5071c3880ee24b13b02c963d4d421b66',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(62b05900-93e3-4190-a88f-1d87324303d1),volume_type_id=62b05900-93e3-4190-a88f-1d87324303d1)}" {{(pid=84538) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 29 19:05:26 devstack cinder-volume[84538]: DEBUG cinder.volume.drivers.remotefs [None req-bfee77b3-3238-4527-a63e-800854a9e2c9 tempest-CreateVolumesFromImageTest-547880467 None] Creating volume 758a3766-3e9b-45d1-9556-c48a7e8f5d1b {{(pid=84538) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 29 19:05:26 devstack cinder-volume[84538]: DEBUG oslo_concurrency.lockutils [None req-bfee77b3-3238-4527-a63e-800854a9e2c9 tempest-CreateVolumesFromImageTest-547880467 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 19:05:26 devstack cinder-volume[84538]: DEBUG oslo_concurrency.lockutils [None req-bfee77b3-3238-4527-a63e-800854a9e2c9 tempest-CreateVolumesFromImageTest-547880467 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=84538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 19:05:26 devstack cinder-volume[84538]: DEBUG cinder.volume.drivers.quobyte [None req-bfee77b3-3238-4527-a63e-800854a9e2c9 tempest-CreateVolumesFromImageTest-547880467 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-34312b00-dd6d-45bb-af98-75855cea8e48': None} {{(pid=84538) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 19:05:26 devstack cinder-volume[84538]: DEBUG cinder.volume.drivers.quobyte [None req-bfee77b3-3238-4527-a63e-800854a9e2c9 tempest-CreateVolumesFromImageTest-547880467 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-34312b00-dd6d-45bb-af98-75855cea8e48'] {{(pid=84538) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 19:05:26 devstack cinder-volume[84538]: DEBUG oslo_concurrency.lockutils [None req-bfee77b3-3238-4527-a63e-800854a9e2c9 tempest-CreateVolumesFromImageTest-547880467 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=84538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 19:05:26 devstack cinder-volume[84538]: DEBUG cinder.volume.drivers.quobyte [None req-bfee77b3-3238-4527-a63e-800854a9e2c9 tempest-CreateVolumesFromImageTest-547880467 None] Selected osci02.corp.quobyte.com/cinder-vol-34312b00-dd6d-45bb-af98-75855cea8e48 as target Quobyte volume. {{(pid=84538) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 29 19:05:26 devstack cinder-volume[84538]: INFO cinder.volume.drivers.remotefs [None req-bfee77b3-3238-4527-a63e-800854a9e2c9 tempest-CreateVolumesFromImageTest-547880467 None] casted to osci02.corp.quobyte.com/cinder-vol-34312b00-dd6d-45bb-af98-75855cea8e48 Apr 29 19:05:26 devstack cinder-volume[84538]: DEBUG oslo_concurrency.processutils [None req-bfee77b3-3238-4527-a63e-800854a9e2c9 tempest-CreateVolumesFromImageTest-547880467 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-758a3766-3e9b-45d1-9556-c48a7e8f5d1b 1073741824 {{(pid=84538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 19:05:26 devstack cinder-volume[84538]: DEBUG oslo_concurrency.processutils [None req-922713f8-3a39-4d4c-b388-875671fc60e0 tempest-CinderUnicodeTest-1144970881 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-723bbfbf-d981-4a0e-8a8c-2bbf66f2115e" returned: 0 in 1.041s {{(pid=84538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 19:05:26 devstack cinder-volume[84538]: DEBUG oslo_concurrency.processutils [None req-922713f8-3a39-4d4c-b388-875671fc60e0 tempest-CinderUnicodeTest-1144970881 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-723bbfbf-d981-4a0e-8a8c-2bbf66f2115e.a767e3d2-1842-41db-9300-1163b2d910d0 {{(pid=84538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 19:05:26 devstack sudo[92199]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-758a3766-3e9b-45d1-9556-c48a7e8f5d1b 1073741824 Apr 29 19:05:26 devstack sudo[92199]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 19:05:26 devstack sudo[92200]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-723bbfbf-d981-4a0e-8a8c-2bbf66f2115e.a767e3d2-1842-41db-9300-1163b2d910d0 Apr 29 19:05:26 devstack sudo[92200]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 19:05:26 devstack cinder-volume[84538]: DEBUG cinder.volume.flows.manager.create_volume [None req-c81cf357-bb6f-45f8-b479-b14e51b28dd8 tempest-CreateVolumesFromImageTest-547880467 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84538) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Apr 29 19:05:26 devstack cinder-volume[84538]: DEBUG cinder.volume.manager [None req-c81cf357-bb6f-45f8-b479-b14e51b28dd8 tempest-CreateVolumesFromImageTest-547880467 None] Flow 'volume_create_manager' (90ff405b-5fab-477b-911a-0b323f87c9d0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84538) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 19:05:26 devstack cinder-volume[84538]: DEBUG cinder.volume.manager [None req-c81cf357-bb6f-45f8-b479-b14e51b28dd8 tempest-CreateVolumesFromImageTest-547880467 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (75a9b855-f1f8-4425-95c1-ecce8690d5c4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 19:05:26 devstack cinder-volume[84538]: DEBUG cinder.volume.manager [None req-c81cf357-bb6f-45f8-b479-b14e51b28dd8 tempest-CreateVolumesFromImageTest-547880467 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (75a9b855-f1f8-4425-95c1-ecce8690d5c4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-29T17:05:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-840509506',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7a342f37-33ee-4408-a8ac-3a1eb8345e88,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='70dfeacba8b84cb6a76d7485cd8e6064',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T17:05:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T17:05:27Z,use_quota=True,user_id='5071c3880ee24b13b02c963d4d421b66',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(62b05900-93e3-4190-a88f-1d87324303d1),volume_type_id=62b05900-93e3-4190-a88f-1d87324303d1)' {{(pid=84538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 19:05:27 devstack cinder-volume[84538]: DEBUG cinder.volume.manager [None req-c81cf357-bb6f-45f8-b479-b14e51b28dd8 tempest-CreateVolumesFromImageTest-547880467 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (79122a58-b397-4184-b1b8-8eac3ca7e928) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 19:05:27 devstack cinder-volume[84538]: DEBUG cinder.volume.manager [None req-c81cf357-bb6f-45f8-b479-b14e51b28dd8 tempest-CreateVolumesFromImageTest-547880467 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (79122a58-b397-4184-b1b8-8eac3ca7e928) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 19:05:27 devstack cinder-volume[84538]: DEBUG cinder.volume.manager [None req-c81cf357-bb6f-45f8-b479-b14e51b28dd8 tempest-CreateVolumesFromImageTest-547880467 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bb89e1da-b788-4b57-8497-0b0ad659fa98) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 19:05:27 devstack cinder-volume[84538]: DEBUG cinder.volume.manager [None req-c81cf357-bb6f-45f8-b479-b14e51b28dd8 tempest-CreateVolumesFromImageTest-547880467 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bb89e1da-b788-4b57-8497-0b0ad659fa98) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7a342f37-33ee-4408-a8ac-3a1eb8345e88', 'volume_name': 'volume-7a342f37-33ee-4408-a8ac-3a1eb8345e88', 'volume_size': 1}' {{(pid=84538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 19:05:27 devstack cinder-volume[84538]: DEBUG cinder.volume.manager [None req-c81cf357-bb6f-45f8-b479-b14e51b28dd8 tempest-CreateVolumesFromImageTest-547880467 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1285da8b-8a49-4347-b02d-6a9b616aa4f3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 19:05:27 devstack cinder-volume[84538]: DEBUG cinder.volume.manager [None req-c81cf357-bb6f-45f8-b479-b14e51b28dd8 tempest-CreateVolumesFromImageTest-547880467 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1285da8b-8a49-4347-b02d-6a9b616aa4f3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 19:05:27 devstack cinder-volume[84538]: DEBUG cinder.volume.manager [None req-c81cf357-bb6f-45f8-b479-b14e51b28dd8 tempest-CreateVolumesFromImageTest-547880467 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7ebc5ead-0f36-4efd-ae06-a63d58da518d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 19:05:27 devstack cinder-volume[84538]: INFO cinder.volume.flows.manager.create_volume [None req-c81cf357-bb6f-45f8-b479-b14e51b28dd8 tempest-CreateVolumesFromImageTest-547880467 None] Volume 7a342f37-33ee-4408-a8ac-3a1eb8345e88: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7a342f37-33ee-4408-a8ac-3a1eb8345e88', 'volume_size': 1} Apr 29 19:05:27 devstack cinder-volume[84538]: DEBUG oslo_concurrency.lockutils [None req-c81cf357-bb6f-45f8-b479-b14e51b28dd8 tempest-CreateVolumesFromImageTest-547880467 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 19:05:27 devstack cinder-volume[84538]: DEBUG cinder.volume.flows.manager.create_volume [None req-12a968ff-251b-4a03-9587-6b989e717fc6 tempest-CreateVolumesFromImageTest-547880467 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84538) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Apr 29 19:05:27 devstack cinder-volume[84538]: DEBUG cinder.volume.manager [None req-12a968ff-251b-4a03-9587-6b989e717fc6 tempest-CreateVolumesFromImageTest-547880467 None] Flow 'volume_create_manager' (28f63a6a-34a9-4d1b-a8e7-226b56075fdf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84538) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 19:05:27 devstack cinder-volume[84538]: DEBUG cinder.volume.manager [None req-12a968ff-251b-4a03-9587-6b989e717fc6 tempest-CreateVolumesFromImageTest-547880467 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6aac1e1f-b63a-48ed-b0f0-f359cea544d9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 19:05:27 devstack cinder-volume[84538]: DEBUG cinder.volume.manager [None req-12a968ff-251b-4a03-9587-6b989e717fc6 tempest-CreateVolumesFromImageTest-547880467 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6aac1e1f-b63a-48ed-b0f0-f359cea544d9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-29T17:05:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-596339865',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=beed7bb7-d093-47d6-9b2a-a9797cb45c84,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='70dfeacba8b84cb6a76d7485cd8e6064',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T17:05:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T17:05:27Z,use_quota=True,user_id='5071c3880ee24b13b02c963d4d421b66',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(62b05900-93e3-4190-a88f-1d87324303d1),volume_type_id=62b05900-93e3-4190-a88f-1d87324303d1)' {{(pid=84538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 19:05:27 devstack cinder-volume[84538]: DEBUG cinder.volume.manager [None req-12a968ff-251b-4a03-9587-6b989e717fc6 tempest-CreateVolumesFromImageTest-547880467 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (10343cea-0090-482e-bde8-bfd998623228) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 19:05:27 devstack cinder-volume[84538]: DEBUG cinder.volume.manager [None req-12a968ff-251b-4a03-9587-6b989e717fc6 tempest-CreateVolumesFromImageTest-547880467 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (10343cea-0090-482e-bde8-bfd998623228) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 19:05:27 devstack cinder-volume[84538]: DEBUG cinder.volume.manager [None req-12a968ff-251b-4a03-9587-6b989e717fc6 tempest-CreateVolumesFromImageTest-547880467 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e4291cc6-37c9-49f5-a803-1ded675fa356) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 19:05:27 devstack cinder-volume[84538]: DEBUG cinder.volume.manager [None req-12a968ff-251b-4a03-9587-6b989e717fc6 tempest-CreateVolumesFromImageTest-547880467 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e4291cc6-37c9-49f5-a803-1ded675fa356) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'beed7bb7-d093-47d6-9b2a-a9797cb45c84', 'volume_name': 'volume-beed7bb7-d093-47d6-9b2a-a9797cb45c84', 'volume_size': 1}' {{(pid=84538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 19:05:27 devstack sudo[92192]: pam_unix(sudo:session): session closed for user root Apr 29 19:05:27 devstack cinder-volume[84538]: DEBUG cinder.volume.manager [None req-12a968ff-251b-4a03-9587-6b989e717fc6 tempest-CreateVolumesFromImageTest-547880467 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a66e30b9-eb3c-4853-8d19-9de54e3b60a2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 19:05:27 devstack cinder-volume[84538]: DEBUG cinder.volume.manager [None req-12a968ff-251b-4a03-9587-6b989e717fc6 tempest-CreateVolumesFromImageTest-547880467 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a66e30b9-eb3c-4853-8d19-9de54e3b60a2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 19:05:27 devstack cinder-volume[84538]: DEBUG cinder.volume.manager [None req-12a968ff-251b-4a03-9587-6b989e717fc6 tempest-CreateVolumesFromImageTest-547880467 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bea99711-1761-4406-8439-b64d374fd24e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 19:05:27 devstack cinder-volume[84538]: INFO cinder.volume.flows.manager.create_volume [None req-12a968ff-251b-4a03-9587-6b989e717fc6 tempest-CreateVolumesFromImageTest-547880467 None] Volume beed7bb7-d093-47d6-9b2a-a9797cb45c84: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-beed7bb7-d093-47d6-9b2a-a9797cb45c84', 'volume_size': 1} Apr 29 19:05:27 devstack cinder-volume[84538]: DEBUG oslo_concurrency.lockutils [None req-12a968ff-251b-4a03-9587-6b989e717fc6 tempest-CreateVolumesFromImageTest-547880467 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 19:05:27 devstack cinder-volume[84538]: DEBUG oslo_concurrency.processutils [None req-7a7a6f61-2f2f-4a54-90e6-3f15be0738d2 tempest-VolumesExtendTest-451302124 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_11605644-0a6a-4a0a-b123-c09ab01cd4db_ddds8lcb" returned: 1 in 1.395s {{(pid=84538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 19:05:27 devstack cinder-volume[84538]: DEBUG oslo_concurrency.processutils [None req-7a7a6f61-2f2f-4a54-90e6-3f15be0738d2 tempest-VolumesExtendTest-451302124 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_11605644-0a6a-4a0a-b123-c09ab01cd4db_ddds8lcb' failed. Not Retrying. {{(pid=84538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Apr 29 19:05:27 devstack cinder-volume[84538]: DEBUG oslo.privsep.daemon [-] privsep: reply[38637398-889f-4f4d-b460-7cb971b32c6e]: (4, 'qcow2') {{(pid=85803) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 19:05:27 devstack cinder-volume[84538]: DEBUG oslo_concurrency.processutils [None req-7a7a6f61-2f2f-4a54-90e6-3f15be0738d2 tempest-VolumesExtendTest-451302124 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_11605644-0a6a-4a0a-b123-c09ab01cd4db_mj2_bw19devstack@QuobyteHD {{(pid=84538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 19:05:27 devstack sudo[92196]: pam_unix(sudo:session): session closed for user root Apr 29 19:05:27 devstack cinder-volume[84538]: DEBUG oslo_concurrency.processutils [None req-b4597d12-61bf-4b7c-a6a2-b87ef6f5d5aa tempest-VolumesSnapshotTestJSON-1345007867 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-8ffdf26a-b64d-43d0-8e13-5805979ca936" returned: 0 in 1.205s {{(pid=84538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 19:05:27 devstack cinder-volume[84538]: DEBUG oslo_concurrency.processutils [None req-b4597d12-61bf-4b7c-a6a2-b87ef6f5d5aa tempest-VolumesSnapshotTestJSON-1345007867 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-8ffdf26a-b64d-43d0-8e13-5805979ca936 {{(pid=84538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 19:05:27 devstack sudo[92216]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-8ffdf26a-b64d-43d0-8e13-5805979ca936 Apr 29 19:05:27 devstack sudo[92216]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 19:05:27 devstack sudo[92200]: pam_unix(sudo:session): session closed for user root Apr 29 19:05:27 devstack cinder-volume[84538]: DEBUG oslo_concurrency.processutils [None req-922713f8-3a39-4d4c-b388-875671fc60e0 tempest-CinderUnicodeTest-1144970881 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-723bbfbf-d981-4a0e-8a8c-2bbf66f2115e.a767e3d2-1842-41db-9300-1163b2d910d0" returned: 0 in 1.039s {{(pid=84538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 19:05:27 devstack cinder-volume[84538]: DEBUG oslo_concurrency.processutils [None req-922713f8-3a39-4d4c-b388-875671fc60e0 tempest-CinderUnicodeTest-1144970881 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-723bbfbf-d981-4a0e-8a8c-2bbf66f2115e.a767e3d2-1842-41db-9300-1163b2d910d0 {{(pid=84538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 19:05:27 devstack sudo[92218]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-723bbfbf-d981-4a0e-8a8c-2bbf66f2115e.a767e3d2-1842-41db-9300-1163b2d910d0 Apr 29 19:05:27 devstack sudo[92218]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 19:05:27 devstack sudo[92214]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_11605644-0a6a-4a0a-b123-c09ab01cd4db_mj2_bw19devstack@QuobyteHD Apr 29 19:05:27 devstack sudo[92214]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 19:05:27 devstack sudo[92199]: pam_unix(sudo:session): session closed for user root Apr 29 19:05:27 devstack cinder-volume[84538]: DEBUG oslo_concurrency.processutils [None req-bfee77b3-3238-4527-a63e-800854a9e2c9 tempest-CreateVolumesFromImageTest-547880467 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-758a3766-3e9b-45d1-9556-c48a7e8f5d1b 1073741824" returned: 0 in 1.351s {{(pid=84538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 19:05:28 devstack cinder-volume[84538]: DEBUG cinder.volume.flows.manager.create_volume [None req-57e6d6d8-98ce-4e9b-b76e-d4e1984d6130 tempest-CreateVolumesFromImageTest-547880467 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84538) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Apr 29 19:05:28 devstack cinder-volume[84538]: DEBUG cinder.volume.manager [None req-57e6d6d8-98ce-4e9b-b76e-d4e1984d6130 tempest-CreateVolumesFromImageTest-547880467 None] Flow 'volume_create_manager' (1d84aa5c-ab9c-4269-adbe-8c46a4440427) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84538) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 19:05:28 devstack cinder-volume[84538]: DEBUG cinder.volume.manager [None req-57e6d6d8-98ce-4e9b-b76e-d4e1984d6130 tempest-CreateVolumesFromImageTest-547880467 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (718c1692-41d2-4ab5-bc59-ef910ecb161f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 19:05:28 devstack cinder-volume[84538]: DEBUG oslo_concurrency.processutils [None req-bfee77b3-3238-4527-a63e-800854a9e2c9 tempest-CreateVolumesFromImageTest-547880467 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-758a3766-3e9b-45d1-9556-c48a7e8f5d1b {{(pid=84538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 19:05:28 devstack cinder-volume[84538]: DEBUG cinder.volume.manager [None req-57e6d6d8-98ce-4e9b-b76e-d4e1984d6130 tempest-CreateVolumesFromImageTest-547880467 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (718c1692-41d2-4ab5-bc59-ef910ecb161f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-29T17:05:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1778820022',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a4e2f0da-8600-4cd3-8ae0-7552b7bc3f49,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='70dfeacba8b84cb6a76d7485cd8e6064',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T17:05:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T17:05:28Z,use_quota=True,user_id='5071c3880ee24b13b02c963d4d421b66',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(62b05900-93e3-4190-a88f-1d87324303d1),volume_type_id=62b05900-93e3-4190-a88f-1d87324303d1)' {{(pid=84538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 19:05:28 devstack cinder-volume[84538]: DEBUG cinder.volume.manager [None req-57e6d6d8-98ce-4e9b-b76e-d4e1984d6130 tempest-CreateVolumesFromImageTest-547880467 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6cacfe3c-8391-40eb-8fe5-4e5039124760) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 19:05:28 devstack sudo[92221]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-758a3766-3e9b-45d1-9556-c48a7e8f5d1b Apr 29 19:05:28 devstack sudo[92221]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 19:05:28 devstack cinder-volume[84538]: DEBUG cinder.volume.manager [None req-57e6d6d8-98ce-4e9b-b76e-d4e1984d6130 tempest-CreateVolumesFromImageTest-547880467 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6cacfe3c-8391-40eb-8fe5-4e5039124760) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 19:05:28 devstack cinder-volume[84538]: DEBUG cinder.volume.manager [None req-57e6d6d8-98ce-4e9b-b76e-d4e1984d6130 tempest-CreateVolumesFromImageTest-547880467 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9fd26ebe-eec7-47b6-88c2-0ade9ac46568) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 19:05:28 devstack cinder-volume[84538]: DEBUG cinder.volume.manager [None req-57e6d6d8-98ce-4e9b-b76e-d4e1984d6130 tempest-CreateVolumesFromImageTest-547880467 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9fd26ebe-eec7-47b6-88c2-0ade9ac46568) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a4e2f0da-8600-4cd3-8ae0-7552b7bc3f49', 'volume_name': 'volume-a4e2f0da-8600-4cd3-8ae0-7552b7bc3f49', 'volume_size': 1}' {{(pid=84538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 19:05:28 devstack cinder-volume[84538]: DEBUG cinder.volume.manager [None req-57e6d6d8-98ce-4e9b-b76e-d4e1984d6130 tempest-CreateVolumesFromImageTest-547880467 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e0c038db-65fb-4077-94fe-d97f369eddee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 19:05:28 devstack cinder-volume[84538]: DEBUG cinder.volume.manager [None req-57e6d6d8-98ce-4e9b-b76e-d4e1984d6130 tempest-CreateVolumesFromImageTest-547880467 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e0c038db-65fb-4077-94fe-d97f369eddee) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 19:05:28 devstack cinder-volume[84538]: DEBUG cinder.volume.manager [None req-57e6d6d8-98ce-4e9b-b76e-d4e1984d6130 tempest-CreateVolumesFromImageTest-547880467 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c8a0e101-cafd-463c-8c18-2412acbe763f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 19:05:28 devstack cinder-volume[84538]: INFO cinder.volume.flows.manager.create_volume [None req-57e6d6d8-98ce-4e9b-b76e-d4e1984d6130 tempest-CreateVolumesFromImageTest-547880467 None] Volume a4e2f0da-8600-4cd3-8ae0-7552b7bc3f49: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a4e2f0da-8600-4cd3-8ae0-7552b7bc3f49', 'volume_size': 1} Apr 29 19:05:28 devstack cinder-volume[84538]: DEBUG oslo_concurrency.lockutils [None req-57e6d6d8-98ce-4e9b-b76e-d4e1984d6130 tempest-CreateVolumesFromImageTest-547880467 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 19:05:28 devstack cinder-volume[84538]: DEBUG cinder.volume.flows.manager.create_volume [None req-7326cab3-71e7-4336-9c3a-36bbb542349a tempest-CreateVolumesFromImageTest-547880467 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84538) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Apr 29 19:05:28 devstack sudo[92216]: pam_unix(sudo:session): session closed for user root Apr 29 19:05:28 devstack cinder-volume[84538]: DEBUG cinder.volume.manager [None req-7326cab3-71e7-4336-9c3a-36bbb542349a tempest-CreateVolumesFromImageTest-547880467 None] Flow 'volume_create_manager' (ce9bd1cd-8ff8-4173-82fc-d79ac7a85c4c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84538) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 19:05:28 devstack cinder-volume[84538]: DEBUG cinder.volume.manager [None req-7326cab3-71e7-4336-9c3a-36bbb542349a tempest-CreateVolumesFromImageTest-547880467 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (91f6ce13-4b38-4e10-afed-b6210a5bb5ee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 19:05:28 devstack cinder-volume[84538]: DEBUG oslo_concurrency.processutils [None req-b4597d12-61bf-4b7c-a6a2-b87ef6f5d5aa tempest-VolumesSnapshotTestJSON-1345007867 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-8ffdf26a-b64d-43d0-8e13-5805979ca936" returned: 0 in 0.942s {{(pid=84538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 19:05:28 devstack cinder-volume[84538]: DEBUG cinder.volume.manager [None req-7326cab3-71e7-4336-9c3a-36bbb542349a tempest-CreateVolumesFromImageTest-547880467 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (91f6ce13-4b38-4e10-afed-b6210a5bb5ee) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-29T17:05:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1070861220',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cc096e82-8cca-4974-9081-4f8b9344c1cc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='70dfeacba8b84cb6a76d7485cd8e6064',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T17:05:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T17:05:28Z,use_quota=True,user_id='5071c3880ee24b13b02c963d4d421b66',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(62b05900-93e3-4190-a88f-1d87324303d1),volume_type_id=62b05900-93e3-4190-a88f-1d87324303d1)' {{(pid=84538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 19:05:28 devstack cinder-volume[84538]: DEBUG cinder.volume.manager [None req-7326cab3-71e7-4336-9c3a-36bbb542349a tempest-CreateVolumesFromImageTest-547880467 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (668e020f-0a93-4c5f-8d9f-84f890af1915) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 19:05:28 devstack cinder-volume[84538]: DEBUG cinder.volume.manager [None req-7326cab3-71e7-4336-9c3a-36bbb542349a tempest-CreateVolumesFromImageTest-547880467 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (668e020f-0a93-4c5f-8d9f-84f890af1915) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 19:05:28 devstack sudo[92214]: pam_unix(sudo:session): session closed for user root Apr 29 19:05:28 devstack cinder-volume[84538]: DEBUG cinder.volume.manager [None req-7326cab3-71e7-4336-9c3a-36bbb542349a tempest-CreateVolumesFromImageTest-547880467 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ed972ccb-67b4-4c07-91e4-77862a3557bb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 19:05:28 devstack cinder-volume[84538]: DEBUG cinder.volume.manager [None req-7326cab3-71e7-4336-9c3a-36bbb542349a tempest-CreateVolumesFromImageTest-547880467 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ed972ccb-67b4-4c07-91e4-77862a3557bb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'cc096e82-8cca-4974-9081-4f8b9344c1cc', 'volume_name': 'volume-cc096e82-8cca-4974-9081-4f8b9344c1cc', 'volume_size': 1}' {{(pid=84538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 19:05:28 devstack cinder-volume[84538]: DEBUG cinder.volume.manager [None req-7326cab3-71e7-4336-9c3a-36bbb542349a tempest-CreateVolumesFromImageTest-547880467 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9b96bd05-8ecf-46e9-b595-ea16cb101756) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 19:05:28 devstack cinder-volume[84538]: DEBUG cinder.volume.manager [None req-7326cab3-71e7-4336-9c3a-36bbb542349a tempest-CreateVolumesFromImageTest-547880467 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9b96bd05-8ecf-46e9-b595-ea16cb101756) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 19:05:28 devstack cinder-volume[84538]: DEBUG cinder.volume.manager [None req-7326cab3-71e7-4336-9c3a-36bbb542349a tempest-CreateVolumesFromImageTest-547880467 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (dceff4b9-5e91-4a9b-9057-55aed9e60ef2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 19:05:28 devstack cinder-volume[84538]: INFO cinder.volume.flows.manager.create_volume [None req-7326cab3-71e7-4336-9c3a-36bbb542349a tempest-CreateVolumesFromImageTest-547880467 None] Volume cc096e82-8cca-4974-9081-4f8b9344c1cc: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-cc096e82-8cca-4974-9081-4f8b9344c1cc', 'volume_size': 1} Apr 29 19:05:28 devstack cinder-volume[84538]: DEBUG oslo_concurrency.lockutils [None req-7326cab3-71e7-4336-9c3a-36bbb542349a tempest-CreateVolumesFromImageTest-547880467 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 19:05:28 devstack cinder-volume[84538]: DEBUG cinder.coordination [None req-b4597d12-61bf-4b7c-a6a2-b87ef6f5d5aa tempest-VolumesSnapshotTestJSON-1345007867 None] Lock "cinder-quobyte-8ffdf26a-b64d-43d0-8e13-5805979ca936" released by "delete_volume" :: held 2.297s {{(pid=84538) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 19:05:28 devstack cinder-volume[84538]: DEBUG oslo_concurrency.processutils [None req-7a7a6f61-2f2f-4a54-90e6-3f15be0738d2 tempest-VolumesExtendTest-451302124 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_11605644-0a6a-4a0a-b123-c09ab01cd4db_mj2_bw19devstack@QuobyteHD" returned: 0 in 1.042s {{(pid=84538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 19:05:28 devstack cinder-volume[84538]: DEBUG cinder.image.image_utils [None req-7a7a6f61-2f2f-4a54-90e6-3f15be0738d2 tempest-VolumesExtendTest-451302124 None] 11605644-0a6a-4a0a-b123-c09ab01cd4db was qcow2, converting to raw {{(pid=84538) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1120}} Apr 29 19:05:28 devstack cinder-volume[84538]: DEBUG oslo_concurrency.processutils [None req-7a7a6f61-2f2f-4a54-90e6-3f15be0738d2 tempest-VolumesExtendTest-451302124 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_11605644-0a6a-4a0a-b123-c09ab01cd4db_mj2_bw19devstack@QuobyteHD /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-6b9ca0e6-2b0f-40a7-908b-ee6d4f7f7489 {{(pid=84538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 19:05:28 devstack sudo[92228]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_11605644-0a6a-4a0a-b123-c09ab01cd4db_mj2_bw19devstack@QuobyteHD /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-6b9ca0e6-2b0f-40a7-908b-ee6d4f7f7489 Apr 29 19:05:28 devstack sudo[92228]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 19:05:28 devstack cinder-volume[84538]: DEBUG cinder.quota [None req-b4597d12-61bf-4b7c-a6a2-b87ef6f5d5aa tempest-VolumesSnapshotTestJSON-1345007867 None] Created reservations ['fe32bcb7-c8f7-449a-a544-9ba2b11d96b6', '8819aa1c-c86e-4fb2-b8d3-1884fcedfb74', '7cce2b78-e1c0-41ca-8865-5f8f3898ad8b', 'e851d24b-37f2-4372-bd96-81c069a28649'] {{(pid=84538) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 29 19:05:28 devstack cinder-volume[84538]: DEBUG oslo_concurrency.lockutils [None req-b4597d12-61bf-4b7c-a6a2-b87ef6f5d5aa tempest-VolumesSnapshotTestJSON-1345007867 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 19:05:28 devstack cinder-volume[84538]: DEBUG oslo_concurrency.lockutils [None req-b4597d12-61bf-4b7c-a6a2-b87ef6f5d5aa tempest-VolumesSnapshotTestJSON-1345007867 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 19:05:28 devstack cinder-volume[84538]: DEBUG cinder.volume.drivers.quobyte [None req-b4597d12-61bf-4b7c-a6a2-b87ef6f5d5aa tempest-VolumesSnapshotTestJSON-1345007867 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-34312b00-dd6d-45bb-af98-75855cea8e48': None} {{(pid=84538) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 19:05:28 devstack cinder-volume[84538]: DEBUG cinder.volume.drivers.quobyte [None req-b4597d12-61bf-4b7c-a6a2-b87ef6f5d5aa tempest-VolumesSnapshotTestJSON-1345007867 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-34312b00-dd6d-45bb-af98-75855cea8e48'] {{(pid=84538) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 19:05:28 devstack cinder-volume[84538]: DEBUG oslo_concurrency.lockutils [None req-b4597d12-61bf-4b7c-a6a2-b87ef6f5d5aa tempest-VolumesSnapshotTestJSON-1345007867 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=84538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 19:05:28 devstack cinder-volume[84538]: DEBUG oslo_concurrency.processutils [None req-b4597d12-61bf-4b7c-a6a2-b87ef6f5d5aa tempest-VolumesSnapshotTestJSON-1345007867 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d {{(pid=84538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 19:05:28 devstack sudo[92218]: pam_unix(sudo:session): session closed for user root Apr 29 19:05:28 devstack cinder-volume[84538]: DEBUG oslo_concurrency.processutils [None req-922713f8-3a39-4d4c-b388-875671fc60e0 tempest-CinderUnicodeTest-1144970881 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-723bbfbf-d981-4a0e-8a8c-2bbf66f2115e.a767e3d2-1842-41db-9300-1163b2d910d0" returned: 0 in 1.115s {{(pid=84538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 19:05:28 devstack sudo[92231]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d Apr 29 19:05:28 devstack sudo[92231]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 19:05:28 devstack cinder-volume[84538]: DEBUG cinder.coordination [None req-922713f8-3a39-4d4c-b388-875671fc60e0 tempest-CinderUnicodeTest-1144970881 None] Lock "cinder-quobyte-a767e3d2-1842-41db-9300-1163b2d910d0" released by "_delete_snapshot" :: held 4.331s {{(pid=84538) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 19:05:28 devstack cinder-volume[84538]: DEBUG cinder.coordination [None req-922713f8-3a39-4d4c-b388-875671fc60e0 tempest-CinderUnicodeTest-1144970881 None] Lock "cinder-quobyte-723bbfbf-d981-4a0e-8a8c-2bbf66f2115e" released by "delete_snapshot" :: held 4.363s {{(pid=84538) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 19:05:28 devstack cinder-volume[84538]: DEBUG cinder.quota [None req-922713f8-3a39-4d4c-b388-875671fc60e0 tempest-CinderUnicodeTest-1144970881 None] Created reservations ['2c42a130-54d6-48fe-998d-ca975af5a013', '5b6e698d-a09c-4ed4-adf4-5ab98997af2e', 'bf58538a-8bbb-4318-9ac8-cadf0ce2a131', '740990c8-5451-43a3-aadd-8a4398ee2ad7'] {{(pid=84538) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 29 19:05:28 devstack sudo[92221]: pam_unix(sudo:session): session closed for user root Apr 29 19:05:28 devstack cinder-volume[84538]: DEBUG oslo_concurrency.processutils [None req-bfee77b3-3238-4527-a63e-800854a9e2c9 tempest-CreateVolumesFromImageTest-547880467 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-758a3766-3e9b-45d1-9556-c48a7e8f5d1b" returned: 0 in 0.857s {{(pid=84538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 19:05:28 devstack cinder-volume[84538]: DEBUG cinder.volume.drivers.quobyte [None req-bfee77b3-3238-4527-a63e-800854a9e2c9 tempest-CreateVolumesFromImageTest-547880467 None] <== create_volume: return (2373ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-34312b00-dd6d-45bb-af98-75855cea8e48'} {{(pid=84538) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 29 19:05:28 devstack cinder-volume[84538]: DEBUG oslo_concurrency.lockutils [None req-bfee77b3-3238-4527-a63e-800854a9e2c9 tempest-CreateVolumesFromImageTest-547880467 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.378s {{(pid=84538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 19:05:28 devstack cinder-volume[84538]: DEBUG oslo_concurrency.lockutils [None req-c81cf357-bb6f-45f8-b479-b14e51b28dd8 tempest-CreateVolumesFromImageTest-547880467 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.930s {{(pid=84538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 19:05:29 devstack cinder-volume[84538]: DEBUG cinder.volume.drivers.quobyte [None req-c81cf357-bb6f-45f8-b479-b14e51b28dd8 tempest-CreateVolumesFromImageTest-547880467 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-29T17:05:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-840509506',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7a342f37-33ee-4408-a8ac-3a1eb8345e88,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='70dfeacba8b84cb6a76d7485cd8e6064',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T17:05:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T17:05:27Z,use_quota=True,user_id='5071c3880ee24b13b02c963d4d421b66',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(62b05900-93e3-4190-a88f-1d87324303d1),volume_type_id=62b05900-93e3-4190-a88f-1d87324303d1)}" {{(pid=84538) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 29 19:05:29 devstack cinder-volume[84538]: DEBUG cinder.volume.drivers.remotefs [None req-c81cf357-bb6f-45f8-b479-b14e51b28dd8 tempest-CreateVolumesFromImageTest-547880467 None] Creating volume 7a342f37-33ee-4408-a8ac-3a1eb8345e88 {{(pid=84538) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 29 19:05:29 devstack cinder-volume[84538]: DEBUG oslo_concurrency.lockutils [None req-c81cf357-bb6f-45f8-b479-b14e51b28dd8 tempest-CreateVolumesFromImageTest-547880467 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 19:05:29 devstack cinder-volume[84538]: DEBUG oslo_concurrency.lockutils [None req-c81cf357-bb6f-45f8-b479-b14e51b28dd8 tempest-CreateVolumesFromImageTest-547880467 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 19:05:29 devstack cinder-volume[84538]: DEBUG cinder.volume.drivers.quobyte [None req-c81cf357-bb6f-45f8-b479-b14e51b28dd8 tempest-CreateVolumesFromImageTest-547880467 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-34312b00-dd6d-45bb-af98-75855cea8e48': None} {{(pid=84538) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 19:05:29 devstack cinder-volume[84538]: DEBUG cinder.volume.drivers.quobyte [None req-c81cf357-bb6f-45f8-b479-b14e51b28dd8 tempest-CreateVolumesFromImageTest-547880467 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-34312b00-dd6d-45bb-af98-75855cea8e48'] {{(pid=84538) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 19:05:29 devstack cinder-volume[84538]: DEBUG oslo_concurrency.lockutils [None req-c81cf357-bb6f-45f8-b479-b14e51b28dd8 tempest-CreateVolumesFromImageTest-547880467 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=84538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 19:05:29 devstack cinder-volume[84538]: DEBUG cinder.volume.drivers.quobyte [None req-c81cf357-bb6f-45f8-b479-b14e51b28dd8 tempest-CreateVolumesFromImageTest-547880467 None] Selected osci02.corp.quobyte.com/cinder-vol-34312b00-dd6d-45bb-af98-75855cea8e48 as target Quobyte volume. {{(pid=84538) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 29 19:05:29 devstack cinder-volume[84538]: INFO cinder.volume.drivers.remotefs [None req-c81cf357-bb6f-45f8-b479-b14e51b28dd8 tempest-CreateVolumesFromImageTest-547880467 None] casted to osci02.corp.quobyte.com/cinder-vol-34312b00-dd6d-45bb-af98-75855cea8e48 Apr 29 19:05:29 devstack cinder-volume[84538]: DEBUG oslo_concurrency.processutils [None req-c81cf357-bb6f-45f8-b479-b14e51b28dd8 tempest-CreateVolumesFromImageTest-547880467 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-7a342f37-33ee-4408-a8ac-3a1eb8345e88 1073741824 {{(pid=84538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 19:05:29 devstack cinder-volume[84538]: INFO cinder.volume.manager [None req-922713f8-3a39-4d4c-b388-875671fc60e0 tempest-CinderUnicodeTest-1144970881 None] Delete snapshot completed successfully. Apr 29 19:05:29 devstack cinder-volume[84538]: DEBUG cinder.coordination [None req-922713f8-3a39-4d4c-b388-875671fc60e0 tempest-CinderUnicodeTest-1144970881 None] Lock "cinder-a767e3d2-1842-41db-9300-1163b2d910d0-delete_snapshot" released by "delete_snapshot" :: held 4.556s {{(pid=84538) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 19:05:29 devstack cinder-volume[84538]: DEBUG cinder.volume.manager [None req-bfee77b3-3238-4527-a63e-800854a9e2c9 tempest-CreateVolumesFromImageTest-547880467 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4344b130-ae0f-4928-a6f8-a4f67c5de8e7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-758a3766-3e9b-45d1-9556-c48a7e8f5d1b', 'volume_size': 1}' {{(pid=84538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 19:05:29 devstack cinder-volume[84538]: DEBUG cinder.volume.manager [None req-bfee77b3-3238-4527-a63e-800854a9e2c9 tempest-CreateVolumesFromImageTest-547880467 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5e083507-ac0a-4c74-9bcc-8ca3f8b54283) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 19:05:29 devstack sudo[92234]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-7a342f37-33ee-4408-a8ac-3a1eb8345e88 1073741824 Apr 29 19:05:29 devstack sudo[92234]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 19:05:29 devstack cinder-volume[84538]: INFO cinder.volume.flows.manager.create_volume [None req-bfee77b3-3238-4527-a63e-800854a9e2c9 tempest-CreateVolumesFromImageTest-547880467 None] Volume volume-758a3766-3e9b-45d1-9556-c48a7e8f5d1b (758a3766-3e9b-45d1-9556-c48a7e8f5d1b): created successfully Apr 29 19:05:29 devstack cinder-volume[84538]: DEBUG cinder.volume.manager [None req-bfee77b3-3238-4527-a63e-800854a9e2c9 tempest-CreateVolumesFromImageTest-547880467 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5e083507-ac0a-4c74-9bcc-8ca3f8b54283) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 19:05:29 devstack cinder-volume[84538]: DEBUG cinder.volume.manager [None req-bfee77b3-3238-4527-a63e-800854a9e2c9 tempest-CreateVolumesFromImageTest-547880467 None] Flow 'volume_create_manager' (b9d23493-a795-4e8a-93d6-780714383a17) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84538) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 19:05:29 devstack cinder-volume[84538]: INFO cinder.volume.manager [None req-bfee77b3-3238-4527-a63e-800854a9e2c9 tempest-CreateVolumesFromImageTest-547880467 None] Created volume successfully. Apr 29 19:05:29 devstack sudo[92231]: pam_unix(sudo:session): session closed for user root Apr 29 19:05:29 devstack cinder-volume[84538]: DEBUG oslo_concurrency.processutils [None req-b4597d12-61bf-4b7c-a6a2-b87ef6f5d5aa tempest-VolumesSnapshotTestJSON-1345007867 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d" returned: 0 in 0.696s {{(pid=84538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 19:05:29 devstack cinder-volume[84538]: DEBUG cinder.manager [None req-b4597d12-61bf-4b7c-a6a2-b87ef6f5d5aa tempest-VolumesSnapshotTestJSON-1345007867 None] Notifying Schedulers of capabilities ... {{(pid=84538) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 29 19:05:29 devstack cinder-volume[84538]: INFO cinder.volume.manager [None req-b4597d12-61bf-4b7c-a6a2-b87ef6f5d5aa tempest-VolumesSnapshotTestJSON-1345007867 None] Deleted volume successfully. Apr 29 19:05:29 devstack cinder-volume[84538]: DEBUG cinder.coordination [None req-b4597d12-61bf-4b7c-a6a2-b87ef6f5d5aa tempest-VolumesSnapshotTestJSON-1345007867 None] Lock "cinder-8ffdf26a-b64d-43d0-8e13-5805979ca936-delete_volume" released by "delete_volume" :: held 3.294s {{(pid=84538) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 19:05:29 devstack cinder-volume[84538]: DEBUG cinder.coordination [None req-1681d644-a575-46d9-8864-78e7bcf8fee7 tempest-VolumesSnapshotTestJSON-1345007867 None] Acquiring lock "cinder-8dd11e3d-82b0-43a9-a9a1-cacffe80f65e-delete_volume" by "delete_volume" {{(pid=84538) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 19:05:29 devstack cinder-volume[84538]: DEBUG cinder.coordination [None req-1681d644-a575-46d9-8864-78e7bcf8fee7 tempest-VolumesSnapshotTestJSON-1345007867 None] Lock "cinder-8dd11e3d-82b0-43a9-a9a1-cacffe80f65e-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=84538) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 19:05:29 devstack cinder-volume[84538]: DEBUG cinder.coordination [None req-1681d644-a575-46d9-8864-78e7bcf8fee7 tempest-VolumesSnapshotTestJSON-1345007867 None] Acquiring lock "cinder-quobyte-8dd11e3d-82b0-43a9-a9a1-cacffe80f65e" by "delete_volume" {{(pid=84538) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 19:05:29 devstack cinder-volume[84538]: DEBUG cinder.coordination [None req-1681d644-a575-46d9-8864-78e7bcf8fee7 tempest-VolumesSnapshotTestJSON-1345007867 None] Lock "cinder-quobyte-8dd11e3d-82b0-43a9-a9a1-cacffe80f65e" acquired by "delete_volume" :: waited 0.019s {{(pid=84538) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 19:05:29 devstack cinder-volume[84538]: DEBUG cinder.coordination [None req-79e0bb3f-fecf-4da1-9ed2-7eb0e2609641 tempest-CinderUnicodeTest-1144970881 None] Acquiring lock "cinder-723bbfbf-d981-4a0e-8a8c-2bbf66f2115e-delete_volume" by "delete_volume" {{(pid=84538) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 19:05:29 devstack cinder-volume[84538]: DEBUG cinder.coordination [None req-79e0bb3f-fecf-4da1-9ed2-7eb0e2609641 tempest-CinderUnicodeTest-1144970881 None] Lock "cinder-723bbfbf-d981-4a0e-8a8c-2bbf66f2115e-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=84538) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 19:05:29 devstack cinder-volume[84538]: DEBUG oslo.privsep.daemon [-] privsep: reply[2ed22f33-4d9f-4b3b-a27e-1075fbf44949]: (4, 'qcow2') {{(pid=85803) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 19:05:29 devstack cinder-volume[84538]: DEBUG oslo_concurrency.processutils [None req-1681d644-a575-46d9-8864-78e7bcf8fee7 tempest-VolumesSnapshotTestJSON-1345007867 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-8dd11e3d-82b0-43a9-a9a1-cacffe80f65e {{(pid=84538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 19:05:29 devstack cinder-volume[84538]: DEBUG cinder.coordination [None req-79e0bb3f-fecf-4da1-9ed2-7eb0e2609641 tempest-CinderUnicodeTest-1144970881 None] Acquiring lock "cinder-quobyte-723bbfbf-d981-4a0e-8a8c-2bbf66f2115e" by "delete_volume" {{(pid=84538) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 19:05:30 devstack cinder-volume[84538]: DEBUG cinder.coordination [None req-79e0bb3f-fecf-4da1-9ed2-7eb0e2609641 tempest-CinderUnicodeTest-1144970881 None] Lock "cinder-quobyte-723bbfbf-d981-4a0e-8a8c-2bbf66f2115e" acquired by "delete_volume" :: waited 0.019s {{(pid=84538) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 19:05:30 devstack sudo[92259]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-8dd11e3d-82b0-43a9-a9a1-cacffe80f65e Apr 29 19:05:30 devstack sudo[92259]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 19:05:30 devstack cinder-volume[84538]: DEBUG oslo.privsep.daemon [-] privsep: reply[fe031433-9d15-4c22-97f0-ec6508e752bd]: (4, 'qcow2') {{(pid=85803) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 19:05:30 devstack cinder-volume[84538]: DEBUG oslo_concurrency.processutils [None req-79e0bb3f-fecf-4da1-9ed2-7eb0e2609641 tempest-CinderUnicodeTest-1144970881 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-723bbfbf-d981-4a0e-8a8c-2bbf66f2115e {{(pid=84538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 19:05:30 devstack sudo[92234]: pam_unix(sudo:session): session closed for user root Apr 29 19:05:30 devstack cinder-volume[84538]: DEBUG oslo_concurrency.processutils [None req-c81cf357-bb6f-45f8-b479-b14e51b28dd8 tempest-CreateVolumesFromImageTest-547880467 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-7a342f37-33ee-4408-a8ac-3a1eb8345e88 1073741824" returned: 0 in 1.091s {{(pid=84538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 19:05:30 devstack cinder-volume[84538]: DEBUG oslo_concurrency.processutils [None req-c81cf357-bb6f-45f8-b479-b14e51b28dd8 tempest-CreateVolumesFromImageTest-547880467 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-7a342f37-33ee-4408-a8ac-3a1eb8345e88 {{(pid=84538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 19:05:30 devstack sudo[92262]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-7a342f37-33ee-4408-a8ac-3a1eb8345e88 Apr 29 19:05:30 devstack sudo[92262]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 19:05:30 devstack sudo[92261]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-723bbfbf-d981-4a0e-8a8c-2bbf66f2115e Apr 29 19:05:30 devstack sudo[92261]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 19:05:30 devstack sudo[92228]: pam_unix(sudo:session): session closed for user root Apr 29 19:05:30 devstack cinder-volume[84538]: DEBUG oslo_concurrency.processutils [None req-7a7a6f61-2f2f-4a54-90e6-3f15be0738d2 tempest-VolumesExtendTest-451302124 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_11605644-0a6a-4a0a-b123-c09ab01cd4db_mj2_bw19devstack@QuobyteHD /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-6b9ca0e6-2b0f-40a7-908b-ee6d4f7f7489" returned: 0 in 2.108s {{(pid=84538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 19:05:30 devstack cinder-volume[84538]: DEBUG cinder.image.image_utils [None req-7a7a6f61-2f2f-4a54-90e6-3f15be0738d2 tempest-VolumesExtendTest-451302124 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_11605644-0a6a-4a0a-b123-c09ab01cd4db_mj2_bw19devstack@QuobyteHD, size 112.00 MB, duration 2.11 sec, destination /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-6b9ca0e6-2b0f-40a7-908b-ee6d4f7f7489 {{(pid=84538) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}} Apr 29 19:05:30 devstack cinder-volume[84538]: INFO cinder.image.image_utils [None req-7a7a6f61-2f2f-4a54-90e6-3f15be0738d2 tempest-VolumesExtendTest-451302124 None] Converted 112.00 MB image at 53.10 MB/s Apr 29 19:05:30 devstack cinder-volume[84538]: DEBUG oslo_concurrency.processutils [None req-7a7a6f61-2f2f-4a54-90e6-3f15be0738d2 tempest-VolumesExtendTest-451302124 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-6b9ca0e6-2b0f-40a7-908b-ee6d4f7f7489 1G {{(pid=84538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 19:05:30 devstack sudo[92268]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-6b9ca0e6-2b0f-40a7-908b-ee6d4f7f7489 1G Apr 29 19:05:30 devstack sudo[92268]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 19:05:30 devstack sudo[92259]: pam_unix(sudo:session): session closed for user root Apr 29 19:05:30 devstack cinder-volume[84538]: DEBUG oslo_concurrency.processutils [None req-1681d644-a575-46d9-8864-78e7bcf8fee7 tempest-VolumesSnapshotTestJSON-1345007867 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-8dd11e3d-82b0-43a9-a9a1-cacffe80f65e" returned: 0 in 0.912s {{(pid=84538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 19:05:30 devstack cinder-volume[84538]: DEBUG oslo_concurrency.processutils [None req-1681d644-a575-46d9-8864-78e7bcf8fee7 tempest-VolumesSnapshotTestJSON-1345007867 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-8dd11e3d-82b0-43a9-a9a1-cacffe80f65e {{(pid=84538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 19:05:30 devstack sudo[92275]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-8dd11e3d-82b0-43a9-a9a1-cacffe80f65e Apr 29 19:05:30 devstack sudo[92275]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 19:05:30 devstack sudo[92262]: pam_unix(sudo:session): session closed for user root Apr 29 19:05:30 devstack cinder-volume[84538]: DEBUG oslo_concurrency.processutils [None req-c81cf357-bb6f-45f8-b479-b14e51b28dd8 tempest-CreateVolumesFromImageTest-547880467 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-7a342f37-33ee-4408-a8ac-3a1eb8345e88" returned: 0 in 0.757s {{(pid=84538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 19:05:30 devstack cinder-volume[84538]: DEBUG cinder.volume.drivers.quobyte [None req-c81cf357-bb6f-45f8-b479-b14e51b28dd8 tempest-CreateVolumesFromImageTest-547880467 None] <== create_volume: return (1915ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-34312b00-dd6d-45bb-af98-75855cea8e48'} {{(pid=84538) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 29 19:05:30 devstack cinder-volume[84538]: DEBUG oslo_concurrency.lockutils [None req-c81cf357-bb6f-45f8-b479-b14e51b28dd8 tempest-CreateVolumesFromImageTest-547880467 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.920s {{(pid=84538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 19:05:30 devstack cinder-volume[84538]: DEBUG oslo_concurrency.lockutils [None req-12a968ff-251b-4a03-9587-6b989e717fc6 tempest-CreateVolumesFromImageTest-547880467 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.348s {{(pid=84538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 19:05:30 devstack cinder-volume[84538]: DEBUG cinder.volume.drivers.quobyte [None req-12a968ff-251b-4a03-9587-6b989e717fc6 tempest-CreateVolumesFromImageTest-547880467 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-29T17:05:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-596339865',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=beed7bb7-d093-47d6-9b2a-a9797cb45c84,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='70dfeacba8b84cb6a76d7485cd8e6064',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T17:05:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T17:05:27Z,use_quota=True,user_id='5071c3880ee24b13b02c963d4d421b66',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(62b05900-93e3-4190-a88f-1d87324303d1),volume_type_id=62b05900-93e3-4190-a88f-1d87324303d1)}" {{(pid=84538) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 29 19:05:30 devstack cinder-volume[84538]: DEBUG cinder.volume.drivers.remotefs [None req-12a968ff-251b-4a03-9587-6b989e717fc6 tempest-CreateVolumesFromImageTest-547880467 None] Creating volume beed7bb7-d093-47d6-9b2a-a9797cb45c84 {{(pid=84538) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 29 19:05:30 devstack cinder-volume[84538]: DEBUG oslo_concurrency.lockutils [None req-12a968ff-251b-4a03-9587-6b989e717fc6 tempest-CreateVolumesFromImageTest-547880467 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 19:05:30 devstack cinder-volume[84538]: DEBUG oslo_concurrency.lockutils [None req-12a968ff-251b-4a03-9587-6b989e717fc6 tempest-CreateVolumesFromImageTest-547880467 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=84538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 19:05:30 devstack cinder-volume[84538]: DEBUG cinder.volume.drivers.quobyte [None req-12a968ff-251b-4a03-9587-6b989e717fc6 tempest-CreateVolumesFromImageTest-547880467 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-34312b00-dd6d-45bb-af98-75855cea8e48': None} {{(pid=84538) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 19:05:30 devstack cinder-volume[84538]: DEBUG cinder.volume.drivers.quobyte [None req-12a968ff-251b-4a03-9587-6b989e717fc6 tempest-CreateVolumesFromImageTest-547880467 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-34312b00-dd6d-45bb-af98-75855cea8e48'] {{(pid=84538) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 19:05:30 devstack cinder-volume[84538]: DEBUG oslo_concurrency.lockutils [None req-12a968ff-251b-4a03-9587-6b989e717fc6 tempest-CreateVolumesFromImageTest-547880467 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=84538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 19:05:30 devstack cinder-volume[84538]: DEBUG cinder.volume.drivers.quobyte [None req-12a968ff-251b-4a03-9587-6b989e717fc6 tempest-CreateVolumesFromImageTest-547880467 None] Selected osci02.corp.quobyte.com/cinder-vol-34312b00-dd6d-45bb-af98-75855cea8e48 as target Quobyte volume. {{(pid=84538) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 29 19:05:30 devstack cinder-volume[84538]: INFO cinder.volume.drivers.remotefs [None req-12a968ff-251b-4a03-9587-6b989e717fc6 tempest-CreateVolumesFromImageTest-547880467 None] casted to osci02.corp.quobyte.com/cinder-vol-34312b00-dd6d-45bb-af98-75855cea8e48 Apr 29 19:05:30 devstack cinder-volume[84538]: DEBUG oslo_concurrency.processutils [None req-12a968ff-251b-4a03-9587-6b989e717fc6 tempest-CreateVolumesFromImageTest-547880467 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-beed7bb7-d093-47d6-9b2a-a9797cb45c84 1073741824 {{(pid=84538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 19:05:30 devstack cinder-volume[84538]: DEBUG cinder.volume.manager [None req-c81cf357-bb6f-45f8-b479-b14e51b28dd8 tempest-CreateVolumesFromImageTest-547880467 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7ebc5ead-0f36-4efd-ae06-a63d58da518d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7a342f37-33ee-4408-a8ac-3a1eb8345e88', 'volume_size': 1}' {{(pid=84538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 19:05:30 devstack sudo[92261]: pam_unix(sudo:session): session closed for user root Apr 29 19:05:30 devstack cinder-volume[84538]: DEBUG cinder.volume.manager [None req-c81cf357-bb6f-45f8-b479-b14e51b28dd8 tempest-CreateVolumesFromImageTest-547880467 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d2cd81cf-4ca6-4ed6-9dbb-b6d14c303136) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 19:05:30 devstack sudo[92277]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-beed7bb7-d093-47d6-9b2a-a9797cb45c84 1073741824 Apr 29 19:05:30 devstack sudo[92277]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 19:05:30 devstack cinder-volume[84538]: DEBUG oslo_concurrency.processutils [None req-79e0bb3f-fecf-4da1-9ed2-7eb0e2609641 tempest-CinderUnicodeTest-1144970881 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-723bbfbf-d981-4a0e-8a8c-2bbf66f2115e" returned: 0 in 0.909s {{(pid=84538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 19:05:30 devstack cinder-volume[84538]: DEBUG oslo_concurrency.processutils [None req-79e0bb3f-fecf-4da1-9ed2-7eb0e2609641 tempest-CinderUnicodeTest-1144970881 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-723bbfbf-d981-4a0e-8a8c-2bbf66f2115e {{(pid=84538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 19:05:31 devstack cinder-volume[84538]: INFO cinder.volume.flows.manager.create_volume [None req-c81cf357-bb6f-45f8-b479-b14e51b28dd8 tempest-CreateVolumesFromImageTest-547880467 None] Volume volume-7a342f37-33ee-4408-a8ac-3a1eb8345e88 (7a342f37-33ee-4408-a8ac-3a1eb8345e88): created successfully Apr 29 19:05:31 devstack cinder-volume[84538]: DEBUG cinder.volume.manager [None req-c81cf357-bb6f-45f8-b479-b14e51b28dd8 tempest-CreateVolumesFromImageTest-547880467 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d2cd81cf-4ca6-4ed6-9dbb-b6d14c303136) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 19:05:31 devstack cinder-volume[84538]: DEBUG cinder.volume.manager [None req-c81cf357-bb6f-45f8-b479-b14e51b28dd8 tempest-CreateVolumesFromImageTest-547880467 None] Flow 'volume_create_manager' (90ff405b-5fab-477b-911a-0b323f87c9d0) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84538) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 19:05:31 devstack cinder-volume[84538]: INFO cinder.volume.manager [None req-c81cf357-bb6f-45f8-b479-b14e51b28dd8 tempest-CreateVolumesFromImageTest-547880467 None] Created volume successfully. Apr 29 19:05:31 devstack sudo[92279]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-723bbfbf-d981-4a0e-8a8c-2bbf66f2115e Apr 29 19:05:31 devstack sudo[92279]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 19:05:31 devstack sudo[92268]: pam_unix(sudo:session): session closed for user root Apr 29 19:05:31 devstack cinder-volume[84538]: DEBUG oslo_concurrency.processutils [None req-7a7a6f61-2f2f-4a54-90e6-3f15be0738d2 tempest-VolumesExtendTest-451302124 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-6b9ca0e6-2b0f-40a7-908b-ee6d4f7f7489 1G" returned: 0 in 0.730s {{(pid=84538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 19:05:31 devstack cinder-volume[84538]: DEBUG oslo.privsep.daemon [-] privsep: reply[b041b98e-7a67-4512-ad39-bddb079e86c5]: (4, 'raw') {{(pid=85803) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 19:05:31 devstack cinder-volume[84538]: DEBUG oslo_concurrency.processutils [None req-7a7a6f61-2f2f-4a54-90e6-3f15be0738d2 tempest-VolumesExtendTest-451302124 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-6b9ca0e6-2b0f-40a7-908b-ee6d4f7f7489 {{(pid=84538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 19:05:31 devstack sudo[92275]: pam_unix(sudo:session): session closed for user root Apr 29 19:05:31 devstack cinder-volume[84538]: DEBUG oslo_concurrency.processutils [None req-1681d644-a575-46d9-8864-78e7bcf8fee7 tempest-VolumesSnapshotTestJSON-1345007867 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-8dd11e3d-82b0-43a9-a9a1-cacffe80f65e" returned: 0 in 0.703s {{(pid=84538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 19:05:31 devstack cinder-volume[84538]: DEBUG cinder.coordination [None req-1681d644-a575-46d9-8864-78e7bcf8fee7 tempest-VolumesSnapshotTestJSON-1345007867 None] Lock "cinder-quobyte-8dd11e3d-82b0-43a9-a9a1-cacffe80f65e" released by "delete_volume" :: held 1.709s {{(pid=84538) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 19:05:31 devstack sudo[92285]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-6b9ca0e6-2b0f-40a7-908b-ee6d4f7f7489 Apr 29 19:05:31 devstack sudo[92285]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 19:05:31 devstack cinder-volume[84538]: DEBUG cinder.quota [None req-1681d644-a575-46d9-8864-78e7bcf8fee7 tempest-VolumesSnapshotTestJSON-1345007867 None] Created reservations ['cabf525e-b0a0-48cb-8a37-06d178cf6ade', 'cb8f2311-5901-4241-9136-7487ed0e7869', '49084ef6-9536-4a96-92db-5b8a10e6a5ac', 'dccb0cd2-5719-492b-be13-a8108a090d18'] {{(pid=84538) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 29 19:05:31 devstack cinder-volume[84538]: DEBUG oslo_concurrency.lockutils [None req-1681d644-a575-46d9-8864-78e7bcf8fee7 tempest-VolumesSnapshotTestJSON-1345007867 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 19:05:31 devstack cinder-volume[84538]: DEBUG oslo_concurrency.lockutils [None req-1681d644-a575-46d9-8864-78e7bcf8fee7 tempest-VolumesSnapshotTestJSON-1345007867 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 19:05:31 devstack cinder-volume[84538]: DEBUG cinder.volume.drivers.quobyte [None req-1681d644-a575-46d9-8864-78e7bcf8fee7 tempest-VolumesSnapshotTestJSON-1345007867 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-34312b00-dd6d-45bb-af98-75855cea8e48': None} {{(pid=84538) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 19:05:31 devstack cinder-volume[84538]: DEBUG cinder.volume.drivers.quobyte [None req-1681d644-a575-46d9-8864-78e7bcf8fee7 tempest-VolumesSnapshotTestJSON-1345007867 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-34312b00-dd6d-45bb-af98-75855cea8e48'] {{(pid=84538) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 19:05:31 devstack cinder-volume[84538]: DEBUG oslo_concurrency.lockutils [None req-1681d644-a575-46d9-8864-78e7bcf8fee7 tempest-VolumesSnapshotTestJSON-1345007867 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=84538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 19:05:31 devstack cinder-volume[84538]: DEBUG oslo_concurrency.processutils [None req-1681d644-a575-46d9-8864-78e7bcf8fee7 tempest-VolumesSnapshotTestJSON-1345007867 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d {{(pid=84538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 19:05:31 devstack sudo[92279]: pam_unix(sudo:session): session closed for user root Apr 29 19:05:31 devstack cinder-volume[84538]: DEBUG oslo_concurrency.processutils [None req-79e0bb3f-fecf-4da1-9ed2-7eb0e2609641 tempest-CinderUnicodeTest-1144970881 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-723bbfbf-d981-4a0e-8a8c-2bbf66f2115e" returned: 0 in 0.735s {{(pid=84538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 19:05:31 devstack sudo[92291]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d Apr 29 19:05:31 devstack sudo[92291]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 19:05:31 devstack cinder-volume[84538]: DEBUG cinder.coordination [None req-79e0bb3f-fecf-4da1-9ed2-7eb0e2609641 tempest-CinderUnicodeTest-1144970881 None] Lock "cinder-quobyte-723bbfbf-d981-4a0e-8a8c-2bbf66f2115e" released by "delete_volume" :: held 1.744s {{(pid=84538) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 19:05:31 devstack cinder-volume[84538]: DEBUG cinder.quota [None req-79e0bb3f-fecf-4da1-9ed2-7eb0e2609641 tempest-CinderUnicodeTest-1144970881 None] Created reservations ['4d4fd4c9-438f-402c-bc93-f0731e41e103', 'f46fed78-b19c-47aa-93b8-fc8197805752', '68ed1621-cf89-4b44-86c9-84fe1c2ea114', 'ea118f26-4dc1-4236-bad3-dfa36f36de72'] {{(pid=84538) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 29 19:05:31 devstack cinder-volume[84538]: DEBUG oslo_concurrency.lockutils [None req-79e0bb3f-fecf-4da1-9ed2-7eb0e2609641 tempest-CinderUnicodeTest-1144970881 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 19:05:31 devstack cinder-volume[84538]: DEBUG oslo_concurrency.lockutils [None req-79e0bb3f-fecf-4da1-9ed2-7eb0e2609641 tempest-CinderUnicodeTest-1144970881 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 19:05:31 devstack cinder-volume[84538]: DEBUG cinder.volume.drivers.quobyte [None req-79e0bb3f-fecf-4da1-9ed2-7eb0e2609641 tempest-CinderUnicodeTest-1144970881 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-34312b00-dd6d-45bb-af98-75855cea8e48': None} {{(pid=84538) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 19:05:31 devstack cinder-volume[84538]: DEBUG cinder.volume.drivers.quobyte [None req-79e0bb3f-fecf-4da1-9ed2-7eb0e2609641 tempest-CinderUnicodeTest-1144970881 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-34312b00-dd6d-45bb-af98-75855cea8e48'] {{(pid=84538) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 19:05:31 devstack cinder-volume[84538]: DEBUG oslo_concurrency.lockutils [None req-79e0bb3f-fecf-4da1-9ed2-7eb0e2609641 tempest-CinderUnicodeTest-1144970881 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=84538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 19:05:31 devstack cinder-volume[84538]: DEBUG oslo_concurrency.processutils [None req-79e0bb3f-fecf-4da1-9ed2-7eb0e2609641 tempest-CinderUnicodeTest-1144970881 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d {{(pid=84538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 19:05:31 devstack sudo[92293]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d Apr 29 19:05:31 devstack sudo[92293]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 19:05:31 devstack sudo[92277]: pam_unix(sudo:session): session closed for user root Apr 29 19:05:31 devstack cinder-volume[84538]: DEBUG oslo_concurrency.processutils [None req-12a968ff-251b-4a03-9587-6b989e717fc6 tempest-CreateVolumesFromImageTest-547880467 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-beed7bb7-d093-47d6-9b2a-a9797cb45c84 1073741824" returned: 0 in 1.017s {{(pid=84538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 19:05:31 devstack cinder-volume[84538]: DEBUG oslo_concurrency.processutils [None req-12a968ff-251b-4a03-9587-6b989e717fc6 tempest-CreateVolumesFromImageTest-547880467 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-beed7bb7-d093-47d6-9b2a-a9797cb45c84 {{(pid=84538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 19:05:32 devstack sudo[92295]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-beed7bb7-d093-47d6-9b2a-a9797cb45c84 Apr 29 19:05:32 devstack sudo[92295]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 19:05:32 devstack cinder-volume[84538]: DEBUG cinder.coordination [None req-f7cc7f58-c1a0-41ed-ba7e-35bab1f2baec tempest-CinderUnicodeTest-1144970881 None] Acquiring lock "cinder-08c63ba4-25bf-4e74-b3fc-cbd11bca14ce-delete_volume" by "delete_volume" {{(pid=84538) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 19:05:32 devstack cinder-volume[84538]: DEBUG cinder.coordination [None req-f7cc7f58-c1a0-41ed-ba7e-35bab1f2baec tempest-CinderUnicodeTest-1144970881 None] Lock "cinder-08c63ba4-25bf-4e74-b3fc-cbd11bca14ce-delete_volume" acquired by "delete_volume" :: waited 0.043s {{(pid=84538) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 19:05:32 devstack cinder-volume[84538]: DEBUG cinder.coordination [None req-f7cc7f58-c1a0-41ed-ba7e-35bab1f2baec tempest-CinderUnicodeTest-1144970881 None] Acquiring lock "cinder-quobyte-08c63ba4-25bf-4e74-b3fc-cbd11bca14ce" by "delete_volume" {{(pid=84538) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 19:05:32 devstack cinder-volume[84538]: DEBUG cinder.coordination [None req-f7cc7f58-c1a0-41ed-ba7e-35bab1f2baec tempest-CinderUnicodeTest-1144970881 None] Lock "cinder-quobyte-08c63ba4-25bf-4e74-b3fc-cbd11bca14ce" acquired by "delete_volume" :: waited 0.016s {{(pid=84538) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 19:05:32 devstack cinder-volume[84538]: DEBUG oslo.privsep.daemon [-] privsep: reply[f13428f3-a6e2-402f-9b3c-58a1631396c8]: (4, 'qcow2') {{(pid=85803) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 19:05:32 devstack cinder-volume[84538]: DEBUG oslo_concurrency.processutils [None req-f7cc7f58-c1a0-41ed-ba7e-35bab1f2baec tempest-CinderUnicodeTest-1144970881 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-08c63ba4-25bf-4e74-b3fc-cbd11bca14ce {{(pid=84538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 19:05:32 devstack sudo[92297]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-08c63ba4-25bf-4e74-b3fc-cbd11bca14ce Apr 29 19:05:32 devstack sudo[92297]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 19:05:32 devstack sudo[92285]: pam_unix(sudo:session): session closed for user root Apr 29 19:05:32 devstack cinder-volume[84538]: DEBUG oslo_concurrency.processutils [None req-7a7a6f61-2f2f-4a54-90e6-3f15be0738d2 tempest-VolumesExtendTest-451302124 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-6b9ca0e6-2b0f-40a7-908b-ee6d4f7f7489" returned: 0 in 1.211s {{(pid=84538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 19:05:32 devstack cinder-volume[84538]: DEBUG oslo_concurrency.processutils [None req-7a7a6f61-2f2f-4a54-90e6-3f15be0738d2 tempest-VolumesExtendTest-451302124 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-6b9ca0e6-2b0f-40a7-908b-ee6d4f7f7489 {{(pid=84538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 19:05:32 devstack sudo[92291]: pam_unix(sudo:session): session closed for user root Apr 29 19:05:32 devstack cinder-volume[84538]: DEBUG oslo_concurrency.processutils [None req-1681d644-a575-46d9-8864-78e7bcf8fee7 tempest-VolumesSnapshotTestJSON-1345007867 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d" returned: 0 in 1.078s {{(pid=84538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 19:05:32 devstack cinder-volume[84538]: DEBUG cinder.manager [None req-1681d644-a575-46d9-8864-78e7bcf8fee7 tempest-VolumesSnapshotTestJSON-1345007867 None] Notifying Schedulers of capabilities ... {{(pid=84538) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 29 19:05:32 devstack cinder-volume[84538]: INFO cinder.volume.manager [None req-1681d644-a575-46d9-8864-78e7bcf8fee7 tempest-VolumesSnapshotTestJSON-1345007867 None] Deleted volume successfully. Apr 29 19:05:32 devstack cinder-volume[84538]: DEBUG cinder.coordination [None req-1681d644-a575-46d9-8864-78e7bcf8fee7 tempest-VolumesSnapshotTestJSON-1345007867 None] Lock "cinder-8dd11e3d-82b0-43a9-a9a1-cacffe80f65e-delete_volume" released by "delete_volume" :: held 3.058s {{(pid=84538) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 19:05:32 devstack sudo[92293]: pam_unix(sudo:session): session closed for user root Apr 29 19:05:32 devstack cinder-volume[84538]: DEBUG oslo_concurrency.processutils [None req-79e0bb3f-fecf-4da1-9ed2-7eb0e2609641 tempest-CinderUnicodeTest-1144970881 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d" returned: 0 in 0.974s {{(pid=84538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 19:05:32 devstack cinder-volume[84538]: DEBUG cinder.manager [None req-79e0bb3f-fecf-4da1-9ed2-7eb0e2609641 tempest-CinderUnicodeTest-1144970881 None] Notifying Schedulers of capabilities ... {{(pid=84538) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 29 19:05:32 devstack cinder-volume[84538]: INFO cinder.volume.manager [None req-79e0bb3f-fecf-4da1-9ed2-7eb0e2609641 tempest-CinderUnicodeTest-1144970881 None] Deleted volume successfully. Apr 29 19:05:32 devstack cinder-volume[84538]: DEBUG cinder.coordination [None req-79e0bb3f-fecf-4da1-9ed2-7eb0e2609641 tempest-CinderUnicodeTest-1144970881 None] Lock "cinder-723bbfbf-d981-4a0e-8a8c-2bbf66f2115e-delete_volume" released by "delete_volume" :: held 2.998s {{(pid=84538) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 19:05:32 devstack sudo[92303]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-6b9ca0e6-2b0f-40a7-908b-ee6d4f7f7489 Apr 29 19:05:32 devstack sudo[92303]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 19:05:32 devstack sudo[92295]: pam_unix(sudo:session): session closed for user root Apr 29 19:05:32 devstack cinder-volume[84538]: DEBUG oslo_concurrency.processutils [None req-12a968ff-251b-4a03-9587-6b989e717fc6 tempest-CreateVolumesFromImageTest-547880467 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-beed7bb7-d093-47d6-9b2a-a9797cb45c84" returned: 0 in 0.966s {{(pid=84538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 19:05:32 devstack cinder-volume[84538]: DEBUG cinder.volume.drivers.quobyte [None req-12a968ff-251b-4a03-9587-6b989e717fc6 tempest-CreateVolumesFromImageTest-547880467 None] <== create_volume: return (2035ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-34312b00-dd6d-45bb-af98-75855cea8e48'} {{(pid=84538) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 29 19:05:32 devstack cinder-volume[84538]: DEBUG oslo_concurrency.lockutils [None req-12a968ff-251b-4a03-9587-6b989e717fc6 tempest-CreateVolumesFromImageTest-547880467 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.038s {{(pid=84538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 19:05:32 devstack cinder-volume[84538]: DEBUG oslo_concurrency.lockutils [None req-57e6d6d8-98ce-4e9b-b76e-d4e1984d6130 tempest-CreateVolumesFromImageTest-547880467 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.683s {{(pid=84538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 19:05:32 devstack cinder-volume[84538]: DEBUG cinder.volume.drivers.quobyte [None req-57e6d6d8-98ce-4e9b-b76e-d4e1984d6130 tempest-CreateVolumesFromImageTest-547880467 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-29T17:05:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1778820022',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a4e2f0da-8600-4cd3-8ae0-7552b7bc3f49,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='70dfeacba8b84cb6a76d7485cd8e6064',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T17:05:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T17:05:28Z,use_quota=True,user_id='5071c3880ee24b13b02c963d4d421b66',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(62b05900-93e3-4190-a88f-1d87324303d1),volume_type_id=62b05900-93e3-4190-a88f-1d87324303d1)}" {{(pid=84538) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 29 19:05:32 devstack cinder-volume[84538]: DEBUG cinder.volume.drivers.remotefs [None req-57e6d6d8-98ce-4e9b-b76e-d4e1984d6130 tempest-CreateVolumesFromImageTest-547880467 None] Creating volume a4e2f0da-8600-4cd3-8ae0-7552b7bc3f49 {{(pid=84538) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 29 19:05:32 devstack cinder-volume[84538]: DEBUG oslo_concurrency.lockutils [None req-57e6d6d8-98ce-4e9b-b76e-d4e1984d6130 tempest-CreateVolumesFromImageTest-547880467 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 19:05:32 devstack cinder-volume[84538]: DEBUG oslo_concurrency.lockutils [None req-57e6d6d8-98ce-4e9b-b76e-d4e1984d6130 tempest-CreateVolumesFromImageTest-547880467 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=84538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 19:05:32 devstack cinder-volume[84538]: DEBUG cinder.volume.drivers.quobyte [None req-57e6d6d8-98ce-4e9b-b76e-d4e1984d6130 tempest-CreateVolumesFromImageTest-547880467 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-34312b00-dd6d-45bb-af98-75855cea8e48': None} {{(pid=84538) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 19:05:32 devstack cinder-volume[84538]: DEBUG cinder.volume.drivers.quobyte [None req-57e6d6d8-98ce-4e9b-b76e-d4e1984d6130 tempest-CreateVolumesFromImageTest-547880467 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-34312b00-dd6d-45bb-af98-75855cea8e48'] {{(pid=84538) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 19:05:32 devstack cinder-volume[84538]: DEBUG oslo_concurrency.lockutils [None req-57e6d6d8-98ce-4e9b-b76e-d4e1984d6130 tempest-CreateVolumesFromImageTest-547880467 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=84538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 19:05:32 devstack cinder-volume[84538]: DEBUG cinder.volume.drivers.quobyte [None req-57e6d6d8-98ce-4e9b-b76e-d4e1984d6130 tempest-CreateVolumesFromImageTest-547880467 None] Selected osci02.corp.quobyte.com/cinder-vol-34312b00-dd6d-45bb-af98-75855cea8e48 as target Quobyte volume. {{(pid=84538) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 29 19:05:32 devstack cinder-volume[84538]: INFO cinder.volume.drivers.remotefs [None req-57e6d6d8-98ce-4e9b-b76e-d4e1984d6130 tempest-CreateVolumesFromImageTest-547880467 None] casted to osci02.corp.quobyte.com/cinder-vol-34312b00-dd6d-45bb-af98-75855cea8e48 Apr 29 19:05:32 devstack cinder-volume[84538]: DEBUG oslo_concurrency.processutils [None req-57e6d6d8-98ce-4e9b-b76e-d4e1984d6130 tempest-CreateVolumesFromImageTest-547880467 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-a4e2f0da-8600-4cd3-8ae0-7552b7bc3f49 1073741824 {{(pid=84538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 19:05:33 devstack cinder-volume[84538]: DEBUG cinder.volume.manager [None req-12a968ff-251b-4a03-9587-6b989e717fc6 tempest-CreateVolumesFromImageTest-547880467 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bea99711-1761-4406-8439-b64d374fd24e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-beed7bb7-d093-47d6-9b2a-a9797cb45c84', 'volume_size': 1}' {{(pid=84538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 19:05:33 devstack sudo[92306]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-a4e2f0da-8600-4cd3-8ae0-7552b7bc3f49 1073741824 Apr 29 19:05:33 devstack sudo[92306]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 19:05:33 devstack cinder-volume[84538]: DEBUG cinder.volume.manager [None req-12a968ff-251b-4a03-9587-6b989e717fc6 tempest-CreateVolumesFromImageTest-547880467 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (18796477-78f0-4f6f-828e-123b0a5e9e1f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 19:05:33 devstack cinder-volume[84538]: INFO cinder.volume.flows.manager.create_volume [None req-12a968ff-251b-4a03-9587-6b989e717fc6 tempest-CreateVolumesFromImageTest-547880467 None] Volume volume-beed7bb7-d093-47d6-9b2a-a9797cb45c84 (beed7bb7-d093-47d6-9b2a-a9797cb45c84): created successfully Apr 29 19:05:33 devstack cinder-volume[84538]: DEBUG cinder.volume.manager [None req-12a968ff-251b-4a03-9587-6b989e717fc6 tempest-CreateVolumesFromImageTest-547880467 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (18796477-78f0-4f6f-828e-123b0a5e9e1f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 19:05:33 devstack cinder-volume[84538]: DEBUG cinder.volume.manager [None req-12a968ff-251b-4a03-9587-6b989e717fc6 tempest-CreateVolumesFromImageTest-547880467 None] Flow 'volume_create_manager' (28f63a6a-34a9-4d1b-a8e7-226b56075fdf) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84538) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 19:05:33 devstack cinder-volume[84538]: INFO cinder.volume.manager [None req-12a968ff-251b-4a03-9587-6b989e717fc6 tempest-CreateVolumesFromImageTest-547880467 None] Created volume successfully. Apr 29 19:05:33 devstack sudo[92297]: pam_unix(sudo:session): session closed for user root Apr 29 19:05:33 devstack cinder-volume[84538]: DEBUG oslo_concurrency.processutils [None req-f7cc7f58-c1a0-41ed-ba7e-35bab1f2baec tempest-CinderUnicodeTest-1144970881 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-08c63ba4-25bf-4e74-b3fc-cbd11bca14ce" returned: 0 in 0.971s {{(pid=84538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 19:05:33 devstack cinder-volume[84538]: DEBUG oslo_concurrency.processutils [None req-f7cc7f58-c1a0-41ed-ba7e-35bab1f2baec tempest-CinderUnicodeTest-1144970881 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-08c63ba4-25bf-4e74-b3fc-cbd11bca14ce {{(pid=84538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 19:05:33 devstack sudo[92312]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-08c63ba4-25bf-4e74-b3fc-cbd11bca14ce Apr 29 19:05:33 devstack sudo[92312]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 19:05:33 devstack sudo[92303]: pam_unix(sudo:session): session closed for user root Apr 29 19:05:33 devstack cinder-volume[84538]: DEBUG oslo_concurrency.processutils [None req-7a7a6f61-2f2f-4a54-90e6-3f15be0738d2 tempest-VolumesExtendTest-451302124 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-6b9ca0e6-2b0f-40a7-908b-ee6d4f7f7489" returned: 1 in 0.986s {{(pid=84538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 19:05:33 devstack cinder-volume[84538]: DEBUG oslo_concurrency.processutils [None req-7a7a6f61-2f2f-4a54-90e6-3f15be0738d2 tempest-VolumesExtendTest-451302124 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-6b9ca0e6-2b0f-40a7-908b-ee6d4f7f7489' failed. Not Retrying. {{(pid=84538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Apr 29 19:05:33 devstack cinder-volume[84538]: DEBUG cinder.volume.volume_utils [None req-7a7a6f61-2f2f-4a54-90e6-3f15be0738d2 tempest-VolumesExtendTest-451302124 None] Downloaded image 11605644-0a6a-4a0a-b123-c09ab01cd4db ((None, [{'url': 'file:///opt/stack/data/glance/images/11605644-0a6a-4a0a-b123-c09ab01cd4db', 'metadata': {}}])) to volume 6b9ca0e6-2b0f-40a7-908b-ee6d4f7f7489 successfully. {{(pid=84538) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1234}} Apr 29 19:05:33 devstack cinder-volume[84538]: DEBUG cinder.image.image_utils [None req-7a7a6f61-2f2f-4a54-90e6-3f15be0738d2 tempest-VolumesExtendTest-451302124 None] Temporary image 11605644-0a6a-4a0a-b123-c09ab01cd4db for user 865814330ca6407a83ca3897a4368e2b is deleted. {{(pid=84538) fetch /opt/stack/cinder/cinder/image/image_utils.py:1435}} Apr 29 19:05:33 devstack cinder-volume[84538]: DEBUG cinder.volume.volume_utils [None req-7a7a6f61-2f2f-4a54-90e6-3f15be0738d2 tempest-VolumesExtendTest-451302124 None] Marking volume 6b9ca0e6-2b0f-40a7-908b-ee6d4f7f7489 as bootable. {{(pid=84538) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1138}} Apr 29 19:05:33 devstack cinder-volume[84538]: DEBUG cinder.volume.flows.manager.create_volume [None req-7a7a6f61-2f2f-4a54-90e6-3f15be0738d2 tempest-VolumesExtendTest-451302124 None] Copying metadata from image 11605644-0a6a-4a0a-b123-c09ab01cd4db to 6b9ca0e6-2b0f-40a7-908b-ee6d4f7f7489. {{(pid=84538) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Apr 29 19:05:33 devstack cinder-volume[84538]: DEBUG cinder.volume.flows.manager.create_volume [None req-7a7a6f61-2f2f-4a54-90e6-3f15be0738d2 tempest-VolumesExtendTest-451302124 None] Creating volume glance metadata for volume 6b9ca0e6-2b0f-40a7-908b-ee6d4f7f7489 backed by image 11605644-0a6a-4a0a-b123-c09ab01cd4db with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': '11605644-0a6a-4a0a-b123-c09ab01cd4db', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=84538) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Apr 29 19:05:33 devstack cinder-volume[84538]: DEBUG cinder.volume.manager [None req-7a7a6f61-2f2f-4a54-90e6-3f15be0738d2 tempest-VolumesExtendTest-451302124 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a8383725-773f-4c16-aa9a-16571cf204f9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6b9ca0e6-2b0f-40a7-908b-ee6d4f7f7489', 'volume_size': 1, 'image_id': '11605644-0a6a-4a0a-b123-c09ab01cd4db', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/11605644-0a6a-4a0a-b123-c09ab01cd4db', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '853afc5ea27148009f8c02d351cf4d80', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '11605644-0a6a-4a0a-b123-c09ab01cd4db', 'created_at': datetime.datetime(2026, 4, 29, 16, 52, 8, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 4, 29, 16, 52, 10, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/11605644-0a6a-4a0a-b123-c09ab01cd4db/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=84538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 19:05:33 devstack cinder-volume[84538]: DEBUG cinder.volume.manager [None req-7a7a6f61-2f2f-4a54-90e6-3f15be0738d2 tempest-VolumesExtendTest-451302124 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (855a6de3-09cd-4e9b-889e-7743076e1051) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 19:05:33 devstack cinder-volume[84538]: INFO cinder.volume.flows.manager.create_volume [None req-7a7a6f61-2f2f-4a54-90e6-3f15be0738d2 tempest-VolumesExtendTest-451302124 None] Volume volume-6b9ca0e6-2b0f-40a7-908b-ee6d4f7f7489 (6b9ca0e6-2b0f-40a7-908b-ee6d4f7f7489): created successfully Apr 29 19:05:33 devstack cinder-volume[84538]: DEBUG cinder.volume.manager [None req-7a7a6f61-2f2f-4a54-90e6-3f15be0738d2 tempest-VolumesExtendTest-451302124 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (855a6de3-09cd-4e9b-889e-7743076e1051) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 19:05:33 devstack cinder-volume[84538]: DEBUG cinder.volume.manager [None req-7a7a6f61-2f2f-4a54-90e6-3f15be0738d2 tempest-VolumesExtendTest-451302124 None] Flow 'volume_create_manager' (e34da31b-af6f-4151-9e9a-be845bbac186) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84538) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 19:05:33 devstack cinder-volume[84538]: INFO cinder.volume.manager [None req-7a7a6f61-2f2f-4a54-90e6-3f15be0738d2 tempest-VolumesExtendTest-451302124 None] Created volume successfully. Apr 29 19:05:33 devstack sudo[92306]: pam_unix(sudo:session): session closed for user root Apr 29 19:05:33 devstack cinder-volume[84538]: DEBUG oslo_concurrency.processutils [None req-57e6d6d8-98ce-4e9b-b76e-d4e1984d6130 tempest-CreateVolumesFromImageTest-547880467 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-a4e2f0da-8600-4cd3-8ae0-7552b7bc3f49 1073741824" returned: 0 in 0.980s {{(pid=84538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 19:05:34 devstack cinder-volume[84538]: DEBUG oslo_concurrency.processutils [None req-57e6d6d8-98ce-4e9b-b76e-d4e1984d6130 tempest-CreateVolumesFromImageTest-547880467 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-a4e2f0da-8600-4cd3-8ae0-7552b7bc3f49 {{(pid=84538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 19:05:34 devstack sudo[92322]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-a4e2f0da-8600-4cd3-8ae0-7552b7bc3f49 Apr 29 19:05:34 devstack sudo[92322]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 19:05:34 devstack sudo[92312]: pam_unix(sudo:session): session closed for user root Apr 29 19:05:34 devstack cinder-volume[84538]: DEBUG oslo_concurrency.processutils [None req-f7cc7f58-c1a0-41ed-ba7e-35bab1f2baec tempest-CinderUnicodeTest-1144970881 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-08c63ba4-25bf-4e74-b3fc-cbd11bca14ce" returned: 0 in 0.788s {{(pid=84538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 19:05:34 devstack cinder-volume[84538]: DEBUG cinder.coordination [None req-f7cc7f58-c1a0-41ed-ba7e-35bab1f2baec tempest-CinderUnicodeTest-1144970881 None] Lock "cinder-quobyte-08c63ba4-25bf-4e74-b3fc-cbd11bca14ce" released by "delete_volume" :: held 1.821s {{(pid=84538) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 19:05:34 devstack cinder-volume[84538]: DEBUG cinder.quota [None req-f7cc7f58-c1a0-41ed-ba7e-35bab1f2baec tempest-CinderUnicodeTest-1144970881 None] Created reservations ['93cc2682-ffc8-4caf-acea-83b28977a92f', '8b4d84f5-65ce-415a-a6b8-2c9055315ff7', '91aa0e2c-fffc-4d9b-a682-e3ca631d1943', '257a7105-f6ee-4083-9701-327c6d8ebf22'] {{(pid=84538) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 29 19:05:34 devstack cinder-volume[84538]: DEBUG oslo_concurrency.lockutils [None req-9284b347-114b-4c3b-8d57-32b1dae1653f tempest-VolumesExtendTest-451302124 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" {{(pid=84538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 19:05:34 devstack cinder-volume[84538]: DEBUG oslo_concurrency.lockutils [None req-f7cc7f58-c1a0-41ed-ba7e-35bab1f2baec tempest-CinderUnicodeTest-1144970881 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 19:05:34 devstack cinder-volume[84538]: DEBUG oslo_concurrency.lockutils [None req-f7cc7f58-c1a0-41ed-ba7e-35bab1f2baec tempest-CinderUnicodeTest-1144970881 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 19:05:34 devstack cinder-volume[84538]: DEBUG cinder.volume.drivers.quobyte [None req-f7cc7f58-c1a0-41ed-ba7e-35bab1f2baec tempest-CinderUnicodeTest-1144970881 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-34312b00-dd6d-45bb-af98-75855cea8e48': None} {{(pid=84538) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 19:05:34 devstack cinder-volume[84538]: DEBUG cinder.volume.drivers.quobyte [None req-f7cc7f58-c1a0-41ed-ba7e-35bab1f2baec tempest-CinderUnicodeTest-1144970881 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-34312b00-dd6d-45bb-af98-75855cea8e48'] {{(pid=84538) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 19:05:34 devstack cinder-volume[84538]: DEBUG oslo_concurrency.lockutils [None req-f7cc7f58-c1a0-41ed-ba7e-35bab1f2baec tempest-CinderUnicodeTest-1144970881 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=84538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 19:05:34 devstack cinder-volume[84538]: DEBUG oslo_concurrency.processutils [None req-f7cc7f58-c1a0-41ed-ba7e-35bab1f2baec tempest-CinderUnicodeTest-1144970881 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d {{(pid=84538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 19:05:34 devstack sudo[92325]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d Apr 29 19:05:34 devstack sudo[92325]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 19:05:34 devstack sudo[92322]: pam_unix(sudo:session): session closed for user root Apr 29 19:05:34 devstack cinder-volume[84538]: DEBUG oslo_concurrency.processutils [None req-57e6d6d8-98ce-4e9b-b76e-d4e1984d6130 tempest-CreateVolumesFromImageTest-547880467 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-a4e2f0da-8600-4cd3-8ae0-7552b7bc3f49" returned: 0 in 0.757s {{(pid=84538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 19:05:34 devstack cinder-volume[84538]: DEBUG cinder.volume.drivers.quobyte [None req-57e6d6d8-98ce-4e9b-b76e-d4e1984d6130 tempest-CreateVolumesFromImageTest-547880467 None] <== create_volume: return (1807ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-34312b00-dd6d-45bb-af98-75855cea8e48'} {{(pid=84538) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 29 19:05:34 devstack cinder-volume[84538]: DEBUG oslo_concurrency.lockutils [None req-57e6d6d8-98ce-4e9b-b76e-d4e1984d6130 tempest-CreateVolumesFromImageTest-547880467 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.810s {{(pid=84538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 19:05:34 devstack cinder-volume[84538]: DEBUG oslo_concurrency.lockutils [None req-7326cab3-71e7-4336-9c3a-36bbb542349a tempest-CreateVolumesFromImageTest-547880467 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 6.168s {{(pid=84538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 19:05:34 devstack cinder-volume[84538]: DEBUG cinder.volume.drivers.quobyte [None req-7326cab3-71e7-4336-9c3a-36bbb542349a tempest-CreateVolumesFromImageTest-547880467 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-29T17:05:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1070861220',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cc096e82-8cca-4974-9081-4f8b9344c1cc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='70dfeacba8b84cb6a76d7485cd8e6064',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T17:05:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T17:05:28Z,use_quota=True,user_id='5071c3880ee24b13b02c963d4d421b66',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(62b05900-93e3-4190-a88f-1d87324303d1),volume_type_id=62b05900-93e3-4190-a88f-1d87324303d1)}" {{(pid=84538) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 29 19:05:34 devstack cinder-volume[84538]: DEBUG cinder.volume.drivers.remotefs [None req-7326cab3-71e7-4336-9c3a-36bbb542349a tempest-CreateVolumesFromImageTest-547880467 None] Creating volume cc096e82-8cca-4974-9081-4f8b9344c1cc {{(pid=84538) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 29 19:05:34 devstack cinder-volume[84538]: DEBUG oslo_concurrency.lockutils [None req-7326cab3-71e7-4336-9c3a-36bbb542349a tempest-CreateVolumesFromImageTest-547880467 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 19:05:34 devstack cinder-volume[84538]: DEBUG oslo_concurrency.lockutils [None req-7326cab3-71e7-4336-9c3a-36bbb542349a tempest-CreateVolumesFromImageTest-547880467 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=84538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 19:05:34 devstack cinder-volume[84538]: DEBUG cinder.volume.drivers.quobyte [None req-7326cab3-71e7-4336-9c3a-36bbb542349a tempest-CreateVolumesFromImageTest-547880467 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-34312b00-dd6d-45bb-af98-75855cea8e48': None} {{(pid=84538) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 19:05:34 devstack cinder-volume[84538]: DEBUG cinder.volume.drivers.quobyte [None req-7326cab3-71e7-4336-9c3a-36bbb542349a tempest-CreateVolumesFromImageTest-547880467 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-34312b00-dd6d-45bb-af98-75855cea8e48'] {{(pid=84538) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 19:05:34 devstack cinder-volume[84538]: DEBUG oslo_concurrency.lockutils [None req-7326cab3-71e7-4336-9c3a-36bbb542349a tempest-CreateVolumesFromImageTest-547880467 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=84538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 19:05:34 devstack cinder-volume[84538]: DEBUG cinder.volume.drivers.quobyte [None req-7326cab3-71e7-4336-9c3a-36bbb542349a tempest-CreateVolumesFromImageTest-547880467 None] Selected osci02.corp.quobyte.com/cinder-vol-34312b00-dd6d-45bb-af98-75855cea8e48 as target Quobyte volume. {{(pid=84538) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 29 19:05:34 devstack cinder-volume[84538]: INFO cinder.volume.drivers.remotefs [None req-7326cab3-71e7-4336-9c3a-36bbb542349a tempest-CreateVolumesFromImageTest-547880467 None] casted to osci02.corp.quobyte.com/cinder-vol-34312b00-dd6d-45bb-af98-75855cea8e48 Apr 29 19:05:34 devstack cinder-volume[84538]: DEBUG oslo_concurrency.processutils [None req-7326cab3-71e7-4336-9c3a-36bbb542349a tempest-CreateVolumesFromImageTest-547880467 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-cc096e82-8cca-4974-9081-4f8b9344c1cc 1073741824 {{(pid=84538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 19:05:34 devstack sudo[92328]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-cc096e82-8cca-4974-9081-4f8b9344c1cc 1073741824 Apr 29 19:05:34 devstack sudo[92328]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 19:05:34 devstack cinder-volume[84538]: DEBUG cinder.volume.manager [None req-57e6d6d8-98ce-4e9b-b76e-d4e1984d6130 tempest-CreateVolumesFromImageTest-547880467 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c8a0e101-cafd-463c-8c18-2412acbe763f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a4e2f0da-8600-4cd3-8ae0-7552b7bc3f49', 'volume_size': 1}' {{(pid=84538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 19:05:34 devstack cinder-volume[84538]: DEBUG cinder.volume.manager [None req-57e6d6d8-98ce-4e9b-b76e-d4e1984d6130 tempest-CreateVolumesFromImageTest-547880467 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f1e94816-d3c0-4bb4-90bc-765efbabbc4b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 19:05:34 devstack cinder-volume[84538]: INFO cinder.volume.flows.manager.create_volume [None req-57e6d6d8-98ce-4e9b-b76e-d4e1984d6130 tempest-CreateVolumesFromImageTest-547880467 None] Volume volume-a4e2f0da-8600-4cd3-8ae0-7552b7bc3f49 (a4e2f0da-8600-4cd3-8ae0-7552b7bc3f49): created successfully Apr 29 19:05:34 devstack cinder-volume[84538]: DEBUG cinder.volume.manager [None req-57e6d6d8-98ce-4e9b-b76e-d4e1984d6130 tempest-CreateVolumesFromImageTest-547880467 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f1e94816-d3c0-4bb4-90bc-765efbabbc4b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 19:05:34 devstack cinder-volume[84538]: DEBUG cinder.volume.manager [None req-57e6d6d8-98ce-4e9b-b76e-d4e1984d6130 tempest-CreateVolumesFromImageTest-547880467 None] Flow 'volume_create_manager' (1d84aa5c-ab9c-4269-adbe-8c46a4440427) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84538) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 19:05:34 devstack cinder-volume[84538]: INFO cinder.volume.manager [None req-57e6d6d8-98ce-4e9b-b76e-d4e1984d6130 tempest-CreateVolumesFromImageTest-547880467 None] Created volume successfully. Apr 29 19:05:35 devstack sudo[92325]: pam_unix(sudo:session): session closed for user root Apr 29 19:05:35 devstack cinder-volume[84538]: DEBUG oslo_concurrency.processutils [None req-f7cc7f58-c1a0-41ed-ba7e-35bab1f2baec tempest-CinderUnicodeTest-1144970881 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d" returned: 0 in 0.667s {{(pid=84538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 19:05:35 devstack cinder-volume[84538]: DEBUG cinder.manager [None req-f7cc7f58-c1a0-41ed-ba7e-35bab1f2baec tempest-CinderUnicodeTest-1144970881 None] Notifying Schedulers of capabilities ... {{(pid=84538) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 29 19:05:35 devstack cinder-volume[84538]: INFO cinder.volume.manager [None req-f7cc7f58-c1a0-41ed-ba7e-35bab1f2baec tempest-CinderUnicodeTest-1144970881 None] Deleted volume successfully. Apr 29 19:05:35 devstack cinder-volume[84538]: DEBUG cinder.coordination [None req-f7cc7f58-c1a0-41ed-ba7e-35bab1f2baec tempest-CinderUnicodeTest-1144970881 None] Lock "cinder-08c63ba4-25bf-4e74-b3fc-cbd11bca14ce-delete_volume" released by "delete_volume" :: held 2.846s {{(pid=84538) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 19:05:35 devstack sudo[92328]: pam_unix(sudo:session): session closed for user root Apr 29 19:05:35 devstack cinder-volume[84538]: DEBUG oslo_concurrency.processutils [None req-7326cab3-71e7-4336-9c3a-36bbb542349a tempest-CreateVolumesFromImageTest-547880467 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-cc096e82-8cca-4974-9081-4f8b9344c1cc 1073741824" returned: 0 in 1.111s {{(pid=84538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 19:05:35 devstack cinder-volume[84538]: DEBUG oslo_concurrency.processutils [None req-7326cab3-71e7-4336-9c3a-36bbb542349a tempest-CreateVolumesFromImageTest-547880467 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-cc096e82-8cca-4974-9081-4f8b9344c1cc {{(pid=84538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 19:05:35 devstack sudo[92335]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-cc096e82-8cca-4974-9081-4f8b9344c1cc Apr 29 19:05:35 devstack sudo[92335]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 19:05:36 devstack sudo[92335]: pam_unix(sudo:session): session closed for user root Apr 29 19:05:36 devstack cinder-volume[84538]: DEBUG oslo_concurrency.processutils [None req-7326cab3-71e7-4336-9c3a-36bbb542349a tempest-CreateVolumesFromImageTest-547880467 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-cc096e82-8cca-4974-9081-4f8b9344c1cc" returned: 0 in 0.726s {{(pid=84538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 19:05:36 devstack cinder-volume[84538]: DEBUG cinder.volume.drivers.quobyte [None req-7326cab3-71e7-4336-9c3a-36bbb542349a tempest-CreateVolumesFromImageTest-547880467 None] <== create_volume: return (1885ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-34312b00-dd6d-45bb-af98-75855cea8e48'} {{(pid=84538) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 29 19:05:36 devstack cinder-volume[84538]: DEBUG oslo_concurrency.lockutils [None req-7326cab3-71e7-4336-9c3a-36bbb542349a tempest-CreateVolumesFromImageTest-547880467 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.888s {{(pid=84538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 19:05:36 devstack cinder-volume[84538]: DEBUG oslo_concurrency.lockutils [None req-9284b347-114b-4c3b-8d57-32b1dae1653f tempest-VolumesExtendTest-451302124 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" :: waited 2.381s {{(pid=84538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 19:05:36 devstack cinder-volume[84538]: DEBUG cinder.volume.manager [None req-7326cab3-71e7-4336-9c3a-36bbb542349a tempest-CreateVolumesFromImageTest-547880467 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (dceff4b9-5e91-4a9b-9057-55aed9e60ef2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-cc096e82-8cca-4974-9081-4f8b9344c1cc', 'volume_size': 1}' {{(pid=84538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 19:05:36 devstack cinder-volume[84538]: DEBUG cinder.volume.manager [None req-7326cab3-71e7-4336-9c3a-36bbb542349a tempest-CreateVolumesFromImageTest-547880467 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (76ed30cd-91a7-4e50-8c52-2ffa7299cb43) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 19:05:36 devstack cinder-volume[84538]: INFO cinder.volume.flows.manager.create_volume [None req-7326cab3-71e7-4336-9c3a-36bbb542349a tempest-CreateVolumesFromImageTest-547880467 None] Volume volume-cc096e82-8cca-4974-9081-4f8b9344c1cc (cc096e82-8cca-4974-9081-4f8b9344c1cc): created successfully Apr 29 19:05:36 devstack cinder-volume[84538]: DEBUG cinder.volume.manager [None req-7326cab3-71e7-4336-9c3a-36bbb542349a tempest-CreateVolumesFromImageTest-547880467 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (76ed30cd-91a7-4e50-8c52-2ffa7299cb43) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 19:05:36 devstack cinder-volume[84538]: DEBUG cinder.volume.manager [None req-7326cab3-71e7-4336-9c3a-36bbb542349a tempest-CreateVolumesFromImageTest-547880467 None] Flow 'volume_create_manager' (ce9bd1cd-8ff8-4173-82fc-d79ac7a85c4c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84538) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 19:05:36 devstack cinder-volume[84538]: DEBUG oslo.privsep.daemon [-] privsep: reply[1bda455b-dc07-494e-a084-b510a741f12e]: (4, 'raw') {{(pid=85803) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 19:05:36 devstack cinder-volume[84538]: DEBUG oslo_concurrency.processutils [None req-9284b347-114b-4c3b-8d57-32b1dae1653f tempest-VolumesExtendTest-451302124 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-6b9ca0e6-2b0f-40a7-908b-ee6d4f7f7489 {{(pid=84538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 19:05:36 devstack cinder-volume[84538]: INFO cinder.volume.manager [None req-7326cab3-71e7-4336-9c3a-36bbb542349a tempest-CreateVolumesFromImageTest-547880467 None] Created volume successfully. Apr 29 19:05:36 devstack sudo[92339]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-6b9ca0e6-2b0f-40a7-908b-ee6d4f7f7489 Apr 29 19:05:36 devstack sudo[92339]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 19:05:37 devstack cinder-volume[84538]: DEBUG cinder.coordination [None req-9b5681c2-5830-46f0-8eb5-2722cb6700c3 tempest-CreateVolumesFromImageTest-547880467 None] Acquiring lock "cinder-cc096e82-8cca-4974-9081-4f8b9344c1cc-delete_volume" by "delete_volume" {{(pid=84538) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 19:05:37 devstack cinder-volume[84538]: DEBUG cinder.coordination [None req-9b5681c2-5830-46f0-8eb5-2722cb6700c3 tempest-CreateVolumesFromImageTest-547880467 None] Lock "cinder-cc096e82-8cca-4974-9081-4f8b9344c1cc-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=84538) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 19:05:37 devstack cinder-volume[84538]: DEBUG cinder.coordination [None req-9b5681c2-5830-46f0-8eb5-2722cb6700c3 tempest-CreateVolumesFromImageTest-547880467 None] Acquiring lock "cinder-quobyte-cc096e82-8cca-4974-9081-4f8b9344c1cc" by "delete_volume" {{(pid=84538) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 19:05:37 devstack sudo[92339]: pam_unix(sudo:session): session closed for user root Apr 29 19:05:37 devstack cinder-volume[84538]: DEBUG cinder.coordination [None req-9b5681c2-5830-46f0-8eb5-2722cb6700c3 tempest-CreateVolumesFromImageTest-547880467 None] Lock "cinder-quobyte-cc096e82-8cca-4974-9081-4f8b9344c1cc" acquired by "delete_volume" :: waited 0.020s {{(pid=84538) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 19:05:37 devstack cinder-volume[84538]: DEBUG oslo_concurrency.processutils [None req-9284b347-114b-4c3b-8d57-32b1dae1653f tempest-VolumesExtendTest-451302124 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-6b9ca0e6-2b0f-40a7-908b-ee6d4f7f7489" returned: 0 in 0.793s {{(pid=84538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 19:05:37 devstack cinder-volume[84538]: DEBUG oslo_concurrency.processutils [None req-9284b347-114b-4c3b-8d57-32b1dae1653f tempest-VolumesExtendTest-451302124 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-6b9ca0e6-2b0f-40a7-908b-ee6d4f7f7489 {{(pid=84538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 19:05:37 devstack cinder-volume[84538]: DEBUG oslo.privsep.daemon [-] privsep: reply[6af23771-6840-472e-8aa1-0a41f7e610f1]: (4, 'qcow2') {{(pid=85803) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 19:05:37 devstack cinder-volume[84538]: DEBUG oslo_concurrency.processutils [None req-9b5681c2-5830-46f0-8eb5-2722cb6700c3 tempest-CreateVolumesFromImageTest-547880467 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-cc096e82-8cca-4974-9081-4f8b9344c1cc {{(pid=84538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 19:05:37 devstack sudo[92343]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-6b9ca0e6-2b0f-40a7-908b-ee6d4f7f7489 Apr 29 19:05:37 devstack sudo[92343]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 19:05:37 devstack sudo[92344]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-cc096e82-8cca-4974-9081-4f8b9344c1cc Apr 29 19:05:37 devstack sudo[92344]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 19:05:38 devstack sudo[92344]: pam_unix(sudo:session): session closed for user root Apr 29 19:05:38 devstack sudo[92343]: pam_unix(sudo:session): session closed for user root Apr 29 19:05:38 devstack cinder-volume[84538]: DEBUG oslo_concurrency.processutils [None req-9b5681c2-5830-46f0-8eb5-2722cb6700c3 tempest-CreateVolumesFromImageTest-547880467 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-cc096e82-8cca-4974-9081-4f8b9344c1cc" returned: 0 in 0.752s {{(pid=84538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 19:05:38 devstack cinder-volume[84538]: DEBUG oslo_concurrency.processutils [None req-9b5681c2-5830-46f0-8eb5-2722cb6700c3 tempest-CreateVolumesFromImageTest-547880467 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-cc096e82-8cca-4974-9081-4f8b9344c1cc {{(pid=84538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 19:05:38 devstack cinder-volume[84538]: DEBUG oslo_concurrency.processutils [None req-9284b347-114b-4c3b-8d57-32b1dae1653f tempest-VolumesExtendTest-451302124 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-6b9ca0e6-2b0f-40a7-908b-ee6d4f7f7489" returned: 1 in 0.783s {{(pid=84538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 19:05:38 devstack cinder-volume[84538]: DEBUG oslo_concurrency.processutils [None req-9284b347-114b-4c3b-8d57-32b1dae1653f tempest-VolumesExtendTest-451302124 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-6b9ca0e6-2b0f-40a7-908b-ee6d4f7f7489' failed. Not Retrying. {{(pid=84538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Apr 29 19:05:38 devstack cinder-volume[84538]: DEBUG oslo_concurrency.processutils [None req-9284b347-114b-4c3b-8d57-32b1dae1653f tempest-VolumesExtendTest-451302124 None] Running cmd (subprocess): qemu-img resize /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-6b9ca0e6-2b0f-40a7-908b-ee6d4f7f7489 2G {{(pid=84538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 19:05:38 devstack sudo[92355]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-cc096e82-8cca-4974-9081-4f8b9344c1cc Apr 29 19:05:38 devstack sudo[92355]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 19:05:38 devstack cinder-volume[84538]: DEBUG oslo_concurrency.processutils [None req-9284b347-114b-4c3b-8d57-32b1dae1653f tempest-VolumesExtendTest-451302124 None] CMD "qemu-img resize /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-6b9ca0e6-2b0f-40a7-908b-ee6d4f7f7489 2G" returned: 0 in 0.079s {{(pid=84538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 19:05:38 devstack cinder-volume[84538]: DEBUG oslo_concurrency.lockutils [None req-9284b347-114b-4c3b-8d57-32b1dae1653f tempest-VolumesExtendTest-451302124 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" :: held 1.735s {{(pid=84538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 19:05:38 devstack cinder-volume[84538]: INFO cinder.volume.manager [None req-9284b347-114b-4c3b-8d57-32b1dae1653f tempest-VolumesExtendTest-451302124 None] Extend volume completed successfully. Apr 29 19:05:38 devstack cinder-volume[84538]: DEBUG cinder.coordination [None req-012a1325-d697-4100-8cbe-df2bdf3a719d tempest-VolumesExtendTest-451302124 None] Acquiring lock "cinder-6b9ca0e6-2b0f-40a7-908b-ee6d4f7f7489-delete_volume" by "delete_volume" {{(pid=84538) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 19:05:38 devstack cinder-volume[84538]: DEBUG cinder.coordination [None req-012a1325-d697-4100-8cbe-df2bdf3a719d tempest-VolumesExtendTest-451302124 None] Lock "cinder-6b9ca0e6-2b0f-40a7-908b-ee6d4f7f7489-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=84538) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 19:05:38 devstack cinder-volume[84538]: DEBUG cinder.coordination [None req-012a1325-d697-4100-8cbe-df2bdf3a719d tempest-VolumesExtendTest-451302124 None] Acquiring lock "cinder-quobyte-6b9ca0e6-2b0f-40a7-908b-ee6d4f7f7489" by "delete_volume" {{(pid=84538) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 19:05:38 devstack cinder-volume[84538]: DEBUG cinder.coordination [None req-012a1325-d697-4100-8cbe-df2bdf3a719d tempest-VolumesExtendTest-451302124 None] Lock "cinder-quobyte-6b9ca0e6-2b0f-40a7-908b-ee6d4f7f7489" acquired by "delete_volume" :: waited 0.023s {{(pid=84538) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 19:05:38 devstack sudo[92355]: pam_unix(sudo:session): session closed for user root Apr 29 19:05:38 devstack cinder-volume[84538]: DEBUG oslo_concurrency.processutils [None req-9b5681c2-5830-46f0-8eb5-2722cb6700c3 tempest-CreateVolumesFromImageTest-547880467 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-cc096e82-8cca-4974-9081-4f8b9344c1cc" returned: 0 in 0.680s {{(pid=84538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 19:05:39 devstack cinder-volume[84538]: DEBUG cinder.coordination [None req-9b5681c2-5830-46f0-8eb5-2722cb6700c3 tempest-CreateVolumesFromImageTest-547880467 None] Lock "cinder-quobyte-cc096e82-8cca-4974-9081-4f8b9344c1cc" released by "delete_volume" :: held 1.486s {{(pid=84538) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 19:05:39 devstack cinder-volume[84538]: DEBUG oslo.privsep.daemon [-] privsep: reply[30ca6c05-6522-4437-89ea-27d2cfff0043]: (4, 'raw') {{(pid=85803) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 19:05:39 devstack cinder-volume[84538]: DEBUG oslo_concurrency.processutils [None req-012a1325-d697-4100-8cbe-df2bdf3a719d tempest-VolumesExtendTest-451302124 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-6b9ca0e6-2b0f-40a7-908b-ee6d4f7f7489 {{(pid=84538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 19:05:39 devstack cinder-volume[84538]: DEBUG cinder.quota [None req-9b5681c2-5830-46f0-8eb5-2722cb6700c3 tempest-CreateVolumesFromImageTest-547880467 None] Created reservations ['996db617-2e08-4d07-b111-d27b6d012273', 'f8d5a0d4-1ec0-44dd-808c-c0ce3f956aaf', '2190ad4f-7d6f-4d57-8ce0-e303644e2e20', 'fafbc8ce-d8b2-4c3c-bf1c-aa0dc31b7ae4'] {{(pid=84538) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 29 19:05:39 devstack sudo[92362]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-6b9ca0e6-2b0f-40a7-908b-ee6d4f7f7489 Apr 29 19:05:39 devstack sudo[92362]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 19:05:39 devstack cinder-volume[84538]: DEBUG cinder.volume.flows.manager.create_volume [None req-7918770c-de0a-4d51-ba14-e504dc548bbd tempest-VolumesSnapshotListTestJSON-317057059 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84538) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Apr 29 19:05:39 devstack cinder-volume[84538]: DEBUG cinder.volume.manager [None req-7918770c-de0a-4d51-ba14-e504dc548bbd tempest-VolumesSnapshotListTestJSON-317057059 None] Flow 'volume_create_manager' (8dcce883-6414-4767-b213-2f4076e78512) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84538) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 19:05:39 devstack cinder-volume[84538]: DEBUG cinder.volume.manager [None req-7918770c-de0a-4d51-ba14-e504dc548bbd tempest-VolumesSnapshotListTestJSON-317057059 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e006836b-9100-4e7a-804a-71525a680f9f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 19:05:39 devstack cinder-volume[84538]: DEBUG cinder.volume.manager [None req-7918770c-de0a-4d51-ba14-e504dc548bbd tempest-VolumesSnapshotListTestJSON-317057059 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e006836b-9100-4e7a-804a-71525a680f9f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-29T17:05:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotListTestJSON-Volume-26694035',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1387f25c-dfd4-4f52-beab-27cf8a1036b3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9fb6dbdc6f0049ad945d4a1887ab245f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T17:05:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T17:05:39Z,use_quota=True,user_id='bcfbe03ab5f6435988dd9d8480760d6e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(62b05900-93e3-4190-a88f-1d87324303d1),volume_type_id=62b05900-93e3-4190-a88f-1d87324303d1)' {{(pid=84538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 19:05:39 devstack cinder-volume[84538]: DEBUG cinder.volume.manager [None req-7918770c-de0a-4d51-ba14-e504dc548bbd tempest-VolumesSnapshotListTestJSON-317057059 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (62115dfb-e678-4dcc-a552-a16f3c6909a3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 19:05:39 devstack cinder-volume[84538]: DEBUG cinder.volume.manager [None req-7918770c-de0a-4d51-ba14-e504dc548bbd tempest-VolumesSnapshotListTestJSON-317057059 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (62115dfb-e678-4dcc-a552-a16f3c6909a3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 19:05:39 devstack cinder-volume[84538]: DEBUG cinder.volume.manager [None req-7918770c-de0a-4d51-ba14-e504dc548bbd tempest-VolumesSnapshotListTestJSON-317057059 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fe48555e-e122-4fa9-bb6a-68299bac0ef0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 19:05:39 devstack cinder-volume[84538]: DEBUG cinder.volume.manager [None req-7918770c-de0a-4d51-ba14-e504dc548bbd tempest-VolumesSnapshotListTestJSON-317057059 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fe48555e-e122-4fa9-bb6a-68299bac0ef0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1387f25c-dfd4-4f52-beab-27cf8a1036b3', 'volume_name': 'volume-1387f25c-dfd4-4f52-beab-27cf8a1036b3', 'volume_size': 1}' {{(pid=84538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 19:05:39 devstack cinder-volume[84538]: DEBUG cinder.volume.manager [None req-7918770c-de0a-4d51-ba14-e504dc548bbd tempest-VolumesSnapshotListTestJSON-317057059 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c3c7e75c-27b2-4c24-b8c4-cefbd5be3791) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 19:05:39 devstack cinder-volume[84538]: DEBUG cinder.volume.manager [None req-7918770c-de0a-4d51-ba14-e504dc548bbd tempest-VolumesSnapshotListTestJSON-317057059 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c3c7e75c-27b2-4c24-b8c4-cefbd5be3791) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 19:05:39 devstack cinder-volume[84538]: DEBUG cinder.volume.manager [None req-7918770c-de0a-4d51-ba14-e504dc548bbd tempest-VolumesSnapshotListTestJSON-317057059 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7ebabf35-6849-4afa-8cda-6448fcadf771) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 19:05:39 devstack cinder-volume[84538]: INFO cinder.volume.flows.manager.create_volume [None req-7918770c-de0a-4d51-ba14-e504dc548bbd tempest-VolumesSnapshotListTestJSON-317057059 None] Volume 1387f25c-dfd4-4f52-beab-27cf8a1036b3: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1387f25c-dfd4-4f52-beab-27cf8a1036b3', 'volume_size': 1} Apr 29 19:05:39 devstack cinder-volume[84538]: DEBUG oslo_concurrency.lockutils [None req-7918770c-de0a-4d51-ba14-e504dc548bbd tempest-VolumesSnapshotListTestJSON-317057059 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 19:05:39 devstack cinder-volume[84538]: DEBUG oslo_concurrency.lockutils [None req-7918770c-de0a-4d51-ba14-e504dc548bbd tempest-VolumesSnapshotListTestJSON-317057059 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=84538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 19:05:39 devstack cinder-volume[84538]: DEBUG cinder.volume.drivers.quobyte [None req-7918770c-de0a-4d51-ba14-e504dc548bbd tempest-VolumesSnapshotListTestJSON-317057059 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-29T17:05:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotListTestJSON-Volume-26694035',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1387f25c-dfd4-4f52-beab-27cf8a1036b3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9fb6dbdc6f0049ad945d4a1887ab245f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T17:05:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T17:05:39Z,use_quota=True,user_id='bcfbe03ab5f6435988dd9d8480760d6e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(62b05900-93e3-4190-a88f-1d87324303d1),volume_type_id=62b05900-93e3-4190-a88f-1d87324303d1)}" {{(pid=84538) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 29 19:05:39 devstack cinder-volume[84538]: DEBUG cinder.volume.drivers.remotefs [None req-7918770c-de0a-4d51-ba14-e504dc548bbd tempest-VolumesSnapshotListTestJSON-317057059 None] Creating volume 1387f25c-dfd4-4f52-beab-27cf8a1036b3 {{(pid=84538) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 29 19:05:39 devstack cinder-volume[84538]: DEBUG oslo_concurrency.lockutils [None req-7918770c-de0a-4d51-ba14-e504dc548bbd tempest-VolumesSnapshotListTestJSON-317057059 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 19:05:39 devstack cinder-volume[84538]: DEBUG oslo_concurrency.lockutils [None req-7918770c-de0a-4d51-ba14-e504dc548bbd tempest-VolumesSnapshotListTestJSON-317057059 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=84538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 19:05:39 devstack cinder-volume[84538]: DEBUG cinder.volume.drivers.quobyte [None req-7918770c-de0a-4d51-ba14-e504dc548bbd tempest-VolumesSnapshotListTestJSON-317057059 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-34312b00-dd6d-45bb-af98-75855cea8e48': None} {{(pid=84538) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 19:05:39 devstack cinder-volume[84538]: DEBUG cinder.volume.drivers.quobyte [None req-7918770c-de0a-4d51-ba14-e504dc548bbd tempest-VolumesSnapshotListTestJSON-317057059 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-34312b00-dd6d-45bb-af98-75855cea8e48'] {{(pid=84538) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 19:05:39 devstack cinder-volume[84538]: DEBUG oslo_concurrency.lockutils [None req-7918770c-de0a-4d51-ba14-e504dc548bbd tempest-VolumesSnapshotListTestJSON-317057059 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=84538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 19:05:39 devstack cinder-volume[84538]: DEBUG cinder.volume.drivers.quobyte [None req-7918770c-de0a-4d51-ba14-e504dc548bbd tempest-VolumesSnapshotListTestJSON-317057059 None] Selected osci02.corp.quobyte.com/cinder-vol-34312b00-dd6d-45bb-af98-75855cea8e48 as target Quobyte volume. {{(pid=84538) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 29 19:05:39 devstack cinder-volume[84538]: INFO cinder.volume.drivers.remotefs [None req-7918770c-de0a-4d51-ba14-e504dc548bbd tempest-VolumesSnapshotListTestJSON-317057059 None] casted to osci02.corp.quobyte.com/cinder-vol-34312b00-dd6d-45bb-af98-75855cea8e48 Apr 29 19:05:39 devstack cinder-volume[84538]: DEBUG oslo_concurrency.processutils [None req-7918770c-de0a-4d51-ba14-e504dc548bbd tempest-VolumesSnapshotListTestJSON-317057059 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-1387f25c-dfd4-4f52-beab-27cf8a1036b3 1073741824 {{(pid=84538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 19:05:39 devstack cinder-volume[84538]: DEBUG oslo_concurrency.lockutils [None req-9b5681c2-5830-46f0-8eb5-2722cb6700c3 tempest-CreateVolumesFromImageTest-547880467 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 19:05:39 devstack cinder-volume[84538]: DEBUG oslo_concurrency.lockutils [None req-9b5681c2-5830-46f0-8eb5-2722cb6700c3 tempest-CreateVolumesFromImageTest-547880467 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=84538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 19:05:39 devstack cinder-volume[84538]: DEBUG cinder.volume.drivers.quobyte [None req-9b5681c2-5830-46f0-8eb5-2722cb6700c3 tempest-CreateVolumesFromImageTest-547880467 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-34312b00-dd6d-45bb-af98-75855cea8e48': None} {{(pid=84538) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 19:05:39 devstack cinder-volume[84538]: DEBUG cinder.volume.drivers.quobyte [None req-9b5681c2-5830-46f0-8eb5-2722cb6700c3 tempest-CreateVolumesFromImageTest-547880467 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-34312b00-dd6d-45bb-af98-75855cea8e48'] {{(pid=84538) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 19:05:39 devstack cinder-volume[84538]: DEBUG oslo_concurrency.lockutils [None req-9b5681c2-5830-46f0-8eb5-2722cb6700c3 tempest-CreateVolumesFromImageTest-547880467 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=84538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 19:05:39 devstack cinder-volume[84538]: DEBUG oslo_concurrency.processutils [None req-9b5681c2-5830-46f0-8eb5-2722cb6700c3 tempest-CreateVolumesFromImageTest-547880467 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d {{(pid=84538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 19:05:39 devstack sudo[92364]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-1387f25c-dfd4-4f52-beab-27cf8a1036b3 1073741824 Apr 29 19:05:39 devstack sudo[92364]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 19:05:39 devstack sudo[92366]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d Apr 29 19:05:39 devstack sudo[92366]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 19:05:39 devstack cinder-volume[84538]: DEBUG cinder.coordination [None req-40628df0-4e46-467d-9373-bf7ca0c143cc tempest-CreateVolumesFromImageTest-547880467 None] Acquiring lock "cinder-a4e2f0da-8600-4cd3-8ae0-7552b7bc3f49-delete_volume" by "delete_volume" {{(pid=84538) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 19:05:39 devstack cinder-volume[84538]: DEBUG cinder.coordination [None req-40628df0-4e46-467d-9373-bf7ca0c143cc tempest-CreateVolumesFromImageTest-547880467 None] Lock "cinder-a4e2f0da-8600-4cd3-8ae0-7552b7bc3f49-delete_volume" acquired by "delete_volume" :: waited 0.031s {{(pid=84538) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 19:05:39 devstack cinder-volume[84538]: DEBUG cinder.coordination [None req-40628df0-4e46-467d-9373-bf7ca0c143cc tempest-CreateVolumesFromImageTest-547880467 None] Acquiring lock "cinder-quobyte-a4e2f0da-8600-4cd3-8ae0-7552b7bc3f49" by "delete_volume" {{(pid=84538) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 19:05:39 devstack cinder-volume[84538]: DEBUG cinder.coordination [None req-40628df0-4e46-467d-9373-bf7ca0c143cc tempest-CreateVolumesFromImageTest-547880467 None] Lock "cinder-quobyte-a4e2f0da-8600-4cd3-8ae0-7552b7bc3f49" acquired by "delete_volume" :: waited 0.016s {{(pid=84538) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 19:05:39 devstack cinder-volume[84538]: DEBUG oslo.privsep.daemon [-] privsep: reply[1c64533b-ff60-4552-9966-815c6c4bba52]: (4, 'qcow2') {{(pid=85803) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 19:05:39 devstack cinder-volume[84538]: DEBUG oslo_concurrency.processutils [None req-40628df0-4e46-467d-9373-bf7ca0c143cc tempest-CreateVolumesFromImageTest-547880467 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-a4e2f0da-8600-4cd3-8ae0-7552b7bc3f49 {{(pid=84538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 19:05:39 devstack sudo[92362]: pam_unix(sudo:session): session closed for user root Apr 29 19:05:39 devstack cinder-volume[84538]: DEBUG oslo_concurrency.processutils [None req-012a1325-d697-4100-8cbe-df2bdf3a719d tempest-VolumesExtendTest-451302124 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-6b9ca0e6-2b0f-40a7-908b-ee6d4f7f7489" returned: 0 in 0.803s {{(pid=84538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 19:05:39 devstack cinder-volume[84538]: DEBUG oslo_concurrency.processutils [None req-012a1325-d697-4100-8cbe-df2bdf3a719d tempest-VolumesExtendTest-451302124 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-6b9ca0e6-2b0f-40a7-908b-ee6d4f7f7489 {{(pid=84538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 19:05:39 devstack sudo[92370]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-a4e2f0da-8600-4cd3-8ae0-7552b7bc3f49 Apr 29 19:05:39 devstack sudo[92370]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 19:05:39 devstack sudo[92372]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-6b9ca0e6-2b0f-40a7-908b-ee6d4f7f7489 Apr 29 19:05:39 devstack sudo[92372]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 19:05:39 devstack sudo[92366]: pam_unix(sudo:session): session closed for user root Apr 29 19:05:39 devstack cinder-volume[84538]: DEBUG oslo_concurrency.processutils [None req-9b5681c2-5830-46f0-8eb5-2722cb6700c3 tempest-CreateVolumesFromImageTest-547880467 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d" returned: 0 in 0.671s {{(pid=84538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 19:05:39 devstack cinder-volume[84538]: DEBUG cinder.manager [None req-9b5681c2-5830-46f0-8eb5-2722cb6700c3 tempest-CreateVolumesFromImageTest-547880467 None] Notifying Schedulers of capabilities ... {{(pid=84538) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 29 19:05:39 devstack cinder-volume[84538]: INFO cinder.volume.manager [None req-9b5681c2-5830-46f0-8eb5-2722cb6700c3 tempest-CreateVolumesFromImageTest-547880467 None] Deleted volume successfully. Apr 29 19:05:40 devstack cinder-volume[84538]: DEBUG cinder.coordination [None req-9b5681c2-5830-46f0-8eb5-2722cb6700c3 tempest-CreateVolumesFromImageTest-547880467 None] Lock "cinder-cc096e82-8cca-4974-9081-4f8b9344c1cc-delete_volume" released by "delete_volume" :: held 2.572s {{(pid=84538) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 19:05:40 devstack sudo[92364]: pam_unix(sudo:session): session closed for user root Apr 29 19:05:40 devstack cinder-volume[84538]: DEBUG oslo_concurrency.processutils [None req-7918770c-de0a-4d51-ba14-e504dc548bbd tempest-VolumesSnapshotListTestJSON-317057059 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-1387f25c-dfd4-4f52-beab-27cf8a1036b3 1073741824" returned: 0 in 0.971s {{(pid=84538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 19:05:40 devstack cinder-volume[84538]: DEBUG oslo_concurrency.processutils [None req-7918770c-de0a-4d51-ba14-e504dc548bbd tempest-VolumesSnapshotListTestJSON-317057059 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-1387f25c-dfd4-4f52-beab-27cf8a1036b3 {{(pid=84538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 19:05:40 devstack sudo[92379]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-1387f25c-dfd4-4f52-beab-27cf8a1036b3 Apr 29 19:05:40 devstack sudo[92379]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 19:05:40 devstack sudo[92372]: pam_unix(sudo:session): session closed for user root Apr 29 19:05:40 devstack cinder-volume[84538]: DEBUG oslo_concurrency.processutils [None req-012a1325-d697-4100-8cbe-df2bdf3a719d tempest-VolumesExtendTest-451302124 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-6b9ca0e6-2b0f-40a7-908b-ee6d4f7f7489" returned: 1 in 0.760s {{(pid=84538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 19:05:40 devstack cinder-volume[84538]: DEBUG oslo_concurrency.processutils [None req-012a1325-d697-4100-8cbe-df2bdf3a719d tempest-VolumesExtendTest-451302124 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-6b9ca0e6-2b0f-40a7-908b-ee6d4f7f7489' failed. Not Retrying. {{(pid=84538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Apr 29 19:05:40 devstack cinder-volume[84538]: DEBUG oslo_concurrency.processutils [None req-012a1325-d697-4100-8cbe-df2bdf3a719d tempest-VolumesExtendTest-451302124 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-6b9ca0e6-2b0f-40a7-908b-ee6d4f7f7489 {{(pid=84538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 19:05:40 devstack sudo[92370]: pam_unix(sudo:session): session closed for user root Apr 29 19:05:40 devstack cinder-volume[84538]: DEBUG oslo_concurrency.processutils [None req-40628df0-4e46-467d-9373-bf7ca0c143cc tempest-CreateVolumesFromImageTest-547880467 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-a4e2f0da-8600-4cd3-8ae0-7552b7bc3f49" returned: 0 in 0.806s {{(pid=84538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 19:05:40 devstack cinder-volume[84538]: DEBUG oslo_concurrency.processutils [None req-40628df0-4e46-467d-9373-bf7ca0c143cc tempest-CreateVolumesFromImageTest-547880467 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-a4e2f0da-8600-4cd3-8ae0-7552b7bc3f49 {{(pid=84538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 19:05:40 devstack sudo[92387]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-6b9ca0e6-2b0f-40a7-908b-ee6d4f7f7489 Apr 29 19:05:40 devstack sudo[92387]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 19:05:40 devstack sudo[92389]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-a4e2f0da-8600-4cd3-8ae0-7552b7bc3f49 Apr 29 19:05:40 devstack sudo[92389]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 19:05:40 devstack sudo[92379]: pam_unix(sudo:session): session closed for user root Apr 29 19:05:40 devstack cinder-volume[84538]: DEBUG oslo_concurrency.processutils [None req-7918770c-de0a-4d51-ba14-e504dc548bbd tempest-VolumesSnapshotListTestJSON-317057059 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-1387f25c-dfd4-4f52-beab-27cf8a1036b3" returned: 0 in 0.674s {{(pid=84538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 19:05:40 devstack cinder-volume[84538]: DEBUG cinder.volume.drivers.quobyte [None req-7918770c-de0a-4d51-ba14-e504dc548bbd tempest-VolumesSnapshotListTestJSON-317057059 None] <== create_volume: return (1693ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-34312b00-dd6d-45bb-af98-75855cea8e48'} {{(pid=84538) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 29 19:05:40 devstack cinder-volume[84538]: DEBUG oslo_concurrency.lockutils [None req-7918770c-de0a-4d51-ba14-e504dc548bbd tempest-VolumesSnapshotListTestJSON-317057059 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.695s {{(pid=84538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 19:05:40 devstack cinder-volume[84538]: DEBUG cinder.volume.manager [None req-7918770c-de0a-4d51-ba14-e504dc548bbd tempest-VolumesSnapshotListTestJSON-317057059 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7ebabf35-6849-4afa-8cda-6448fcadf771) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1387f25c-dfd4-4f52-beab-27cf8a1036b3', 'volume_size': 1}' {{(pid=84538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 19:05:40 devstack cinder-volume[84538]: DEBUG cinder.volume.manager [None req-7918770c-de0a-4d51-ba14-e504dc548bbd tempest-VolumesSnapshotListTestJSON-317057059 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5da0c5f4-6fbe-4e54-b6c9-6e4a6f6f4741) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 19:05:40 devstack cinder-volume[84538]: INFO cinder.volume.flows.manager.create_volume [None req-7918770c-de0a-4d51-ba14-e504dc548bbd tempest-VolumesSnapshotListTestJSON-317057059 None] Volume volume-1387f25c-dfd4-4f52-beab-27cf8a1036b3 (1387f25c-dfd4-4f52-beab-27cf8a1036b3): created successfully Apr 29 19:05:41 devstack cinder-volume[84538]: DEBUG cinder.volume.manager [None req-7918770c-de0a-4d51-ba14-e504dc548bbd tempest-VolumesSnapshotListTestJSON-317057059 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5da0c5f4-6fbe-4e54-b6c9-6e4a6f6f4741) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 19:05:41 devstack cinder-volume[84538]: DEBUG cinder.volume.manager [None req-7918770c-de0a-4d51-ba14-e504dc548bbd tempest-VolumesSnapshotListTestJSON-317057059 None] Flow 'volume_create_manager' (8dcce883-6414-4767-b213-2f4076e78512) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84538) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 19:05:41 devstack cinder-volume[84538]: INFO cinder.volume.manager [None req-7918770c-de0a-4d51-ba14-e504dc548bbd tempest-VolumesSnapshotListTestJSON-317057059 None] Created volume successfully. Apr 29 19:05:41 devstack sudo[92387]: pam_unix(sudo:session): session closed for user root Apr 29 19:05:41 devstack cinder-volume[84538]: DEBUG oslo_concurrency.processutils [None req-012a1325-d697-4100-8cbe-df2bdf3a719d tempest-VolumesExtendTest-451302124 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-6b9ca0e6-2b0f-40a7-908b-ee6d4f7f7489" returned: 0 in 0.653s {{(pid=84538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 19:05:41 devstack sudo[92389]: pam_unix(sudo:session): session closed for user root Apr 29 19:05:41 devstack cinder-volume[84538]: DEBUG oslo_concurrency.processutils [None req-40628df0-4e46-467d-9373-bf7ca0c143cc tempest-CreateVolumesFromImageTest-547880467 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-a4e2f0da-8600-4cd3-8ae0-7552b7bc3f49" returned: 0 in 0.644s {{(pid=84538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 19:05:41 devstack cinder-volume[84538]: DEBUG cinder.coordination [None req-012a1325-d697-4100-8cbe-df2bdf3a719d tempest-VolumesExtendTest-451302124 None] Lock "cinder-quobyte-6b9ca0e6-2b0f-40a7-908b-ee6d4f7f7489" released by "delete_volume" :: held 2.323s {{(pid=84538) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 19:05:41 devstack cinder-volume[84538]: DEBUG cinder.coordination [None req-40628df0-4e46-467d-9373-bf7ca0c143cc tempest-CreateVolumesFromImageTest-547880467 None] Lock "cinder-quobyte-a4e2f0da-8600-4cd3-8ae0-7552b7bc3f49" released by "delete_volume" :: held 1.509s {{(pid=84538) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 19:05:41 devstack cinder-volume[84538]: DEBUG cinder.quota [None req-012a1325-d697-4100-8cbe-df2bdf3a719d tempest-VolumesExtendTest-451302124 None] Created reservations ['0dc9ad7a-5d2f-4d0c-9660-7a13f694cefb', '911fb786-f168-48bc-8b99-d9e65a3d07a2', '31f73eac-a158-4d63-b02c-8917f23fa5d7', 'bcc91dfa-f449-4b73-a5b9-de04c36a1132'] {{(pid=84538) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 29 19:05:41 devstack cinder-volume[84538]: DEBUG cinder.quota [None req-40628df0-4e46-467d-9373-bf7ca0c143cc tempest-CreateVolumesFromImageTest-547880467 None] Created reservations ['ef890fe8-7861-4a17-8ba1-30e64f31f826', '3a7379f0-77a6-4d77-a76c-da780df4b052', '7930393d-41b1-4a37-b1cd-1cb2083119fa', '45434e33-c522-40bb-bed5-29e86f1d494d'] {{(pid=84538) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 29 19:05:41 devstack cinder-volume[84538]: DEBUG oslo_concurrency.lockutils [None req-012a1325-d697-4100-8cbe-df2bdf3a719d tempest-VolumesExtendTest-451302124 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 19:05:41 devstack cinder-volume[84538]: DEBUG oslo_concurrency.lockutils [None req-012a1325-d697-4100-8cbe-df2bdf3a719d tempest-VolumesExtendTest-451302124 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 19:05:41 devstack cinder-volume[84538]: DEBUG cinder.volume.drivers.quobyte [None req-012a1325-d697-4100-8cbe-df2bdf3a719d tempest-VolumesExtendTest-451302124 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-34312b00-dd6d-45bb-af98-75855cea8e48': None} {{(pid=84538) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 19:05:41 devstack cinder-volume[84538]: DEBUG cinder.volume.drivers.quobyte [None req-012a1325-d697-4100-8cbe-df2bdf3a719d tempest-VolumesExtendTest-451302124 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-34312b00-dd6d-45bb-af98-75855cea8e48'] {{(pid=84538) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 19:05:41 devstack cinder-volume[84538]: DEBUG oslo_concurrency.lockutils [None req-012a1325-d697-4100-8cbe-df2bdf3a719d tempest-VolumesExtendTest-451302124 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=84538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 19:05:41 devstack cinder-volume[84538]: DEBUG oslo_concurrency.processutils [None req-012a1325-d697-4100-8cbe-df2bdf3a719d tempest-VolumesExtendTest-451302124 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d {{(pid=84538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 19:05:41 devstack cinder-volume[84538]: DEBUG oslo_concurrency.lockutils [None req-40628df0-4e46-467d-9373-bf7ca0c143cc tempest-CreateVolumesFromImageTest-547880467 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 19:05:41 devstack cinder-volume[84538]: DEBUG oslo_concurrency.lockutils [None req-40628df0-4e46-467d-9373-bf7ca0c143cc tempest-CreateVolumesFromImageTest-547880467 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=84538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 19:05:41 devstack cinder-volume[84538]: DEBUG cinder.volume.drivers.quobyte [None req-40628df0-4e46-467d-9373-bf7ca0c143cc tempest-CreateVolumesFromImageTest-547880467 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-34312b00-dd6d-45bb-af98-75855cea8e48': None} {{(pid=84538) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 19:05:41 devstack cinder-volume[84538]: DEBUG cinder.volume.drivers.quobyte [None req-40628df0-4e46-467d-9373-bf7ca0c143cc tempest-CreateVolumesFromImageTest-547880467 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-34312b00-dd6d-45bb-af98-75855cea8e48'] {{(pid=84538) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 19:05:41 devstack cinder-volume[84538]: DEBUG oslo_concurrency.lockutils [None req-40628df0-4e46-467d-9373-bf7ca0c143cc tempest-CreateVolumesFromImageTest-547880467 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=84538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 19:05:41 devstack cinder-volume[84538]: DEBUG oslo_concurrency.processutils [None req-40628df0-4e46-467d-9373-bf7ca0c143cc tempest-CreateVolumesFromImageTest-547880467 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d {{(pid=84538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 19:05:41 devstack sudo[92396]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d Apr 29 19:05:41 devstack sudo[92396]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 19:05:41 devstack sudo[92397]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d Apr 29 19:05:41 devstack sudo[92397]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 19:05:41 devstack cinder-volume[84538]: DEBUG oslo_concurrency.lockutils [None req-d3490b6e-d01b-4367-9550-944d9f952f33 tempest-VolumesSnapshotListTestJSON-317057059 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=84538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 19:05:41 devstack cinder-volume[84538]: DEBUG oslo_concurrency.lockutils [None req-d3490b6e-d01b-4367-9550-944d9f952f33 tempest-VolumesSnapshotListTestJSON-317057059 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=84538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 19:05:41 devstack cinder-volume[84538]: DEBUG cinder.volume.drivers.remotefs [None req-d3490b6e-d01b-4367-9550-944d9f952f33 tempest-VolumesSnapshotListTestJSON-317057059 None] Creating offline snapshot 836c5cf9-432f-46db-a134-1c1b3e799d42 of volume 1387f25c-dfd4-4f52-beab-27cf8a1036b3 {{(pid=84538) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}} Apr 29 19:05:41 devstack cinder-volume[84538]: DEBUG oslo.privsep.daemon [-] privsep: reply[ed89a3eb-3e09-40e9-8b27-d890cf2502d7]: (4, 'qcow2') {{(pid=85803) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 19:05:41 devstack cinder-volume[84538]: DEBUG oslo_concurrency.processutils [None req-d3490b6e-d01b-4367-9550-944d9f952f33 tempest-VolumesSnapshotListTestJSON-317057059 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-1387f25c-dfd4-4f52-beab-27cf8a1036b3 {{(pid=84538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 19:05:41 devstack sudo[92400]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-1387f25c-dfd4-4f52-beab-27cf8a1036b3 Apr 29 19:05:41 devstack sudo[92400]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 19:05:41 devstack cinder-volume[84538]: DEBUG cinder.coordination [None req-e2f1815e-5ce5-4cc1-8a80-7b3e49066961 tempest-CreateVolumesFromImageTest-547880467 None] Acquiring lock "cinder-beed7bb7-d093-47d6-9b2a-a9797cb45c84-delete_volume" by "delete_volume" {{(pid=84538) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 19:05:41 devstack cinder-volume[84538]: DEBUG cinder.coordination [None req-e2f1815e-5ce5-4cc1-8a80-7b3e49066961 tempest-CreateVolumesFromImageTest-547880467 None] Lock "cinder-beed7bb7-d093-47d6-9b2a-a9797cb45c84-delete_volume" acquired by "delete_volume" :: waited 0.035s {{(pid=84538) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 19:05:42 devstack cinder-volume[84538]: DEBUG cinder.coordination [None req-e2f1815e-5ce5-4cc1-8a80-7b3e49066961 tempest-CreateVolumesFromImageTest-547880467 None] Acquiring lock "cinder-quobyte-beed7bb7-d093-47d6-9b2a-a9797cb45c84" by "delete_volume" {{(pid=84538) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 19:05:42 devstack cinder-volume[84538]: DEBUG cinder.coordination [None req-e2f1815e-5ce5-4cc1-8a80-7b3e49066961 tempest-CreateVolumesFromImageTest-547880467 None] Lock "cinder-quobyte-beed7bb7-d093-47d6-9b2a-a9797cb45c84" acquired by "delete_volume" :: waited 0.035s {{(pid=84538) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 19:05:42 devstack cinder-volume[84538]: DEBUG oslo.privsep.daemon [-] privsep: reply[47105020-e88a-4868-96ed-5f0d33fe033f]: (4, 'qcow2') {{(pid=85803) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 19:05:42 devstack cinder-volume[84538]: DEBUG oslo_concurrency.processutils [None req-e2f1815e-5ce5-4cc1-8a80-7b3e49066961 tempest-CreateVolumesFromImageTest-547880467 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-beed7bb7-d093-47d6-9b2a-a9797cb45c84 {{(pid=84538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 19:05:42 devstack sudo[92396]: pam_unix(sudo:session): session closed for user root Apr 29 19:05:42 devstack cinder-volume[84538]: DEBUG oslo_concurrency.processutils [None req-012a1325-d697-4100-8cbe-df2bdf3a719d tempest-VolumesExtendTest-451302124 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d" returned: 0 in 0.656s {{(pid=84538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 19:05:42 devstack cinder-volume[84538]: DEBUG cinder.manager [None req-012a1325-d697-4100-8cbe-df2bdf3a719d tempest-VolumesExtendTest-451302124 None] Notifying Schedulers of capabilities ... {{(pid=84538) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 29 19:05:42 devstack cinder-volume[84538]: INFO cinder.volume.manager [None req-012a1325-d697-4100-8cbe-df2bdf3a719d tempest-VolumesExtendTest-451302124 None] Deleted volume successfully. Apr 29 19:05:42 devstack cinder-volume[84538]: DEBUG cinder.coordination [None req-012a1325-d697-4100-8cbe-df2bdf3a719d tempest-VolumesExtendTest-451302124 None] Lock "cinder-6b9ca0e6-2b0f-40a7-908b-ee6d4f7f7489-delete_volume" released by "delete_volume" :: held 3.276s {{(pid=84538) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 19:05:42 devstack sudo[92403]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-beed7bb7-d093-47d6-9b2a-a9797cb45c84 Apr 29 19:05:42 devstack sudo[92403]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 19:05:42 devstack sudo[92397]: pam_unix(sudo:session): session closed for user root Apr 29 19:05:42 devstack cinder-volume[84538]: DEBUG oslo_concurrency.processutils [None req-40628df0-4e46-467d-9373-bf7ca0c143cc tempest-CreateVolumesFromImageTest-547880467 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d" returned: 0 in 0.849s {{(pid=84538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 19:05:42 devstack cinder-volume[84538]: DEBUG cinder.manager [None req-40628df0-4e46-467d-9373-bf7ca0c143cc tempest-CreateVolumesFromImageTest-547880467 None] Notifying Schedulers of capabilities ... {{(pid=84538) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 29 19:05:42 devstack cinder-volume[84538]: INFO cinder.volume.manager [None req-40628df0-4e46-467d-9373-bf7ca0c143cc tempest-CreateVolumesFromImageTest-547880467 None] Deleted volume successfully. Apr 29 19:05:42 devstack cinder-volume[84538]: DEBUG cinder.coordination [None req-40628df0-4e46-467d-9373-bf7ca0c143cc tempest-CreateVolumesFromImageTest-547880467 None] Lock "cinder-a4e2f0da-8600-4cd3-8ae0-7552b7bc3f49-delete_volume" released by "delete_volume" :: held 2.638s {{(pid=84538) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 19:05:42 devstack sudo[92400]: pam_unix(sudo:session): session closed for user root Apr 29 19:05:42 devstack cinder-volume[84538]: DEBUG oslo_concurrency.processutils [None req-d3490b6e-d01b-4367-9550-944d9f952f33 tempest-VolumesSnapshotListTestJSON-317057059 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-1387f25c-dfd4-4f52-beab-27cf8a1036b3" returned: 0 in 0.913s {{(pid=84538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 19:05:42 devstack cinder-volume[84538]: DEBUG oslo_concurrency.processutils [None req-d3490b6e-d01b-4367-9550-944d9f952f33 tempest-VolumesSnapshotListTestJSON-317057059 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-1387f25c-dfd4-4f52-beab-27cf8a1036b3,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-1387f25c-dfd4-4f52-beab-27cf8a1036b3.836c5cf9-432f-46db-a134-1c1b3e799d42 1G {{(pid=84538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 19:05:42 devstack sudo[92410]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-1387f25c-dfd4-4f52-beab-27cf8a1036b3,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-1387f25c-dfd4-4f52-beab-27cf8a1036b3.836c5cf9-432f-46db-a134-1c1b3e799d42 1G Apr 29 19:05:42 devstack sudo[92410]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 19:05:42 devstack cinder-volume[84538]: DEBUG cinder.volume.flows.manager.create_volume [None req-8625eff3-a3d5-4bb9-bd8a-4b680995435e tempest-VolumesExtendTest-451302124 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84538) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Apr 29 19:05:42 devstack cinder-volume[84538]: DEBUG cinder.volume.manager [None req-8625eff3-a3d5-4bb9-bd8a-4b680995435e tempest-VolumesExtendTest-451302124 None] Flow 'volume_create_manager' (b8aacc19-64ac-458b-8ce8-a63126ab95c4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84538) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 19:05:42 devstack cinder-volume[84538]: DEBUG cinder.volume.manager [None req-8625eff3-a3d5-4bb9-bd8a-4b680995435e tempest-VolumesExtendTest-451302124 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fe3c22b8-bba1-46fa-9172-6730fc214822) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 19:05:42 devstack cinder-volume[84538]: DEBUG cinder.volume.manager [None req-8625eff3-a3d5-4bb9-bd8a-4b680995435e tempest-VolumesExtendTest-451302124 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fe3c22b8-bba1-46fa-9172-6730fc214822) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-29T17:05:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-1024882860',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5aebb3fe-daab-4c3c-ab11-1603804e4ec7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e75c2db35d914882a975b826675987e5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T17:05:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T17:05:43Z,use_quota=True,user_id='865814330ca6407a83ca3897a4368e2b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(62b05900-93e3-4190-a88f-1d87324303d1),volume_type_id=62b05900-93e3-4190-a88f-1d87324303d1)' {{(pid=84538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 19:05:42 devstack cinder-volume[84538]: DEBUG cinder.volume.manager [None req-8625eff3-a3d5-4bb9-bd8a-4b680995435e tempest-VolumesExtendTest-451302124 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (70eab3c8-1b4f-45e9-9f5f-3cddc7218689) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 19:05:42 devstack cinder-volume[84538]: DEBUG cinder.volume.manager [None req-8625eff3-a3d5-4bb9-bd8a-4b680995435e tempest-VolumesExtendTest-451302124 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (70eab3c8-1b4f-45e9-9f5f-3cddc7218689) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 19:05:42 devstack cinder-volume[84538]: DEBUG cinder.volume.manager [None req-8625eff3-a3d5-4bb9-bd8a-4b680995435e tempest-VolumesExtendTest-451302124 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bcdb534a-901a-4b5a-a30c-bec73c7ca8d6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 19:05:42 devstack cinder-volume[84538]: DEBUG cinder.volume.manager [None req-8625eff3-a3d5-4bb9-bd8a-4b680995435e tempest-VolumesExtendTest-451302124 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bcdb534a-901a-4b5a-a30c-bec73c7ca8d6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5aebb3fe-daab-4c3c-ab11-1603804e4ec7', 'volume_name': 'volume-5aebb3fe-daab-4c3c-ab11-1603804e4ec7', 'volume_size': 1}' {{(pid=84538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 19:05:42 devstack cinder-volume[84538]: DEBUG cinder.volume.manager [None req-8625eff3-a3d5-4bb9-bd8a-4b680995435e tempest-VolumesExtendTest-451302124 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2e7ac619-d7d3-4c9b-a48f-e9bfba300320) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 19:05:42 devstack cinder-volume[84538]: DEBUG cinder.volume.manager [None req-8625eff3-a3d5-4bb9-bd8a-4b680995435e tempest-VolumesExtendTest-451302124 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2e7ac619-d7d3-4c9b-a48f-e9bfba300320) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 19:05:42 devstack cinder-volume[84538]: DEBUG cinder.volume.manager [None req-8625eff3-a3d5-4bb9-bd8a-4b680995435e tempest-VolumesExtendTest-451302124 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cc5b8100-4804-4e05-9e06-a25871637637) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 19:05:42 devstack cinder-volume[84538]: INFO cinder.volume.flows.manager.create_volume [None req-8625eff3-a3d5-4bb9-bd8a-4b680995435e tempest-VolumesExtendTest-451302124 None] Volume 5aebb3fe-daab-4c3c-ab11-1603804e4ec7: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5aebb3fe-daab-4c3c-ab11-1603804e4ec7', 'volume_size': 1} Apr 29 19:05:42 devstack cinder-volume[84538]: DEBUG oslo_concurrency.lockutils [None req-8625eff3-a3d5-4bb9-bd8a-4b680995435e tempest-VolumesExtendTest-451302124 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 19:05:42 devstack sudo[92403]: pam_unix(sudo:session): session closed for user root Apr 29 19:05:42 devstack cinder-volume[84538]: DEBUG oslo_concurrency.processutils [None req-e2f1815e-5ce5-4cc1-8a80-7b3e49066961 tempest-CreateVolumesFromImageTest-547880467 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-beed7bb7-d093-47d6-9b2a-a9797cb45c84" returned: 0 in 0.862s {{(pid=84538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 19:05:42 devstack cinder-volume[84538]: DEBUG oslo_concurrency.processutils [None req-e2f1815e-5ce5-4cc1-8a80-7b3e49066961 tempest-CreateVolumesFromImageTest-547880467 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-beed7bb7-d093-47d6-9b2a-a9797cb45c84 {{(pid=84538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 19:05:42 devstack sudo[92415]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-beed7bb7-d093-47d6-9b2a-a9797cb45c84 Apr 29 19:05:42 devstack sudo[92415]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 19:05:43 devstack sudo[92410]: pam_unix(sudo:session): session closed for user root Apr 29 19:05:43 devstack cinder-volume[84538]: DEBUG oslo_concurrency.processutils [None req-d3490b6e-d01b-4367-9550-944d9f952f33 tempest-VolumesSnapshotListTestJSON-317057059 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-1387f25c-dfd4-4f52-beab-27cf8a1036b3,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-1387f25c-dfd4-4f52-beab-27cf8a1036b3.836c5cf9-432f-46db-a134-1c1b3e799d42 1G" returned: 0 in 0.834s {{(pid=84538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 19:05:43 devstack cinder-volume[84538]: DEBUG oslo_concurrency.processutils [None req-d3490b6e-d01b-4367-9550-944d9f952f33 tempest-VolumesSnapshotListTestJSON-317057059 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-1387f25c-dfd4-4f52-beab-27cf8a1036b3 -F qcow2 /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-1387f25c-dfd4-4f52-beab-27cf8a1036b3.836c5cf9-432f-46db-a134-1c1b3e799d42 {{(pid=84538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 19:05:43 devstack sudo[92420]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-1387f25c-dfd4-4f52-beab-27cf8a1036b3 -F qcow2 /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-1387f25c-dfd4-4f52-beab-27cf8a1036b3.836c5cf9-432f-46db-a134-1c1b3e799d42 Apr 29 19:05:43 devstack sudo[92420]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 19:05:43 devstack sudo[92415]: pam_unix(sudo:session): session closed for user root Apr 29 19:05:43 devstack cinder-volume[84538]: DEBUG oslo_concurrency.processutils [None req-e2f1815e-5ce5-4cc1-8a80-7b3e49066961 tempest-CreateVolumesFromImageTest-547880467 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-beed7bb7-d093-47d6-9b2a-a9797cb45c84" returned: 0 in 0.606s {{(pid=84538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 19:05:43 devstack cinder-volume[84538]: DEBUG cinder.coordination [None req-e2f1815e-5ce5-4cc1-8a80-7b3e49066961 tempest-CreateVolumesFromImageTest-547880467 None] Lock "cinder-quobyte-beed7bb7-d093-47d6-9b2a-a9797cb45c84" released by "delete_volume" :: held 1.525s {{(pid=84538) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 19:05:43 devstack cinder-volume[84538]: DEBUG cinder.quota [None req-e2f1815e-5ce5-4cc1-8a80-7b3e49066961 tempest-CreateVolumesFromImageTest-547880467 None] Created reservations ['4b13e298-48d2-41c4-9a92-700ed9a3ca18', '57fa95ec-66e8-480f-9996-7edd6fc5a5e2', '85b7d6d9-1c04-4265-a0a9-a26ac68e6969', 'fe85b085-bfa8-4a18-8226-05286c41cc53'] {{(pid=84538) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 29 19:05:43 devstack cinder-volume[84538]: DEBUG oslo_concurrency.lockutils [None req-e2f1815e-5ce5-4cc1-8a80-7b3e49066961 tempest-CreateVolumesFromImageTest-547880467 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 19:05:43 devstack cinder-volume[84538]: DEBUG oslo_concurrency.lockutils [None req-e2f1815e-5ce5-4cc1-8a80-7b3e49066961 tempest-CreateVolumesFromImageTest-547880467 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=84538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 19:05:43 devstack cinder-volume[84538]: DEBUG cinder.volume.drivers.quobyte [None req-e2f1815e-5ce5-4cc1-8a80-7b3e49066961 tempest-CreateVolumesFromImageTest-547880467 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-34312b00-dd6d-45bb-af98-75855cea8e48': None} {{(pid=84538) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 19:05:43 devstack cinder-volume[84538]: DEBUG cinder.volume.drivers.quobyte [None req-e2f1815e-5ce5-4cc1-8a80-7b3e49066961 tempest-CreateVolumesFromImageTest-547880467 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-34312b00-dd6d-45bb-af98-75855cea8e48'] {{(pid=84538) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 19:05:43 devstack cinder-volume[84538]: DEBUG oslo_concurrency.lockutils [None req-e2f1815e-5ce5-4cc1-8a80-7b3e49066961 tempest-CreateVolumesFromImageTest-547880467 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=84538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 19:05:43 devstack cinder-volume[84538]: DEBUG oslo_concurrency.processutils [None req-e2f1815e-5ce5-4cc1-8a80-7b3e49066961 tempest-CreateVolumesFromImageTest-547880467 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d {{(pid=84538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 19:05:43 devstack sudo[92423]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d Apr 29 19:05:43 devstack sudo[92423]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 19:05:43 devstack sudo[92420]: pam_unix(sudo:session): session closed for user root Apr 29 19:05:43 devstack cinder-volume[84538]: DEBUG oslo_concurrency.processutils [None req-d3490b6e-d01b-4367-9550-944d9f952f33 tempest-VolumesSnapshotListTestJSON-317057059 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-1387f25c-dfd4-4f52-beab-27cf8a1036b3 -F qcow2 /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-1387f25c-dfd4-4f52-beab-27cf8a1036b3.836c5cf9-432f-46db-a134-1c1b3e799d42" returned: 0 in 0.655s {{(pid=84538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 19:05:43 devstack cinder-volume[84538]: WARNING cinder.volume.drivers.remotefs [None req-d3490b6e-d01b-4367-9550-944d9f952f33 tempest-VolumesSnapshotListTestJSON-317057059 None] /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-1387f25c-dfd4-4f52-beab-27cf8a1036b3.836c5cf9-432f-46db-a134-1c1b3e799d42 is being set with open permissions: ugo+rw Apr 29 19:05:43 devstack cinder-volume[84538]: DEBUG oslo_concurrency.processutils [None req-d3490b6e-d01b-4367-9550-944d9f952f33 tempest-VolumesSnapshotListTestJSON-317057059 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-1387f25c-dfd4-4f52-beab-27cf8a1036b3.836c5cf9-432f-46db-a134-1c1b3e799d42 {{(pid=84538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 19:05:44 devstack sudo[92428]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-1387f25c-dfd4-4f52-beab-27cf8a1036b3.836c5cf9-432f-46db-a134-1c1b3e799d42 Apr 29 19:05:44 devstack sudo[92428]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 19:05:44 devstack cinder-volume[84538]: DEBUG cinder.coordination [None req-2e1ff0a9-f58d-49cd-ab65-80f1f55beb65 tempest-CreateVolumesFromImageTest-547880467 None] Acquiring lock "cinder-7a342f37-33ee-4408-a8ac-3a1eb8345e88-delete_volume" by "delete_volume" {{(pid=84538) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 19:05:44 devstack cinder-volume[84538]: DEBUG cinder.coordination [None req-2e1ff0a9-f58d-49cd-ab65-80f1f55beb65 tempest-CreateVolumesFromImageTest-547880467 None] Lock "cinder-7a342f37-33ee-4408-a8ac-3a1eb8345e88-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=84538) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 19:05:44 devstack cinder-volume[84538]: DEBUG cinder.coordination [None req-2e1ff0a9-f58d-49cd-ab65-80f1f55beb65 tempest-CreateVolumesFromImageTest-547880467 None] Acquiring lock "cinder-quobyte-7a342f37-33ee-4408-a8ac-3a1eb8345e88" by "delete_volume" {{(pid=84538) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 19:05:44 devstack cinder-volume[84538]: DEBUG cinder.coordination [None req-2e1ff0a9-f58d-49cd-ab65-80f1f55beb65 tempest-CreateVolumesFromImageTest-547880467 None] Lock "cinder-quobyte-7a342f37-33ee-4408-a8ac-3a1eb8345e88" acquired by "delete_volume" :: waited 0.017s {{(pid=84538) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 19:05:44 devstack cinder-volume[84538]: DEBUG oslo.privsep.daemon [-] privsep: reply[916a2dfc-5d3f-477b-99ee-d405f3541944]: (4, 'qcow2') {{(pid=85803) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 19:05:44 devstack cinder-volume[84538]: DEBUG oslo_concurrency.processutils [None req-2e1ff0a9-f58d-49cd-ab65-80f1f55beb65 tempest-CreateVolumesFromImageTest-547880467 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-7a342f37-33ee-4408-a8ac-3a1eb8345e88 {{(pid=84538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 19:05:44 devstack sudo[92423]: pam_unix(sudo:session): session closed for user root Apr 29 19:05:44 devstack cinder-volume[84538]: DEBUG oslo_concurrency.processutils [None req-e2f1815e-5ce5-4cc1-8a80-7b3e49066961 tempest-CreateVolumesFromImageTest-547880467 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d" returned: 0 in 0.689s {{(pid=84538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 19:05:44 devstack cinder-volume[84538]: DEBUG cinder.manager [None req-e2f1815e-5ce5-4cc1-8a80-7b3e49066961 tempest-CreateVolumesFromImageTest-547880467 None] Notifying Schedulers of capabilities ... {{(pid=84538) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 29 19:05:44 devstack cinder-volume[84538]: INFO cinder.volume.manager [None req-e2f1815e-5ce5-4cc1-8a80-7b3e49066961 tempest-CreateVolumesFromImageTest-547880467 None] Deleted volume successfully. Apr 29 19:05:44 devstack sudo[92431]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-7a342f37-33ee-4408-a8ac-3a1eb8345e88 Apr 29 19:05:44 devstack cinder-volume[84538]: DEBUG cinder.coordination [None req-e2f1815e-5ce5-4cc1-8a80-7b3e49066961 tempest-CreateVolumesFromImageTest-547880467 None] Lock "cinder-beed7bb7-d093-47d6-9b2a-a9797cb45c84-delete_volume" released by "delete_volume" :: held 2.507s {{(pid=84538) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 19:05:44 devstack sudo[92431]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 19:05:44 devstack sudo[92428]: pam_unix(sudo:session): session closed for user root Apr 29 19:05:44 devstack cinder-volume[84538]: DEBUG oslo_concurrency.processutils [None req-d3490b6e-d01b-4367-9550-944d9f952f33 tempest-VolumesSnapshotListTestJSON-317057059 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-1387f25c-dfd4-4f52-beab-27cf8a1036b3.836c5cf9-432f-46db-a134-1c1b3e799d42" returned: 0 in 0.678s {{(pid=84538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 19:05:44 devstack cinder-volume[84538]: DEBUG oslo_concurrency.processutils [None req-d3490b6e-d01b-4367-9550-944d9f952f33 tempest-VolumesSnapshotListTestJSON-317057059 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-1387f25c-dfd4-4f52-beab-27cf8a1036b3.info {{(pid=84538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 19:05:44 devstack sudo[92434]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-1387f25c-dfd4-4f52-beab-27cf8a1036b3.info Apr 29 19:05:44 devstack sudo[92434]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 19:05:45 devstack sudo[92431]: pam_unix(sudo:session): session closed for user root Apr 29 19:05:45 devstack cinder-volume[84538]: DEBUG oslo_concurrency.processutils [None req-2e1ff0a9-f58d-49cd-ab65-80f1f55beb65 tempest-CreateVolumesFromImageTest-547880467 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-7a342f37-33ee-4408-a8ac-3a1eb8345e88" returned: 0 in 0.761s {{(pid=84538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 19:05:45 devstack cinder-volume[84538]: DEBUG oslo_concurrency.processutils [None req-2e1ff0a9-f58d-49cd-ab65-80f1f55beb65 tempest-CreateVolumesFromImageTest-547880467 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-7a342f37-33ee-4408-a8ac-3a1eb8345e88 {{(pid=84538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 19:05:45 devstack sudo[92439]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-7a342f37-33ee-4408-a8ac-3a1eb8345e88 Apr 29 19:05:45 devstack sudo[92439]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 19:05:45 devstack sudo[92434]: pam_unix(sudo:session): session closed for user root Apr 29 19:05:45 devstack cinder-volume[84538]: DEBUG oslo_concurrency.processutils [None req-d3490b6e-d01b-4367-9550-944d9f952f33 tempest-VolumesSnapshotListTestJSON-317057059 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-1387f25c-dfd4-4f52-beab-27cf8a1036b3.info" returned: 0 in 0.620s {{(pid=84538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 19:05:45 devstack cinder-volume[84538]: WARNING cinder.volume.drivers.remotefs [None req-d3490b6e-d01b-4367-9550-944d9f952f33 tempest-VolumesSnapshotListTestJSON-317057059 None] /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-1387f25c-dfd4-4f52-beab-27cf8a1036b3.info is being set with open permissions: ugo+rw Apr 29 19:05:45 devstack cinder-volume[84538]: DEBUG oslo_concurrency.processutils [None req-d3490b6e-d01b-4367-9550-944d9f952f33 tempest-VolumesSnapshotListTestJSON-317057059 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-1387f25c-dfd4-4f52-beab-27cf8a1036b3.info {{(pid=84538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 19:05:45 devstack sudo[92442]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-1387f25c-dfd4-4f52-beab-27cf8a1036b3.info Apr 29 19:05:45 devstack sudo[92442]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 19:05:45 devstack sudo[92439]: pam_unix(sudo:session): session closed for user root Apr 29 19:05:45 devstack cinder-volume[84538]: DEBUG oslo_concurrency.processutils [None req-2e1ff0a9-f58d-49cd-ab65-80f1f55beb65 tempest-CreateVolumesFromImageTest-547880467 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-7a342f37-33ee-4408-a8ac-3a1eb8345e88" returned: 0 in 0.592s {{(pid=84538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 19:05:45 devstack cinder-volume[84538]: DEBUG cinder.coordination [None req-2e1ff0a9-f58d-49cd-ab65-80f1f55beb65 tempest-CreateVolumesFromImageTest-547880467 None] Lock "cinder-quobyte-7a342f37-33ee-4408-a8ac-3a1eb8345e88" released by "delete_volume" :: held 1.405s {{(pid=84538) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 19:05:45 devstack cinder-volume[84538]: DEBUG dbcounter [-] [84538] Writing DB stats cinder:SELECT=126,cinder:UPDATE=156,cinder:INSERT=51,cinder:DELETE=17 {{(pid=84538) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Apr 29 19:05:45 devstack cinder-volume[84538]: DEBUG dbcounter [-] [84538] Writing DB stats cinder:SELECT=127,cinder:UPDATE=174,cinder:DELETE=12,cinder:INSERT=38 {{(pid=84538) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Apr 29 19:05:45 devstack cinder-volume[84538]: DEBUG cinder.quota [None req-2e1ff0a9-f58d-49cd-ab65-80f1f55beb65 tempest-CreateVolumesFromImageTest-547880467 None] Created reservations ['9a9d90ab-2166-42c0-9086-e2f1df286606', 'a78cd2dd-ea9e-43d3-90a5-dc21ce8168ad', '84eddffb-28f0-426f-bbb6-dc69f9348121', '36b1d1eb-b70b-4f1b-af96-97f12e43e97a'] {{(pid=84538) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 29 19:05:45 devstack cinder-volume[84538]: DEBUG oslo_concurrency.lockutils [None req-2e1ff0a9-f58d-49cd-ab65-80f1f55beb65 tempest-CreateVolumesFromImageTest-547880467 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 19:05:45 devstack cinder-volume[84538]: DEBUG oslo_concurrency.lockutils [None req-2e1ff0a9-f58d-49cd-ab65-80f1f55beb65 tempest-CreateVolumesFromImageTest-547880467 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 19:05:45 devstack cinder-volume[84538]: DEBUG cinder.volume.drivers.quobyte [None req-2e1ff0a9-f58d-49cd-ab65-80f1f55beb65 tempest-CreateVolumesFromImageTest-547880467 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-34312b00-dd6d-45bb-af98-75855cea8e48': None} {{(pid=84538) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 19:05:45 devstack cinder-volume[84538]: DEBUG cinder.volume.drivers.quobyte [None req-2e1ff0a9-f58d-49cd-ab65-80f1f55beb65 tempest-CreateVolumesFromImageTest-547880467 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-34312b00-dd6d-45bb-af98-75855cea8e48'] {{(pid=84538) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 19:05:45 devstack cinder-volume[84538]: DEBUG oslo_concurrency.lockutils [None req-2e1ff0a9-f58d-49cd-ab65-80f1f55beb65 tempest-CreateVolumesFromImageTest-547880467 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=84538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 19:05:45 devstack cinder-volume[84538]: DEBUG oslo_concurrency.processutils [None req-2e1ff0a9-f58d-49cd-ab65-80f1f55beb65 tempest-CreateVolumesFromImageTest-547880467 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d {{(pid=84538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 19:05:45 devstack sudo[92446]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d Apr 29 19:05:45 devstack sudo[92446]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 19:05:45 devstack sudo[92442]: pam_unix(sudo:session): session closed for user root Apr 29 19:05:45 devstack cinder-volume[84538]: DEBUG oslo_concurrency.processutils [None req-d3490b6e-d01b-4367-9550-944d9f952f33 tempest-VolumesSnapshotListTestJSON-317057059 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-1387f25c-dfd4-4f52-beab-27cf8a1036b3.info" returned: 0 in 0.599s {{(pid=84538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 19:05:45 devstack cinder-volume[84538]: DEBUG oslo_concurrency.lockutils [None req-d3490b6e-d01b-4367-9550-944d9f952f33 tempest-VolumesSnapshotListTestJSON-317057059 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.398s {{(pid=84538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 19:05:45 devstack cinder-volume[84538]: DEBUG oslo_concurrency.lockutils [None req-8625eff3-a3d5-4bb9-bd8a-4b680995435e tempest-VolumesExtendTest-451302124 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.160s {{(pid=84538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 19:05:45 devstack cinder-volume[84538]: DEBUG cinder.volume.drivers.quobyte [None req-8625eff3-a3d5-4bb9-bd8a-4b680995435e tempest-VolumesExtendTest-451302124 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-29T17:05:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-1024882860',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5aebb3fe-daab-4c3c-ab11-1603804e4ec7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e75c2db35d914882a975b826675987e5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T17:05:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T17:05:43Z,use_quota=True,user_id='865814330ca6407a83ca3897a4368e2b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(62b05900-93e3-4190-a88f-1d87324303d1),volume_type_id=62b05900-93e3-4190-a88f-1d87324303d1)}" {{(pid=84538) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 29 19:05:45 devstack cinder-volume[84538]: DEBUG cinder.volume.drivers.remotefs [None req-8625eff3-a3d5-4bb9-bd8a-4b680995435e tempest-VolumesExtendTest-451302124 None] Creating volume 5aebb3fe-daab-4c3c-ab11-1603804e4ec7 {{(pid=84538) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 29 19:05:45 devstack cinder-volume[84538]: DEBUG oslo_concurrency.lockutils [None req-8625eff3-a3d5-4bb9-bd8a-4b680995435e tempest-VolumesExtendTest-451302124 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 19:05:45 devstack cinder-volume[84538]: DEBUG oslo_concurrency.lockutils [None req-8625eff3-a3d5-4bb9-bd8a-4b680995435e tempest-VolumesExtendTest-451302124 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=84538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 19:05:45 devstack cinder-volume[84538]: DEBUG cinder.volume.drivers.quobyte [None req-8625eff3-a3d5-4bb9-bd8a-4b680995435e tempest-VolumesExtendTest-451302124 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-34312b00-dd6d-45bb-af98-75855cea8e48': None} {{(pid=84538) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 19:05:45 devstack cinder-volume[84538]: DEBUG cinder.volume.drivers.quobyte [None req-8625eff3-a3d5-4bb9-bd8a-4b680995435e tempest-VolumesExtendTest-451302124 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-34312b00-dd6d-45bb-af98-75855cea8e48'] {{(pid=84538) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 19:05:45 devstack cinder-volume[84538]: DEBUG oslo_concurrency.lockutils [None req-8625eff3-a3d5-4bb9-bd8a-4b680995435e tempest-VolumesExtendTest-451302124 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=84538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 19:05:45 devstack cinder-volume[84538]: DEBUG cinder.volume.drivers.quobyte [None req-8625eff3-a3d5-4bb9-bd8a-4b680995435e tempest-VolumesExtendTest-451302124 None] Selected osci02.corp.quobyte.com/cinder-vol-34312b00-dd6d-45bb-af98-75855cea8e48 as target Quobyte volume. {{(pid=84538) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 29 19:05:45 devstack cinder-volume[84538]: INFO cinder.volume.drivers.remotefs [None req-8625eff3-a3d5-4bb9-bd8a-4b680995435e tempest-VolumesExtendTest-451302124 None] casted to osci02.corp.quobyte.com/cinder-vol-34312b00-dd6d-45bb-af98-75855cea8e48 Apr 29 19:05:45 devstack cinder-volume[84538]: DEBUG oslo_concurrency.processutils [None req-8625eff3-a3d5-4bb9-bd8a-4b680995435e tempest-VolumesExtendTest-451302124 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-5aebb3fe-daab-4c3c-ab11-1603804e4ec7 1073741824 {{(pid=84538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 19:05:45 devstack sudo[92448]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-5aebb3fe-daab-4c3c-ab11-1603804e4ec7 1073741824 Apr 29 19:05:45 devstack sudo[92448]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 19:05:45 devstack cinder-volume[84538]: INFO cinder.volume.manager [None req-d3490b6e-d01b-4367-9550-944d9f952f33 tempest-VolumesSnapshotListTestJSON-317057059 None] Create snapshot completed successfully Apr 29 19:05:46 devstack sudo[92446]: pam_unix(sudo:session): session closed for user root Apr 29 19:05:46 devstack cinder-volume[84538]: DEBUG oslo_concurrency.processutils [None req-2e1ff0a9-f58d-49cd-ab65-80f1f55beb65 tempest-CreateVolumesFromImageTest-547880467 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d" returned: 0 in 0.606s {{(pid=84538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 19:05:46 devstack cinder-volume[84538]: DEBUG cinder.manager [None req-2e1ff0a9-f58d-49cd-ab65-80f1f55beb65 tempest-CreateVolumesFromImageTest-547880467 None] Notifying Schedulers of capabilities ... {{(pid=84538) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 29 19:05:46 devstack cinder-volume[84538]: DEBUG cinder.coordination [None req-5367a959-e0d9-4359-acb5-1205420fcc73 tempest-CreateVolumesFromImageTest-547880467 None] Acquiring lock "cinder-758a3766-3e9b-45d1-9556-c48a7e8f5d1b-delete_volume" by "delete_volume" {{(pid=84538) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 19:05:46 devstack cinder-volume[84538]: INFO cinder.volume.manager [None req-2e1ff0a9-f58d-49cd-ab65-80f1f55beb65 tempest-CreateVolumesFromImageTest-547880467 None] Deleted volume successfully. Apr 29 19:05:46 devstack cinder-volume[84538]: DEBUG cinder.coordination [None req-5367a959-e0d9-4359-acb5-1205420fcc73 tempest-CreateVolumesFromImageTest-547880467 None] Lock "cinder-758a3766-3e9b-45d1-9556-c48a7e8f5d1b-delete_volume" acquired by "delete_volume" :: waited 0.034s {{(pid=84538) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 19:05:46 devstack cinder-volume[84538]: DEBUG cinder.coordination [None req-2e1ff0a9-f58d-49cd-ab65-80f1f55beb65 tempest-CreateVolumesFromImageTest-547880467 None] Lock "cinder-7a342f37-33ee-4408-a8ac-3a1eb8345e88-delete_volume" released by "delete_volume" :: held 2.272s {{(pid=84538) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 19:05:46 devstack cinder-volume[84538]: DEBUG cinder.coordination [None req-5367a959-e0d9-4359-acb5-1205420fcc73 tempest-CreateVolumesFromImageTest-547880467 None] Acquiring lock "cinder-quobyte-758a3766-3e9b-45d1-9556-c48a7e8f5d1b" by "delete_volume" {{(pid=84538) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 19:05:46 devstack cinder-volume[84538]: DEBUG cinder.coordination [None req-5367a959-e0d9-4359-acb5-1205420fcc73 tempest-CreateVolumesFromImageTest-547880467 None] Lock "cinder-quobyte-758a3766-3e9b-45d1-9556-c48a7e8f5d1b" acquired by "delete_volume" :: waited 0.014s {{(pid=84538) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 19:05:46 devstack cinder-volume[84538]: DEBUG oslo.privsep.daemon [-] privsep: reply[298ac761-aa89-4469-943b-bd6437ce28e1]: (4, 'qcow2') {{(pid=85803) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 19:05:46 devstack cinder-volume[84538]: DEBUG oslo_concurrency.processutils [None req-5367a959-e0d9-4359-acb5-1205420fcc73 tempest-CreateVolumesFromImageTest-547880467 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-758a3766-3e9b-45d1-9556-c48a7e8f5d1b {{(pid=84538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 19:05:46 devstack sudo[92488]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-758a3766-3e9b-45d1-9556-c48a7e8f5d1b Apr 29 19:05:46 devstack sudo[92488]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 19:05:46 devstack sudo[92448]: pam_unix(sudo:session): session closed for user root Apr 29 19:05:46 devstack cinder-volume[84538]: DEBUG oslo_concurrency.processutils [None req-8625eff3-a3d5-4bb9-bd8a-4b680995435e tempest-VolumesExtendTest-451302124 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-5aebb3fe-daab-4c3c-ab11-1603804e4ec7 1073741824" returned: 0 in 0.980s {{(pid=84538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 19:05:46 devstack cinder-volume[84538]: DEBUG oslo_concurrency.lockutils [None req-5402183c-9b36-41fd-9fd6-9ee0c524b2d7 tempest-VolumesSnapshotListTestJSON-317057059 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=84538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 19:05:46 devstack cinder-volume[84538]: DEBUG oslo_concurrency.processutils [None req-8625eff3-a3d5-4bb9-bd8a-4b680995435e tempest-VolumesExtendTest-451302124 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-5aebb3fe-daab-4c3c-ab11-1603804e4ec7 {{(pid=84538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 19:05:47 devstack sudo[92492]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-5aebb3fe-daab-4c3c-ab11-1603804e4ec7 Apr 29 19:05:47 devstack sudo[92492]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 19:05:47 devstack sudo[92488]: pam_unix(sudo:session): session closed for user root Apr 29 19:05:47 devstack cinder-volume[84538]: DEBUG oslo_concurrency.processutils [None req-5367a959-e0d9-4359-acb5-1205420fcc73 tempest-CreateVolumesFromImageTest-547880467 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-758a3766-3e9b-45d1-9556-c48a7e8f5d1b" returned: 0 in 0.859s {{(pid=84538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 19:05:47 devstack cinder-volume[84538]: DEBUG oslo_concurrency.processutils [None req-5367a959-e0d9-4359-acb5-1205420fcc73 tempest-CreateVolumesFromImageTest-547880467 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-758a3766-3e9b-45d1-9556-c48a7e8f5d1b {{(pid=84538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 19:05:47 devstack sudo[92497]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-758a3766-3e9b-45d1-9556-c48a7e8f5d1b Apr 29 19:05:47 devstack sudo[92497]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 19:05:47 devstack sudo[92492]: pam_unix(sudo:session): session closed for user root Apr 29 19:05:47 devstack cinder-volume[84538]: DEBUG oslo_concurrency.processutils [None req-8625eff3-a3d5-4bb9-bd8a-4b680995435e tempest-VolumesExtendTest-451302124 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-5aebb3fe-daab-4c3c-ab11-1603804e4ec7" returned: 0 in 0.649s {{(pid=84538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 19:05:47 devstack cinder-volume[84538]: DEBUG cinder.volume.drivers.quobyte [None req-8625eff3-a3d5-4bb9-bd8a-4b680995435e tempest-VolumesExtendTest-451302124 None] <== create_volume: return (1694ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-34312b00-dd6d-45bb-af98-75855cea8e48'} {{(pid=84538) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 29 19:05:47 devstack cinder-volume[84538]: DEBUG oslo_concurrency.lockutils [None req-8625eff3-a3d5-4bb9-bd8a-4b680995435e tempest-VolumesExtendTest-451302124 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.697s {{(pid=84538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 19:05:47 devstack cinder-volume[84538]: DEBUG oslo_concurrency.lockutils [None req-5402183c-9b36-41fd-9fd6-9ee0c524b2d7 tempest-VolumesSnapshotListTestJSON-317057059 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.662s {{(pid=84538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 19:05:47 devstack cinder-volume[84538]: DEBUG cinder.volume.drivers.remotefs [None req-5402183c-9b36-41fd-9fd6-9ee0c524b2d7 tempest-VolumesSnapshotListTestJSON-317057059 None] Creating offline snapshot ff59994d-ced0-4c35-828f-5d485995c96f of volume 1387f25c-dfd4-4f52-beab-27cf8a1036b3 {{(pid=84538) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}} Apr 29 19:05:47 devstack cinder-volume[84538]: DEBUG cinder.volume.manager [None req-8625eff3-a3d5-4bb9-bd8a-4b680995435e tempest-VolumesExtendTest-451302124 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cc5b8100-4804-4e05-9e06-a25871637637) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5aebb3fe-daab-4c3c-ab11-1603804e4ec7', 'volume_size': 1}' {{(pid=84538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 19:05:47 devstack cinder-volume[84538]: DEBUG cinder.volume.manager [None req-8625eff3-a3d5-4bb9-bd8a-4b680995435e tempest-VolumesExtendTest-451302124 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (352cd594-2d08-428f-a5a5-a7b53533c4dc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 19:05:47 devstack cinder-volume[84538]: DEBUG oslo.privsep.daemon [-] privsep: reply[05393d73-bef1-4ecf-bf8d-248124dfa7b3]: (4, 'qcow2') {{(pid=85803) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 19:05:47 devstack cinder-volume[84538]: DEBUG oslo_concurrency.processutils [None req-5402183c-9b36-41fd-9fd6-9ee0c524b2d7 tempest-VolumesSnapshotListTestJSON-317057059 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-1387f25c-dfd4-4f52-beab-27cf8a1036b3.836c5cf9-432f-46db-a134-1c1b3e799d42 {{(pid=84538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 19:05:47 devstack cinder-volume[84538]: INFO cinder.volume.flows.manager.create_volume [None req-8625eff3-a3d5-4bb9-bd8a-4b680995435e tempest-VolumesExtendTest-451302124 None] Volume volume-5aebb3fe-daab-4c3c-ab11-1603804e4ec7 (5aebb3fe-daab-4c3c-ab11-1603804e4ec7): created successfully Apr 29 19:05:47 devstack cinder-volume[84538]: DEBUG cinder.volume.manager [None req-8625eff3-a3d5-4bb9-bd8a-4b680995435e tempest-VolumesExtendTest-451302124 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (352cd594-2d08-428f-a5a5-a7b53533c4dc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 19:05:47 devstack cinder-volume[84538]: DEBUG cinder.volume.manager [None req-8625eff3-a3d5-4bb9-bd8a-4b680995435e tempest-VolumesExtendTest-451302124 None] Flow 'volume_create_manager' (b8aacc19-64ac-458b-8ce8-a63126ab95c4) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84538) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 19:05:47 devstack cinder-volume[84538]: INFO cinder.volume.manager [None req-8625eff3-a3d5-4bb9-bd8a-4b680995435e tempest-VolumesExtendTest-451302124 None] Created volume successfully. Apr 29 19:05:47 devstack sudo[92500]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-1387f25c-dfd4-4f52-beab-27cf8a1036b3.836c5cf9-432f-46db-a134-1c1b3e799d42 Apr 29 19:05:47 devstack sudo[92500]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 19:05:48 devstack sudo[92497]: pam_unix(sudo:session): session closed for user root Apr 29 19:05:48 devstack cinder-volume[84538]: DEBUG oslo_concurrency.processutils [None req-5367a959-e0d9-4359-acb5-1205420fcc73 tempest-CreateVolumesFromImageTest-547880467 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-758a3766-3e9b-45d1-9556-c48a7e8f5d1b" returned: 0 in 0.662s {{(pid=84538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 19:05:48 devstack cinder-volume[84538]: DEBUG cinder.coordination [None req-5367a959-e0d9-4359-acb5-1205420fcc73 tempest-CreateVolumesFromImageTest-547880467 None] Lock "cinder-quobyte-758a3766-3e9b-45d1-9556-c48a7e8f5d1b" released by "delete_volume" :: held 1.573s {{(pid=84538) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 19:05:48 devstack cinder-volume[84538]: DEBUG cinder.quota [None req-5367a959-e0d9-4359-acb5-1205420fcc73 tempest-CreateVolumesFromImageTest-547880467 None] Created reservations ['9c1e3f47-2eff-47b6-bf21-5852447111db', '92d913bb-5f7b-41d8-9f0f-15174d700498', 'c3258013-816a-43eb-ae0d-5dbe4613125d', 'e094497e-448b-45c3-aaa1-51b266e3df4b'] {{(pid=84538) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 29 19:05:48 devstack cinder-volume[84538]: DEBUG oslo_concurrency.lockutils [None req-bd16fcea-c708-468f-9c3c-9cbea21217cd tempest-VolumesExtendTest-451302124 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=84538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 19:05:48 devstack cinder-volume[84538]: DEBUG oslo_concurrency.lockutils [None req-5367a959-e0d9-4359-acb5-1205420fcc73 tempest-CreateVolumesFromImageTest-547880467 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 19:05:48 devstack cinder-volume[84538]: DEBUG oslo_concurrency.lockutils [None req-5367a959-e0d9-4359-acb5-1205420fcc73 tempest-CreateVolumesFromImageTest-547880467 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 19:05:48 devstack cinder-volume[84538]: DEBUG cinder.volume.drivers.quobyte [None req-5367a959-e0d9-4359-acb5-1205420fcc73 tempest-CreateVolumesFromImageTest-547880467 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-34312b00-dd6d-45bb-af98-75855cea8e48': None} {{(pid=84538) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 19:05:48 devstack cinder-volume[84538]: DEBUG cinder.volume.drivers.quobyte [None req-5367a959-e0d9-4359-acb5-1205420fcc73 tempest-CreateVolumesFromImageTest-547880467 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-34312b00-dd6d-45bb-af98-75855cea8e48'] {{(pid=84538) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 19:05:48 devstack cinder-volume[84538]: DEBUG oslo_concurrency.lockutils [None req-5367a959-e0d9-4359-acb5-1205420fcc73 tempest-CreateVolumesFromImageTest-547880467 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=84538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 19:05:48 devstack cinder-volume[84538]: DEBUG oslo_concurrency.processutils [None req-5367a959-e0d9-4359-acb5-1205420fcc73 tempest-CreateVolumesFromImageTest-547880467 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d {{(pid=84538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 19:05:48 devstack sudo[92503]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d Apr 29 19:05:48 devstack sudo[92503]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 19:05:48 devstack sudo[92500]: pam_unix(sudo:session): session closed for user root Apr 29 19:05:48 devstack cinder-volume[84538]: DEBUG oslo_concurrency.processutils [None req-5402183c-9b36-41fd-9fd6-9ee0c524b2d7 tempest-VolumesSnapshotListTestJSON-317057059 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-1387f25c-dfd4-4f52-beab-27cf8a1036b3.836c5cf9-432f-46db-a134-1c1b3e799d42" returned: 0 in 0.750s {{(pid=84538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 19:05:48 devstack cinder-volume[84538]: DEBUG cinder.volume.drivers.remotefs [None req-5402183c-9b36-41fd-9fd6-9ee0c524b2d7 tempest-VolumesSnapshotListTestJSON-317057059 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-1387f25c-dfd4-4f52-beab-27cf8a1036b3(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=84538) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 29 19:05:48 devstack cinder-volume[84538]: DEBUG oslo_concurrency.processutils [None req-5402183c-9b36-41fd-9fd6-9ee0c524b2d7 tempest-VolumesSnapshotListTestJSON-317057059 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-1387f25c-dfd4-4f52-beab-27cf8a1036b3.836c5cf9-432f-46db-a134-1c1b3e799d42,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-1387f25c-dfd4-4f52-beab-27cf8a1036b3.ff59994d-ced0-4c35-828f-5d485995c96f 1G {{(pid=84538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 19:05:48 devstack sudo[92509]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-1387f25c-dfd4-4f52-beab-27cf8a1036b3.836c5cf9-432f-46db-a134-1c1b3e799d42,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-1387f25c-dfd4-4f52-beab-27cf8a1036b3.ff59994d-ced0-4c35-828f-5d485995c96f 1G Apr 29 19:05:48 devstack sudo[92509]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 19:05:48 devstack sudo[92503]: pam_unix(sudo:session): session closed for user root Apr 29 19:05:48 devstack cinder-volume[84538]: DEBUG oslo_concurrency.processutils [None req-5367a959-e0d9-4359-acb5-1205420fcc73 tempest-CreateVolumesFromImageTest-547880467 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d" returned: 0 in 0.643s {{(pid=84538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 19:05:48 devstack cinder-volume[84538]: DEBUG cinder.manager [None req-5367a959-e0d9-4359-acb5-1205420fcc73 tempest-CreateVolumesFromImageTest-547880467 None] Notifying Schedulers of capabilities ... {{(pid=84538) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 29 19:05:48 devstack cinder-volume[84538]: INFO cinder.volume.manager [None req-5367a959-e0d9-4359-acb5-1205420fcc73 tempest-CreateVolumesFromImageTest-547880467 None] Deleted volume successfully. Apr 29 19:05:48 devstack cinder-volume[84538]: DEBUG cinder.coordination [None req-5367a959-e0d9-4359-acb5-1205420fcc73 tempest-CreateVolumesFromImageTest-547880467 None] Lock "cinder-758a3766-3e9b-45d1-9556-c48a7e8f5d1b-delete_volume" released by "delete_volume" :: held 2.517s {{(pid=84538) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 19:05:49 devstack sudo[92509]: pam_unix(sudo:session): session closed for user root Apr 29 19:05:49 devstack cinder-volume[84538]: DEBUG oslo_concurrency.processutils [None req-5402183c-9b36-41fd-9fd6-9ee0c524b2d7 tempest-VolumesSnapshotListTestJSON-317057059 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-1387f25c-dfd4-4f52-beab-27cf8a1036b3.836c5cf9-432f-46db-a134-1c1b3e799d42,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-1387f25c-dfd4-4f52-beab-27cf8a1036b3.ff59994d-ced0-4c35-828f-5d485995c96f 1G" returned: 0 in 0.908s {{(pid=84538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 19:05:49 devstack cinder-volume[84538]: DEBUG oslo_concurrency.processutils [None req-5402183c-9b36-41fd-9fd6-9ee0c524b2d7 tempest-VolumesSnapshotListTestJSON-317057059 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-1387f25c-dfd4-4f52-beab-27cf8a1036b3.836c5cf9-432f-46db-a134-1c1b3e799d42 -F qcow2 /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-1387f25c-dfd4-4f52-beab-27cf8a1036b3.ff59994d-ced0-4c35-828f-5d485995c96f {{(pid=84538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 19:05:49 devstack sudo[92516]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-1387f25c-dfd4-4f52-beab-27cf8a1036b3.836c5cf9-432f-46db-a134-1c1b3e799d42 -F qcow2 /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-1387f25c-dfd4-4f52-beab-27cf8a1036b3.ff59994d-ced0-4c35-828f-5d485995c96f Apr 29 19:05:49 devstack sudo[92516]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 19:05:50 devstack sudo[92516]: pam_unix(sudo:session): session closed for user root Apr 29 19:05:50 devstack cinder-volume[84538]: DEBUG oslo_concurrency.processutils [None req-5402183c-9b36-41fd-9fd6-9ee0c524b2d7 tempest-VolumesSnapshotListTestJSON-317057059 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-1387f25c-dfd4-4f52-beab-27cf8a1036b3.836c5cf9-432f-46db-a134-1c1b3e799d42 -F qcow2 /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-1387f25c-dfd4-4f52-beab-27cf8a1036b3.ff59994d-ced0-4c35-828f-5d485995c96f" returned: 0 in 0.723s {{(pid=84538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 19:05:50 devstack cinder-volume[84538]: WARNING cinder.volume.drivers.remotefs [None req-5402183c-9b36-41fd-9fd6-9ee0c524b2d7 tempest-VolumesSnapshotListTestJSON-317057059 None] /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-1387f25c-dfd4-4f52-beab-27cf8a1036b3.ff59994d-ced0-4c35-828f-5d485995c96f is being set with open permissions: ugo+rw Apr 29 19:05:50 devstack cinder-volume[84538]: DEBUG oslo_concurrency.processutils [None req-5402183c-9b36-41fd-9fd6-9ee0c524b2d7 tempest-VolumesSnapshotListTestJSON-317057059 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-1387f25c-dfd4-4f52-beab-27cf8a1036b3.ff59994d-ced0-4c35-828f-5d485995c96f {{(pid=84538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 19:05:50 devstack sudo[92522]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-1387f25c-dfd4-4f52-beab-27cf8a1036b3.ff59994d-ced0-4c35-828f-5d485995c96f Apr 29 19:05:50 devstack sudo[92522]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 19:05:50 devstack sudo[92522]: pam_unix(sudo:session): session closed for user root Apr 29 19:05:50 devstack cinder-volume[84538]: DEBUG oslo_concurrency.processutils [None req-5402183c-9b36-41fd-9fd6-9ee0c524b2d7 tempest-VolumesSnapshotListTestJSON-317057059 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-1387f25c-dfd4-4f52-beab-27cf8a1036b3.ff59994d-ced0-4c35-828f-5d485995c96f" returned: 0 in 0.613s {{(pid=84538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 19:05:50 devstack cinder-volume[84538]: DEBUG oslo_concurrency.lockutils [None req-5402183c-9b36-41fd-9fd6-9ee0c524b2d7 tempest-VolumesSnapshotListTestJSON-317057059 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.100s {{(pid=84538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 19:05:50 devstack cinder-volume[84538]: DEBUG oslo_concurrency.lockutils [None req-bd16fcea-c708-468f-9c3c-9cbea21217cd tempest-VolumesExtendTest-451302124 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 2.474s {{(pid=84538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 19:05:50 devstack cinder-volume[84538]: DEBUG cinder.volume.drivers.remotefs [None req-bd16fcea-c708-468f-9c3c-9cbea21217cd tempest-VolumesExtendTest-451302124 None] Creating offline snapshot 718e390c-4ce4-498c-995d-6e2a6f9d8fd6 of volume 5aebb3fe-daab-4c3c-ab11-1603804e4ec7 {{(pid=84538) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}} Apr 29 19:05:50 devstack cinder-volume[84538]: INFO cinder.volume.manager [None req-5402183c-9b36-41fd-9fd6-9ee0c524b2d7 tempest-VolumesSnapshotListTestJSON-317057059 None] Create snapshot completed successfully Apr 29 19:05:50 devstack cinder-volume[84538]: DEBUG oslo.privsep.daemon [-] privsep: reply[fea84e8c-924d-40e5-ac1c-b8b4deffca51]: (4, 'qcow2') {{(pid=85803) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 19:05:50 devstack cinder-volume[84538]: DEBUG oslo_concurrency.processutils [None req-bd16fcea-c708-468f-9c3c-9cbea21217cd tempest-VolumesExtendTest-451302124 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-5aebb3fe-daab-4c3c-ab11-1603804e4ec7 {{(pid=84538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 19:05:50 devstack sudo[92525]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-5aebb3fe-daab-4c3c-ab11-1603804e4ec7 Apr 29 19:05:50 devstack sudo[92525]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 19:05:51 devstack cinder-volume[84538]: DEBUG oslo_concurrency.lockutils [None req-c7e733e6-686d-48c9-add1-2b90b73053dd tempest-VolumesSnapshotListTestJSON-317057059 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=84538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 19:05:51 devstack sudo[92525]: pam_unix(sudo:session): session closed for user root Apr 29 19:05:51 devstack cinder-volume[84538]: DEBUG cinder.volume.flows.manager.create_volume [None req-dbfa4507-3f81-4f9d-899b-ebf17cd94892 tempest-CreateVolumesFromSourceVolumeTest-1124812184 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84538) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Apr 29 19:05:51 devstack cinder-volume[84538]: DEBUG cinder.volume.manager [None req-dbfa4507-3f81-4f9d-899b-ebf17cd94892 tempest-CreateVolumesFromSourceVolumeTest-1124812184 None] Flow 'volume_create_manager' (642a06bd-b5e4-46af-8156-96d4a3f9c70d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84538) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 19:05:51 devstack cinder-volume[84538]: DEBUG cinder.volume.manager [None req-dbfa4507-3f81-4f9d-899b-ebf17cd94892 tempest-CreateVolumesFromSourceVolumeTest-1124812184 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (de39c082-dd42-4fa5-aee4-d06d6760e4de) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 19:05:51 devstack cinder-volume[84538]: DEBUG oslo_concurrency.processutils [None req-bd16fcea-c708-468f-9c3c-9cbea21217cd tempest-VolumesExtendTest-451302124 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-5aebb3fe-daab-4c3c-ab11-1603804e4ec7" returned: 0 in 0.842s {{(pid=84538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 19:05:51 devstack cinder-volume[84538]: DEBUG oslo_concurrency.processutils [None req-bd16fcea-c708-468f-9c3c-9cbea21217cd tempest-VolumesExtendTest-451302124 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-5aebb3fe-daab-4c3c-ab11-1603804e4ec7,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-5aebb3fe-daab-4c3c-ab11-1603804e4ec7.718e390c-4ce4-498c-995d-6e2a6f9d8fd6 1G {{(pid=84538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 19:05:51 devstack sudo[92530]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-5aebb3fe-daab-4c3c-ab11-1603804e4ec7,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-5aebb3fe-daab-4c3c-ab11-1603804e4ec7.718e390c-4ce4-498c-995d-6e2a6f9d8fd6 1G Apr 29 19:05:51 devstack cinder-volume[84538]: DEBUG cinder.volume.manager [None req-dbfa4507-3f81-4f9d-899b-ebf17cd94892 tempest-CreateVolumesFromSourceVolumeTest-1124812184 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (de39c082-dd42-4fa5-aee4-d06d6760e4de) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-29T17:05:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1048206505',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=99bceec9-47e0-415c-9c51-fb7b781ae55a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f55552bb071a4e93ae2c788f38b4fe37',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T17:05:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T17:05:52Z,use_quota=True,user_id='9edcc640ca7040a5b9ecc3e6e1801af9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(62b05900-93e3-4190-a88f-1d87324303d1),volume_type_id=62b05900-93e3-4190-a88f-1d87324303d1)' {{(pid=84538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 19:05:51 devstack sudo[92530]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 19:05:51 devstack cinder-volume[84538]: DEBUG cinder.volume.manager [None req-dbfa4507-3f81-4f9d-899b-ebf17cd94892 tempest-CreateVolumesFromSourceVolumeTest-1124812184 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4b895e89-4e39-46b7-aac3-cf77828d04f3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 19:05:51 devstack cinder-volume[84538]: DEBUG cinder.volume.manager [None req-dbfa4507-3f81-4f9d-899b-ebf17cd94892 tempest-CreateVolumesFromSourceVolumeTest-1124812184 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4b895e89-4e39-46b7-aac3-cf77828d04f3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 19:05:51 devstack cinder-volume[84538]: DEBUG cinder.volume.manager [None req-dbfa4507-3f81-4f9d-899b-ebf17cd94892 tempest-CreateVolumesFromSourceVolumeTest-1124812184 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a1689b95-c452-4f62-b1eb-2ee9d3c7a6e5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 19:05:51 devstack cinder-volume[84538]: DEBUG cinder.volume.manager [None req-dbfa4507-3f81-4f9d-899b-ebf17cd94892 tempest-CreateVolumesFromSourceVolumeTest-1124812184 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a1689b95-c452-4f62-b1eb-2ee9d3c7a6e5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '99bceec9-47e0-415c-9c51-fb7b781ae55a', 'volume_name': 'volume-99bceec9-47e0-415c-9c51-fb7b781ae55a', 'volume_size': 1}' {{(pid=84538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 19:05:51 devstack cinder-volume[84538]: DEBUG cinder.volume.manager [None req-dbfa4507-3f81-4f9d-899b-ebf17cd94892 tempest-CreateVolumesFromSourceVolumeTest-1124812184 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (025cb0c1-61de-437e-a5ea-f3e055598aa3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 19:05:51 devstack cinder-volume[84538]: DEBUG cinder.volume.manager [None req-dbfa4507-3f81-4f9d-899b-ebf17cd94892 tempest-CreateVolumesFromSourceVolumeTest-1124812184 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (025cb0c1-61de-437e-a5ea-f3e055598aa3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 19:05:51 devstack cinder-volume[84538]: DEBUG cinder.volume.manager [None req-dbfa4507-3f81-4f9d-899b-ebf17cd94892 tempest-CreateVolumesFromSourceVolumeTest-1124812184 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (33d5ce05-a7d7-4284-a8e9-673d2ef5129e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 19:05:51 devstack cinder-volume[84538]: INFO cinder.volume.flows.manager.create_volume [None req-dbfa4507-3f81-4f9d-899b-ebf17cd94892 tempest-CreateVolumesFromSourceVolumeTest-1124812184 None] Volume 99bceec9-47e0-415c-9c51-fb7b781ae55a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-99bceec9-47e0-415c-9c51-fb7b781ae55a', 'volume_size': 1} Apr 29 19:05:51 devstack cinder-volume[84538]: DEBUG oslo_concurrency.lockutils [None req-dbfa4507-3f81-4f9d-899b-ebf17cd94892 tempest-CreateVolumesFromSourceVolumeTest-1124812184 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 19:05:52 devstack sudo[92530]: pam_unix(sudo:session): session closed for user root Apr 29 19:05:52 devstack cinder-volume[84538]: DEBUG oslo_concurrency.processutils [None req-bd16fcea-c708-468f-9c3c-9cbea21217cd tempest-VolumesExtendTest-451302124 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-5aebb3fe-daab-4c3c-ab11-1603804e4ec7,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-5aebb3fe-daab-4c3c-ab11-1603804e4ec7.718e390c-4ce4-498c-995d-6e2a6f9d8fd6 1G" returned: 0 in 0.772s {{(pid=84538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 19:05:52 devstack cinder-volume[84538]: DEBUG oslo_concurrency.processutils [None req-bd16fcea-c708-468f-9c3c-9cbea21217cd tempest-VolumesExtendTest-451302124 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-5aebb3fe-daab-4c3c-ab11-1603804e4ec7 -F qcow2 /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-5aebb3fe-daab-4c3c-ab11-1603804e4ec7.718e390c-4ce4-498c-995d-6e2a6f9d8fd6 {{(pid=84538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 19:05:52 devstack sudo[92535]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-5aebb3fe-daab-4c3c-ab11-1603804e4ec7 -F qcow2 /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-5aebb3fe-daab-4c3c-ab11-1603804e4ec7.718e390c-4ce4-498c-995d-6e2a6f9d8fd6 Apr 29 19:05:52 devstack sudo[92535]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 19:05:53 devstack sudo[92535]: pam_unix(sudo:session): session closed for user root Apr 29 19:05:53 devstack cinder-volume[84538]: DEBUG oslo_concurrency.processutils [None req-bd16fcea-c708-468f-9c3c-9cbea21217cd tempest-VolumesExtendTest-451302124 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-5aebb3fe-daab-4c3c-ab11-1603804e4ec7 -F qcow2 /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-5aebb3fe-daab-4c3c-ab11-1603804e4ec7.718e390c-4ce4-498c-995d-6e2a6f9d8fd6" returned: 0 in 0.673s {{(pid=84538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 19:05:53 devstack cinder-volume[84538]: WARNING cinder.volume.drivers.remotefs [None req-bd16fcea-c708-468f-9c3c-9cbea21217cd tempest-VolumesExtendTest-451302124 None] /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-5aebb3fe-daab-4c3c-ab11-1603804e4ec7.718e390c-4ce4-498c-995d-6e2a6f9d8fd6 is being set with open permissions: ugo+rw Apr 29 19:05:53 devstack cinder-volume[84538]: DEBUG oslo_concurrency.processutils [None req-bd16fcea-c708-468f-9c3c-9cbea21217cd tempest-VolumesExtendTest-451302124 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-5aebb3fe-daab-4c3c-ab11-1603804e4ec7.718e390c-4ce4-498c-995d-6e2a6f9d8fd6 {{(pid=84538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 19:05:53 devstack sudo[92540]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-5aebb3fe-daab-4c3c-ab11-1603804e4ec7.718e390c-4ce4-498c-995d-6e2a6f9d8fd6 Apr 29 19:05:53 devstack sudo[92540]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 19:05:53 devstack sudo[92540]: pam_unix(sudo:session): session closed for user root Apr 29 19:05:53 devstack cinder-volume[84538]: DEBUG oslo_concurrency.processutils [None req-bd16fcea-c708-468f-9c3c-9cbea21217cd tempest-VolumesExtendTest-451302124 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-5aebb3fe-daab-4c3c-ab11-1603804e4ec7.718e390c-4ce4-498c-995d-6e2a6f9d8fd6" returned: 0 in 0.592s {{(pid=84538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 19:05:53 devstack cinder-volume[84538]: DEBUG oslo_concurrency.processutils [None req-bd16fcea-c708-468f-9c3c-9cbea21217cd tempest-VolumesExtendTest-451302124 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-5aebb3fe-daab-4c3c-ab11-1603804e4ec7.info {{(pid=84538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 19:05:53 devstack sudo[92543]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-5aebb3fe-daab-4c3c-ab11-1603804e4ec7.info Apr 29 19:05:53 devstack sudo[92543]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 19:05:54 devstack sudo[92543]: pam_unix(sudo:session): session closed for user root Apr 29 19:05:54 devstack cinder-volume[84538]: DEBUG oslo_concurrency.processutils [None req-bd16fcea-c708-468f-9c3c-9cbea21217cd tempest-VolumesExtendTest-451302124 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-5aebb3fe-daab-4c3c-ab11-1603804e4ec7.info" returned: 0 in 0.611s {{(pid=84538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 19:05:54 devstack cinder-volume[84538]: WARNING cinder.volume.drivers.remotefs [None req-bd16fcea-c708-468f-9c3c-9cbea21217cd tempest-VolumesExtendTest-451302124 None] /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-5aebb3fe-daab-4c3c-ab11-1603804e4ec7.info is being set with open permissions: ugo+rw Apr 29 19:05:54 devstack cinder-volume[84538]: DEBUG oslo_concurrency.processutils [None req-bd16fcea-c708-468f-9c3c-9cbea21217cd tempest-VolumesExtendTest-451302124 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-5aebb3fe-daab-4c3c-ab11-1603804e4ec7.info {{(pid=84538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 19:05:54 devstack sudo[92546]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-5aebb3fe-daab-4c3c-ab11-1603804e4ec7.info Apr 29 19:05:54 devstack sudo[92546]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 19:05:54 devstack sudo[92546]: pam_unix(sudo:session): session closed for user root Apr 29 19:05:54 devstack cinder-volume[84538]: DEBUG oslo_concurrency.processutils [None req-bd16fcea-c708-468f-9c3c-9cbea21217cd tempest-VolumesExtendTest-451302124 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-5aebb3fe-daab-4c3c-ab11-1603804e4ec7.info" returned: 0 in 0.620s {{(pid=84538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 19:05:54 devstack cinder-volume[84538]: DEBUG oslo_concurrency.lockutils [None req-bd16fcea-c708-468f-9c3c-9cbea21217cd tempest-VolumesExtendTest-451302124 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.210s {{(pid=84538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 19:05:54 devstack cinder-volume[84538]: DEBUG oslo_concurrency.lockutils [None req-c7e733e6-686d-48c9-add1-2b90b73053dd tempest-VolumesSnapshotListTestJSON-317057059 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 3.513s {{(pid=84538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 19:05:54 devstack cinder-volume[84538]: DEBUG cinder.volume.drivers.remotefs [None req-c7e733e6-686d-48c9-add1-2b90b73053dd tempest-VolumesSnapshotListTestJSON-317057059 None] Creating offline snapshot aeccab15-22ba-4e33-a605-893690e2c313 of volume 1387f25c-dfd4-4f52-beab-27cf8a1036b3 {{(pid=84538) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}} Apr 29 19:05:55 devstack cinder-volume[84538]: INFO cinder.volume.manager [None req-bd16fcea-c708-468f-9c3c-9cbea21217cd tempest-VolumesExtendTest-451302124 None] Create snapshot completed successfully Apr 29 19:05:55 devstack cinder-volume[84538]: DEBUG oslo.privsep.daemon [-] privsep: reply[534d2039-7b40-45d9-84ea-77615652303f]: (4, 'qcow2') {{(pid=85803) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 19:05:55 devstack cinder-volume[84538]: DEBUG oslo_concurrency.processutils [None req-c7e733e6-686d-48c9-add1-2b90b73053dd tempest-VolumesSnapshotListTestJSON-317057059 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-1387f25c-dfd4-4f52-beab-27cf8a1036b3.ff59994d-ced0-4c35-828f-5d485995c96f {{(pid=84538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 19:05:55 devstack sudo[92555]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-1387f25c-dfd4-4f52-beab-27cf8a1036b3.ff59994d-ced0-4c35-828f-5d485995c96f Apr 29 19:05:55 devstack sudo[92555]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 19:05:55 devstack cinder-volume[84538]: DEBUG oslo_concurrency.lockutils [None req-33144217-2a10-4481-a883-e5e9f1b84ea2 tempest-VolumesExtendTest-451302124 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" {{(pid=84538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 19:05:55 devstack sudo[92555]: pam_unix(sudo:session): session closed for user root Apr 29 19:05:55 devstack cinder-volume[84538]: DEBUG oslo_concurrency.processutils [None req-c7e733e6-686d-48c9-add1-2b90b73053dd tempest-VolumesSnapshotListTestJSON-317057059 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-1387f25c-dfd4-4f52-beab-27cf8a1036b3.ff59994d-ced0-4c35-828f-5d485995c96f" returned: 0 in 0.804s {{(pid=84538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 19:05:55 devstack cinder-volume[84538]: DEBUG cinder.volume.drivers.remotefs [None req-c7e733e6-686d-48c9-add1-2b90b73053dd tempest-VolumesSnapshotListTestJSON-317057059 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-1387f25c-dfd4-4f52-beab-27cf8a1036b3(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=84538) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 29 19:05:55 devstack cinder-volume[84538]: DEBUG oslo_concurrency.processutils [None req-c7e733e6-686d-48c9-add1-2b90b73053dd tempest-VolumesSnapshotListTestJSON-317057059 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-1387f25c-dfd4-4f52-beab-27cf8a1036b3.ff59994d-ced0-4c35-828f-5d485995c96f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-1387f25c-dfd4-4f52-beab-27cf8a1036b3.aeccab15-22ba-4e33-a605-893690e2c313 1G {{(pid=84538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 19:05:55 devstack sudo[92561]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-1387f25c-dfd4-4f52-beab-27cf8a1036b3.ff59994d-ced0-4c35-828f-5d485995c96f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-1387f25c-dfd4-4f52-beab-27cf8a1036b3.aeccab15-22ba-4e33-a605-893690e2c313 1G Apr 29 19:05:55 devstack sudo[92561]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 19:05:56 devstack sudo[92561]: pam_unix(sudo:session): session closed for user root Apr 29 19:05:56 devstack cinder-volume[84538]: DEBUG oslo_concurrency.processutils [None req-c7e733e6-686d-48c9-add1-2b90b73053dd tempest-VolumesSnapshotListTestJSON-317057059 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-1387f25c-dfd4-4f52-beab-27cf8a1036b3.ff59994d-ced0-4c35-828f-5d485995c96f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-1387f25c-dfd4-4f52-beab-27cf8a1036b3.aeccab15-22ba-4e33-a605-893690e2c313 1G" returned: 0 in 0.808s {{(pid=84538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 19:05:56 devstack cinder-volume[84538]: DEBUG oslo_concurrency.processutils [None req-c7e733e6-686d-48c9-add1-2b90b73053dd tempest-VolumesSnapshotListTestJSON-317057059 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-1387f25c-dfd4-4f52-beab-27cf8a1036b3.ff59994d-ced0-4c35-828f-5d485995c96f -F qcow2 /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-1387f25c-dfd4-4f52-beab-27cf8a1036b3.aeccab15-22ba-4e33-a605-893690e2c313 {{(pid=84538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 19:05:56 devstack sudo[92566]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-1387f25c-dfd4-4f52-beab-27cf8a1036b3.ff59994d-ced0-4c35-828f-5d485995c96f -F qcow2 /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-1387f25c-dfd4-4f52-beab-27cf8a1036b3.aeccab15-22ba-4e33-a605-893690e2c313 Apr 29 19:05:56 devstack sudo[92566]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 19:05:57 devstack sudo[92566]: pam_unix(sudo:session): session closed for user root Apr 29 19:05:57 devstack cinder-volume[84538]: DEBUG oslo_concurrency.processutils [None req-c7e733e6-686d-48c9-add1-2b90b73053dd tempest-VolumesSnapshotListTestJSON-317057059 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-1387f25c-dfd4-4f52-beab-27cf8a1036b3.ff59994d-ced0-4c35-828f-5d485995c96f -F qcow2 /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-1387f25c-dfd4-4f52-beab-27cf8a1036b3.aeccab15-22ba-4e33-a605-893690e2c313" returned: 0 in 0.627s {{(pid=84538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 19:05:57 devstack cinder-volume[84538]: WARNING cinder.volume.drivers.remotefs [None req-c7e733e6-686d-48c9-add1-2b90b73053dd tempest-VolumesSnapshotListTestJSON-317057059 None] /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-1387f25c-dfd4-4f52-beab-27cf8a1036b3.aeccab15-22ba-4e33-a605-893690e2c313 is being set with open permissions: ugo+rw Apr 29 19:05:57 devstack cinder-volume[84538]: DEBUG oslo_concurrency.processutils [None req-c7e733e6-686d-48c9-add1-2b90b73053dd tempest-VolumesSnapshotListTestJSON-317057059 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-1387f25c-dfd4-4f52-beab-27cf8a1036b3.aeccab15-22ba-4e33-a605-893690e2c313 {{(pid=84538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 19:05:57 devstack sudo[92571]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-1387f25c-dfd4-4f52-beab-27cf8a1036b3.aeccab15-22ba-4e33-a605-893690e2c313 Apr 29 19:05:57 devstack sudo[92571]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 19:05:57 devstack sudo[92571]: pam_unix(sudo:session): session closed for user root Apr 29 19:05:57 devstack cinder-volume[84538]: DEBUG oslo_concurrency.processutils [None req-c7e733e6-686d-48c9-add1-2b90b73053dd tempest-VolumesSnapshotListTestJSON-317057059 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-1387f25c-dfd4-4f52-beab-27cf8a1036b3.aeccab15-22ba-4e33-a605-893690e2c313" returned: 0 in 0.607s {{(pid=84538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 19:05:57 devstack cinder-volume[84538]: DEBUG oslo_concurrency.lockutils [None req-c7e733e6-686d-48c9-add1-2b90b73053dd tempest-VolumesSnapshotListTestJSON-317057059 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.947s {{(pid=84538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 19:05:57 devstack cinder-volume[84538]: DEBUG oslo_concurrency.lockutils [None req-dbfa4507-3f81-4f9d-899b-ebf17cd94892 tempest-CreateVolumesFromSourceVolumeTest-1124812184 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 6.210s {{(pid=84538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 19:05:57 devstack cinder-volume[84538]: DEBUG cinder.volume.drivers.quobyte [None req-dbfa4507-3f81-4f9d-899b-ebf17cd94892 tempest-CreateVolumesFromSourceVolumeTest-1124812184 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-29T17:05:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1048206505',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=99bceec9-47e0-415c-9c51-fb7b781ae55a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f55552bb071a4e93ae2c788f38b4fe37',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T17:05:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T17:05:52Z,use_quota=True,user_id='9edcc640ca7040a5b9ecc3e6e1801af9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(62b05900-93e3-4190-a88f-1d87324303d1),volume_type_id=62b05900-93e3-4190-a88f-1d87324303d1)}" {{(pid=84538) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 29 19:05:57 devstack cinder-volume[84538]: DEBUG cinder.volume.drivers.remotefs [None req-dbfa4507-3f81-4f9d-899b-ebf17cd94892 tempest-CreateVolumesFromSourceVolumeTest-1124812184 None] Creating volume 99bceec9-47e0-415c-9c51-fb7b781ae55a {{(pid=84538) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 29 19:05:57 devstack cinder-volume[84538]: DEBUG oslo_concurrency.lockutils [None req-dbfa4507-3f81-4f9d-899b-ebf17cd94892 tempest-CreateVolumesFromSourceVolumeTest-1124812184 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 19:05:57 devstack cinder-volume[84538]: DEBUG oslo_concurrency.lockutils [None req-dbfa4507-3f81-4f9d-899b-ebf17cd94892 tempest-CreateVolumesFromSourceVolumeTest-1124812184 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=84538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 19:05:57 devstack cinder-volume[84538]: DEBUG cinder.volume.drivers.quobyte [None req-dbfa4507-3f81-4f9d-899b-ebf17cd94892 tempest-CreateVolumesFromSourceVolumeTest-1124812184 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-34312b00-dd6d-45bb-af98-75855cea8e48': None} {{(pid=84538) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 19:05:57 devstack cinder-volume[84538]: DEBUG cinder.volume.drivers.quobyte [None req-dbfa4507-3f81-4f9d-899b-ebf17cd94892 tempest-CreateVolumesFromSourceVolumeTest-1124812184 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-34312b00-dd6d-45bb-af98-75855cea8e48'] {{(pid=84538) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 19:05:57 devstack cinder-volume[84538]: DEBUG oslo_concurrency.lockutils [None req-dbfa4507-3f81-4f9d-899b-ebf17cd94892 tempest-CreateVolumesFromSourceVolumeTest-1124812184 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=84538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 19:05:57 devstack cinder-volume[84538]: DEBUG cinder.volume.drivers.quobyte [None req-dbfa4507-3f81-4f9d-899b-ebf17cd94892 tempest-CreateVolumesFromSourceVolumeTest-1124812184 None] Selected osci02.corp.quobyte.com/cinder-vol-34312b00-dd6d-45bb-af98-75855cea8e48 as target Quobyte volume. {{(pid=84538) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 29 19:05:57 devstack cinder-volume[84538]: INFO cinder.volume.drivers.remotefs [None req-dbfa4507-3f81-4f9d-899b-ebf17cd94892 tempest-CreateVolumesFromSourceVolumeTest-1124812184 None] casted to osci02.corp.quobyte.com/cinder-vol-34312b00-dd6d-45bb-af98-75855cea8e48 Apr 29 19:05:57 devstack cinder-volume[84538]: DEBUG oslo_concurrency.processutils [None req-dbfa4507-3f81-4f9d-899b-ebf17cd94892 tempest-CreateVolumesFromSourceVolumeTest-1124812184 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-99bceec9-47e0-415c-9c51-fb7b781ae55a 1073741824 {{(pid=84538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 19:05:57 devstack sudo[92574]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-99bceec9-47e0-415c-9c51-fb7b781ae55a 1073741824 Apr 29 19:05:57 devstack sudo[92574]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 19:05:57 devstack cinder-volume[84538]: INFO cinder.volume.manager [None req-c7e733e6-686d-48c9-add1-2b90b73053dd tempest-VolumesSnapshotListTestJSON-317057059 None] Create snapshot completed successfully Apr 29 19:05:58 devstack sudo[92574]: pam_unix(sudo:session): session closed for user root Apr 29 19:05:58 devstack cinder-volume[84538]: DEBUG oslo_concurrency.processutils [None req-dbfa4507-3f81-4f9d-899b-ebf17cd94892 tempest-CreateVolumesFromSourceVolumeTest-1124812184 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-99bceec9-47e0-415c-9c51-fb7b781ae55a 1073741824" returned: 0 in 0.794s {{(pid=84538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 19:05:58 devstack cinder-volume[84538]: DEBUG oslo_concurrency.processutils [None req-dbfa4507-3f81-4f9d-899b-ebf17cd94892 tempest-CreateVolumesFromSourceVolumeTest-1124812184 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-99bceec9-47e0-415c-9c51-fb7b781ae55a {{(pid=84538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 19:05:58 devstack sudo[92580]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-99bceec9-47e0-415c-9c51-fb7b781ae55a Apr 29 19:05:58 devstack sudo[92580]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 19:05:59 devstack sudo[92580]: pam_unix(sudo:session): session closed for user root Apr 29 19:05:59 devstack cinder-volume[84538]: DEBUG oslo_concurrency.processutils [None req-dbfa4507-3f81-4f9d-899b-ebf17cd94892 tempest-CreateVolumesFromSourceVolumeTest-1124812184 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-99bceec9-47e0-415c-9c51-fb7b781ae55a" returned: 0 in 0.625s {{(pid=84538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 19:05:59 devstack cinder-volume[84538]: DEBUG cinder.volume.drivers.quobyte [None req-dbfa4507-3f81-4f9d-899b-ebf17cd94892 tempest-CreateVolumesFromSourceVolumeTest-1124812184 None] <== create_volume: return (1463ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-34312b00-dd6d-45bb-af98-75855cea8e48'} {{(pid=84538) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 29 19:05:59 devstack cinder-volume[84538]: DEBUG oslo_concurrency.lockutils [None req-dbfa4507-3f81-4f9d-899b-ebf17cd94892 tempest-CreateVolumesFromSourceVolumeTest-1124812184 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.466s {{(pid=84538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 19:05:59 devstack cinder-volume[84538]: DEBUG oslo_concurrency.lockutils [None req-33144217-2a10-4481-a883-e5e9f1b84ea2 tempest-VolumesExtendTest-451302124 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" :: waited 3.700s {{(pid=84538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 19:05:59 devstack cinder-volume[84538]: DEBUG cinder.volume.manager [None req-dbfa4507-3f81-4f9d-899b-ebf17cd94892 tempest-CreateVolumesFromSourceVolumeTest-1124812184 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (33d5ce05-a7d7-4284-a8e9-673d2ef5129e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-99bceec9-47e0-415c-9c51-fb7b781ae55a', 'volume_size': 1}' {{(pid=84538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 19:05:59 devstack cinder-volume[84538]: DEBUG cinder.volume.manager [None req-dbfa4507-3f81-4f9d-899b-ebf17cd94892 tempest-CreateVolumesFromSourceVolumeTest-1124812184 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (35bad395-fd6b-4a6e-ac9c-2046aa80649b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 19:05:59 devstack cinder-volume[84538]: DEBUG oslo.privsep.daemon [-] privsep: reply[627392ce-4065-4f3a-9f87-27f6edc2cadc]: (4, 'qcow2') {{(pid=85803) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 19:05:59 devstack cinder-volume[84538]: DEBUG oslo_concurrency.processutils [None req-33144217-2a10-4481-a883-e5e9f1b84ea2 tempest-VolumesExtendTest-451302124 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-5aebb3fe-daab-4c3c-ab11-1603804e4ec7 {{(pid=84538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 19:05:59 devstack cinder-volume[84538]: INFO cinder.volume.flows.manager.create_volume [None req-dbfa4507-3f81-4f9d-899b-ebf17cd94892 tempest-CreateVolumesFromSourceVolumeTest-1124812184 None] Volume volume-99bceec9-47e0-415c-9c51-fb7b781ae55a (99bceec9-47e0-415c-9c51-fb7b781ae55a): created successfully Apr 29 19:05:59 devstack cinder-volume[84538]: DEBUG cinder.volume.manager [None req-dbfa4507-3f81-4f9d-899b-ebf17cd94892 tempest-CreateVolumesFromSourceVolumeTest-1124812184 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (35bad395-fd6b-4a6e-ac9c-2046aa80649b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 19:05:59 devstack cinder-volume[84538]: DEBUG cinder.volume.manager [None req-dbfa4507-3f81-4f9d-899b-ebf17cd94892 tempest-CreateVolumesFromSourceVolumeTest-1124812184 None] Flow 'volume_create_manager' (642a06bd-b5e4-46af-8156-96d4a3f9c70d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84538) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 19:05:59 devstack cinder-volume[84538]: INFO cinder.volume.manager [None req-dbfa4507-3f81-4f9d-899b-ebf17cd94892 tempest-CreateVolumesFromSourceVolumeTest-1124812184 None] Created volume successfully. Apr 29 19:05:59 devstack sudo[92583]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-5aebb3fe-daab-4c3c-ab11-1603804e4ec7 Apr 29 19:05:59 devstack sudo[92583]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 19:05:59 devstack cinder-volume[84538]: DEBUG cinder.coordination [None req-de318266-d07b-495e-8bec-b2d47525a45c tempest-VolumesSnapshotListTestJSON-317057059 None] Acquiring lock "cinder-aeccab15-22ba-4e33-a605-893690e2c313-delete_snapshot" by "delete_snapshot" {{(pid=84538) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 19:05:59 devstack cinder-volume[84538]: DEBUG cinder.coordination [None req-de318266-d07b-495e-8bec-b2d47525a45c tempest-VolumesSnapshotListTestJSON-317057059 None] Lock "cinder-aeccab15-22ba-4e33-a605-893690e2c313-delete_snapshot" acquired by "delete_snapshot" :: waited 0.023s {{(pid=84538) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 19:05:59 devstack cinder-volume[84538]: DEBUG cinder.coordination [None req-de318266-d07b-495e-8bec-b2d47525a45c tempest-VolumesSnapshotListTestJSON-317057059 None] Acquiring lock "cinder-quobyte-1387f25c-dfd4-4f52-beab-27cf8a1036b3" by "delete_snapshot" {{(pid=84538) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 19:05:59 devstack cinder-volume[84538]: DEBUG cinder.coordination [None req-de318266-d07b-495e-8bec-b2d47525a45c tempest-VolumesSnapshotListTestJSON-317057059 None] Lock "cinder-quobyte-1387f25c-dfd4-4f52-beab-27cf8a1036b3" acquired by "delete_snapshot" :: waited 0.025s {{(pid=84538) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 19:05:59 devstack cinder-volume[84538]: DEBUG cinder.coordination [None req-de318266-d07b-495e-8bec-b2d47525a45c tempest-VolumesSnapshotListTestJSON-317057059 None] Acquiring lock "cinder-quobyte-aeccab15-22ba-4e33-a605-893690e2c313" by "_delete_snapshot" {{(pid=84538) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 19:05:59 devstack cinder-volume[84538]: DEBUG cinder.coordination [None req-de318266-d07b-495e-8bec-b2d47525a45c tempest-VolumesSnapshotListTestJSON-317057059 None] Lock "cinder-quobyte-aeccab15-22ba-4e33-a605-893690e2c313" acquired by "_delete_snapshot" :: waited 0.016s {{(pid=84538) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 19:05:59 devstack cinder-volume[84538]: DEBUG cinder.volume.drivers.remotefs [None req-de318266-d07b-495e-8bec-b2d47525a45c tempest-VolumesSnapshotListTestJSON-317057059 None] Deleting offline snapshot aeccab15-22ba-4e33-a605-893690e2c313 of volume 1387f25c-dfd4-4f52-beab-27cf8a1036b3 {{(pid=84538) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 29 19:05:59 devstack cinder-volume[84538]: DEBUG cinder.volume.drivers.remotefs [None req-de318266-d07b-495e-8bec-b2d47525a45c tempest-VolumesSnapshotListTestJSON-317057059 None] snapshot_file for this snap is: volume-1387f25c-dfd4-4f52-beab-27cf8a1036b3.aeccab15-22ba-4e33-a605-893690e2c313 {{(pid=84538) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 29 19:05:59 devstack cinder-volume[84538]: DEBUG oslo.privsep.daemon [-] privsep: reply[f50070c3-d5a8-41d1-8e18-6b7d24d36696]: (4, 'qcow2') {{(pid=85803) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 19:05:59 devstack cinder-volume[84538]: DEBUG oslo_concurrency.processutils [None req-de318266-d07b-495e-8bec-b2d47525a45c tempest-VolumesSnapshotListTestJSON-317057059 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-1387f25c-dfd4-4f52-beab-27cf8a1036b3.aeccab15-22ba-4e33-a605-893690e2c313 {{(pid=84538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 19:05:59 devstack sudo[92585]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-1387f25c-dfd4-4f52-beab-27cf8a1036b3.aeccab15-22ba-4e33-a605-893690e2c313 Apr 29 19:05:59 devstack sudo[92585]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 19:06:00 devstack sudo[92583]: pam_unix(sudo:session): session closed for user root Apr 29 19:06:00 devstack cinder-volume[84538]: DEBUG oslo_concurrency.processutils [None req-33144217-2a10-4481-a883-e5e9f1b84ea2 tempest-VolumesExtendTest-451302124 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-5aebb3fe-daab-4c3c-ab11-1603804e4ec7" returned: 0 in 0.777s {{(pid=84538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 19:06:00 devstack cinder-volume[84538]: DEBUG oslo_concurrency.processutils [None req-33144217-2a10-4481-a883-e5e9f1b84ea2 tempest-VolumesExtendTest-451302124 None] Running cmd (subprocess): qemu-img resize /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-5aebb3fe-daab-4c3c-ab11-1603804e4ec7.718e390c-4ce4-498c-995d-6e2a6f9d8fd6 2G {{(pid=84538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 19:06:00 devstack cinder-volume[84538]: DEBUG oslo_concurrency.processutils [None req-33144217-2a10-4481-a883-e5e9f1b84ea2 tempest-VolumesExtendTest-451302124 None] CMD "qemu-img resize /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-5aebb3fe-daab-4c3c-ab11-1603804e4ec7.718e390c-4ce4-498c-995d-6e2a6f9d8fd6 2G" returned: 0 in 0.153s {{(pid=84538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 19:06:00 devstack cinder-volume[84538]: DEBUG oslo_concurrency.lockutils [None req-33144217-2a10-4481-a883-e5e9f1b84ea2 tempest-VolumesExtendTest-451302124 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" :: held 0.975s {{(pid=84538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 19:06:00 devstack sudo[92585]: pam_unix(sudo:session): session closed for user root Apr 29 19:06:00 devstack cinder-volume[84538]: DEBUG oslo_concurrency.processutils [None req-de318266-d07b-495e-8bec-b2d47525a45c tempest-VolumesSnapshotListTestJSON-317057059 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-1387f25c-dfd4-4f52-beab-27cf8a1036b3.aeccab15-22ba-4e33-a605-893690e2c313" returned: 0 in 0.747s {{(pid=84538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 19:06:00 devstack cinder-volume[84538]: DEBUG cinder.volume.drivers.remotefs [None req-de318266-d07b-495e-8bec-b2d47525a45c tempest-VolumesSnapshotListTestJSON-317057059 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-1387f25c-dfd4-4f52-beab-27cf8a1036b3(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=84538) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 29 19:06:00 devstack cinder-volume[84538]: DEBUG oslo.privsep.daemon [-] privsep: reply[f091c5b7-0ce7-40e8-a64d-edd349bc9907]: (4, 'qcow2') {{(pid=85803) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 19:06:00 devstack cinder-volume[84538]: DEBUG oslo_concurrency.processutils [None req-de318266-d07b-495e-8bec-b2d47525a45c tempest-VolumesSnapshotListTestJSON-317057059 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-1387f25c-dfd4-4f52-beab-27cf8a1036b3.ff59994d-ced0-4c35-828f-5d485995c96f {{(pid=84538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 19:06:00 devstack cinder-volume[84538]: INFO cinder.volume.manager [None req-33144217-2a10-4481-a883-e5e9f1b84ea2 tempest-VolumesExtendTest-451302124 None] Extend volume completed successfully. Apr 29 19:06:00 devstack cinder-volume[84538]: DEBUG cinder.volume.flows.manager.create_volume [None req-0fb1b817-a6ac-456d-bfa5-698c049dc617 tempest-CreateVolumesFromSourceVolumeTest-1124812184 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84538) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Apr 29 19:06:00 devstack cinder-volume[84538]: DEBUG cinder.volume.manager [None req-0fb1b817-a6ac-456d-bfa5-698c049dc617 tempest-CreateVolumesFromSourceVolumeTest-1124812184 None] Flow 'volume_create_manager' (32466c8c-6f59-41d5-8e4c-9195f1634e1b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84538) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 19:06:00 devstack sudo[92597]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-1387f25c-dfd4-4f52-beab-27cf8a1036b3.ff59994d-ced0-4c35-828f-5d485995c96f Apr 29 19:06:00 devstack sudo[92597]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 19:06:00 devstack cinder-volume[84538]: DEBUG cinder.volume.manager [None req-0fb1b817-a6ac-456d-bfa5-698c049dc617 tempest-CreateVolumesFromSourceVolumeTest-1124812184 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (68703ff3-7dee-4848-9e12-46f39f8b58bb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 19:06:00 devstack cinder-volume[84538]: DEBUG cinder.volume.manager [None req-0fb1b817-a6ac-456d-bfa5-698c049dc617 tempest-CreateVolumesFromSourceVolumeTest-1124812184 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (68703ff3-7dee-4848-9e12-46f39f8b58bb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-29T17:06:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1155994954',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=16c32655-8006-4faf-bd2a-33c9a749eb6b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f55552bb071a4e93ae2c788f38b4fe37',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T17:06:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T17:06:00Z,use_quota=True,user_id='9edcc640ca7040a5b9ecc3e6e1801af9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(62b05900-93e3-4190-a88f-1d87324303d1),volume_type_id=62b05900-93e3-4190-a88f-1d87324303d1)' {{(pid=84538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 19:06:00 devstack cinder-volume[84538]: DEBUG cinder.volume.manager [None req-0fb1b817-a6ac-456d-bfa5-698c049dc617 tempest-CreateVolumesFromSourceVolumeTest-1124812184 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0cf59664-98e7-4b7c-8c6f-97e94e988abf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 19:06:00 devstack cinder-volume[84538]: DEBUG cinder.volume.manager [None req-0fb1b817-a6ac-456d-bfa5-698c049dc617 tempest-CreateVolumesFromSourceVolumeTest-1124812184 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0cf59664-98e7-4b7c-8c6f-97e94e988abf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 19:06:00 devstack cinder-volume[84538]: DEBUG cinder.volume.manager [None req-0fb1b817-a6ac-456d-bfa5-698c049dc617 tempest-CreateVolumesFromSourceVolumeTest-1124812184 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3aa8b484-ef42-4233-b0df-1774ea545a7f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 19:06:00 devstack cinder-volume[84538]: DEBUG cinder.volume.manager [None req-0fb1b817-a6ac-456d-bfa5-698c049dc617 tempest-CreateVolumesFromSourceVolumeTest-1124812184 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3aa8b484-ef42-4233-b0df-1774ea545a7f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '16c32655-8006-4faf-bd2a-33c9a749eb6b', 'volume_name': 'volume-16c32655-8006-4faf-bd2a-33c9a749eb6b', 'volume_size': 1}' {{(pid=84538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 19:06:00 devstack cinder-volume[84538]: DEBUG cinder.volume.manager [None req-0fb1b817-a6ac-456d-bfa5-698c049dc617 tempest-CreateVolumesFromSourceVolumeTest-1124812184 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (63413425-0bcd-430c-9a61-fab29d04ead5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 19:06:00 devstack cinder-volume[84538]: DEBUG cinder.volume.manager [None req-0fb1b817-a6ac-456d-bfa5-698c049dc617 tempest-CreateVolumesFromSourceVolumeTest-1124812184 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (63413425-0bcd-430c-9a61-fab29d04ead5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 19:06:00 devstack cinder-volume[84538]: DEBUG cinder.volume.manager [None req-0fb1b817-a6ac-456d-bfa5-698c049dc617 tempest-CreateVolumesFromSourceVolumeTest-1124812184 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cc64240f-b3c6-41b8-b81d-fed44e3c40ef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 19:06:00 devstack cinder-volume[84538]: INFO cinder.volume.flows.manager.create_volume [None req-0fb1b817-a6ac-456d-bfa5-698c049dc617 tempest-CreateVolumesFromSourceVolumeTest-1124812184 None] Volume 16c32655-8006-4faf-bd2a-33c9a749eb6b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-16c32655-8006-4faf-bd2a-33c9a749eb6b', 'volume_size': 1} Apr 29 19:06:00 devstack cinder-volume[84538]: DEBUG oslo_concurrency.lockutils [None req-0fb1b817-a6ac-456d-bfa5-698c049dc617 tempest-CreateVolumesFromSourceVolumeTest-1124812184 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 19:06:00 devstack cinder-volume[84538]: DEBUG oslo_concurrency.lockutils [None req-0fb1b817-a6ac-456d-bfa5-698c049dc617 tempest-CreateVolumesFromSourceVolumeTest-1124812184 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=84538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 19:06:00 devstack cinder-volume[84538]: DEBUG cinder.volume.drivers.quobyte [None req-0fb1b817-a6ac-456d-bfa5-698c049dc617 tempest-CreateVolumesFromSourceVolumeTest-1124812184 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-29T17:06:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1155994954',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=16c32655-8006-4faf-bd2a-33c9a749eb6b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f55552bb071a4e93ae2c788f38b4fe37',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T17:06:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T17:06:00Z,use_quota=True,user_id='9edcc640ca7040a5b9ecc3e6e1801af9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(62b05900-93e3-4190-a88f-1d87324303d1),volume_type_id=62b05900-93e3-4190-a88f-1d87324303d1)}" {{(pid=84538) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 29 19:06:00 devstack cinder-volume[84538]: DEBUG cinder.volume.drivers.remotefs [None req-0fb1b817-a6ac-456d-bfa5-698c049dc617 tempest-CreateVolumesFromSourceVolumeTest-1124812184 None] Creating volume 16c32655-8006-4faf-bd2a-33c9a749eb6b {{(pid=84538) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 29 19:06:00 devstack cinder-volume[84538]: DEBUG oslo_concurrency.lockutils [None req-0fb1b817-a6ac-456d-bfa5-698c049dc617 tempest-CreateVolumesFromSourceVolumeTest-1124812184 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 19:06:00 devstack cinder-volume[84538]: DEBUG oslo_concurrency.lockutils [None req-0fb1b817-a6ac-456d-bfa5-698c049dc617 tempest-CreateVolumesFromSourceVolumeTest-1124812184 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 19:06:00 devstack cinder-volume[84538]: DEBUG cinder.volume.drivers.quobyte [None req-0fb1b817-a6ac-456d-bfa5-698c049dc617 tempest-CreateVolumesFromSourceVolumeTest-1124812184 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-34312b00-dd6d-45bb-af98-75855cea8e48': None} {{(pid=84538) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 19:06:00 devstack cinder-volume[84538]: DEBUG cinder.volume.drivers.quobyte [None req-0fb1b817-a6ac-456d-bfa5-698c049dc617 tempest-CreateVolumesFromSourceVolumeTest-1124812184 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-34312b00-dd6d-45bb-af98-75855cea8e48'] {{(pid=84538) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 19:06:00 devstack cinder-volume[84538]: DEBUG oslo_concurrency.lockutils [None req-0fb1b817-a6ac-456d-bfa5-698c049dc617 tempest-CreateVolumesFromSourceVolumeTest-1124812184 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=84538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 19:06:00 devstack cinder-volume[84538]: DEBUG cinder.volume.drivers.quobyte [None req-0fb1b817-a6ac-456d-bfa5-698c049dc617 tempest-CreateVolumesFromSourceVolumeTest-1124812184 None] Selected osci02.corp.quobyte.com/cinder-vol-34312b00-dd6d-45bb-af98-75855cea8e48 as target Quobyte volume. {{(pid=84538) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 29 19:06:00 devstack cinder-volume[84538]: INFO cinder.volume.drivers.remotefs [None req-0fb1b817-a6ac-456d-bfa5-698c049dc617 tempest-CreateVolumesFromSourceVolumeTest-1124812184 None] casted to osci02.corp.quobyte.com/cinder-vol-34312b00-dd6d-45bb-af98-75855cea8e48 Apr 29 19:06:00 devstack cinder-volume[84538]: DEBUG oslo_concurrency.processutils [None req-0fb1b817-a6ac-456d-bfa5-698c049dc617 tempest-CreateVolumesFromSourceVolumeTest-1124812184 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-16c32655-8006-4faf-bd2a-33c9a749eb6b 1073741824 {{(pid=84538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 19:06:00 devstack sudo[92599]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-16c32655-8006-4faf-bd2a-33c9a749eb6b 1073741824 Apr 29 19:06:00 devstack sudo[92599]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 19:06:00 devstack cinder-volume[84538]: DEBUG cinder.volume.flows.manager.create_volume [None req-50bc68cc-9c36-448e-b2a5-83eb31388f4c tempest-CreateVolumesFromSourceVolumeTest-1124812184 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84538) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Apr 29 19:06:00 devstack cinder-volume[84538]: DEBUG cinder.volume.manager [None req-50bc68cc-9c36-448e-b2a5-83eb31388f4c tempest-CreateVolumesFromSourceVolumeTest-1124812184 None] Flow 'volume_create_manager' (49fe9e07-2bd2-4643-8fa5-1a45048d6b87) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84538) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 19:06:00 devstack cinder-volume[84538]: DEBUG cinder.volume.manager [None req-50bc68cc-9c36-448e-b2a5-83eb31388f4c tempest-CreateVolumesFromSourceVolumeTest-1124812184 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d6864ef1-eddd-4245-b90d-74e15c1a9221) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 19:06:00 devstack cinder-volume[84538]: DEBUG cinder.volume.manager [None req-50bc68cc-9c36-448e-b2a5-83eb31388f4c tempest-CreateVolumesFromSourceVolumeTest-1124812184 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d6864ef1-eddd-4245-b90d-74e15c1a9221) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-29T17:06:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-256238634',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4b924b80-52da-4699-be6a-1529743f41a1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f55552bb071a4e93ae2c788f38b4fe37',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T17:06:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T17:06:01Z,use_quota=True,user_id='9edcc640ca7040a5b9ecc3e6e1801af9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(62b05900-93e3-4190-a88f-1d87324303d1),volume_type_id=62b05900-93e3-4190-a88f-1d87324303d1)' {{(pid=84538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 19:06:00 devstack cinder-volume[84538]: DEBUG cinder.volume.manager [None req-50bc68cc-9c36-448e-b2a5-83eb31388f4c tempest-CreateVolumesFromSourceVolumeTest-1124812184 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ea809884-f745-4f49-8253-efc3e14711ec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 19:06:00 devstack cinder-volume[84538]: DEBUG cinder.volume.manager [None req-50bc68cc-9c36-448e-b2a5-83eb31388f4c tempest-CreateVolumesFromSourceVolumeTest-1124812184 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ea809884-f745-4f49-8253-efc3e14711ec) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 19:06:00 devstack cinder-volume[84538]: DEBUG cinder.volume.manager [None req-50bc68cc-9c36-448e-b2a5-83eb31388f4c tempest-CreateVolumesFromSourceVolumeTest-1124812184 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bb00ad24-4c79-4ee7-b27f-75d1eec87fbc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 19:06:00 devstack cinder-volume[84538]: DEBUG cinder.volume.manager [None req-50bc68cc-9c36-448e-b2a5-83eb31388f4c tempest-CreateVolumesFromSourceVolumeTest-1124812184 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bb00ad24-4c79-4ee7-b27f-75d1eec87fbc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4b924b80-52da-4699-be6a-1529743f41a1', 'volume_name': 'volume-4b924b80-52da-4699-be6a-1529743f41a1', 'volume_size': 1}' {{(pid=84538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 19:06:00 devstack cinder-volume[84538]: DEBUG cinder.volume.manager [None req-50bc68cc-9c36-448e-b2a5-83eb31388f4c tempest-CreateVolumesFromSourceVolumeTest-1124812184 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e4b3cf10-e077-4510-b514-417cb9da74e5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 19:06:00 devstack cinder-volume[84538]: DEBUG cinder.volume.manager [None req-50bc68cc-9c36-448e-b2a5-83eb31388f4c tempest-CreateVolumesFromSourceVolumeTest-1124812184 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e4b3cf10-e077-4510-b514-417cb9da74e5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 19:06:00 devstack cinder-volume[84538]: DEBUG cinder.volume.manager [None req-50bc68cc-9c36-448e-b2a5-83eb31388f4c tempest-CreateVolumesFromSourceVolumeTest-1124812184 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e412cd6b-6e21-4db6-9e7e-3eba0de5e37f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 19:06:00 devstack cinder-volume[84538]: INFO cinder.volume.flows.manager.create_volume [None req-50bc68cc-9c36-448e-b2a5-83eb31388f4c tempest-CreateVolumesFromSourceVolumeTest-1124812184 None] Volume 4b924b80-52da-4699-be6a-1529743f41a1: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4b924b80-52da-4699-be6a-1529743f41a1', 'volume_size': 1} Apr 29 19:06:00 devstack cinder-volume[84538]: DEBUG oslo_concurrency.lockutils [None req-50bc68cc-9c36-448e-b2a5-83eb31388f4c tempest-CreateVolumesFromSourceVolumeTest-1124812184 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 19:06:01 devstack cinder-volume[84538]: DEBUG cinder.coordination [None req-15c0b00e-baaf-4a87-a01b-9eddd1346881 tempest-VolumesExtendTest-451302124 None] Acquiring lock "cinder-718e390c-4ce4-498c-995d-6e2a6f9d8fd6-delete_snapshot" by "delete_snapshot" {{(pid=84538) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 19:06:01 devstack cinder-volume[84538]: DEBUG cinder.coordination [None req-15c0b00e-baaf-4a87-a01b-9eddd1346881 tempest-VolumesExtendTest-451302124 None] Lock "cinder-718e390c-4ce4-498c-995d-6e2a6f9d8fd6-delete_snapshot" acquired by "delete_snapshot" :: waited 0.063s {{(pid=84538) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 19:06:01 devstack cinder-volume[84538]: DEBUG cinder.coordination [None req-15c0b00e-baaf-4a87-a01b-9eddd1346881 tempest-VolumesExtendTest-451302124 None] Acquiring lock "cinder-quobyte-5aebb3fe-daab-4c3c-ab11-1603804e4ec7" by "delete_snapshot" {{(pid=84538) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 19:06:01 devstack cinder-volume[84538]: DEBUG cinder.volume.flows.manager.create_volume [None req-b0f65cdd-c728-45d6-8dd5-f65c7b635430 tempest-CreateVolumesFromSourceVolumeTest-1124812184 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84538) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Apr 29 19:06:01 devstack cinder-volume[84538]: DEBUG cinder.volume.manager [None req-b0f65cdd-c728-45d6-8dd5-f65c7b635430 tempest-CreateVolumesFromSourceVolumeTest-1124812184 None] Flow 'volume_create_manager' (25b1d8c5-f47b-45f8-995c-70a95a5f39cc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84538) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 19:06:01 devstack cinder-volume[84538]: DEBUG cinder.volume.manager [None req-b0f65cdd-c728-45d6-8dd5-f65c7b635430 tempest-CreateVolumesFromSourceVolumeTest-1124812184 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f6a3331d-10cf-4b5c-b23d-81c4cbd3276b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 19:06:01 devstack sudo[92597]: pam_unix(sudo:session): session closed for user root Apr 29 19:06:01 devstack cinder-volume[84538]: DEBUG cinder.volume.manager [None req-b0f65cdd-c728-45d6-8dd5-f65c7b635430 tempest-CreateVolumesFromSourceVolumeTest-1124812184 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f6a3331d-10cf-4b5c-b23d-81c4cbd3276b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-29T17:06:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1493235706',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=855aa78a-368b-425a-a7c7-54110dd8846d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f55552bb071a4e93ae2c788f38b4fe37',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T17:06:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T17:06:01Z,use_quota=True,user_id='9edcc640ca7040a5b9ecc3e6e1801af9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(62b05900-93e3-4190-a88f-1d87324303d1),volume_type_id=62b05900-93e3-4190-a88f-1d87324303d1)' {{(pid=84538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 19:06:01 devstack cinder-volume[84538]: DEBUG cinder.volume.manager [None req-b0f65cdd-c728-45d6-8dd5-f65c7b635430 tempest-CreateVolumesFromSourceVolumeTest-1124812184 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5c43d148-bedb-4474-abea-17cfd94f8667) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 19:06:01 devstack cinder-volume[84538]: DEBUG cinder.volume.manager [None req-b0f65cdd-c728-45d6-8dd5-f65c7b635430 tempest-CreateVolumesFromSourceVolumeTest-1124812184 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5c43d148-bedb-4474-abea-17cfd94f8667) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 19:06:01 devstack cinder-volume[84538]: DEBUG cinder.volume.manager [None req-b0f65cdd-c728-45d6-8dd5-f65c7b635430 tempest-CreateVolumesFromSourceVolumeTest-1124812184 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9148987b-d7df-4eef-a46f-184b60357c90) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 19:06:01 devstack cinder-volume[84538]: DEBUG cinder.volume.manager [None req-b0f65cdd-c728-45d6-8dd5-f65c7b635430 tempest-CreateVolumesFromSourceVolumeTest-1124812184 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9148987b-d7df-4eef-a46f-184b60357c90) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '855aa78a-368b-425a-a7c7-54110dd8846d', 'volume_name': 'volume-855aa78a-368b-425a-a7c7-54110dd8846d', 'volume_size': 1}' {{(pid=84538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 19:06:01 devstack cinder-volume[84538]: DEBUG cinder.volume.manager [None req-b0f65cdd-c728-45d6-8dd5-f65c7b635430 tempest-CreateVolumesFromSourceVolumeTest-1124812184 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (838758d7-498a-42b2-8f44-3c14c51bd754) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 19:06:01 devstack cinder-volume[84538]: DEBUG cinder.volume.manager [None req-b0f65cdd-c728-45d6-8dd5-f65c7b635430 tempest-CreateVolumesFromSourceVolumeTest-1124812184 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (838758d7-498a-42b2-8f44-3c14c51bd754) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 19:06:01 devstack cinder-volume[84538]: DEBUG cinder.volume.manager [None req-b0f65cdd-c728-45d6-8dd5-f65c7b635430 tempest-CreateVolumesFromSourceVolumeTest-1124812184 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a9ed76f1-4151-4567-80f3-45508a74bb97) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 19:06:01 devstack cinder-volume[84538]: INFO cinder.volume.flows.manager.create_volume [None req-b0f65cdd-c728-45d6-8dd5-f65c7b635430 tempest-CreateVolumesFromSourceVolumeTest-1124812184 None] Volume 855aa78a-368b-425a-a7c7-54110dd8846d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-855aa78a-368b-425a-a7c7-54110dd8846d', 'volume_size': 1} Apr 29 19:06:01 devstack cinder-volume[84538]: DEBUG oslo_concurrency.lockutils [None req-b0f65cdd-c728-45d6-8dd5-f65c7b635430 tempest-CreateVolumesFromSourceVolumeTest-1124812184 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 19:06:01 devstack cinder-volume[84538]: DEBUG cinder.coordination [None req-15c0b00e-baaf-4a87-a01b-9eddd1346881 tempest-VolumesExtendTest-451302124 None] Lock "cinder-quobyte-5aebb3fe-daab-4c3c-ab11-1603804e4ec7" acquired by "delete_snapshot" :: waited 0.100s {{(pid=84538) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 19:06:01 devstack cinder-volume[84538]: DEBUG cinder.coordination [None req-15c0b00e-baaf-4a87-a01b-9eddd1346881 tempest-VolumesExtendTest-451302124 None] Acquiring lock "cinder-quobyte-718e390c-4ce4-498c-995d-6e2a6f9d8fd6" by "_delete_snapshot" {{(pid=84538) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 19:06:01 devstack cinder-volume[84538]: DEBUG oslo_concurrency.processutils [None req-de318266-d07b-495e-8bec-b2d47525a45c tempest-VolumesSnapshotListTestJSON-317057059 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-1387f25c-dfd4-4f52-beab-27cf8a1036b3.ff59994d-ced0-4c35-828f-5d485995c96f" returned: 0 in 1.080s {{(pid=84538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 19:06:01 devstack cinder-volume[84538]: DEBUG cinder.volume.drivers.remotefs [None req-de318266-d07b-495e-8bec-b2d47525a45c tempest-VolumesSnapshotListTestJSON-317057059 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-1387f25c-dfd4-4f52-beab-27cf8a1036b3(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=84538) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 29 19:06:01 devstack cinder-volume[84538]: DEBUG oslo_concurrency.processutils [None req-de318266-d07b-495e-8bec-b2d47525a45c tempest-VolumesSnapshotListTestJSON-317057059 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-1387f25c-dfd4-4f52-beab-27cf8a1036b3.aeccab15-22ba-4e33-a605-893690e2c313 {{(pid=84538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 19:06:01 devstack cinder-volume[84538]: DEBUG cinder.coordination [None req-15c0b00e-baaf-4a87-a01b-9eddd1346881 tempest-VolumesExtendTest-451302124 None] Lock "cinder-quobyte-718e390c-4ce4-498c-995d-6e2a6f9d8fd6" acquired by "_delete_snapshot" :: waited 0.036s {{(pid=84538) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 19:06:01 devstack cinder-volume[84538]: DEBUG cinder.volume.drivers.remotefs [None req-15c0b00e-baaf-4a87-a01b-9eddd1346881 tempest-VolumesExtendTest-451302124 None] Deleting offline snapshot 718e390c-4ce4-498c-995d-6e2a6f9d8fd6 of volume 5aebb3fe-daab-4c3c-ab11-1603804e4ec7 {{(pid=84538) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 29 19:06:01 devstack sudo[92607]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-1387f25c-dfd4-4f52-beab-27cf8a1036b3.aeccab15-22ba-4e33-a605-893690e2c313 Apr 29 19:06:01 devstack sudo[92607]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 19:06:01 devstack cinder-volume[84538]: DEBUG cinder.volume.drivers.remotefs [None req-15c0b00e-baaf-4a87-a01b-9eddd1346881 tempest-VolumesExtendTest-451302124 None] snapshot_file for this snap is: volume-5aebb3fe-daab-4c3c-ab11-1603804e4ec7.718e390c-4ce4-498c-995d-6e2a6f9d8fd6 {{(pid=84538) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 29 19:06:01 devstack cinder-volume[84538]: DEBUG oslo.privsep.daemon [-] privsep: reply[d94603e0-59ff-4b24-bce8-84ec225b7cee]: (4, 'qcow2') {{(pid=85803) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 19:06:01 devstack cinder-volume[84538]: DEBUG oslo_concurrency.processutils [None req-15c0b00e-baaf-4a87-a01b-9eddd1346881 tempest-VolumesExtendTest-451302124 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-5aebb3fe-daab-4c3c-ab11-1603804e4ec7.718e390c-4ce4-498c-995d-6e2a6f9d8fd6 {{(pid=84538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 19:06:01 devstack sudo[92599]: pam_unix(sudo:session): session closed for user root Apr 29 19:06:01 devstack cinder-volume[84538]: DEBUG oslo_concurrency.processutils [None req-0fb1b817-a6ac-456d-bfa5-698c049dc617 tempest-CreateVolumesFromSourceVolumeTest-1124812184 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-16c32655-8006-4faf-bd2a-33c9a749eb6b 1073741824" returned: 0 in 1.031s {{(pid=84538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 19:06:01 devstack cinder-volume[84538]: DEBUG cinder.volume.flows.manager.create_volume [None req-0a91f20f-aac0-4ca0-ada2-6bb67e7fc047 tempest-CreateVolumesFromSourceVolumeTest-1124812184 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84538) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Apr 29 19:06:01 devstack cinder-volume[84538]: DEBUG cinder.volume.manager [None req-0a91f20f-aac0-4ca0-ada2-6bb67e7fc047 tempest-CreateVolumesFromSourceVolumeTest-1124812184 None] Flow 'volume_create_manager' (e7cf31b8-f200-4b7d-b50b-06ba33e3de90) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84538) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 19:06:01 devstack sudo[92609]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-5aebb3fe-daab-4c3c-ab11-1603804e4ec7.718e390c-4ce4-498c-995d-6e2a6f9d8fd6 Apr 29 19:06:01 devstack sudo[92609]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 19:06:01 devstack cinder-volume[84538]: DEBUG cinder.volume.manager [None req-0a91f20f-aac0-4ca0-ada2-6bb67e7fc047 tempest-CreateVolumesFromSourceVolumeTest-1124812184 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ef23e099-76f3-4e8b-b143-f61b9a8b56eb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 19:06:01 devstack cinder-volume[84538]: DEBUG oslo_concurrency.processutils [None req-0fb1b817-a6ac-456d-bfa5-698c049dc617 tempest-CreateVolumesFromSourceVolumeTest-1124812184 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-16c32655-8006-4faf-bd2a-33c9a749eb6b {{(pid=84538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 19:06:01 devstack cinder-volume[84538]: DEBUG cinder.volume.manager [None req-0a91f20f-aac0-4ca0-ada2-6bb67e7fc047 tempest-CreateVolumesFromSourceVolumeTest-1124812184 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ef23e099-76f3-4e8b-b143-f61b9a8b56eb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-29T17:06:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-73415617',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=faff55de-8fb1-438a-ac6f-95b0ccef21ab,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f55552bb071a4e93ae2c788f38b4fe37',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T17:06:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T17:06:02Z,use_quota=True,user_id='9edcc640ca7040a5b9ecc3e6e1801af9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(62b05900-93e3-4190-a88f-1d87324303d1),volume_type_id=62b05900-93e3-4190-a88f-1d87324303d1)' {{(pid=84538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 19:06:01 devstack cinder-volume[84538]: DEBUG cinder.volume.manager [None req-0a91f20f-aac0-4ca0-ada2-6bb67e7fc047 tempest-CreateVolumesFromSourceVolumeTest-1124812184 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c90c290f-f890-4e75-aea5-6e95533d1940) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 19:06:01 devstack cinder-volume[84538]: DEBUG cinder.volume.manager [None req-0a91f20f-aac0-4ca0-ada2-6bb67e7fc047 tempest-CreateVolumesFromSourceVolumeTest-1124812184 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c90c290f-f890-4e75-aea5-6e95533d1940) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 19:06:01 devstack cinder-volume[84538]: DEBUG cinder.volume.manager [None req-0a91f20f-aac0-4ca0-ada2-6bb67e7fc047 tempest-CreateVolumesFromSourceVolumeTest-1124812184 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d0cf3aed-98e6-4daa-b823-6ddbabd7dcac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 19:06:01 devstack cinder-volume[84538]: DEBUG cinder.volume.manager [None req-0a91f20f-aac0-4ca0-ada2-6bb67e7fc047 tempest-CreateVolumesFromSourceVolumeTest-1124812184 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d0cf3aed-98e6-4daa-b823-6ddbabd7dcac) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'faff55de-8fb1-438a-ac6f-95b0ccef21ab', 'volume_name': 'volume-faff55de-8fb1-438a-ac6f-95b0ccef21ab', 'volume_size': 1}' {{(pid=84538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 19:06:01 devstack sudo[92611]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-16c32655-8006-4faf-bd2a-33c9a749eb6b Apr 29 19:06:01 devstack sudo[92611]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 19:06:01 devstack cinder-volume[84538]: DEBUG cinder.volume.manager [None req-0a91f20f-aac0-4ca0-ada2-6bb67e7fc047 tempest-CreateVolumesFromSourceVolumeTest-1124812184 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (107a4c70-1587-494a-8f47-036cf6b0dc46) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 19:06:01 devstack cinder-volume[84538]: DEBUG cinder.volume.manager [None req-0a91f20f-aac0-4ca0-ada2-6bb67e7fc047 tempest-CreateVolumesFromSourceVolumeTest-1124812184 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (107a4c70-1587-494a-8f47-036cf6b0dc46) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 19:06:01 devstack cinder-volume[84538]: DEBUG cinder.volume.manager [None req-0a91f20f-aac0-4ca0-ada2-6bb67e7fc047 tempest-CreateVolumesFromSourceVolumeTest-1124812184 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (22320c70-62ab-4d1d-82e4-2cda1a651a70) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 19:06:01 devstack cinder-volume[84538]: INFO cinder.volume.flows.manager.create_volume [None req-0a91f20f-aac0-4ca0-ada2-6bb67e7fc047 tempest-CreateVolumesFromSourceVolumeTest-1124812184 None] Volume faff55de-8fb1-438a-ac6f-95b0ccef21ab: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-faff55de-8fb1-438a-ac6f-95b0ccef21ab', 'volume_size': 1} Apr 29 19:06:01 devstack cinder-volume[84538]: DEBUG oslo_concurrency.lockutils [None req-0a91f20f-aac0-4ca0-ada2-6bb67e7fc047 tempest-CreateVolumesFromSourceVolumeTest-1124812184 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 19:06:02 devstack cinder-volume[84538]: DEBUG cinder.volume.flows.manager.create_volume [None req-9c48e0ef-6d53-4bea-9cb5-c36fba3425d7 tempest-CreateVolumesFromSourceVolumeTest-1124812184 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84538) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Apr 29 19:06:02 devstack cinder-volume[84538]: DEBUG cinder.volume.manager [None req-9c48e0ef-6d53-4bea-9cb5-c36fba3425d7 tempest-CreateVolumesFromSourceVolumeTest-1124812184 None] Flow 'volume_create_manager' (567327b9-9e1f-4852-8a5b-6559e5dcbca4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84538) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 19:06:02 devstack cinder-volume[84538]: DEBUG cinder.volume.manager [None req-9c48e0ef-6d53-4bea-9cb5-c36fba3425d7 tempest-CreateVolumesFromSourceVolumeTest-1124812184 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (53e1d87c-0174-4b15-9b77-f71ec722f1c8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 19:06:02 devstack cinder-volume[84538]: DEBUG cinder.volume.manager [None req-9c48e0ef-6d53-4bea-9cb5-c36fba3425d7 tempest-CreateVolumesFromSourceVolumeTest-1124812184 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (53e1d87c-0174-4b15-9b77-f71ec722f1c8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-29T17:06:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1946898676',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f1b480be-1196-40a1-98f8-e83fc415de16,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f55552bb071a4e93ae2c788f38b4fe37',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T17:06:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T17:06:02Z,use_quota=True,user_id='9edcc640ca7040a5b9ecc3e6e1801af9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(62b05900-93e3-4190-a88f-1d87324303d1),volume_type_id=62b05900-93e3-4190-a88f-1d87324303d1)' {{(pid=84538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 19:06:02 devstack cinder-volume[84538]: DEBUG cinder.volume.manager [None req-9c48e0ef-6d53-4bea-9cb5-c36fba3425d7 tempest-CreateVolumesFromSourceVolumeTest-1124812184 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d42a16df-15c0-43e4-8e2c-32c5852bedfd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 19:06:02 devstack cinder-volume[84538]: DEBUG cinder.volume.manager [None req-9c48e0ef-6d53-4bea-9cb5-c36fba3425d7 tempest-CreateVolumesFromSourceVolumeTest-1124812184 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d42a16df-15c0-43e4-8e2c-32c5852bedfd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 19:06:02 devstack cinder-volume[84538]: DEBUG cinder.volume.manager [None req-9c48e0ef-6d53-4bea-9cb5-c36fba3425d7 tempest-CreateVolumesFromSourceVolumeTest-1124812184 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1e0ca0d9-1163-40fa-ab83-66104c4386d6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 19:06:02 devstack cinder-volume[84538]: DEBUG cinder.volume.manager [None req-9c48e0ef-6d53-4bea-9cb5-c36fba3425d7 tempest-CreateVolumesFromSourceVolumeTest-1124812184 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1e0ca0d9-1163-40fa-ab83-66104c4386d6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f1b480be-1196-40a1-98f8-e83fc415de16', 'volume_name': 'volume-f1b480be-1196-40a1-98f8-e83fc415de16', 'volume_size': 1}' {{(pid=84538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 19:06:02 devstack cinder-volume[84538]: DEBUG cinder.volume.manager [None req-9c48e0ef-6d53-4bea-9cb5-c36fba3425d7 tempest-CreateVolumesFromSourceVolumeTest-1124812184 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7ffd622e-5834-4b2b-b1d4-fc4c8a397671) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 19:06:02 devstack cinder-volume[84538]: DEBUG cinder.volume.manager [None req-9c48e0ef-6d53-4bea-9cb5-c36fba3425d7 tempest-CreateVolumesFromSourceVolumeTest-1124812184 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7ffd622e-5834-4b2b-b1d4-fc4c8a397671) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 19:06:02 devstack cinder-volume[84538]: DEBUG cinder.volume.manager [None req-9c48e0ef-6d53-4bea-9cb5-c36fba3425d7 tempest-CreateVolumesFromSourceVolumeTest-1124812184 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7bc6e518-e598-4f98-b9ca-dfdfc45788dd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 19:06:02 devstack cinder-volume[84538]: INFO cinder.volume.flows.manager.create_volume [None req-9c48e0ef-6d53-4bea-9cb5-c36fba3425d7 tempest-CreateVolumesFromSourceVolumeTest-1124812184 None] Volume f1b480be-1196-40a1-98f8-e83fc415de16: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f1b480be-1196-40a1-98f8-e83fc415de16', 'volume_size': 1} Apr 29 19:06:02 devstack cinder-volume[84538]: DEBUG oslo_concurrency.lockutils [None req-9c48e0ef-6d53-4bea-9cb5-c36fba3425d7 tempest-CreateVolumesFromSourceVolumeTest-1124812184 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 19:06:02 devstack sudo[92607]: pam_unix(sudo:session): session closed for user root Apr 29 19:06:02 devstack cinder-volume[84538]: DEBUG oslo_concurrency.processutils [None req-de318266-d07b-495e-8bec-b2d47525a45c tempest-VolumesSnapshotListTestJSON-317057059 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-1387f25c-dfd4-4f52-beab-27cf8a1036b3.aeccab15-22ba-4e33-a605-893690e2c313" returned: 0 in 0.946s {{(pid=84538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 19:06:02 devstack cinder-volume[84538]: DEBUG oslo_concurrency.processutils [None req-de318266-d07b-495e-8bec-b2d47525a45c tempest-VolumesSnapshotListTestJSON-317057059 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-1387f25c-dfd4-4f52-beab-27cf8a1036b3.aeccab15-22ba-4e33-a605-893690e2c313 {{(pid=84538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 19:06:02 devstack sudo[92609]: pam_unix(sudo:session): session closed for user root Apr 29 19:06:02 devstack cinder-volume[84538]: DEBUG oslo_concurrency.processutils [None req-15c0b00e-baaf-4a87-a01b-9eddd1346881 tempest-VolumesExtendTest-451302124 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-5aebb3fe-daab-4c3c-ab11-1603804e4ec7.718e390c-4ce4-498c-995d-6e2a6f9d8fd6" returned: 0 in 0.866s {{(pid=84538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 19:06:02 devstack cinder-volume[84538]: DEBUG cinder.volume.drivers.remotefs [None req-15c0b00e-baaf-4a87-a01b-9eddd1346881 tempest-VolumesExtendTest-451302124 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-5aebb3fe-daab-4c3c-ab11-1603804e4ec7(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=84538) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 29 19:06:02 devstack sudo[92620]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-1387f25c-dfd4-4f52-beab-27cf8a1036b3.aeccab15-22ba-4e33-a605-893690e2c313 Apr 29 19:06:02 devstack sudo[92620]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 19:06:02 devstack cinder-volume[84538]: DEBUG oslo.privsep.daemon [-] privsep: reply[b19770a8-52cd-48ac-90f0-98039f507d61]: (4, 'qcow2') {{(pid=85803) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 19:06:02 devstack cinder-volume[84538]: DEBUG oslo_concurrency.processutils [None req-15c0b00e-baaf-4a87-a01b-9eddd1346881 tempest-VolumesExtendTest-451302124 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-5aebb3fe-daab-4c3c-ab11-1603804e4ec7 {{(pid=84538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 19:06:02 devstack sudo[92611]: pam_unix(sudo:session): session closed for user root Apr 29 19:06:02 devstack cinder-volume[84538]: DEBUG oslo_concurrency.processutils [None req-0fb1b817-a6ac-456d-bfa5-698c049dc617 tempest-CreateVolumesFromSourceVolumeTest-1124812184 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-16c32655-8006-4faf-bd2a-33c9a749eb6b" returned: 0 in 0.813s {{(pid=84538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 19:06:02 devstack cinder-volume[84538]: DEBUG cinder.volume.drivers.quobyte [None req-0fb1b817-a6ac-456d-bfa5-698c049dc617 tempest-CreateVolumesFromSourceVolumeTest-1124812184 None] <== create_volume: return (1966ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-34312b00-dd6d-45bb-af98-75855cea8e48'} {{(pid=84538) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 29 19:06:02 devstack cinder-volume[84538]: DEBUG oslo_concurrency.lockutils [None req-0fb1b817-a6ac-456d-bfa5-698c049dc617 tempest-CreateVolumesFromSourceVolumeTest-1124812184 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.971s {{(pid=84538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 19:06:02 devstack cinder-volume[84538]: DEBUG oslo_concurrency.lockutils [None req-50bc68cc-9c36-448e-b2a5-83eb31388f4c tempest-CreateVolumesFromSourceVolumeTest-1124812184 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.615s {{(pid=84538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 19:06:02 devstack cinder-volume[84538]: DEBUG cinder.volume.drivers.quobyte [None req-50bc68cc-9c36-448e-b2a5-83eb31388f4c tempest-CreateVolumesFromSourceVolumeTest-1124812184 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-29T17:06:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-256238634',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4b924b80-52da-4699-be6a-1529743f41a1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f55552bb071a4e93ae2c788f38b4fe37',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T17:06:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T17:06:01Z,use_quota=True,user_id='9edcc640ca7040a5b9ecc3e6e1801af9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(62b05900-93e3-4190-a88f-1d87324303d1),volume_type_id=62b05900-93e3-4190-a88f-1d87324303d1)}" {{(pid=84538) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 29 19:06:02 devstack cinder-volume[84538]: DEBUG cinder.volume.drivers.remotefs [None req-50bc68cc-9c36-448e-b2a5-83eb31388f4c tempest-CreateVolumesFromSourceVolumeTest-1124812184 None] Creating volume 4b924b80-52da-4699-be6a-1529743f41a1 {{(pid=84538) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 29 19:06:02 devstack cinder-volume[84538]: DEBUG oslo_concurrency.lockutils [None req-50bc68cc-9c36-448e-b2a5-83eb31388f4c tempest-CreateVolumesFromSourceVolumeTest-1124812184 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 19:06:02 devstack cinder-volume[84538]: DEBUG oslo_concurrency.lockutils [None req-50bc68cc-9c36-448e-b2a5-83eb31388f4c tempest-CreateVolumesFromSourceVolumeTest-1124812184 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=84538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 19:06:02 devstack cinder-volume[84538]: DEBUG cinder.volume.drivers.quobyte [None req-50bc68cc-9c36-448e-b2a5-83eb31388f4c tempest-CreateVolumesFromSourceVolumeTest-1124812184 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-34312b00-dd6d-45bb-af98-75855cea8e48': None} {{(pid=84538) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 19:06:02 devstack sudo[92623]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-5aebb3fe-daab-4c3c-ab11-1603804e4ec7 Apr 29 19:06:02 devstack cinder-volume[84538]: DEBUG cinder.volume.drivers.quobyte [None req-50bc68cc-9c36-448e-b2a5-83eb31388f4c tempest-CreateVolumesFromSourceVolumeTest-1124812184 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-34312b00-dd6d-45bb-af98-75855cea8e48'] {{(pid=84538) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 19:06:02 devstack cinder-volume[84538]: DEBUG oslo_concurrency.lockutils [None req-50bc68cc-9c36-448e-b2a5-83eb31388f4c tempest-CreateVolumesFromSourceVolumeTest-1124812184 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=84538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 19:06:02 devstack cinder-volume[84538]: DEBUG cinder.volume.drivers.quobyte [None req-50bc68cc-9c36-448e-b2a5-83eb31388f4c tempest-CreateVolumesFromSourceVolumeTest-1124812184 None] Selected osci02.corp.quobyte.com/cinder-vol-34312b00-dd6d-45bb-af98-75855cea8e48 as target Quobyte volume. {{(pid=84538) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 29 19:06:02 devstack cinder-volume[84538]: INFO cinder.volume.drivers.remotefs [None req-50bc68cc-9c36-448e-b2a5-83eb31388f4c tempest-CreateVolumesFromSourceVolumeTest-1124812184 None] casted to osci02.corp.quobyte.com/cinder-vol-34312b00-dd6d-45bb-af98-75855cea8e48 Apr 29 19:06:02 devstack cinder-volume[84538]: DEBUG oslo_concurrency.processutils [None req-50bc68cc-9c36-448e-b2a5-83eb31388f4c tempest-CreateVolumesFromSourceVolumeTest-1124812184 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-4b924b80-52da-4699-be6a-1529743f41a1 1073741824 {{(pid=84538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 19:06:02 devstack sudo[92623]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 19:06:02 devstack sudo[92625]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-4b924b80-52da-4699-be6a-1529743f41a1 1073741824 Apr 29 19:06:02 devstack sudo[92625]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 19:06:02 devstack cinder-volume[84538]: DEBUG cinder.volume.manager [None req-0fb1b817-a6ac-456d-bfa5-698c049dc617 tempest-CreateVolumesFromSourceVolumeTest-1124812184 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cc64240f-b3c6-41b8-b81d-fed44e3c40ef) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-16c32655-8006-4faf-bd2a-33c9a749eb6b', 'volume_size': 1}' {{(pid=84538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 19:06:02 devstack cinder-volume[84538]: DEBUG cinder.volume.manager [None req-0fb1b817-a6ac-456d-bfa5-698c049dc617 tempest-CreateVolumesFromSourceVolumeTest-1124812184 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a3933e55-c5ae-4bed-87bd-7b214736e158) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 19:06:02 devstack cinder-volume[84538]: INFO cinder.volume.flows.manager.create_volume [None req-0fb1b817-a6ac-456d-bfa5-698c049dc617 tempest-CreateVolumesFromSourceVolumeTest-1124812184 None] Volume volume-16c32655-8006-4faf-bd2a-33c9a749eb6b (16c32655-8006-4faf-bd2a-33c9a749eb6b): created successfully Apr 29 19:06:02 devstack cinder-volume[84538]: DEBUG cinder.volume.manager [None req-0fb1b817-a6ac-456d-bfa5-698c049dc617 tempest-CreateVolumesFromSourceVolumeTest-1124812184 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a3933e55-c5ae-4bed-87bd-7b214736e158) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 19:06:02 devstack cinder-volume[84538]: DEBUG cinder.volume.manager [None req-0fb1b817-a6ac-456d-bfa5-698c049dc617 tempest-CreateVolumesFromSourceVolumeTest-1124812184 None] Flow 'volume_create_manager' (32466c8c-6f59-41d5-8e4c-9195f1634e1b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84538) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 19:06:02 devstack cinder-volume[84538]: INFO cinder.volume.manager [None req-0fb1b817-a6ac-456d-bfa5-698c049dc617 tempest-CreateVolumesFromSourceVolumeTest-1124812184 None] Created volume successfully. Apr 29 19:06:03 devstack sudo[92620]: pam_unix(sudo:session): session closed for user root Apr 29 19:06:03 devstack cinder-volume[84538]: DEBUG oslo_concurrency.processutils [None req-de318266-d07b-495e-8bec-b2d47525a45c tempest-VolumesSnapshotListTestJSON-317057059 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-1387f25c-dfd4-4f52-beab-27cf8a1036b3.aeccab15-22ba-4e33-a605-893690e2c313" returned: 0 in 0.663s {{(pid=84538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 19:06:03 devstack cinder-volume[84538]: DEBUG cinder.coordination [None req-de318266-d07b-495e-8bec-b2d47525a45c tempest-VolumesSnapshotListTestJSON-317057059 None] Lock "cinder-quobyte-aeccab15-22ba-4e33-a605-893690e2c313" released by "_delete_snapshot" :: held 3.544s {{(pid=84538) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 19:06:03 devstack cinder-volume[84538]: DEBUG cinder.coordination [None req-de318266-d07b-495e-8bec-b2d47525a45c tempest-VolumesSnapshotListTestJSON-317057059 None] Lock "cinder-quobyte-1387f25c-dfd4-4f52-beab-27cf8a1036b3" released by "delete_snapshot" :: held 3.572s {{(pid=84538) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 19:06:03 devstack cinder-volume[84538]: DEBUG cinder.quota [None req-de318266-d07b-495e-8bec-b2d47525a45c tempest-VolumesSnapshotListTestJSON-317057059 None] Created reservations ['5fb9e189-fed4-4fe7-a250-2224e3fdf346', 'a7db2ec5-be5e-4b3e-b713-87a9cdc9d02a', '3d4db8bd-70fd-459c-b118-3b4fbea3b693', 'ff1541ad-4ab9-479b-8f22-9392e33389c5'] {{(pid=84538) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 29 19:06:03 devstack sudo[92623]: pam_unix(sudo:session): session closed for user root Apr 29 19:06:03 devstack cinder-volume[84538]: DEBUG oslo_concurrency.processutils [None req-15c0b00e-baaf-4a87-a01b-9eddd1346881 tempest-VolumesExtendTest-451302124 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-5aebb3fe-daab-4c3c-ab11-1603804e4ec7" returned: 0 in 0.773s {{(pid=84538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 19:06:03 devstack cinder-volume[84538]: DEBUG oslo_concurrency.processutils [None req-15c0b00e-baaf-4a87-a01b-9eddd1346881 tempest-VolumesExtendTest-451302124 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-5aebb3fe-daab-4c3c-ab11-1603804e4ec7.718e390c-4ce4-498c-995d-6e2a6f9d8fd6 {{(pid=84538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 19:06:03 devstack sudo[92635]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-5aebb3fe-daab-4c3c-ab11-1603804e4ec7.718e390c-4ce4-498c-995d-6e2a6f9d8fd6 Apr 29 19:06:03 devstack sudo[92635]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 19:06:03 devstack cinder-volume[84538]: INFO cinder.volume.manager [None req-de318266-d07b-495e-8bec-b2d47525a45c tempest-VolumesSnapshotListTestJSON-317057059 None] Delete snapshot completed successfully. Apr 29 19:06:03 devstack cinder-volume[84538]: DEBUG cinder.coordination [None req-de318266-d07b-495e-8bec-b2d47525a45c tempest-VolumesSnapshotListTestJSON-317057059 None] Lock "cinder-aeccab15-22ba-4e33-a605-893690e2c313-delete_snapshot" released by "delete_snapshot" :: held 3.750s {{(pid=84538) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 19:06:03 devstack sudo[92625]: pam_unix(sudo:session): session closed for user root Apr 29 19:06:03 devstack cinder-volume[84538]: DEBUG oslo_concurrency.processutils [None req-50bc68cc-9c36-448e-b2a5-83eb31388f4c tempest-CreateVolumesFromSourceVolumeTest-1124812184 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-4b924b80-52da-4699-be6a-1529743f41a1 1073741824" returned: 0 in 0.849s {{(pid=84538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 19:06:03 devstack cinder-volume[84538]: DEBUG oslo_concurrency.processutils [None req-50bc68cc-9c36-448e-b2a5-83eb31388f4c tempest-CreateVolumesFromSourceVolumeTest-1124812184 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-4b924b80-52da-4699-be6a-1529743f41a1 {{(pid=84538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 19:06:03 devstack sudo[92638]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-4b924b80-52da-4699-be6a-1529743f41a1 Apr 29 19:06:03 devstack sudo[92638]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 19:06:03 devstack cinder-volume[84538]: DEBUG cinder.coordination [None req-288c07d5-7224-46d3-a728-f70692f5a350 tempest-VolumesSnapshotListTestJSON-317057059 None] Acquiring lock "cinder-ff59994d-ced0-4c35-828f-5d485995c96f-delete_snapshot" by "delete_snapshot" {{(pid=84538) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 19:06:03 devstack cinder-volume[84538]: DEBUG cinder.coordination [None req-288c07d5-7224-46d3-a728-f70692f5a350 tempest-VolumesSnapshotListTestJSON-317057059 None] Lock "cinder-ff59994d-ced0-4c35-828f-5d485995c96f-delete_snapshot" acquired by "delete_snapshot" :: waited 0.022s {{(pid=84538) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 19:06:03 devstack cinder-volume[84538]: DEBUG cinder.coordination [None req-288c07d5-7224-46d3-a728-f70692f5a350 tempest-VolumesSnapshotListTestJSON-317057059 None] Acquiring lock "cinder-quobyte-1387f25c-dfd4-4f52-beab-27cf8a1036b3" by "delete_snapshot" {{(pid=84538) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 19:06:03 devstack cinder-volume[84538]: DEBUG cinder.coordination [None req-288c07d5-7224-46d3-a728-f70692f5a350 tempest-VolumesSnapshotListTestJSON-317057059 None] Lock "cinder-quobyte-1387f25c-dfd4-4f52-beab-27cf8a1036b3" acquired by "delete_snapshot" :: waited 0.021s {{(pid=84538) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 19:06:03 devstack cinder-volume[84538]: DEBUG cinder.coordination [None req-288c07d5-7224-46d3-a728-f70692f5a350 tempest-VolumesSnapshotListTestJSON-317057059 None] Acquiring lock "cinder-quobyte-ff59994d-ced0-4c35-828f-5d485995c96f" by "_delete_snapshot" {{(pid=84538) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 19:06:03 devstack cinder-volume[84538]: DEBUG cinder.coordination [None req-288c07d5-7224-46d3-a728-f70692f5a350 tempest-VolumesSnapshotListTestJSON-317057059 None] Lock "cinder-quobyte-ff59994d-ced0-4c35-828f-5d485995c96f" acquired by "_delete_snapshot" :: waited 0.018s {{(pid=84538) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 19:06:03 devstack cinder-volume[84538]: DEBUG cinder.volume.drivers.remotefs [None req-288c07d5-7224-46d3-a728-f70692f5a350 tempest-VolumesSnapshotListTestJSON-317057059 None] Deleting offline snapshot ff59994d-ced0-4c35-828f-5d485995c96f of volume 1387f25c-dfd4-4f52-beab-27cf8a1036b3 {{(pid=84538) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 29 19:06:03 devstack cinder-volume[84538]: DEBUG cinder.volume.drivers.remotefs [None req-288c07d5-7224-46d3-a728-f70692f5a350 tempest-VolumesSnapshotListTestJSON-317057059 None] snapshot_file for this snap is: volume-1387f25c-dfd4-4f52-beab-27cf8a1036b3.ff59994d-ced0-4c35-828f-5d485995c96f {{(pid=84538) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 29 19:06:03 devstack cinder-volume[84538]: DEBUG oslo.privsep.daemon [-] privsep: reply[c1fb71f6-2fdc-48a8-83df-e6364e630415]: (4, 'qcow2') {{(pid=85803) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 19:06:03 devstack cinder-volume[84538]: DEBUG oslo_concurrency.processutils [None req-288c07d5-7224-46d3-a728-f70692f5a350 tempest-VolumesSnapshotListTestJSON-317057059 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-1387f25c-dfd4-4f52-beab-27cf8a1036b3.ff59994d-ced0-4c35-828f-5d485995c96f {{(pid=84538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 19:06:04 devstack sudo[92643]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-1387f25c-dfd4-4f52-beab-27cf8a1036b3.ff59994d-ced0-4c35-828f-5d485995c96f Apr 29 19:06:04 devstack sudo[92643]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 19:06:04 devstack sudo[92638]: pam_unix(sudo:session): session closed for user root Apr 29 19:06:04 devstack cinder-volume[84538]: DEBUG oslo_concurrency.processutils [None req-50bc68cc-9c36-448e-b2a5-83eb31388f4c tempest-CreateVolumesFromSourceVolumeTest-1124812184 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-4b924b80-52da-4699-be6a-1529743f41a1" returned: 0 in 0.588s {{(pid=84538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 19:06:04 devstack cinder-volume[84538]: DEBUG cinder.volume.drivers.quobyte [None req-50bc68cc-9c36-448e-b2a5-83eb31388f4c tempest-CreateVolumesFromSourceVolumeTest-1124812184 None] <== create_volume: return (1478ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-34312b00-dd6d-45bb-af98-75855cea8e48'} {{(pid=84538) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 29 19:06:04 devstack cinder-volume[84538]: DEBUG oslo_concurrency.lockutils [None req-50bc68cc-9c36-448e-b2a5-83eb31388f4c tempest-CreateVolumesFromSourceVolumeTest-1124812184 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.482s {{(pid=84538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 19:06:04 devstack cinder-volume[84538]: DEBUG oslo_concurrency.lockutils [None req-b0f65cdd-c728-45d6-8dd5-f65c7b635430 tempest-CreateVolumesFromSourceVolumeTest-1124812184 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.585s {{(pid=84538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 19:06:04 devstack cinder-volume[84538]: DEBUG cinder.volume.drivers.quobyte [None req-b0f65cdd-c728-45d6-8dd5-f65c7b635430 tempest-CreateVolumesFromSourceVolumeTest-1124812184 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-29T17:06:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1493235706',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=855aa78a-368b-425a-a7c7-54110dd8846d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f55552bb071a4e93ae2c788f38b4fe37',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T17:06:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T17:06:01Z,use_quota=True,user_id='9edcc640ca7040a5b9ecc3e6e1801af9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(62b05900-93e3-4190-a88f-1d87324303d1),volume_type_id=62b05900-93e3-4190-a88f-1d87324303d1)}" {{(pid=84538) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 29 19:06:04 devstack cinder-volume[84538]: DEBUG cinder.volume.drivers.remotefs [None req-b0f65cdd-c728-45d6-8dd5-f65c7b635430 tempest-CreateVolumesFromSourceVolumeTest-1124812184 None] Creating volume 855aa78a-368b-425a-a7c7-54110dd8846d {{(pid=84538) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 29 19:06:04 devstack cinder-volume[84538]: DEBUG oslo_concurrency.lockutils [None req-b0f65cdd-c728-45d6-8dd5-f65c7b635430 tempest-CreateVolumesFromSourceVolumeTest-1124812184 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 19:06:04 devstack cinder-volume[84538]: DEBUG oslo_concurrency.lockutils [None req-b0f65cdd-c728-45d6-8dd5-f65c7b635430 tempest-CreateVolumesFromSourceVolumeTest-1124812184 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=84538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 19:06:04 devstack cinder-volume[84538]: DEBUG cinder.volume.drivers.quobyte [None req-b0f65cdd-c728-45d6-8dd5-f65c7b635430 tempest-CreateVolumesFromSourceVolumeTest-1124812184 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-34312b00-dd6d-45bb-af98-75855cea8e48': None} {{(pid=84538) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 19:06:04 devstack cinder-volume[84538]: DEBUG cinder.volume.drivers.quobyte [None req-b0f65cdd-c728-45d6-8dd5-f65c7b635430 tempest-CreateVolumesFromSourceVolumeTest-1124812184 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-34312b00-dd6d-45bb-af98-75855cea8e48'] {{(pid=84538) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 19:06:04 devstack cinder-volume[84538]: DEBUG oslo_concurrency.lockutils [None req-b0f65cdd-c728-45d6-8dd5-f65c7b635430 tempest-CreateVolumesFromSourceVolumeTest-1124812184 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=84538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 19:06:04 devstack cinder-volume[84538]: DEBUG cinder.volume.drivers.quobyte [None req-b0f65cdd-c728-45d6-8dd5-f65c7b635430 tempest-CreateVolumesFromSourceVolumeTest-1124812184 None] Selected osci02.corp.quobyte.com/cinder-vol-34312b00-dd6d-45bb-af98-75855cea8e48 as target Quobyte volume. {{(pid=84538) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 29 19:06:04 devstack cinder-volume[84538]: INFO cinder.volume.drivers.remotefs [None req-b0f65cdd-c728-45d6-8dd5-f65c7b635430 tempest-CreateVolumesFromSourceVolumeTest-1124812184 None] casted to osci02.corp.quobyte.com/cinder-vol-34312b00-dd6d-45bb-af98-75855cea8e48 Apr 29 19:06:04 devstack cinder-volume[84538]: DEBUG oslo_concurrency.processutils [None req-b0f65cdd-c728-45d6-8dd5-f65c7b635430 tempest-CreateVolumesFromSourceVolumeTest-1124812184 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-855aa78a-368b-425a-a7c7-54110dd8846d 1073741824 {{(pid=84538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 19:06:04 devstack sudo[92635]: pam_unix(sudo:session): session closed for user root Apr 29 19:06:04 devstack cinder-volume[84538]: DEBUG oslo_concurrency.processutils [None req-15c0b00e-baaf-4a87-a01b-9eddd1346881 tempest-VolumesExtendTest-451302124 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-5aebb3fe-daab-4c3c-ab11-1603804e4ec7.718e390c-4ce4-498c-995d-6e2a6f9d8fd6" returned: 0 in 0.840s {{(pid=84538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 19:06:04 devstack cinder-volume[84538]: DEBUG oslo_concurrency.processutils [None req-15c0b00e-baaf-4a87-a01b-9eddd1346881 tempest-VolumesExtendTest-451302124 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-5aebb3fe-daab-4c3c-ab11-1603804e4ec7.718e390c-4ce4-498c-995d-6e2a6f9d8fd6 {{(pid=84538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 19:06:04 devstack sudo[92646]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-855aa78a-368b-425a-a7c7-54110dd8846d 1073741824 Apr 29 19:06:04 devstack sudo[92646]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 19:06:04 devstack cinder-volume[84538]: DEBUG cinder.volume.manager [None req-50bc68cc-9c36-448e-b2a5-83eb31388f4c tempest-CreateVolumesFromSourceVolumeTest-1124812184 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e412cd6b-6e21-4db6-9e7e-3eba0de5e37f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4b924b80-52da-4699-be6a-1529743f41a1', 'volume_size': 1}' {{(pid=84538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 19:06:04 devstack cinder-volume[84538]: DEBUG cinder.volume.manager [None req-50bc68cc-9c36-448e-b2a5-83eb31388f4c tempest-CreateVolumesFromSourceVolumeTest-1124812184 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1a09a62a-5039-49e2-bb02-7cafa39d1b2e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 19:06:04 devstack sudo[92648]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-5aebb3fe-daab-4c3c-ab11-1603804e4ec7.718e390c-4ce4-498c-995d-6e2a6f9d8fd6 Apr 29 19:06:04 devstack sudo[92648]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 19:06:04 devstack cinder-volume[84538]: INFO cinder.volume.flows.manager.create_volume [None req-50bc68cc-9c36-448e-b2a5-83eb31388f4c tempest-CreateVolumesFromSourceVolumeTest-1124812184 None] Volume volume-4b924b80-52da-4699-be6a-1529743f41a1 (4b924b80-52da-4699-be6a-1529743f41a1): created successfully Apr 29 19:06:04 devstack cinder-volume[84538]: DEBUG cinder.volume.manager [None req-50bc68cc-9c36-448e-b2a5-83eb31388f4c tempest-CreateVolumesFromSourceVolumeTest-1124812184 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1a09a62a-5039-49e2-bb02-7cafa39d1b2e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 19:06:04 devstack cinder-volume[84538]: DEBUG cinder.volume.manager [None req-50bc68cc-9c36-448e-b2a5-83eb31388f4c tempest-CreateVolumesFromSourceVolumeTest-1124812184 None] Flow 'volume_create_manager' (49fe9e07-2bd2-4643-8fa5-1a45048d6b87) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84538) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 19:06:04 devstack cinder-volume[84538]: INFO cinder.volume.manager [None req-50bc68cc-9c36-448e-b2a5-83eb31388f4c tempest-CreateVolumesFromSourceVolumeTest-1124812184 None] Created volume successfully. Apr 29 19:06:04 devstack sudo[92643]: pam_unix(sudo:session): session closed for user root Apr 29 19:06:04 devstack cinder-volume[84538]: DEBUG oslo_concurrency.processutils [None req-288c07d5-7224-46d3-a728-f70692f5a350 tempest-VolumesSnapshotListTestJSON-317057059 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-1387f25c-dfd4-4f52-beab-27cf8a1036b3.ff59994d-ced0-4c35-828f-5d485995c96f" returned: 0 in 0.771s {{(pid=84538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 19:06:04 devstack cinder-volume[84538]: DEBUG cinder.volume.drivers.remotefs [None req-288c07d5-7224-46d3-a728-f70692f5a350 tempest-VolumesSnapshotListTestJSON-317057059 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-1387f25c-dfd4-4f52-beab-27cf8a1036b3(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=84538) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 29 19:06:04 devstack cinder-volume[84538]: DEBUG oslo.privsep.daemon [-] privsep: reply[78488f05-bea6-4714-b622-3c44a3e88d59]: (4, 'qcow2') {{(pid=85803) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 19:06:04 devstack cinder-volume[84538]: DEBUG oslo_concurrency.processutils [None req-288c07d5-7224-46d3-a728-f70692f5a350 tempest-VolumesSnapshotListTestJSON-317057059 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-1387f25c-dfd4-4f52-beab-27cf8a1036b3.836c5cf9-432f-46db-a134-1c1b3e799d42 {{(pid=84538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 19:06:04 devstack sudo[92648]: pam_unix(sudo:session): session closed for user root Apr 29 19:06:04 devstack cinder-volume[84538]: DEBUG oslo_concurrency.processutils [None req-15c0b00e-baaf-4a87-a01b-9eddd1346881 tempest-VolumesExtendTest-451302124 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-5aebb3fe-daab-4c3c-ab11-1603804e4ec7.718e390c-4ce4-498c-995d-6e2a6f9d8fd6" returned: 0 in 0.639s {{(pid=84538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 19:06:04 devstack cinder-volume[84538]: DEBUG cinder.coordination [None req-15c0b00e-baaf-4a87-a01b-9eddd1346881 tempest-VolumesExtendTest-451302124 None] Lock "cinder-quobyte-718e390c-4ce4-498c-995d-6e2a6f9d8fd6" released by "_delete_snapshot" :: held 3.261s {{(pid=84538) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 19:06:04 devstack cinder-volume[84538]: DEBUG cinder.coordination [None req-15c0b00e-baaf-4a87-a01b-9eddd1346881 tempest-VolumesExtendTest-451302124 None] Lock "cinder-quobyte-5aebb3fe-daab-4c3c-ab11-1603804e4ec7" released by "delete_snapshot" :: held 3.308s {{(pid=84538) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 19:06:04 devstack sudo[92657]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-1387f25c-dfd4-4f52-beab-27cf8a1036b3.836c5cf9-432f-46db-a134-1c1b3e799d42 Apr 29 19:06:04 devstack sudo[92657]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 19:06:04 devstack cinder-volume[84538]: DEBUG cinder.quota [None req-15c0b00e-baaf-4a87-a01b-9eddd1346881 tempest-VolumesExtendTest-451302124 None] Created reservations ['851b3ab9-9221-43db-838e-7dff1ff5110b', '5fdbbefd-e68f-4e0d-b949-fc4c78251095', '0455ce60-6e73-455d-85ba-ebd11bc1595f', '3ae46205-160a-429c-bd46-7f6df0d02d0a'] {{(pid=84538) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 29 19:06:04 devstack cinder-volume[84538]: INFO cinder.volume.manager [None req-15c0b00e-baaf-4a87-a01b-9eddd1346881 tempest-VolumesExtendTest-451302124 None] Delete snapshot completed successfully. Apr 29 19:06:04 devstack cinder-volume[84538]: DEBUG cinder.coordination [None req-15c0b00e-baaf-4a87-a01b-9eddd1346881 tempest-VolumesExtendTest-451302124 None] Lock "cinder-718e390c-4ce4-498c-995d-6e2a6f9d8fd6-delete_snapshot" released by "delete_snapshot" :: held 3.554s {{(pid=84538) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 19:06:05 devstack sudo[92646]: pam_unix(sudo:session): session closed for user root Apr 29 19:06:05 devstack cinder-volume[84538]: DEBUG oslo_concurrency.processutils [None req-b0f65cdd-c728-45d6-8dd5-f65c7b635430 tempest-CreateVolumesFromSourceVolumeTest-1124812184 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-855aa78a-368b-425a-a7c7-54110dd8846d 1073741824" returned: 0 in 0.911s {{(pid=84538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 19:06:05 devstack cinder-volume[84538]: DEBUG oslo_concurrency.processutils [None req-b0f65cdd-c728-45d6-8dd5-f65c7b635430 tempest-CreateVolumesFromSourceVolumeTest-1124812184 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-855aa78a-368b-425a-a7c7-54110dd8846d {{(pid=84538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 19:06:05 devstack sudo[92660]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-855aa78a-368b-425a-a7c7-54110dd8846d Apr 29 19:06:05 devstack sudo[92660]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 19:06:05 devstack sudo[92657]: pam_unix(sudo:session): session closed for user root Apr 29 19:06:05 devstack cinder-volume[84538]: DEBUG oslo_concurrency.processutils [None req-288c07d5-7224-46d3-a728-f70692f5a350 tempest-VolumesSnapshotListTestJSON-317057059 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-1387f25c-dfd4-4f52-beab-27cf8a1036b3.836c5cf9-432f-46db-a134-1c1b3e799d42" returned: 0 in 0.810s {{(pid=84538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 19:06:05 devstack cinder-volume[84538]: DEBUG cinder.volume.drivers.remotefs [None req-288c07d5-7224-46d3-a728-f70692f5a350 tempest-VolumesSnapshotListTestJSON-317057059 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-1387f25c-dfd4-4f52-beab-27cf8a1036b3(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=84538) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 29 19:06:05 devstack cinder-volume[84538]: DEBUG oslo_concurrency.processutils [None req-288c07d5-7224-46d3-a728-f70692f5a350 tempest-VolumesSnapshotListTestJSON-317057059 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-1387f25c-dfd4-4f52-beab-27cf8a1036b3.ff59994d-ced0-4c35-828f-5d485995c96f {{(pid=84538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 19:06:05 devstack sudo[92666]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-1387f25c-dfd4-4f52-beab-27cf8a1036b3.ff59994d-ced0-4c35-828f-5d485995c96f Apr 29 19:06:05 devstack sudo[92666]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 19:06:05 devstack sudo[92660]: pam_unix(sudo:session): session closed for user root Apr 29 19:06:05 devstack cinder-volume[84538]: DEBUG oslo_concurrency.processutils [None req-b0f65cdd-c728-45d6-8dd5-f65c7b635430 tempest-CreateVolumesFromSourceVolumeTest-1124812184 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-855aa78a-368b-425a-a7c7-54110dd8846d" returned: 0 in 0.609s {{(pid=84538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 19:06:05 devstack cinder-volume[84538]: DEBUG cinder.volume.drivers.quobyte [None req-b0f65cdd-c728-45d6-8dd5-f65c7b635430 tempest-CreateVolumesFromSourceVolumeTest-1124812184 None] <== create_volume: return (1562ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-34312b00-dd6d-45bb-af98-75855cea8e48'} {{(pid=84538) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 29 19:06:05 devstack cinder-volume[84538]: DEBUG oslo_concurrency.lockutils [None req-b0f65cdd-c728-45d6-8dd5-f65c7b635430 tempest-CreateVolumesFromSourceVolumeTest-1124812184 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.566s {{(pid=84538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 19:06:05 devstack cinder-volume[84538]: DEBUG oslo_concurrency.lockutils [None req-0a91f20f-aac0-4ca0-ada2-6bb67e7fc047 tempest-CreateVolumesFromSourceVolumeTest-1124812184 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.808s {{(pid=84538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 19:06:05 devstack cinder-volume[84538]: DEBUG cinder.volume.drivers.quobyte [None req-0a91f20f-aac0-4ca0-ada2-6bb67e7fc047 tempest-CreateVolumesFromSourceVolumeTest-1124812184 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-29T17:06:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-73415617',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=faff55de-8fb1-438a-ac6f-95b0ccef21ab,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f55552bb071a4e93ae2c788f38b4fe37',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T17:06:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T17:06:02Z,use_quota=True,user_id='9edcc640ca7040a5b9ecc3e6e1801af9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(62b05900-93e3-4190-a88f-1d87324303d1),volume_type_id=62b05900-93e3-4190-a88f-1d87324303d1)}" {{(pid=84538) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 29 19:06:05 devstack cinder-volume[84538]: DEBUG cinder.volume.drivers.remotefs [None req-0a91f20f-aac0-4ca0-ada2-6bb67e7fc047 tempest-CreateVolumesFromSourceVolumeTest-1124812184 None] Creating volume faff55de-8fb1-438a-ac6f-95b0ccef21ab {{(pid=84538) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 29 19:06:05 devstack cinder-volume[84538]: DEBUG oslo_concurrency.lockutils [None req-0a91f20f-aac0-4ca0-ada2-6bb67e7fc047 tempest-CreateVolumesFromSourceVolumeTest-1124812184 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 19:06:05 devstack cinder-volume[84538]: DEBUG oslo_concurrency.lockutils [None req-0a91f20f-aac0-4ca0-ada2-6bb67e7fc047 tempest-CreateVolumesFromSourceVolumeTest-1124812184 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=84538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 19:06:05 devstack cinder-volume[84538]: DEBUG cinder.volume.drivers.quobyte [None req-0a91f20f-aac0-4ca0-ada2-6bb67e7fc047 tempest-CreateVolumesFromSourceVolumeTest-1124812184 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-34312b00-dd6d-45bb-af98-75855cea8e48': None} {{(pid=84538) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 19:06:05 devstack cinder-volume[84538]: DEBUG cinder.volume.drivers.quobyte [None req-0a91f20f-aac0-4ca0-ada2-6bb67e7fc047 tempest-CreateVolumesFromSourceVolumeTest-1124812184 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-34312b00-dd6d-45bb-af98-75855cea8e48'] {{(pid=84538) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 19:06:05 devstack cinder-volume[84538]: DEBUG oslo_concurrency.lockutils [None req-0a91f20f-aac0-4ca0-ada2-6bb67e7fc047 tempest-CreateVolumesFromSourceVolumeTest-1124812184 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=84538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 19:06:05 devstack cinder-volume[84538]: DEBUG cinder.volume.drivers.quobyte [None req-0a91f20f-aac0-4ca0-ada2-6bb67e7fc047 tempest-CreateVolumesFromSourceVolumeTest-1124812184 None] Selected osci02.corp.quobyte.com/cinder-vol-34312b00-dd6d-45bb-af98-75855cea8e48 as target Quobyte volume. {{(pid=84538) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 29 19:06:05 devstack cinder-volume[84538]: INFO cinder.volume.drivers.remotefs [None req-0a91f20f-aac0-4ca0-ada2-6bb67e7fc047 tempest-CreateVolumesFromSourceVolumeTest-1124812184 None] casted to osci02.corp.quobyte.com/cinder-vol-34312b00-dd6d-45bb-af98-75855cea8e48 Apr 29 19:06:05 devstack cinder-volume[84538]: DEBUG oslo_concurrency.processutils [None req-0a91f20f-aac0-4ca0-ada2-6bb67e7fc047 tempest-CreateVolumesFromSourceVolumeTest-1124812184 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-faff55de-8fb1-438a-ac6f-95b0ccef21ab 1073741824 {{(pid=84538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 19:06:05 devstack cinder-volume[84538]: DEBUG cinder.coordination [None req-c2cf9925-da6c-4fbf-a581-99418239a56d tempest-VolumesExtendTest-451302124 None] Acquiring lock "cinder-5aebb3fe-daab-4c3c-ab11-1603804e4ec7-delete_volume" by "delete_volume" {{(pid=84538) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 19:06:05 devstack sudo[92668]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-faff55de-8fb1-438a-ac6f-95b0ccef21ab 1073741824 Apr 29 19:06:05 devstack sudo[92668]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 19:06:05 devstack cinder-volume[84538]: DEBUG cinder.volume.manager [None req-b0f65cdd-c728-45d6-8dd5-f65c7b635430 tempest-CreateVolumesFromSourceVolumeTest-1124812184 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a9ed76f1-4151-4567-80f3-45508a74bb97) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-855aa78a-368b-425a-a7c7-54110dd8846d', 'volume_size': 1}' {{(pid=84538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 19:06:05 devstack cinder-volume[84538]: DEBUG cinder.volume.manager [None req-b0f65cdd-c728-45d6-8dd5-f65c7b635430 tempest-CreateVolumesFromSourceVolumeTest-1124812184 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7176765a-530f-4441-98ed-f7e71e87f81f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 19:06:05 devstack cinder-volume[84538]: DEBUG cinder.coordination [None req-c2cf9925-da6c-4fbf-a581-99418239a56d tempest-VolumesExtendTest-451302124 None] Lock "cinder-5aebb3fe-daab-4c3c-ab11-1603804e4ec7-delete_volume" acquired by "delete_volume" :: waited 0.037s {{(pid=84538) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 19:06:05 devstack cinder-volume[84538]: INFO cinder.volume.flows.manager.create_volume [None req-b0f65cdd-c728-45d6-8dd5-f65c7b635430 tempest-CreateVolumesFromSourceVolumeTest-1124812184 None] Volume volume-855aa78a-368b-425a-a7c7-54110dd8846d (855aa78a-368b-425a-a7c7-54110dd8846d): created successfully Apr 29 19:06:05 devstack cinder-volume[84538]: DEBUG cinder.volume.manager [None req-b0f65cdd-c728-45d6-8dd5-f65c7b635430 tempest-CreateVolumesFromSourceVolumeTest-1124812184 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7176765a-530f-4441-98ed-f7e71e87f81f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 19:06:05 devstack cinder-volume[84538]: DEBUG cinder.volume.manager [None req-b0f65cdd-c728-45d6-8dd5-f65c7b635430 tempest-CreateVolumesFromSourceVolumeTest-1124812184 None] Flow 'volume_create_manager' (25b1d8c5-f47b-45f8-995c-70a95a5f39cc) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84538) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 19:06:05 devstack cinder-volume[84538]: INFO cinder.volume.manager [None req-b0f65cdd-c728-45d6-8dd5-f65c7b635430 tempest-CreateVolumesFromSourceVolumeTest-1124812184 None] Created volume successfully. Apr 29 19:06:05 devstack cinder-volume[84538]: DEBUG cinder.coordination [None req-c2cf9925-da6c-4fbf-a581-99418239a56d tempest-VolumesExtendTest-451302124 None] Acquiring lock "cinder-quobyte-5aebb3fe-daab-4c3c-ab11-1603804e4ec7" by "delete_volume" {{(pid=84538) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 19:06:05 devstack cinder-volume[84538]: DEBUG cinder.coordination [None req-c2cf9925-da6c-4fbf-a581-99418239a56d tempest-VolumesExtendTest-451302124 None] Lock "cinder-quobyte-5aebb3fe-daab-4c3c-ab11-1603804e4ec7" acquired by "delete_volume" :: waited 0.023s {{(pid=84538) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 19:06:05 devstack cinder-volume[84538]: DEBUG oslo.privsep.daemon [-] privsep: reply[b743fb67-ffd2-4d3c-bfdd-f9c9df96dddc]: (4, 'qcow2') {{(pid=85803) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 19:06:05 devstack cinder-volume[84538]: DEBUG oslo_concurrency.processutils [None req-c2cf9925-da6c-4fbf-a581-99418239a56d tempest-VolumesExtendTest-451302124 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-5aebb3fe-daab-4c3c-ab11-1603804e4ec7 {{(pid=84538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 19:06:05 devstack sudo[92670]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-5aebb3fe-daab-4c3c-ab11-1603804e4ec7 Apr 29 19:06:05 devstack sudo[92670]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 19:06:06 devstack sudo[92666]: pam_unix(sudo:session): session closed for user root Apr 29 19:06:06 devstack cinder-volume[84538]: DEBUG oslo_concurrency.processutils [None req-288c07d5-7224-46d3-a728-f70692f5a350 tempest-VolumesSnapshotListTestJSON-317057059 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-1387f25c-dfd4-4f52-beab-27cf8a1036b3.ff59994d-ced0-4c35-828f-5d485995c96f" returned: 0 in 0.822s {{(pid=84538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 19:06:06 devstack cinder-volume[84538]: DEBUG oslo_concurrency.processutils [None req-288c07d5-7224-46d3-a728-f70692f5a350 tempest-VolumesSnapshotListTestJSON-317057059 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-1387f25c-dfd4-4f52-beab-27cf8a1036b3.ff59994d-ced0-4c35-828f-5d485995c96f {{(pid=84538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 19:06:06 devstack sudo[92680]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-1387f25c-dfd4-4f52-beab-27cf8a1036b3.ff59994d-ced0-4c35-828f-5d485995c96f Apr 29 19:06:06 devstack sudo[92680]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 19:06:06 devstack sudo[92668]: pam_unix(sudo:session): session closed for user root Apr 29 19:06:06 devstack cinder-volume[84538]: DEBUG oslo_concurrency.processutils [None req-0a91f20f-aac0-4ca0-ada2-6bb67e7fc047 tempest-CreateVolumesFromSourceVolumeTest-1124812184 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-faff55de-8fb1-438a-ac6f-95b0ccef21ab 1073741824" returned: 0 in 0.873s {{(pid=84538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 19:06:06 devstack cinder-volume[84538]: DEBUG oslo_concurrency.processutils [None req-0a91f20f-aac0-4ca0-ada2-6bb67e7fc047 tempest-CreateVolumesFromSourceVolumeTest-1124812184 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-faff55de-8fb1-438a-ac6f-95b0ccef21ab {{(pid=84538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 19:06:06 devstack sudo[92686]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-faff55de-8fb1-438a-ac6f-95b0ccef21ab Apr 29 19:06:06 devstack sudo[92686]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 19:06:06 devstack sudo[92670]: pam_unix(sudo:session): session closed for user root Apr 29 19:06:06 devstack cinder-volume[84538]: DEBUG oslo_concurrency.processutils [None req-c2cf9925-da6c-4fbf-a581-99418239a56d tempest-VolumesExtendTest-451302124 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-5aebb3fe-daab-4c3c-ab11-1603804e4ec7" returned: 0 in 0.770s {{(pid=84538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 19:06:06 devstack cinder-volume[84538]: DEBUG oslo_concurrency.processutils [None req-c2cf9925-da6c-4fbf-a581-99418239a56d tempest-VolumesExtendTest-451302124 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-5aebb3fe-daab-4c3c-ab11-1603804e4ec7 {{(pid=84538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 19:06:06 devstack sudo[92688]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-5aebb3fe-daab-4c3c-ab11-1603804e4ec7 Apr 29 19:06:06 devstack sudo[92688]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 19:06:06 devstack sudo[92680]: pam_unix(sudo:session): session closed for user root Apr 29 19:06:07 devstack cinder-volume[84538]: DEBUG oslo_concurrency.processutils [None req-288c07d5-7224-46d3-a728-f70692f5a350 tempest-VolumesSnapshotListTestJSON-317057059 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-1387f25c-dfd4-4f52-beab-27cf8a1036b3.ff59994d-ced0-4c35-828f-5d485995c96f" returned: 0 in 0.650s {{(pid=84538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 19:06:07 devstack cinder-volume[84538]: DEBUG cinder.coordination [None req-288c07d5-7224-46d3-a728-f70692f5a350 tempest-VolumesSnapshotListTestJSON-317057059 None] Lock "cinder-quobyte-ff59994d-ced0-4c35-828f-5d485995c96f" released by "_delete_snapshot" :: held 3.149s {{(pid=84538) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 19:06:07 devstack cinder-volume[84538]: DEBUG cinder.coordination [None req-288c07d5-7224-46d3-a728-f70692f5a350 tempest-VolumesSnapshotListTestJSON-317057059 None] Lock "cinder-quobyte-1387f25c-dfd4-4f52-beab-27cf8a1036b3" released by "delete_snapshot" :: held 3.182s {{(pid=84538) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 19:06:07 devstack cinder-volume[84538]: DEBUG cinder.quota [None req-288c07d5-7224-46d3-a728-f70692f5a350 tempest-VolumesSnapshotListTestJSON-317057059 None] Created reservations ['05df2d67-ab43-4a72-bbff-5fc76773ba75', 'edd90527-8775-416b-b6e0-5c7f02eba289', '7cb29b08-99c8-4f4a-8a22-0fc97a16b8a2', '3db5dec4-1563-4584-b2dd-8f972faed2ab'] {{(pid=84538) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 29 19:06:07 devstack cinder-volume[84538]: INFO cinder.volume.manager [None req-288c07d5-7224-46d3-a728-f70692f5a350 tempest-VolumesSnapshotListTestJSON-317057059 None] Delete snapshot completed successfully. Apr 29 19:06:07 devstack cinder-volume[84538]: DEBUG cinder.coordination [None req-288c07d5-7224-46d3-a728-f70692f5a350 tempest-VolumesSnapshotListTestJSON-317057059 None] Lock "cinder-ff59994d-ced0-4c35-828f-5d485995c96f-delete_snapshot" released by "delete_snapshot" :: held 3.327s {{(pid=84538) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 19:06:07 devstack sudo[92686]: pam_unix(sudo:session): session closed for user root Apr 29 19:06:07 devstack cinder-volume[84538]: DEBUG oslo_concurrency.processutils [None req-0a91f20f-aac0-4ca0-ada2-6bb67e7fc047 tempest-CreateVolumesFromSourceVolumeTest-1124812184 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-faff55de-8fb1-438a-ac6f-95b0ccef21ab" returned: 0 in 0.630s {{(pid=84538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 19:06:07 devstack cinder-volume[84538]: DEBUG cinder.volume.drivers.quobyte [None req-0a91f20f-aac0-4ca0-ada2-6bb67e7fc047 tempest-CreateVolumesFromSourceVolumeTest-1124812184 None] <== create_volume: return (1548ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-34312b00-dd6d-45bb-af98-75855cea8e48'} {{(pid=84538) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 29 19:06:07 devstack cinder-volume[84538]: DEBUG oslo_concurrency.lockutils [None req-0a91f20f-aac0-4ca0-ada2-6bb67e7fc047 tempest-CreateVolumesFromSourceVolumeTest-1124812184 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.552s {{(pid=84538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 19:06:07 devstack cinder-volume[84538]: DEBUG oslo_concurrency.lockutils [None req-9c48e0ef-6d53-4bea-9cb5-c36fba3425d7 tempest-CreateVolumesFromSourceVolumeTest-1124812184 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.901s {{(pid=84538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 19:06:07 devstack cinder-volume[84538]: DEBUG cinder.volume.drivers.quobyte [None req-9c48e0ef-6d53-4bea-9cb5-c36fba3425d7 tempest-CreateVolumesFromSourceVolumeTest-1124812184 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-29T17:06:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1946898676',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f1b480be-1196-40a1-98f8-e83fc415de16,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f55552bb071a4e93ae2c788f38b4fe37',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T17:06:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T17:06:02Z,use_quota=True,user_id='9edcc640ca7040a5b9ecc3e6e1801af9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(62b05900-93e3-4190-a88f-1d87324303d1),volume_type_id=62b05900-93e3-4190-a88f-1d87324303d1)}" {{(pid=84538) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 29 19:06:07 devstack cinder-volume[84538]: DEBUG cinder.volume.drivers.remotefs [None req-9c48e0ef-6d53-4bea-9cb5-c36fba3425d7 tempest-CreateVolumesFromSourceVolumeTest-1124812184 None] Creating volume f1b480be-1196-40a1-98f8-e83fc415de16 {{(pid=84538) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 29 19:06:07 devstack cinder-volume[84538]: DEBUG oslo_concurrency.lockutils [None req-9c48e0ef-6d53-4bea-9cb5-c36fba3425d7 tempest-CreateVolumesFromSourceVolumeTest-1124812184 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 19:06:07 devstack cinder-volume[84538]: DEBUG oslo_concurrency.lockutils [None req-9c48e0ef-6d53-4bea-9cb5-c36fba3425d7 tempest-CreateVolumesFromSourceVolumeTest-1124812184 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 19:06:07 devstack cinder-volume[84538]: DEBUG cinder.volume.drivers.quobyte [None req-9c48e0ef-6d53-4bea-9cb5-c36fba3425d7 tempest-CreateVolumesFromSourceVolumeTest-1124812184 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-34312b00-dd6d-45bb-af98-75855cea8e48': None} {{(pid=84538) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 19:06:07 devstack cinder-volume[84538]: DEBUG cinder.volume.drivers.quobyte [None req-9c48e0ef-6d53-4bea-9cb5-c36fba3425d7 tempest-CreateVolumesFromSourceVolumeTest-1124812184 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-34312b00-dd6d-45bb-af98-75855cea8e48'] {{(pid=84538) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 19:06:07 devstack cinder-volume[84538]: DEBUG oslo_concurrency.lockutils [None req-9c48e0ef-6d53-4bea-9cb5-c36fba3425d7 tempest-CreateVolumesFromSourceVolumeTest-1124812184 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=84538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 19:06:07 devstack cinder-volume[84538]: DEBUG cinder.volume.drivers.quobyte [None req-9c48e0ef-6d53-4bea-9cb5-c36fba3425d7 tempest-CreateVolumesFromSourceVolumeTest-1124812184 None] Selected osci02.corp.quobyte.com/cinder-vol-34312b00-dd6d-45bb-af98-75855cea8e48 as target Quobyte volume. {{(pid=84538) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 29 19:06:07 devstack cinder-volume[84538]: INFO cinder.volume.drivers.remotefs [None req-9c48e0ef-6d53-4bea-9cb5-c36fba3425d7 tempest-CreateVolumesFromSourceVolumeTest-1124812184 None] casted to osci02.corp.quobyte.com/cinder-vol-34312b00-dd6d-45bb-af98-75855cea8e48 Apr 29 19:06:07 devstack cinder-volume[84538]: DEBUG oslo_concurrency.processutils [None req-9c48e0ef-6d53-4bea-9cb5-c36fba3425d7 tempest-CreateVolumesFromSourceVolumeTest-1124812184 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-f1b480be-1196-40a1-98f8-e83fc415de16 1073741824 {{(pid=84538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 19:06:07 devstack cinder-volume[84538]: DEBUG cinder.volume.manager [None req-0a91f20f-aac0-4ca0-ada2-6bb67e7fc047 tempest-CreateVolumesFromSourceVolumeTest-1124812184 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (22320c70-62ab-4d1d-82e4-2cda1a651a70) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-faff55de-8fb1-438a-ac6f-95b0ccef21ab', 'volume_size': 1}' {{(pid=84538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 19:06:07 devstack sudo[92693]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-f1b480be-1196-40a1-98f8-e83fc415de16 1073741824 Apr 29 19:06:07 devstack sudo[92693]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 19:06:07 devstack cinder-volume[84538]: DEBUG cinder.volume.manager [None req-0a91f20f-aac0-4ca0-ada2-6bb67e7fc047 tempest-CreateVolumesFromSourceVolumeTest-1124812184 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (807a422f-d065-4955-bf7d-e665cb3cb309) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 19:06:07 devstack cinder-volume[84538]: INFO cinder.volume.flows.manager.create_volume [None req-0a91f20f-aac0-4ca0-ada2-6bb67e7fc047 tempest-CreateVolumesFromSourceVolumeTest-1124812184 None] Volume volume-faff55de-8fb1-438a-ac6f-95b0ccef21ab (faff55de-8fb1-438a-ac6f-95b0ccef21ab): created successfully Apr 29 19:06:07 devstack cinder-volume[84538]: DEBUG cinder.volume.manager [None req-0a91f20f-aac0-4ca0-ada2-6bb67e7fc047 tempest-CreateVolumesFromSourceVolumeTest-1124812184 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (807a422f-d065-4955-bf7d-e665cb3cb309) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 19:06:07 devstack cinder-volume[84538]: DEBUG cinder.volume.manager [None req-0a91f20f-aac0-4ca0-ada2-6bb67e7fc047 tempest-CreateVolumesFromSourceVolumeTest-1124812184 None] Flow 'volume_create_manager' (e7cf31b8-f200-4b7d-b50b-06ba33e3de90) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84538) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 19:06:07 devstack cinder-volume[84538]: INFO cinder.volume.manager [None req-0a91f20f-aac0-4ca0-ada2-6bb67e7fc047 tempest-CreateVolumesFromSourceVolumeTest-1124812184 None] Created volume successfully. Apr 29 19:06:07 devstack sudo[92688]: pam_unix(sudo:session): session closed for user root Apr 29 19:06:07 devstack cinder-volume[84538]: DEBUG oslo_concurrency.processutils [None req-c2cf9925-da6c-4fbf-a581-99418239a56d tempest-VolumesExtendTest-451302124 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-5aebb3fe-daab-4c3c-ab11-1603804e4ec7" returned: 0 in 0.670s {{(pid=84538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 19:06:07 devstack cinder-volume[84538]: DEBUG cinder.coordination [None req-c2cf9925-da6c-4fbf-a581-99418239a56d tempest-VolumesExtendTest-451302124 None] Lock "cinder-quobyte-5aebb3fe-daab-4c3c-ab11-1603804e4ec7" released by "delete_volume" :: held 1.504s {{(pid=84538) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 19:06:07 devstack cinder-volume[84538]: DEBUG cinder.quota [None req-c2cf9925-da6c-4fbf-a581-99418239a56d tempest-VolumesExtendTest-451302124 None] Created reservations ['2ae4e51b-77ec-4d62-926a-6e29c452346d', 'bc041474-8a2d-4844-a446-310c27cb56ee', '58f24be5-e6f1-4d68-9763-e4bedb4c432d', 'd1f20978-b419-476a-ae1d-9f07296db41e'] {{(pid=84538) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 29 19:06:07 devstack cinder-volume[84538]: DEBUG oslo_concurrency.lockutils [None req-c2cf9925-da6c-4fbf-a581-99418239a56d tempest-VolumesExtendTest-451302124 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 19:06:07 devstack cinder-volume[84538]: DEBUG oslo_concurrency.lockutils [None req-c2cf9925-da6c-4fbf-a581-99418239a56d tempest-VolumesExtendTest-451302124 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 19:06:07 devstack cinder-volume[84538]: DEBUG cinder.volume.drivers.quobyte [None req-c2cf9925-da6c-4fbf-a581-99418239a56d tempest-VolumesExtendTest-451302124 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-34312b00-dd6d-45bb-af98-75855cea8e48': None} {{(pid=84538) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 19:06:07 devstack cinder-volume[84538]: DEBUG cinder.volume.drivers.quobyte [None req-c2cf9925-da6c-4fbf-a581-99418239a56d tempest-VolumesExtendTest-451302124 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-34312b00-dd6d-45bb-af98-75855cea8e48'] {{(pid=84538) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 19:06:07 devstack cinder-volume[84538]: DEBUG oslo_concurrency.lockutils [None req-c2cf9925-da6c-4fbf-a581-99418239a56d tempest-VolumesExtendTest-451302124 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=84538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 19:06:07 devstack cinder-volume[84538]: DEBUG oslo_concurrency.processutils [None req-c2cf9925-da6c-4fbf-a581-99418239a56d tempest-VolumesExtendTest-451302124 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d {{(pid=84538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 19:06:07 devstack sudo[92695]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d Apr 29 19:06:07 devstack sudo[92695]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 19:06:08 devstack sudo[92693]: pam_unix(sudo:session): session closed for user root Apr 29 19:06:08 devstack cinder-volume[84538]: DEBUG oslo_concurrency.processutils [None req-9c48e0ef-6d53-4bea-9cb5-c36fba3425d7 tempest-CreateVolumesFromSourceVolumeTest-1124812184 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-f1b480be-1196-40a1-98f8-e83fc415de16 1073741824" returned: 0 in 0.830s {{(pid=84538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 19:06:08 devstack cinder-volume[84538]: DEBUG cinder.coordination [None req-b4b88640-5e54-41db-bd9e-f3583f1ef953 tempest-VolumesSnapshotListTestJSON-317057059 None] Acquiring lock "cinder-836c5cf9-432f-46db-a134-1c1b3e799d42-delete_snapshot" by "delete_snapshot" {{(pid=84538) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 19:06:08 devstack cinder-volume[84538]: DEBUG cinder.coordination [None req-b4b88640-5e54-41db-bd9e-f3583f1ef953 tempest-VolumesSnapshotListTestJSON-317057059 None] Lock "cinder-836c5cf9-432f-46db-a134-1c1b3e799d42-delete_snapshot" acquired by "delete_snapshot" :: waited 0.039s {{(pid=84538) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 19:06:08 devstack cinder-volume[84538]: DEBUG cinder.coordination [None req-b4b88640-5e54-41db-bd9e-f3583f1ef953 tempest-VolumesSnapshotListTestJSON-317057059 None] Acquiring lock "cinder-quobyte-1387f25c-dfd4-4f52-beab-27cf8a1036b3" by "delete_snapshot" {{(pid=84538) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 19:06:08 devstack sudo[92695]: pam_unix(sudo:session): session closed for user root Apr 29 19:06:08 devstack cinder-volume[84538]: DEBUG oslo_concurrency.processutils [None req-c2cf9925-da6c-4fbf-a581-99418239a56d tempest-VolumesExtendTest-451302124 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d" returned: 0 in 0.688s {{(pid=84538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 19:06:08 devstack cinder-volume[84538]: DEBUG cinder.manager [None req-c2cf9925-da6c-4fbf-a581-99418239a56d tempest-VolumesExtendTest-451302124 None] Notifying Schedulers of capabilities ... {{(pid=84538) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 29 19:06:08 devstack cinder-volume[84538]: DEBUG oslo_concurrency.processutils [None req-9c48e0ef-6d53-4bea-9cb5-c36fba3425d7 tempest-CreateVolumesFromSourceVolumeTest-1124812184 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-f1b480be-1196-40a1-98f8-e83fc415de16 {{(pid=84538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 19:06:08 devstack cinder-volume[84538]: INFO cinder.volume.manager [None req-c2cf9925-da6c-4fbf-a581-99418239a56d tempest-VolumesExtendTest-451302124 None] Deleted volume successfully. Apr 29 19:06:08 devstack cinder-volume[84538]: DEBUG cinder.coordination [None req-b4b88640-5e54-41db-bd9e-f3583f1ef953 tempest-VolumesSnapshotListTestJSON-317057059 None] Lock "cinder-quobyte-1387f25c-dfd4-4f52-beab-27cf8a1036b3" acquired by "delete_snapshot" :: waited 0.049s {{(pid=84538) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 19:06:08 devstack cinder-volume[84538]: DEBUG cinder.coordination [None req-b4b88640-5e54-41db-bd9e-f3583f1ef953 tempest-VolumesSnapshotListTestJSON-317057059 None] Acquiring lock "cinder-quobyte-836c5cf9-432f-46db-a134-1c1b3e799d42" by "_delete_snapshot" {{(pid=84538) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 19:06:08 devstack sudo[92701]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-f1b480be-1196-40a1-98f8-e83fc415de16 Apr 29 19:06:08 devstack sudo[92701]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 19:06:08 devstack cinder-volume[84538]: DEBUG cinder.coordination [None req-b4b88640-5e54-41db-bd9e-f3583f1ef953 tempest-VolumesSnapshotListTestJSON-317057059 None] Lock "cinder-quobyte-836c5cf9-432f-46db-a134-1c1b3e799d42" acquired by "_delete_snapshot" :: waited 0.020s {{(pid=84538) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 19:06:08 devstack cinder-volume[84538]: DEBUG cinder.volume.drivers.remotefs [None req-b4b88640-5e54-41db-bd9e-f3583f1ef953 tempest-VolumesSnapshotListTestJSON-317057059 None] Deleting offline snapshot 836c5cf9-432f-46db-a134-1c1b3e799d42 of volume 1387f25c-dfd4-4f52-beab-27cf8a1036b3 {{(pid=84538) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 29 19:06:08 devstack cinder-volume[84538]: DEBUG cinder.volume.drivers.remotefs [None req-b4b88640-5e54-41db-bd9e-f3583f1ef953 tempest-VolumesSnapshotListTestJSON-317057059 None] snapshot_file for this snap is: volume-1387f25c-dfd4-4f52-beab-27cf8a1036b3.836c5cf9-432f-46db-a134-1c1b3e799d42 {{(pid=84538) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 29 19:06:08 devstack cinder-volume[84538]: DEBUG cinder.coordination [None req-c2cf9925-da6c-4fbf-a581-99418239a56d tempest-VolumesExtendTest-451302124 None] Lock "cinder-5aebb3fe-daab-4c3c-ab11-1603804e4ec7-delete_volume" released by "delete_volume" :: held 2.498s {{(pid=84538) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 19:06:08 devstack cinder-volume[84538]: DEBUG oslo.privsep.daemon [-] privsep: reply[b4be3f0d-5776-4d56-95a6-1f0cb3f72585]: (4, 'qcow2') {{(pid=85803) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 19:06:08 devstack cinder-volume[84538]: DEBUG oslo_concurrency.processutils [None req-b4b88640-5e54-41db-bd9e-f3583f1ef953 tempest-VolumesSnapshotListTestJSON-317057059 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-1387f25c-dfd4-4f52-beab-27cf8a1036b3.836c5cf9-432f-46db-a134-1c1b3e799d42 {{(pid=84538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 19:06:08 devstack sudo[92703]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-1387f25c-dfd4-4f52-beab-27cf8a1036b3.836c5cf9-432f-46db-a134-1c1b3e799d42 Apr 29 19:06:08 devstack sudo[92703]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 19:06:08 devstack sudo[92701]: pam_unix(sudo:session): session closed for user root Apr 29 19:06:08 devstack cinder-volume[84538]: DEBUG oslo_concurrency.processutils [None req-9c48e0ef-6d53-4bea-9cb5-c36fba3425d7 tempest-CreateVolumesFromSourceVolumeTest-1124812184 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-f1b480be-1196-40a1-98f8-e83fc415de16" returned: 0 in 0.675s {{(pid=84538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 19:06:08 devstack cinder-volume[84538]: DEBUG cinder.volume.drivers.quobyte [None req-9c48e0ef-6d53-4bea-9cb5-c36fba3425d7 tempest-CreateVolumesFromSourceVolumeTest-1124812184 None] <== create_volume: return (1607ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-34312b00-dd6d-45bb-af98-75855cea8e48'} {{(pid=84538) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 29 19:06:08 devstack cinder-volume[84538]: DEBUG oslo_concurrency.lockutils [None req-9c48e0ef-6d53-4bea-9cb5-c36fba3425d7 tempest-CreateVolumesFromSourceVolumeTest-1124812184 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.611s {{(pid=84538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 19:06:08 devstack cinder-volume[84538]: DEBUG cinder.volume.manager [None req-9c48e0ef-6d53-4bea-9cb5-c36fba3425d7 tempest-CreateVolumesFromSourceVolumeTest-1124812184 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7bc6e518-e598-4f98-b9ca-dfdfc45788dd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f1b480be-1196-40a1-98f8-e83fc415de16', 'volume_size': 1}' {{(pid=84538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 19:06:08 devstack cinder-volume[84538]: DEBUG cinder.volume.manager [None req-9c48e0ef-6d53-4bea-9cb5-c36fba3425d7 tempest-CreateVolumesFromSourceVolumeTest-1124812184 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5ada1eed-9888-4a72-93d8-d3fd1c816801) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 19:06:08 devstack cinder-volume[84538]: INFO cinder.volume.flows.manager.create_volume [None req-9c48e0ef-6d53-4bea-9cb5-c36fba3425d7 tempest-CreateVolumesFromSourceVolumeTest-1124812184 None] Volume volume-f1b480be-1196-40a1-98f8-e83fc415de16 (f1b480be-1196-40a1-98f8-e83fc415de16): created successfully Apr 29 19:06:08 devstack cinder-volume[84538]: DEBUG cinder.volume.manager [None req-9c48e0ef-6d53-4bea-9cb5-c36fba3425d7 tempest-CreateVolumesFromSourceVolumeTest-1124812184 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5ada1eed-9888-4a72-93d8-d3fd1c816801) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 19:06:08 devstack cinder-volume[84538]: DEBUG cinder.volume.manager [None req-9c48e0ef-6d53-4bea-9cb5-c36fba3425d7 tempest-CreateVolumesFromSourceVolumeTest-1124812184 None] Flow 'volume_create_manager' (567327b9-9e1f-4852-8a5b-6559e5dcbca4) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84538) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 19:06:08 devstack cinder-volume[84538]: INFO cinder.volume.manager [None req-9c48e0ef-6d53-4bea-9cb5-c36fba3425d7 tempest-CreateVolumesFromSourceVolumeTest-1124812184 None] Created volume successfully. Apr 29 19:06:09 devstack sudo[92703]: pam_unix(sudo:session): session closed for user root Apr 29 19:06:09 devstack cinder-volume[84538]: DEBUG oslo_concurrency.processutils [None req-b4b88640-5e54-41db-bd9e-f3583f1ef953 tempest-VolumesSnapshotListTestJSON-317057059 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-1387f25c-dfd4-4f52-beab-27cf8a1036b3.836c5cf9-432f-46db-a134-1c1b3e799d42" returned: 0 in 0.836s {{(pid=84538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 19:06:09 devstack cinder-volume[84538]: DEBUG cinder.volume.drivers.remotefs [None req-b4b88640-5e54-41db-bd9e-f3583f1ef953 tempest-VolumesSnapshotListTestJSON-317057059 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-1387f25c-dfd4-4f52-beab-27cf8a1036b3(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=84538) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 29 19:06:09 devstack cinder-volume[84538]: DEBUG oslo.privsep.daemon [-] privsep: reply[eec66cac-32cc-4a11-bde6-2ed00d8319ba]: (4, 'qcow2') {{(pid=85803) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 19:06:09 devstack cinder-volume[84538]: DEBUG oslo_concurrency.processutils [None req-b4b88640-5e54-41db-bd9e-f3583f1ef953 tempest-VolumesSnapshotListTestJSON-317057059 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-1387f25c-dfd4-4f52-beab-27cf8a1036b3 {{(pid=84538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 19:06:09 devstack sudo[92711]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-1387f25c-dfd4-4f52-beab-27cf8a1036b3 Apr 29 19:06:09 devstack sudo[92711]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 19:06:09 devstack sudo[92711]: pam_unix(sudo:session): session closed for user root Apr 29 19:06:09 devstack cinder-volume[84538]: DEBUG oslo_concurrency.processutils [None req-b4b88640-5e54-41db-bd9e-f3583f1ef953 tempest-VolumesSnapshotListTestJSON-317057059 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-1387f25c-dfd4-4f52-beab-27cf8a1036b3" returned: 0 in 0.757s {{(pid=84538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 19:06:09 devstack cinder-volume[84538]: DEBUG oslo_concurrency.processutils [None req-b4b88640-5e54-41db-bd9e-f3583f1ef953 tempest-VolumesSnapshotListTestJSON-317057059 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-1387f25c-dfd4-4f52-beab-27cf8a1036b3.836c5cf9-432f-46db-a134-1c1b3e799d42 {{(pid=84538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 19:06:09 devstack cinder-volume[84538]: DEBUG cinder.coordination [None req-c0f41c9d-4a68-46fd-8e59-e9fd1cb20855 tempest-CreateVolumesFromSourceVolumeTest-1124812184 None] Acquiring lock "cinder-f1b480be-1196-40a1-98f8-e83fc415de16-delete_volume" by "delete_volume" {{(pid=84538) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 19:06:09 devstack sudo[92716]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-1387f25c-dfd4-4f52-beab-27cf8a1036b3.836c5cf9-432f-46db-a134-1c1b3e799d42 Apr 29 19:06:09 devstack sudo[92716]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 19:06:09 devstack cinder-volume[84538]: DEBUG cinder.coordination [None req-c0f41c9d-4a68-46fd-8e59-e9fd1cb20855 tempest-CreateVolumesFromSourceVolumeTest-1124812184 None] Lock "cinder-f1b480be-1196-40a1-98f8-e83fc415de16-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=84538) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 19:06:09 devstack cinder-volume[84538]: DEBUG cinder.coordination [None req-c0f41c9d-4a68-46fd-8e59-e9fd1cb20855 tempest-CreateVolumesFromSourceVolumeTest-1124812184 None] Acquiring lock "cinder-quobyte-f1b480be-1196-40a1-98f8-e83fc415de16" by "delete_volume" {{(pid=84538) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 19:06:09 devstack cinder-volume[84538]: DEBUG cinder.coordination [None req-c0f41c9d-4a68-46fd-8e59-e9fd1cb20855 tempest-CreateVolumesFromSourceVolumeTest-1124812184 None] Lock "cinder-quobyte-f1b480be-1196-40a1-98f8-e83fc415de16" acquired by "delete_volume" :: waited 0.029s {{(pid=84538) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 19:06:10 devstack cinder-volume[84538]: DEBUG oslo.privsep.daemon [-] privsep: reply[2e265109-ea6d-4c78-8650-44fc26e642c4]: (4, 'qcow2') {{(pid=85803) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 19:06:10 devstack cinder-volume[84538]: DEBUG oslo_concurrency.processutils [None req-c0f41c9d-4a68-46fd-8e59-e9fd1cb20855 tempest-CreateVolumesFromSourceVolumeTest-1124812184 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-f1b480be-1196-40a1-98f8-e83fc415de16 {{(pid=84538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 19:06:10 devstack sudo[92718]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-f1b480be-1196-40a1-98f8-e83fc415de16 Apr 29 19:06:10 devstack sudo[92718]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 19:06:10 devstack sudo[92716]: pam_unix(sudo:session): session closed for user root Apr 29 19:06:10 devstack cinder-volume[84538]: DEBUG oslo_concurrency.processutils [None req-b4b88640-5e54-41db-bd9e-f3583f1ef953 tempest-VolumesSnapshotListTestJSON-317057059 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-1387f25c-dfd4-4f52-beab-27cf8a1036b3.836c5cf9-432f-46db-a134-1c1b3e799d42" returned: 0 in 0.845s {{(pid=84538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 19:06:10 devstack cinder-volume[84538]: DEBUG oslo_concurrency.processutils [None req-b4b88640-5e54-41db-bd9e-f3583f1ef953 tempest-VolumesSnapshotListTestJSON-317057059 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-1387f25c-dfd4-4f52-beab-27cf8a1036b3.836c5cf9-432f-46db-a134-1c1b3e799d42 {{(pid=84538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 19:06:10 devstack sudo[92726]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-1387f25c-dfd4-4f52-beab-27cf8a1036b3.836c5cf9-432f-46db-a134-1c1b3e799d42 Apr 29 19:06:10 devstack sudo[92726]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 19:06:10 devstack sudo[92718]: pam_unix(sudo:session): session closed for user root Apr 29 19:06:10 devstack cinder-volume[84538]: DEBUG oslo_concurrency.processutils [None req-c0f41c9d-4a68-46fd-8e59-e9fd1cb20855 tempest-CreateVolumesFromSourceVolumeTest-1124812184 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-f1b480be-1196-40a1-98f8-e83fc415de16" returned: 0 in 0.825s {{(pid=84538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 19:06:10 devstack cinder-volume[84538]: DEBUG oslo_concurrency.processutils [None req-c0f41c9d-4a68-46fd-8e59-e9fd1cb20855 tempest-CreateVolumesFromSourceVolumeTest-1124812184 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-f1b480be-1196-40a1-98f8-e83fc415de16 {{(pid=84538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 19:06:10 devstack sudo[92728]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-f1b480be-1196-40a1-98f8-e83fc415de16 Apr 29 19:06:10 devstack sudo[92728]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 19:06:11 devstack cinder-volume[84538]: DEBUG cinder.volume.flows.manager.create_volume [None req-3dd740e7-b12f-4450-b8b0-489057182732 tempest-VolumesGetTest-1123317664 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84538) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Apr 29 19:06:11 devstack cinder-volume[84538]: DEBUG cinder.volume.manager [None req-3dd740e7-b12f-4450-b8b0-489057182732 tempest-VolumesGetTest-1123317664 None] Flow 'volume_create_manager' (f694cf9f-6cee-42e2-9f9b-002f4567b9fe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84538) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 19:06:11 devstack cinder-volume[84538]: DEBUG cinder.volume.manager [None req-3dd740e7-b12f-4450-b8b0-489057182732 tempest-VolumesGetTest-1123317664 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fda870a1-2128-447b-972a-2f6f66aed433) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 19:06:11 devstack cinder-volume[84538]: DEBUG cinder.volume.manager [None req-3dd740e7-b12f-4450-b8b0-489057182732 tempest-VolumesGetTest-1123317664 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fda870a1-2128-447b-972a-2f6f66aed433) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-29T17:06:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-286042359',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ab721445-de20-4a57-9742-9f65ba62c259,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='62ab81799a05449b9f5b7eb23c6c9071',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T17:06:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T17:06:11Z,use_quota=True,user_id='2c9aaf152c0f49d3887038450048a477',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(62b05900-93e3-4190-a88f-1d87324303d1),volume_type_id=62b05900-93e3-4190-a88f-1d87324303d1)' {{(pid=84538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 19:06:11 devstack cinder-volume[84538]: DEBUG cinder.volume.manager [None req-3dd740e7-b12f-4450-b8b0-489057182732 tempest-VolumesGetTest-1123317664 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3bf07d76-2939-4210-b297-083433f1fc07) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 19:06:11 devstack cinder-volume[84538]: DEBUG cinder.volume.manager [None req-3dd740e7-b12f-4450-b8b0-489057182732 tempest-VolumesGetTest-1123317664 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3bf07d76-2939-4210-b297-083433f1fc07) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 19:06:11 devstack cinder-volume[84538]: DEBUG cinder.volume.manager [None req-3dd740e7-b12f-4450-b8b0-489057182732 tempest-VolumesGetTest-1123317664 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2bc52f30-320f-4b35-89b3-e34d6b3e6a3e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 19:06:11 devstack cinder-volume[84538]: DEBUG cinder.volume.manager [None req-3dd740e7-b12f-4450-b8b0-489057182732 tempest-VolumesGetTest-1123317664 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2bc52f30-320f-4b35-89b3-e34d6b3e6a3e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ab721445-de20-4a57-9742-9f65ba62c259', 'volume_name': 'volume-ab721445-de20-4a57-9742-9f65ba62c259', 'volume_size': 1}' {{(pid=84538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 19:06:11 devstack cinder-volume[84538]: DEBUG cinder.volume.manager [None req-3dd740e7-b12f-4450-b8b0-489057182732 tempest-VolumesGetTest-1123317664 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (da444ea1-d7dc-492a-bc2c-0b9b741bbcc3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 19:06:11 devstack cinder-volume[84538]: DEBUG cinder.volume.manager [None req-3dd740e7-b12f-4450-b8b0-489057182732 tempest-VolumesGetTest-1123317664 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (da444ea1-d7dc-492a-bc2c-0b9b741bbcc3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 19:06:11 devstack cinder-volume[84538]: DEBUG cinder.volume.manager [None req-3dd740e7-b12f-4450-b8b0-489057182732 tempest-VolumesGetTest-1123317664 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (57d1f77a-1816-4c96-a3be-cde369208749) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 19:06:11 devstack cinder-volume[84538]: INFO cinder.volume.flows.manager.create_volume [None req-3dd740e7-b12f-4450-b8b0-489057182732 tempest-VolumesGetTest-1123317664 None] Volume ab721445-de20-4a57-9742-9f65ba62c259: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ab721445-de20-4a57-9742-9f65ba62c259', 'volume_size': 1} Apr 29 19:06:11 devstack cinder-volume[84538]: DEBUG oslo_concurrency.lockutils [None req-3dd740e7-b12f-4450-b8b0-489057182732 tempest-VolumesGetTest-1123317664 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 19:06:11 devstack cinder-volume[84538]: DEBUG oslo_concurrency.lockutils [None req-3dd740e7-b12f-4450-b8b0-489057182732 tempest-VolumesGetTest-1123317664 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=84538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 19:06:11 devstack cinder-volume[84538]: DEBUG cinder.volume.drivers.quobyte [None req-3dd740e7-b12f-4450-b8b0-489057182732 tempest-VolumesGetTest-1123317664 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-29T17:06:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-286042359',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ab721445-de20-4a57-9742-9f65ba62c259,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='62ab81799a05449b9f5b7eb23c6c9071',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T17:06:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T17:06:11Z,use_quota=True,user_id='2c9aaf152c0f49d3887038450048a477',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(62b05900-93e3-4190-a88f-1d87324303d1),volume_type_id=62b05900-93e3-4190-a88f-1d87324303d1)}" {{(pid=84538) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 29 19:06:11 devstack cinder-volume[84538]: DEBUG cinder.volume.drivers.remotefs [None req-3dd740e7-b12f-4450-b8b0-489057182732 tempest-VolumesGetTest-1123317664 None] Creating volume ab721445-de20-4a57-9742-9f65ba62c259 {{(pid=84538) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 29 19:06:11 devstack cinder-volume[84538]: DEBUG oslo_concurrency.lockutils [None req-3dd740e7-b12f-4450-b8b0-489057182732 tempest-VolumesGetTest-1123317664 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 19:06:11 devstack cinder-volume[84538]: DEBUG oslo_concurrency.lockutils [None req-3dd740e7-b12f-4450-b8b0-489057182732 tempest-VolumesGetTest-1123317664 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=84538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 19:06:11 devstack cinder-volume[84538]: DEBUG cinder.volume.drivers.quobyte [None req-3dd740e7-b12f-4450-b8b0-489057182732 tempest-VolumesGetTest-1123317664 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-34312b00-dd6d-45bb-af98-75855cea8e48': None} {{(pid=84538) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 19:06:11 devstack cinder-volume[84538]: DEBUG cinder.volume.drivers.quobyte [None req-3dd740e7-b12f-4450-b8b0-489057182732 tempest-VolumesGetTest-1123317664 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-34312b00-dd6d-45bb-af98-75855cea8e48'] {{(pid=84538) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 19:06:11 devstack cinder-volume[84538]: DEBUG oslo_concurrency.lockutils [None req-3dd740e7-b12f-4450-b8b0-489057182732 tempest-VolumesGetTest-1123317664 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=84538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 19:06:11 devstack cinder-volume[84538]: DEBUG cinder.volume.drivers.quobyte [None req-3dd740e7-b12f-4450-b8b0-489057182732 tempest-VolumesGetTest-1123317664 None] Selected osci02.corp.quobyte.com/cinder-vol-34312b00-dd6d-45bb-af98-75855cea8e48 as target Quobyte volume. {{(pid=84538) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 29 19:06:11 devstack cinder-volume[84538]: INFO cinder.volume.drivers.remotefs [None req-3dd740e7-b12f-4450-b8b0-489057182732 tempest-VolumesGetTest-1123317664 None] casted to osci02.corp.quobyte.com/cinder-vol-34312b00-dd6d-45bb-af98-75855cea8e48 Apr 29 19:06:11 devstack cinder-volume[84538]: DEBUG oslo_concurrency.processutils [None req-3dd740e7-b12f-4450-b8b0-489057182732 tempest-VolumesGetTest-1123317664 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-ab721445-de20-4a57-9742-9f65ba62c259 1073741824 {{(pid=84538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 19:06:11 devstack sudo[92730]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-ab721445-de20-4a57-9742-9f65ba62c259 1073741824 Apr 29 19:06:11 devstack sudo[92730]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 19:06:11 devstack sudo[92726]: pam_unix(sudo:session): session closed for user root Apr 29 19:06:11 devstack cinder-volume[84538]: DEBUG oslo_concurrency.processutils [None req-b4b88640-5e54-41db-bd9e-f3583f1ef953 tempest-VolumesSnapshotListTestJSON-317057059 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-1387f25c-dfd4-4f52-beab-27cf8a1036b3.836c5cf9-432f-46db-a134-1c1b3e799d42" returned: 0 in 0.647s {{(pid=84538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 19:06:11 devstack cinder-volume[84538]: DEBUG cinder.coordination [None req-b4b88640-5e54-41db-bd9e-f3583f1ef953 tempest-VolumesSnapshotListTestJSON-317057059 None] Lock "cinder-quobyte-836c5cf9-432f-46db-a134-1c1b3e799d42" released by "_delete_snapshot" :: held 3.214s {{(pid=84538) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 19:06:11 devstack cinder-volume[84538]: DEBUG cinder.coordination [None req-b4b88640-5e54-41db-bd9e-f3583f1ef953 tempest-VolumesSnapshotListTestJSON-317057059 None] Lock "cinder-quobyte-1387f25c-dfd4-4f52-beab-27cf8a1036b3" released by "delete_snapshot" :: held 3.245s {{(pid=84538) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 19:06:11 devstack sudo[92728]: pam_unix(sudo:session): session closed for user root Apr 29 19:06:11 devstack cinder-volume[84538]: DEBUG oslo_concurrency.processutils [None req-c0f41c9d-4a68-46fd-8e59-e9fd1cb20855 tempest-CreateVolumesFromSourceVolumeTest-1124812184 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-f1b480be-1196-40a1-98f8-e83fc415de16" returned: 0 in 0.615s {{(pid=84538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 19:06:11 devstack cinder-volume[84538]: DEBUG cinder.coordination [None req-c0f41c9d-4a68-46fd-8e59-e9fd1cb20855 tempest-CreateVolumesFromSourceVolumeTest-1124812184 None] Lock "cinder-quobyte-f1b480be-1196-40a1-98f8-e83fc415de16" released by "delete_volume" :: held 1.484s {{(pid=84538) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 19:06:11 devstack cinder-volume[84538]: DEBUG cinder.quota [None req-b4b88640-5e54-41db-bd9e-f3583f1ef953 tempest-VolumesSnapshotListTestJSON-317057059 None] Created reservations ['312509bf-c711-4634-840f-f20df37ffc10', '96057e8e-2523-4e4e-8731-8dde21a6b4e9', '5dfb3ee4-825f-4eb6-b5dc-494b95603a32', '55b2acb2-b899-419e-a637-c191bc8327a1'] {{(pid=84538) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 29 19:06:11 devstack cinder-volume[84538]: INFO cinder.volume.manager [None req-b4b88640-5e54-41db-bd9e-f3583f1ef953 tempest-VolumesSnapshotListTestJSON-317057059 None] Delete snapshot completed successfully. Apr 29 19:06:11 devstack cinder-volume[84538]: DEBUG cinder.quota [None req-c0f41c9d-4a68-46fd-8e59-e9fd1cb20855 tempest-CreateVolumesFromSourceVolumeTest-1124812184 None] Created reservations ['77af6f62-cb62-46c5-8ecd-b034cf1bb98f', 'ba2eb914-d7da-45b8-b32c-79a8cc679b45', '681b32a6-c063-4e95-8876-7f1ad564ee02', 'b1cd0cd4-126d-416f-8dc8-46443015cd9c'] {{(pid=84538) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 29 19:06:11 devstack cinder-volume[84538]: DEBUG cinder.coordination [None req-b4b88640-5e54-41db-bd9e-f3583f1ef953 tempest-VolumesSnapshotListTestJSON-317057059 None] Lock "cinder-836c5cf9-432f-46db-a134-1c1b3e799d42-delete_snapshot" released by "delete_snapshot" :: held 3.444s {{(pid=84538) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 19:06:11 devstack cinder-volume[84538]: DEBUG oslo_concurrency.lockutils [None req-c0f41c9d-4a68-46fd-8e59-e9fd1cb20855 tempest-CreateVolumesFromSourceVolumeTest-1124812184 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 19:06:11 devstack cinder-volume[84538]: DEBUG oslo_concurrency.lockutils [None req-c0f41c9d-4a68-46fd-8e59-e9fd1cb20855 tempest-CreateVolumesFromSourceVolumeTest-1124812184 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 19:06:11 devstack cinder-volume[84538]: DEBUG cinder.volume.drivers.quobyte [None req-c0f41c9d-4a68-46fd-8e59-e9fd1cb20855 tempest-CreateVolumesFromSourceVolumeTest-1124812184 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-34312b00-dd6d-45bb-af98-75855cea8e48': None} {{(pid=84538) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 19:06:11 devstack cinder-volume[84538]: DEBUG cinder.volume.drivers.quobyte [None req-c0f41c9d-4a68-46fd-8e59-e9fd1cb20855 tempest-CreateVolumesFromSourceVolumeTest-1124812184 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-34312b00-dd6d-45bb-af98-75855cea8e48'] {{(pid=84538) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 19:06:11 devstack cinder-volume[84538]: DEBUG oslo_concurrency.lockutils [None req-c0f41c9d-4a68-46fd-8e59-e9fd1cb20855 tempest-CreateVolumesFromSourceVolumeTest-1124812184 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=84538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 19:06:11 devstack cinder-volume[84538]: DEBUG oslo_concurrency.processutils [None req-c0f41c9d-4a68-46fd-8e59-e9fd1cb20855 tempest-CreateVolumesFromSourceVolumeTest-1124812184 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d {{(pid=84538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 19:06:11 devstack sudo[92734]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d Apr 29 19:06:11 devstack sudo[92734]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 19:06:11 devstack sudo[92730]: pam_unix(sudo:session): session closed for user root Apr 29 19:06:11 devstack cinder-volume[84538]: DEBUG oslo_concurrency.processutils [None req-3dd740e7-b12f-4450-b8b0-489057182732 tempest-VolumesGetTest-1123317664 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-ab721445-de20-4a57-9742-9f65ba62c259 1073741824" returned: 0 in 0.782s {{(pid=84538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 19:06:11 devstack cinder-volume[84538]: DEBUG oslo_concurrency.processutils [None req-3dd740e7-b12f-4450-b8b0-489057182732 tempest-VolumesGetTest-1123317664 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-ab721445-de20-4a57-9742-9f65ba62c259 {{(pid=84538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 19:06:11 devstack sudo[92739]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-ab721445-de20-4a57-9742-9f65ba62c259 Apr 29 19:06:11 devstack sudo[92739]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 19:06:12 devstack cinder-volume[84538]: DEBUG cinder.coordination [None req-e5603255-adc2-4f5d-808f-424d5b020941 tempest-CreateVolumesFromSourceVolumeTest-1124812184 None] Acquiring lock "cinder-faff55de-8fb1-438a-ac6f-95b0ccef21ab-delete_volume" by "delete_volume" {{(pid=84538) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 19:06:12 devstack cinder-volume[84538]: DEBUG cinder.coordination [None req-e5603255-adc2-4f5d-808f-424d5b020941 tempest-CreateVolumesFromSourceVolumeTest-1124812184 None] Lock "cinder-faff55de-8fb1-438a-ac6f-95b0ccef21ab-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=84538) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 19:06:12 devstack sudo[92734]: pam_unix(sudo:session): session closed for user root Apr 29 19:06:12 devstack cinder-volume[84538]: DEBUG oslo_concurrency.processutils [None req-c0f41c9d-4a68-46fd-8e59-e9fd1cb20855 tempest-CreateVolumesFromSourceVolumeTest-1124812184 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d" returned: 0 in 0.620s {{(pid=84538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 19:06:12 devstack cinder-volume[84538]: DEBUG cinder.manager [None req-c0f41c9d-4a68-46fd-8e59-e9fd1cb20855 tempest-CreateVolumesFromSourceVolumeTest-1124812184 None] Notifying Schedulers of capabilities ... {{(pid=84538) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 29 19:06:12 devstack cinder-volume[84538]: DEBUG cinder.coordination [None req-e5603255-adc2-4f5d-808f-424d5b020941 tempest-CreateVolumesFromSourceVolumeTest-1124812184 None] Acquiring lock "cinder-quobyte-faff55de-8fb1-438a-ac6f-95b0ccef21ab" by "delete_volume" {{(pid=84538) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 19:06:12 devstack cinder-volume[84538]: INFO cinder.volume.manager [None req-c0f41c9d-4a68-46fd-8e59-e9fd1cb20855 tempest-CreateVolumesFromSourceVolumeTest-1124812184 None] Deleted volume successfully. Apr 29 19:06:12 devstack cinder-volume[84538]: DEBUG cinder.coordination [None req-e5603255-adc2-4f5d-808f-424d5b020941 tempest-CreateVolumesFromSourceVolumeTest-1124812184 None] Lock "cinder-quobyte-faff55de-8fb1-438a-ac6f-95b0ccef21ab" acquired by "delete_volume" :: waited 0.024s {{(pid=84538) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 19:06:12 devstack cinder-volume[84538]: DEBUG cinder.coordination [None req-c0f41c9d-4a68-46fd-8e59-e9fd1cb20855 tempest-CreateVolumesFromSourceVolumeTest-1124812184 None] Lock "cinder-f1b480be-1196-40a1-98f8-e83fc415de16-delete_volume" released by "delete_volume" :: held 2.394s {{(pid=84538) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 19:06:12 devstack cinder-volume[84538]: DEBUG oslo.privsep.daemon [-] privsep: reply[d6894d73-eced-4828-8425-1e3a9285d76c]: (4, 'qcow2') {{(pid=85803) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 19:06:12 devstack cinder-volume[84538]: DEBUG oslo_concurrency.processutils [None req-e5603255-adc2-4f5d-808f-424d5b020941 tempest-CreateVolumesFromSourceVolumeTest-1124812184 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-faff55de-8fb1-438a-ac6f-95b0ccef21ab {{(pid=84538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 19:06:12 devstack cinder-volume[84538]: DEBUG cinder.coordination [None req-a01a239d-74b0-433b-8aae-e388b5a9d57e tempest-VolumesSnapshotListTestJSON-317057059 None] Acquiring lock "cinder-1387f25c-dfd4-4f52-beab-27cf8a1036b3-delete_volume" by "delete_volume" {{(pid=84538) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 19:06:12 devstack cinder-volume[84538]: DEBUG cinder.coordination [None req-a01a239d-74b0-433b-8aae-e388b5a9d57e tempest-VolumesSnapshotListTestJSON-317057059 None] Lock "cinder-1387f25c-dfd4-4f52-beab-27cf8a1036b3-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=84538) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 19:06:12 devstack sudo[92742]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-faff55de-8fb1-438a-ac6f-95b0ccef21ab Apr 29 19:06:12 devstack cinder-volume[84538]: DEBUG cinder.coordination [None req-a01a239d-74b0-433b-8aae-e388b5a9d57e tempest-VolumesSnapshotListTestJSON-317057059 None] Acquiring lock "cinder-quobyte-1387f25c-dfd4-4f52-beab-27cf8a1036b3" by "delete_volume" {{(pid=84538) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 19:06:12 devstack sudo[92742]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 19:06:12 devstack cinder-volume[84538]: DEBUG cinder.coordination [None req-a01a239d-74b0-433b-8aae-e388b5a9d57e tempest-VolumesSnapshotListTestJSON-317057059 None] Lock "cinder-quobyte-1387f25c-dfd4-4f52-beab-27cf8a1036b3" acquired by "delete_volume" :: waited 0.018s {{(pid=84538) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 19:06:12 devstack cinder-volume[84538]: DEBUG oslo.privsep.daemon [-] privsep: reply[393c6ccf-3e62-4bf7-80b2-e158d4c0d2d8]: (4, 'qcow2') {{(pid=85803) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 19:06:12 devstack cinder-volume[84538]: DEBUG oslo_concurrency.processutils [None req-a01a239d-74b0-433b-8aae-e388b5a9d57e tempest-VolumesSnapshotListTestJSON-317057059 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-1387f25c-dfd4-4f52-beab-27cf8a1036b3 {{(pid=84538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 19:06:12 devstack sudo[92744]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-1387f25c-dfd4-4f52-beab-27cf8a1036b3 Apr 29 19:06:12 devstack sudo[92744]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 19:06:12 devstack sudo[92739]: pam_unix(sudo:session): session closed for user root Apr 29 19:06:12 devstack cinder-volume[84538]: DEBUG oslo_concurrency.processutils [None req-3dd740e7-b12f-4450-b8b0-489057182732 tempest-VolumesGetTest-1123317664 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-ab721445-de20-4a57-9742-9f65ba62c259" returned: 0 in 0.696s {{(pid=84538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 19:06:12 devstack cinder-volume[84538]: DEBUG cinder.volume.drivers.quobyte [None req-3dd740e7-b12f-4450-b8b0-489057182732 tempest-VolumesGetTest-1123317664 None] <== create_volume: return (1531ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-34312b00-dd6d-45bb-af98-75855cea8e48'} {{(pid=84538) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 29 19:06:12 devstack cinder-volume[84538]: DEBUG oslo_concurrency.lockutils [None req-3dd740e7-b12f-4450-b8b0-489057182732 tempest-VolumesGetTest-1123317664 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.534s {{(pid=84538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 19:06:12 devstack cinder-volume[84538]: DEBUG cinder.volume.manager [None req-3dd740e7-b12f-4450-b8b0-489057182732 tempest-VolumesGetTest-1123317664 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (57d1f77a-1816-4c96-a3be-cde369208749) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ab721445-de20-4a57-9742-9f65ba62c259', 'volume_size': 1}' {{(pid=84538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 19:06:12 devstack cinder-volume[84538]: DEBUG cinder.volume.manager [None req-3dd740e7-b12f-4450-b8b0-489057182732 tempest-VolumesGetTest-1123317664 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4fa45b80-bb1f-4f02-916a-9ab109b7f7c1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 19:06:12 devstack cinder-volume[84538]: INFO cinder.volume.flows.manager.create_volume [None req-3dd740e7-b12f-4450-b8b0-489057182732 tempest-VolumesGetTest-1123317664 None] Volume volume-ab721445-de20-4a57-9742-9f65ba62c259 (ab721445-de20-4a57-9742-9f65ba62c259): created successfully Apr 29 19:06:12 devstack cinder-volume[84538]: DEBUG cinder.volume.manager [None req-3dd740e7-b12f-4450-b8b0-489057182732 tempest-VolumesGetTest-1123317664 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4fa45b80-bb1f-4f02-916a-9ab109b7f7c1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 19:06:12 devstack cinder-volume[84538]: DEBUG cinder.volume.manager [None req-3dd740e7-b12f-4450-b8b0-489057182732 tempest-VolumesGetTest-1123317664 None] Flow 'volume_create_manager' (f694cf9f-6cee-42e2-9f9b-002f4567b9fe) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84538) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 19:06:12 devstack cinder-volume[84538]: INFO cinder.volume.manager [None req-3dd740e7-b12f-4450-b8b0-489057182732 tempest-VolumesGetTest-1123317664 None] Created volume successfully. Apr 29 19:06:13 devstack sudo[92742]: pam_unix(sudo:session): session closed for user root Apr 29 19:06:13 devstack cinder-volume[84538]: DEBUG oslo_concurrency.processutils [None req-e5603255-adc2-4f5d-808f-424d5b020941 tempest-CreateVolumesFromSourceVolumeTest-1124812184 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-faff55de-8fb1-438a-ac6f-95b0ccef21ab" returned: 0 in 0.841s {{(pid=84538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 19:06:13 devstack cinder-volume[84538]: DEBUG oslo_concurrency.processutils [None req-e5603255-adc2-4f5d-808f-424d5b020941 tempest-CreateVolumesFromSourceVolumeTest-1124812184 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-faff55de-8fb1-438a-ac6f-95b0ccef21ab {{(pid=84538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 19:06:13 devstack sudo[92753]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-faff55de-8fb1-438a-ac6f-95b0ccef21ab Apr 29 19:06:13 devstack sudo[92753]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 19:06:13 devstack sudo[92744]: pam_unix(sudo:session): session closed for user root Apr 29 19:06:13 devstack cinder-volume[84538]: DEBUG oslo_concurrency.processutils [None req-a01a239d-74b0-433b-8aae-e388b5a9d57e tempest-VolumesSnapshotListTestJSON-317057059 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-1387f25c-dfd4-4f52-beab-27cf8a1036b3" returned: 0 in 0.761s {{(pid=84538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 19:06:13 devstack cinder-volume[84538]: DEBUG oslo_concurrency.processutils [None req-a01a239d-74b0-433b-8aae-e388b5a9d57e tempest-VolumesSnapshotListTestJSON-317057059 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-1387f25c-dfd4-4f52-beab-27cf8a1036b3 {{(pid=84538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 19:06:13 devstack sudo[92755]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-1387f25c-dfd4-4f52-beab-27cf8a1036b3 Apr 29 19:06:13 devstack sudo[92755]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 19:06:13 devstack cinder-volume[84538]: DEBUG cinder.volume.flows.manager.create_volume [None req-ed1e9b74-52fc-442e-8ac6-f5fdef8de192 tempest-VolumesGetTest-1123317664 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84538) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Apr 29 19:06:13 devstack sudo[92753]: pam_unix(sudo:session): session closed for user root Apr 29 19:06:13 devstack cinder-volume[84538]: DEBUG cinder.volume.manager [None req-ed1e9b74-52fc-442e-8ac6-f5fdef8de192 tempest-VolumesGetTest-1123317664 None] Flow 'volume_create_manager' (7623de0b-9d20-43b4-8c2b-4f1282ea4569) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84538) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 19:06:13 devstack cinder-volume[84538]: DEBUG cinder.volume.manager [None req-ed1e9b74-52fc-442e-8ac6-f5fdef8de192 tempest-VolumesGetTest-1123317664 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6156353b-8e6f-4510-89f6-8cc862fa2e1e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 19:06:13 devstack cinder-volume[84538]: DEBUG oslo_concurrency.processutils [None req-e5603255-adc2-4f5d-808f-424d5b020941 tempest-CreateVolumesFromSourceVolumeTest-1124812184 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-faff55de-8fb1-438a-ac6f-95b0ccef21ab" returned: 0 in 0.756s {{(pid=84538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 19:06:13 devstack cinder-volume[84538]: DEBUG cinder.volume.manager [None req-ed1e9b74-52fc-442e-8ac6-f5fdef8de192 tempest-VolumesGetTest-1123317664 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6156353b-8e6f-4510-89f6-8cc862fa2e1e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-29T17:06:14Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-729528881',display_name='tempest-VolumesGetTest-Volume-2135789696',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ba5a2136-f4ac-483c-b333-cab3c0da6b96,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='62ab81799a05449b9f5b7eb23c6c9071',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T17:06:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T17:06:14Z,use_quota=True,user_id='2c9aaf152c0f49d3887038450048a477',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(62b05900-93e3-4190-a88f-1d87324303d1),volume_type_id=62b05900-93e3-4190-a88f-1d87324303d1)' {{(pid=84538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 19:06:13 devstack sudo[92755]: pam_unix(sudo:session): session closed for user root Apr 29 19:06:13 devstack cinder-volume[84538]: DEBUG cinder.volume.manager [None req-ed1e9b74-52fc-442e-8ac6-f5fdef8de192 tempest-VolumesGetTest-1123317664 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b1dc2142-652a-418d-9a0b-5984ef4dad45) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 19:06:13 devstack cinder-volume[84538]: DEBUG cinder.volume.manager [None req-ed1e9b74-52fc-442e-8ac6-f5fdef8de192 tempest-VolumesGetTest-1123317664 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b1dc2142-652a-418d-9a0b-5984ef4dad45) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 19:06:13 devstack cinder-volume[84538]: DEBUG cinder.volume.manager [None req-ed1e9b74-52fc-442e-8ac6-f5fdef8de192 tempest-VolumesGetTest-1123317664 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (300a35f4-b903-4909-a6e3-771b50afc0ce) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 19:06:13 devstack cinder-volume[84538]: DEBUG cinder.volume.manager [None req-ed1e9b74-52fc-442e-8ac6-f5fdef8de192 tempest-VolumesGetTest-1123317664 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (300a35f4-b903-4909-a6e3-771b50afc0ce) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ba5a2136-f4ac-483c-b333-cab3c0da6b96', 'volume_name': 'volume-ba5a2136-f4ac-483c-b333-cab3c0da6b96', 'volume_size': 1}' {{(pid=84538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 19:06:13 devstack cinder-volume[84538]: DEBUG cinder.volume.manager [None req-ed1e9b74-52fc-442e-8ac6-f5fdef8de192 tempest-VolumesGetTest-1123317664 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0e3e28b7-d876-45f0-987f-4e51e6484200) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 19:06:13 devstack cinder-volume[84538]: DEBUG cinder.volume.manager [None req-ed1e9b74-52fc-442e-8ac6-f5fdef8de192 tempest-VolumesGetTest-1123317664 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0e3e28b7-d876-45f0-987f-4e51e6484200) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 19:06:13 devstack cinder-volume[84538]: DEBUG cinder.volume.manager [None req-ed1e9b74-52fc-442e-8ac6-f5fdef8de192 tempest-VolumesGetTest-1123317664 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b82ea602-a3d1-4411-8b18-fc978209bf53) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 19:06:13 devstack cinder-volume[84538]: INFO cinder.volume.flows.manager.create_volume [None req-ed1e9b74-52fc-442e-8ac6-f5fdef8de192 tempest-VolumesGetTest-1123317664 None] Volume ba5a2136-f4ac-483c-b333-cab3c0da6b96: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ba5a2136-f4ac-483c-b333-cab3c0da6b96', 'volume_size': 1} Apr 29 19:06:13 devstack cinder-volume[84538]: DEBUG oslo_concurrency.lockutils [None req-ed1e9b74-52fc-442e-8ac6-f5fdef8de192 tempest-VolumesGetTest-1123317664 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 19:06:13 devstack cinder-volume[84538]: DEBUG oslo_concurrency.lockutils [None req-ed1e9b74-52fc-442e-8ac6-f5fdef8de192 tempest-VolumesGetTest-1123317664 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=84538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 19:06:13 devstack cinder-volume[84538]: DEBUG cinder.volume.drivers.quobyte [None req-ed1e9b74-52fc-442e-8ac6-f5fdef8de192 tempest-VolumesGetTest-1123317664 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-29T17:06:14Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-729528881',display_name='tempest-VolumesGetTest-Volume-2135789696',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ba5a2136-f4ac-483c-b333-cab3c0da6b96,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='62ab81799a05449b9f5b7eb23c6c9071',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T17:06:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T17:06:14Z,use_quota=True,user_id='2c9aaf152c0f49d3887038450048a477',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(62b05900-93e3-4190-a88f-1d87324303d1),volume_type_id=62b05900-93e3-4190-a88f-1d87324303d1)}" {{(pid=84538) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 29 19:06:13 devstack cinder-volume[84538]: DEBUG cinder.volume.drivers.remotefs [None req-ed1e9b74-52fc-442e-8ac6-f5fdef8de192 tempest-VolumesGetTest-1123317664 None] Creating volume ba5a2136-f4ac-483c-b333-cab3c0da6b96 {{(pid=84538) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 29 19:06:13 devstack cinder-volume[84538]: DEBUG oslo_concurrency.lockutils [None req-ed1e9b74-52fc-442e-8ac6-f5fdef8de192 tempest-VolumesGetTest-1123317664 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 19:06:13 devstack cinder-volume[84538]: DEBUG oslo_concurrency.lockutils [None req-ed1e9b74-52fc-442e-8ac6-f5fdef8de192 tempest-VolumesGetTest-1123317664 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=84538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 19:06:13 devstack cinder-volume[84538]: DEBUG cinder.volume.drivers.quobyte [None req-ed1e9b74-52fc-442e-8ac6-f5fdef8de192 tempest-VolumesGetTest-1123317664 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-34312b00-dd6d-45bb-af98-75855cea8e48': None} {{(pid=84538) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 19:06:13 devstack cinder-volume[84538]: DEBUG cinder.volume.drivers.quobyte [None req-ed1e9b74-52fc-442e-8ac6-f5fdef8de192 tempest-VolumesGetTest-1123317664 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-34312b00-dd6d-45bb-af98-75855cea8e48'] {{(pid=84538) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 19:06:13 devstack cinder-volume[84538]: DEBUG oslo_concurrency.lockutils [None req-ed1e9b74-52fc-442e-8ac6-f5fdef8de192 tempest-VolumesGetTest-1123317664 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=84538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 19:06:13 devstack cinder-volume[84538]: DEBUG cinder.volume.drivers.quobyte [None req-ed1e9b74-52fc-442e-8ac6-f5fdef8de192 tempest-VolumesGetTest-1123317664 None] Selected osci02.corp.quobyte.com/cinder-vol-34312b00-dd6d-45bb-af98-75855cea8e48 as target Quobyte volume. {{(pid=84538) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 29 19:06:13 devstack cinder-volume[84538]: INFO cinder.volume.drivers.remotefs [None req-ed1e9b74-52fc-442e-8ac6-f5fdef8de192 tempest-VolumesGetTest-1123317664 None] casted to osci02.corp.quobyte.com/cinder-vol-34312b00-dd6d-45bb-af98-75855cea8e48 Apr 29 19:06:13 devstack cinder-volume[84538]: DEBUG oslo_concurrency.processutils [None req-ed1e9b74-52fc-442e-8ac6-f5fdef8de192 tempest-VolumesGetTest-1123317664 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-ba5a2136-f4ac-483c-b333-cab3c0da6b96 1073741824 {{(pid=84538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 19:06:13 devstack cinder-volume[84538]: DEBUG cinder.coordination [None req-e5603255-adc2-4f5d-808f-424d5b020941 tempest-CreateVolumesFromSourceVolumeTest-1124812184 None] Lock "cinder-quobyte-faff55de-8fb1-438a-ac6f-95b0ccef21ab" released by "delete_volume" :: held 1.721s {{(pid=84538) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 19:06:14 devstack cinder-volume[84538]: DEBUG oslo_concurrency.processutils [None req-a01a239d-74b0-433b-8aae-e388b5a9d57e tempest-VolumesSnapshotListTestJSON-317057059 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-1387f25c-dfd4-4f52-beab-27cf8a1036b3" returned: 0 in 0.715s {{(pid=84538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 19:06:14 devstack sudo[92759]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-ba5a2136-f4ac-483c-b333-cab3c0da6b96 1073741824 Apr 29 19:06:14 devstack sudo[92759]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 19:06:14 devstack cinder-volume[84538]: DEBUG cinder.coordination [None req-a01a239d-74b0-433b-8aae-e388b5a9d57e tempest-VolumesSnapshotListTestJSON-317057059 None] Lock "cinder-quobyte-1387f25c-dfd4-4f52-beab-27cf8a1036b3" released by "delete_volume" :: held 1.543s {{(pid=84538) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 19:06:14 devstack cinder-volume[84538]: DEBUG cinder.quota [None req-e5603255-adc2-4f5d-808f-424d5b020941 tempest-CreateVolumesFromSourceVolumeTest-1124812184 None] Created reservations ['e539ef43-fb97-4686-b019-2b088506119b', '501d7b0e-acd3-4844-b8db-ff9eb0a08a7d', '012ba2a6-3940-4584-9de6-fdbfc02ef329', '4527f9c0-1122-459b-a054-569fa0d1eb60'] {{(pid=84538) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 29 19:06:14 devstack cinder-volume[84538]: DEBUG cinder.quota [None req-a01a239d-74b0-433b-8aae-e388b5a9d57e tempest-VolumesSnapshotListTestJSON-317057059 None] Created reservations ['55cf2175-d587-4a3f-8705-25e5fe3f5391', 'fe110b13-8a02-48fd-82ba-a942df250158', '1bf8b99e-811f-4ca5-bbfb-0c99591d1fe6', 'f786afaf-f758-4039-bde6-e9b289ed0c7f'] {{(pid=84538) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 29 19:06:14 devstack cinder-volume[84538]: DEBUG oslo_concurrency.lockutils [None req-e5603255-adc2-4f5d-808f-424d5b020941 tempest-CreateVolumesFromSourceVolumeTest-1124812184 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 19:06:14 devstack cinder-volume[84538]: DEBUG oslo_concurrency.lockutils [None req-e5603255-adc2-4f5d-808f-424d5b020941 tempest-CreateVolumesFromSourceVolumeTest-1124812184 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 19:06:14 devstack cinder-volume[84538]: DEBUG cinder.volume.drivers.quobyte [None req-e5603255-adc2-4f5d-808f-424d5b020941 tempest-CreateVolumesFromSourceVolumeTest-1124812184 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-34312b00-dd6d-45bb-af98-75855cea8e48': None} {{(pid=84538) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 19:06:14 devstack cinder-volume[84538]: DEBUG cinder.volume.drivers.quobyte [None req-e5603255-adc2-4f5d-808f-424d5b020941 tempest-CreateVolumesFromSourceVolumeTest-1124812184 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-34312b00-dd6d-45bb-af98-75855cea8e48'] {{(pid=84538) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 19:06:14 devstack cinder-volume[84538]: DEBUG oslo_concurrency.lockutils [None req-e5603255-adc2-4f5d-808f-424d5b020941 tempest-CreateVolumesFromSourceVolumeTest-1124812184 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=84538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 19:06:14 devstack cinder-volume[84538]: DEBUG oslo_concurrency.processutils [None req-e5603255-adc2-4f5d-808f-424d5b020941 tempest-CreateVolumesFromSourceVolumeTest-1124812184 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d {{(pid=84538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 19:06:14 devstack cinder-volume[84538]: DEBUG oslo_concurrency.lockutils [None req-a01a239d-74b0-433b-8aae-e388b5a9d57e tempest-VolumesSnapshotListTestJSON-317057059 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 19:06:14 devstack cinder-volume[84538]: DEBUG oslo_concurrency.lockutils [None req-a01a239d-74b0-433b-8aae-e388b5a9d57e tempest-VolumesSnapshotListTestJSON-317057059 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 19:06:14 devstack cinder-volume[84538]: DEBUG cinder.volume.drivers.quobyte [None req-a01a239d-74b0-433b-8aae-e388b5a9d57e tempest-VolumesSnapshotListTestJSON-317057059 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-34312b00-dd6d-45bb-af98-75855cea8e48': None} {{(pid=84538) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 19:06:14 devstack sudo[92761]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d Apr 29 19:06:14 devstack sudo[92761]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 19:06:14 devstack cinder-volume[84538]: DEBUG cinder.volume.drivers.quobyte [None req-a01a239d-74b0-433b-8aae-e388b5a9d57e tempest-VolumesSnapshotListTestJSON-317057059 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-34312b00-dd6d-45bb-af98-75855cea8e48'] {{(pid=84538) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 19:06:14 devstack cinder-volume[84538]: DEBUG oslo_concurrency.lockutils [None req-a01a239d-74b0-433b-8aae-e388b5a9d57e tempest-VolumesSnapshotListTestJSON-317057059 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=84538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 19:06:14 devstack cinder-volume[84538]: DEBUG oslo_concurrency.processutils [None req-a01a239d-74b0-433b-8aae-e388b5a9d57e tempest-VolumesSnapshotListTestJSON-317057059 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d {{(pid=84538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 19:06:14 devstack sudo[92763]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d Apr 29 19:06:14 devstack sudo[92763]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 19:06:14 devstack cinder-volume[84538]: DEBUG cinder.coordination [None req-ffb5a946-d767-4003-8fb6-c952f82ca451 tempest-CreateVolumesFromSourceVolumeTest-1124812184 None] Acquiring lock "cinder-855aa78a-368b-425a-a7c7-54110dd8846d-delete_volume" by "delete_volume" {{(pid=84538) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 19:06:14 devstack cinder-volume[84538]: DEBUG cinder.coordination [None req-ffb5a946-d767-4003-8fb6-c952f82ca451 tempest-CreateVolumesFromSourceVolumeTest-1124812184 None] Lock "cinder-855aa78a-368b-425a-a7c7-54110dd8846d-delete_volume" acquired by "delete_volume" :: waited 0.034s {{(pid=84538) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 19:06:14 devstack cinder-volume[84538]: DEBUG cinder.coordination [None req-ffb5a946-d767-4003-8fb6-c952f82ca451 tempest-CreateVolumesFromSourceVolumeTest-1124812184 None] Acquiring lock "cinder-quobyte-855aa78a-368b-425a-a7c7-54110dd8846d" by "delete_volume" {{(pid=84538) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 19:06:14 devstack cinder-volume[84538]: DEBUG cinder.coordination [None req-ffb5a946-d767-4003-8fb6-c952f82ca451 tempest-CreateVolumesFromSourceVolumeTest-1124812184 None] Lock "cinder-quobyte-855aa78a-368b-425a-a7c7-54110dd8846d" acquired by "delete_volume" :: waited 0.029s {{(pid=84538) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 19:06:14 devstack cinder-volume[84538]: DEBUG oslo.privsep.daemon [-] privsep: reply[a8dac142-a9e4-4d68-9986-2b92a37c0f16]: (4, 'qcow2') {{(pid=85803) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 19:06:14 devstack cinder-volume[84538]: DEBUG oslo_concurrency.processutils [None req-ffb5a946-d767-4003-8fb6-c952f82ca451 tempest-CreateVolumesFromSourceVolumeTest-1124812184 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-855aa78a-368b-425a-a7c7-54110dd8846d {{(pid=84538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 19:06:14 devstack sudo[92768]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-855aa78a-368b-425a-a7c7-54110dd8846d Apr 29 19:06:14 devstack sudo[92768]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 19:06:14 devstack sudo[92759]: pam_unix(sudo:session): session closed for user root Apr 29 19:06:14 devstack cinder-volume[84538]: DEBUG oslo_concurrency.processutils [None req-ed1e9b74-52fc-442e-8ac6-f5fdef8de192 tempest-VolumesGetTest-1123317664 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-ba5a2136-f4ac-483c-b333-cab3c0da6b96 1073741824" returned: 0 in 0.931s {{(pid=84538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 19:06:14 devstack sudo[92761]: pam_unix(sudo:session): session closed for user root Apr 29 19:06:14 devstack cinder-volume[84538]: DEBUG oslo_concurrency.processutils [None req-e5603255-adc2-4f5d-808f-424d5b020941 tempest-CreateVolumesFromSourceVolumeTest-1124812184 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d" returned: 0 in 0.790s {{(pid=84538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 19:06:14 devstack cinder-volume[84538]: DEBUG cinder.manager [None req-e5603255-adc2-4f5d-808f-424d5b020941 tempest-CreateVolumesFromSourceVolumeTest-1124812184 None] Notifying Schedulers of capabilities ... {{(pid=84538) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 29 19:06:14 devstack cinder-volume[84538]: INFO cinder.volume.manager [None req-e5603255-adc2-4f5d-808f-424d5b020941 tempest-CreateVolumesFromSourceVolumeTest-1124812184 None] Deleted volume successfully. Apr 29 19:06:14 devstack cinder-volume[84538]: DEBUG oslo_concurrency.processutils [None req-ed1e9b74-52fc-442e-8ac6-f5fdef8de192 tempest-VolumesGetTest-1123317664 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-ba5a2136-f4ac-483c-b333-cab3c0da6b96 {{(pid=84538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 19:06:15 devstack cinder-volume[84538]: DEBUG cinder.coordination [None req-e5603255-adc2-4f5d-808f-424d5b020941 tempest-CreateVolumesFromSourceVolumeTest-1124812184 None] Lock "cinder-faff55de-8fb1-438a-ac6f-95b0ccef21ab-delete_volume" released by "delete_volume" :: held 2.815s {{(pid=84538) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 19:06:15 devstack sudo[92773]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-ba5a2136-f4ac-483c-b333-cab3c0da6b96 Apr 29 19:06:15 devstack sudo[92773]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 19:06:15 devstack sudo[92763]: pam_unix(sudo:session): session closed for user root Apr 29 19:06:15 devstack cinder-volume[84538]: DEBUG oslo_concurrency.processutils [None req-a01a239d-74b0-433b-8aae-e388b5a9d57e tempest-VolumesSnapshotListTestJSON-317057059 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d" returned: 0 in 0.835s {{(pid=84538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 19:06:15 devstack cinder-volume[84538]: DEBUG cinder.manager [None req-a01a239d-74b0-433b-8aae-e388b5a9d57e tempest-VolumesSnapshotListTestJSON-317057059 None] Notifying Schedulers of capabilities ... {{(pid=84538) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 29 19:06:15 devstack cinder-volume[84538]: INFO cinder.volume.manager [None req-a01a239d-74b0-433b-8aae-e388b5a9d57e tempest-VolumesSnapshotListTestJSON-317057059 None] Deleted volume successfully. Apr 29 19:06:15 devstack cinder-volume[84538]: DEBUG cinder.coordination [None req-a01a239d-74b0-433b-8aae-e388b5a9d57e tempest-VolumesSnapshotListTestJSON-317057059 None] Lock "cinder-1387f25c-dfd4-4f52-beab-27cf8a1036b3-delete_volume" released by "delete_volume" :: held 2.647s {{(pid=84538) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 19:06:15 devstack sudo[92768]: pam_unix(sudo:session): session closed for user root Apr 29 19:06:15 devstack cinder-volume[84538]: DEBUG oslo_concurrency.processutils [None req-ffb5a946-d767-4003-8fb6-c952f82ca451 tempest-CreateVolumesFromSourceVolumeTest-1124812184 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-855aa78a-368b-425a-a7c7-54110dd8846d" returned: 0 in 0.941s {{(pid=84538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 19:06:15 devstack cinder-volume[84538]: DEBUG oslo_concurrency.processutils [None req-ffb5a946-d767-4003-8fb6-c952f82ca451 tempest-CreateVolumesFromSourceVolumeTest-1124812184 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-855aa78a-368b-425a-a7c7-54110dd8846d {{(pid=84538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 19:06:15 devstack sudo[92780]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-855aa78a-368b-425a-a7c7-54110dd8846d Apr 29 19:06:15 devstack sudo[92780]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 19:06:15 devstack sudo[92773]: pam_unix(sudo:session): session closed for user root Apr 29 19:06:15 devstack cinder-volume[84538]: DEBUG oslo_concurrency.processutils [None req-ed1e9b74-52fc-442e-8ac6-f5fdef8de192 tempest-VolumesGetTest-1123317664 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-ba5a2136-f4ac-483c-b333-cab3c0da6b96" returned: 0 in 0.713s {{(pid=84538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 19:06:15 devstack cinder-volume[84538]: DEBUG cinder.volume.drivers.quobyte [None req-ed1e9b74-52fc-442e-8ac6-f5fdef8de192 tempest-VolumesGetTest-1123317664 None] <== create_volume: return (1709ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-34312b00-dd6d-45bb-af98-75855cea8e48'} {{(pid=84538) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 29 19:06:15 devstack cinder-volume[84538]: DEBUG oslo_concurrency.lockutils [None req-ed1e9b74-52fc-442e-8ac6-f5fdef8de192 tempest-VolumesGetTest-1123317664 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.712s {{(pid=84538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 19:06:15 devstack cinder-volume[84538]: DEBUG cinder.volume.manager [None req-ed1e9b74-52fc-442e-8ac6-f5fdef8de192 tempest-VolumesGetTest-1123317664 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b82ea602-a3d1-4411-8b18-fc978209bf53) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ba5a2136-f4ac-483c-b333-cab3c0da6b96', 'volume_size': 1}' {{(pid=84538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 19:06:15 devstack cinder-volume[84538]: DEBUG cinder.volume.manager [None req-ed1e9b74-52fc-442e-8ac6-f5fdef8de192 tempest-VolumesGetTest-1123317664 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (522c1b60-17ad-4f26-b672-7d575e3ed07c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 19:06:15 devstack cinder-volume[84538]: INFO cinder.volume.flows.manager.create_volume [None req-ed1e9b74-52fc-442e-8ac6-f5fdef8de192 tempest-VolumesGetTest-1123317664 None] Volume volume-ba5a2136-f4ac-483c-b333-cab3c0da6b96 (ba5a2136-f4ac-483c-b333-cab3c0da6b96): created successfully Apr 29 19:06:15 devstack cinder-volume[84538]: DEBUG cinder.volume.manager [None req-ed1e9b74-52fc-442e-8ac6-f5fdef8de192 tempest-VolumesGetTest-1123317664 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (522c1b60-17ad-4f26-b672-7d575e3ed07c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 19:06:15 devstack cinder-volume[84538]: DEBUG cinder.volume.manager [None req-ed1e9b74-52fc-442e-8ac6-f5fdef8de192 tempest-VolumesGetTest-1123317664 None] Flow 'volume_create_manager' (7623de0b-9d20-43b4-8c2b-4f1282ea4569) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84538) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 19:06:15 devstack cinder-volume[84538]: INFO cinder.volume.manager [None req-ed1e9b74-52fc-442e-8ac6-f5fdef8de192 tempest-VolumesGetTest-1123317664 None] Created volume successfully. Apr 29 19:06:16 devstack sudo[92780]: pam_unix(sudo:session): session closed for user root Apr 29 19:06:16 devstack cinder-volume[84538]: DEBUG oslo_concurrency.processutils [None req-ffb5a946-d767-4003-8fb6-c952f82ca451 tempest-CreateVolumesFromSourceVolumeTest-1124812184 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-855aa78a-368b-425a-a7c7-54110dd8846d" returned: 0 in 0.680s {{(pid=84538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 19:06:16 devstack cinder-volume[84538]: DEBUG cinder.coordination [None req-ffb5a946-d767-4003-8fb6-c952f82ca451 tempest-CreateVolumesFromSourceVolumeTest-1124812184 None] Lock "cinder-quobyte-855aa78a-368b-425a-a7c7-54110dd8846d" released by "delete_volume" :: held 1.672s {{(pid=84538) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 19:06:16 devstack cinder-volume[84538]: DEBUG cinder.coordination [None req-a53d7723-1244-4489-8e2d-7e51c922ba0f tempest-VolumesGetTest-1123317664 None] Acquiring lock "cinder-ba5a2136-f4ac-483c-b333-cab3c0da6b96-delete_volume" by "delete_volume" {{(pid=84538) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 19:06:16 devstack cinder-volume[84538]: DEBUG cinder.coordination [None req-a53d7723-1244-4489-8e2d-7e51c922ba0f tempest-VolumesGetTest-1123317664 None] Lock "cinder-ba5a2136-f4ac-483c-b333-cab3c0da6b96-delete_volume" acquired by "delete_volume" :: waited 0.032s {{(pid=84538) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 19:06:16 devstack cinder-volume[84538]: DEBUG cinder.coordination [None req-a53d7723-1244-4489-8e2d-7e51c922ba0f tempest-VolumesGetTest-1123317664 None] Acquiring lock "cinder-quobyte-ba5a2136-f4ac-483c-b333-cab3c0da6b96" by "delete_volume" {{(pid=84538) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 19:06:16 devstack cinder-volume[84538]: DEBUG cinder.quota [None req-ffb5a946-d767-4003-8fb6-c952f82ca451 tempest-CreateVolumesFromSourceVolumeTest-1124812184 None] Created reservations ['132f3017-13e5-4e8b-9f4c-d3b71f615173', 'e24fe743-a078-4417-a556-948fbd220abd', '0ca0bb78-aa1d-4da8-b40f-e6f034516e25', 'f68d4403-2eaf-45a0-85d5-17f27550805c'] {{(pid=84538) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 29 19:06:16 devstack cinder-volume[84538]: DEBUG cinder.coordination [None req-a53d7723-1244-4489-8e2d-7e51c922ba0f tempest-VolumesGetTest-1123317664 None] Lock "cinder-quobyte-ba5a2136-f4ac-483c-b333-cab3c0da6b96" acquired by "delete_volume" :: waited 0.023s {{(pid=84538) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 19:06:16 devstack cinder-volume[84538]: DEBUG oslo.privsep.daemon [-] privsep: reply[043dc91a-6545-4561-aa47-2fba4d58f2d7]: (4, 'qcow2') {{(pid=85803) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 19:06:16 devstack cinder-volume[84538]: DEBUG oslo_concurrency.processutils [None req-a53d7723-1244-4489-8e2d-7e51c922ba0f tempest-VolumesGetTest-1123317664 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-ba5a2136-f4ac-483c-b333-cab3c0da6b96 {{(pid=84538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 19:06:16 devstack cinder-volume[84538]: DEBUG oslo_concurrency.lockutils [None req-ffb5a946-d767-4003-8fb6-c952f82ca451 tempest-CreateVolumesFromSourceVolumeTest-1124812184 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 19:06:16 devstack cinder-volume[84538]: DEBUG oslo_concurrency.lockutils [None req-ffb5a946-d767-4003-8fb6-c952f82ca451 tempest-CreateVolumesFromSourceVolumeTest-1124812184 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 19:06:16 devstack cinder-volume[84538]: DEBUG cinder.volume.drivers.quobyte [None req-ffb5a946-d767-4003-8fb6-c952f82ca451 tempest-CreateVolumesFromSourceVolumeTest-1124812184 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-34312b00-dd6d-45bb-af98-75855cea8e48': None} {{(pid=84538) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 19:06:16 devstack cinder-volume[84538]: DEBUG cinder.volume.drivers.quobyte [None req-ffb5a946-d767-4003-8fb6-c952f82ca451 tempest-CreateVolumesFromSourceVolumeTest-1124812184 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-34312b00-dd6d-45bb-af98-75855cea8e48'] {{(pid=84538) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 19:06:16 devstack cinder-volume[84538]: DEBUG oslo_concurrency.lockutils [None req-ffb5a946-d767-4003-8fb6-c952f82ca451 tempest-CreateVolumesFromSourceVolumeTest-1124812184 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=84538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 19:06:16 devstack cinder-volume[84538]: DEBUG oslo_concurrency.processutils [None req-ffb5a946-d767-4003-8fb6-c952f82ca451 tempest-CreateVolumesFromSourceVolumeTest-1124812184 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d {{(pid=84538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 19:06:16 devstack sudo[92784]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d Apr 29 19:06:16 devstack sudo[92784]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 19:06:16 devstack sudo[92783]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-ba5a2136-f4ac-483c-b333-cab3c0da6b96 Apr 29 19:06:16 devstack sudo[92783]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 19:06:16 devstack cinder-volume[84538]: DEBUG cinder.coordination [None req-be5a5a80-edd5-4a8f-a59d-433ca4cc46cb tempest-CreateVolumesFromSourceVolumeTest-1124812184 None] Acquiring lock "cinder-4b924b80-52da-4699-be6a-1529743f41a1-delete_volume" by "delete_volume" {{(pid=84538) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 19:06:16 devstack cinder-volume[84538]: DEBUG cinder.coordination [None req-be5a5a80-edd5-4a8f-a59d-433ca4cc46cb tempest-CreateVolumesFromSourceVolumeTest-1124812184 None] Lock "cinder-4b924b80-52da-4699-be6a-1529743f41a1-delete_volume" acquired by "delete_volume" :: waited 0.040s {{(pid=84538) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 19:06:16 devstack cinder-volume[84538]: DEBUG cinder.coordination [None req-be5a5a80-edd5-4a8f-a59d-433ca4cc46cb tempest-CreateVolumesFromSourceVolumeTest-1124812184 None] Acquiring lock "cinder-quobyte-4b924b80-52da-4699-be6a-1529743f41a1" by "delete_volume" {{(pid=84538) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 19:06:16 devstack cinder-volume[84538]: DEBUG cinder.coordination [None req-be5a5a80-edd5-4a8f-a59d-433ca4cc46cb tempest-CreateVolumesFromSourceVolumeTest-1124812184 None] Lock "cinder-quobyte-4b924b80-52da-4699-be6a-1529743f41a1" acquired by "delete_volume" :: waited 0.030s {{(pid=84538) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 19:06:16 devstack cinder-volume[84538]: DEBUG oslo.privsep.daemon [-] privsep: reply[d9d6cd4e-ae54-42a9-b191-7e5c913a95ae]: (4, 'qcow2') {{(pid=85803) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 19:06:16 devstack cinder-volume[84538]: DEBUG oslo_concurrency.processutils [None req-be5a5a80-edd5-4a8f-a59d-433ca4cc46cb tempest-CreateVolumesFromSourceVolumeTest-1124812184 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-4b924b80-52da-4699-be6a-1529743f41a1 {{(pid=84538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 19:06:17 devstack sudo[92787]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-4b924b80-52da-4699-be6a-1529743f41a1 Apr 29 19:06:17 devstack sudo[92787]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 19:06:17 devstack sudo[92784]: pam_unix(sudo:session): session closed for user root Apr 29 19:06:17 devstack cinder-volume[84538]: DEBUG oslo_concurrency.processutils [None req-ffb5a946-d767-4003-8fb6-c952f82ca451 tempest-CreateVolumesFromSourceVolumeTest-1124812184 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d" returned: 0 in 0.669s {{(pid=84538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 19:06:17 devstack cinder-volume[84538]: DEBUG cinder.manager [None req-ffb5a946-d767-4003-8fb6-c952f82ca451 tempest-CreateVolumesFromSourceVolumeTest-1124812184 None] Notifying Schedulers of capabilities ... {{(pid=84538) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 29 19:06:17 devstack cinder-volume[84538]: INFO cinder.volume.manager [None req-ffb5a946-d767-4003-8fb6-c952f82ca451 tempest-CreateVolumesFromSourceVolumeTest-1124812184 None] Deleted volume successfully. Apr 29 19:06:17 devstack cinder-volume[84538]: DEBUG cinder.coordination [None req-ffb5a946-d767-4003-8fb6-c952f82ca451 tempest-CreateVolumesFromSourceVolumeTest-1124812184 None] Lock "cinder-855aa78a-368b-425a-a7c7-54110dd8846d-delete_volume" released by "delete_volume" :: held 2.699s {{(pid=84538) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 19:06:17 devstack sudo[92783]: pam_unix(sudo:session): session closed for user root Apr 29 19:06:17 devstack cinder-volume[84538]: DEBUG oslo_concurrency.processutils [None req-a53d7723-1244-4489-8e2d-7e51c922ba0f tempest-VolumesGetTest-1123317664 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-ba5a2136-f4ac-483c-b333-cab3c0da6b96" returned: 0 in 0.909s {{(pid=84538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 19:06:17 devstack cinder-volume[84538]: DEBUG oslo_concurrency.processutils [None req-a53d7723-1244-4489-8e2d-7e51c922ba0f tempest-VolumesGetTest-1123317664 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-ba5a2136-f4ac-483c-b333-cab3c0da6b96 {{(pid=84538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 19:06:17 devstack sudo[92793]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-ba5a2136-f4ac-483c-b333-cab3c0da6b96 Apr 29 19:06:17 devstack sudo[92793]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 19:06:17 devstack sudo[92787]: pam_unix(sudo:session): session closed for user root Apr 29 19:06:17 devstack cinder-volume[84538]: DEBUG oslo_concurrency.processutils [None req-be5a5a80-edd5-4a8f-a59d-433ca4cc46cb tempest-CreateVolumesFromSourceVolumeTest-1124812184 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-4b924b80-52da-4699-be6a-1529743f41a1" returned: 0 in 0.797s {{(pid=84538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 19:06:17 devstack cinder-volume[84538]: DEBUG oslo_concurrency.processutils [None req-be5a5a80-edd5-4a8f-a59d-433ca4cc46cb tempest-CreateVolumesFromSourceVolumeTest-1124812184 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-4b924b80-52da-4699-be6a-1529743f41a1 {{(pid=84538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 19:06:17 devstack sudo[92799]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-4b924b80-52da-4699-be6a-1529743f41a1 Apr 29 19:06:17 devstack sudo[92799]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 19:06:17 devstack sudo[92793]: pam_unix(sudo:session): session closed for user root Apr 29 19:06:17 devstack cinder-volume[84538]: DEBUG oslo_concurrency.processutils [None req-a53d7723-1244-4489-8e2d-7e51c922ba0f tempest-VolumesGetTest-1123317664 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-ba5a2136-f4ac-483c-b333-cab3c0da6b96" returned: 0 in 0.667s {{(pid=84538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 19:06:18 devstack cinder-volume[84538]: DEBUG cinder.coordination [None req-a53d7723-1244-4489-8e2d-7e51c922ba0f tempest-VolumesGetTest-1123317664 None] Lock "cinder-quobyte-ba5a2136-f4ac-483c-b333-cab3c0da6b96" released by "delete_volume" :: held 1.633s {{(pid=84538) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 19:06:18 devstack cinder-volume[84538]: DEBUG cinder.quota [None req-a53d7723-1244-4489-8e2d-7e51c922ba0f tempest-VolumesGetTest-1123317664 None] Created reservations ['bcae1e58-405b-4644-ab82-ba7cb37114b3', '5b87e1d7-6e59-4219-be68-7679edadd7d0', '051760d0-76e1-4d8c-82fd-a27a724b4d8f', '3bdc4725-3b37-4aad-b21e-331cc34064b5'] {{(pid=84538) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 29 19:06:18 devstack cinder-volume[84538]: DEBUG cinder.volume.flows.manager.create_volume [None req-f3c77f95-6b67-4078-93cc-4c8a276377dc tempest-VolumesSnapshotNegativeTestJSON-123355496 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84538) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Apr 29 19:06:18 devstack cinder-volume[84538]: DEBUG cinder.volume.manager [None req-f3c77f95-6b67-4078-93cc-4c8a276377dc tempest-VolumesSnapshotNegativeTestJSON-123355496 None] Flow 'volume_create_manager' (d5a4f3b6-9219-4513-9fcf-25ae75cb6d7c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84538) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 19:06:18 devstack cinder-volume[84538]: DEBUG cinder.volume.manager [None req-f3c77f95-6b67-4078-93cc-4c8a276377dc tempest-VolumesSnapshotNegativeTestJSON-123355496 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (54ceaa52-d691-4ea1-be48-ba0aa1e0aa5c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 19:06:18 devstack cinder-volume[84538]: DEBUG cinder.volume.manager [None req-f3c77f95-6b67-4078-93cc-4c8a276377dc tempest-VolumesSnapshotNegativeTestJSON-123355496 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (54ceaa52-d691-4ea1-be48-ba0aa1e0aa5c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-29T17:06:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotNegativeTestJSON-Volume-600488160',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c5e98ef2-ed97-4db7-a222-4b73142f19d0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6108c27dda08453db57818a6dd9ae82a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T17:06:18Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T17:06:18Z,use_quota=True,user_id='434707b4a302435e8f78e32dbe9ed51d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(62b05900-93e3-4190-a88f-1d87324303d1),volume_type_id=62b05900-93e3-4190-a88f-1d87324303d1)' {{(pid=84538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 19:06:18 devstack cinder-volume[84538]: DEBUG cinder.volume.manager [None req-f3c77f95-6b67-4078-93cc-4c8a276377dc tempest-VolumesSnapshotNegativeTestJSON-123355496 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4e56c5ed-d4b9-445d-a40d-196a4798f74c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 19:06:18 devstack cinder-volume[84538]: DEBUG cinder.volume.manager [None req-f3c77f95-6b67-4078-93cc-4c8a276377dc tempest-VolumesSnapshotNegativeTestJSON-123355496 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4e56c5ed-d4b9-445d-a40d-196a4798f74c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 19:06:18 devstack cinder-volume[84538]: DEBUG cinder.volume.manager [None req-f3c77f95-6b67-4078-93cc-4c8a276377dc tempest-VolumesSnapshotNegativeTestJSON-123355496 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (357b38d6-4bc5-4fcd-9621-1e1589e7bd3a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 19:06:18 devstack cinder-volume[84538]: DEBUG cinder.volume.manager [None req-f3c77f95-6b67-4078-93cc-4c8a276377dc tempest-VolumesSnapshotNegativeTestJSON-123355496 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (357b38d6-4bc5-4fcd-9621-1e1589e7bd3a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c5e98ef2-ed97-4db7-a222-4b73142f19d0', 'volume_name': 'volume-c5e98ef2-ed97-4db7-a222-4b73142f19d0', 'volume_size': 2}' {{(pid=84538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 19:06:18 devstack cinder-volume[84538]: DEBUG cinder.volume.manager [None req-f3c77f95-6b67-4078-93cc-4c8a276377dc tempest-VolumesSnapshotNegativeTestJSON-123355496 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4c34261f-3fc2-44d1-bdfb-18810a504702) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 19:06:18 devstack cinder-volume[84538]: DEBUG cinder.volume.manager [None req-f3c77f95-6b67-4078-93cc-4c8a276377dc tempest-VolumesSnapshotNegativeTestJSON-123355496 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4c34261f-3fc2-44d1-bdfb-18810a504702) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 19:06:18 devstack cinder-volume[84538]: DEBUG cinder.volume.manager [None req-f3c77f95-6b67-4078-93cc-4c8a276377dc tempest-VolumesSnapshotNegativeTestJSON-123355496 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7fb2afc1-3326-4791-8b20-93ed5c0604d8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 19:06:18 devstack cinder-volume[84538]: INFO cinder.volume.flows.manager.create_volume [None req-f3c77f95-6b67-4078-93cc-4c8a276377dc tempest-VolumesSnapshotNegativeTestJSON-123355496 None] Volume c5e98ef2-ed97-4db7-a222-4b73142f19d0: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c5e98ef2-ed97-4db7-a222-4b73142f19d0', 'volume_size': 2} Apr 29 19:06:18 devstack cinder-volume[84538]: DEBUG oslo_concurrency.lockutils [None req-f3c77f95-6b67-4078-93cc-4c8a276377dc tempest-VolumesSnapshotNegativeTestJSON-123355496 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 19:06:18 devstack cinder-volume[84538]: DEBUG oslo_concurrency.lockutils [None req-f3c77f95-6b67-4078-93cc-4c8a276377dc tempest-VolumesSnapshotNegativeTestJSON-123355496 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=84538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 19:06:18 devstack cinder-volume[84538]: DEBUG cinder.volume.drivers.quobyte [None req-f3c77f95-6b67-4078-93cc-4c8a276377dc tempest-VolumesSnapshotNegativeTestJSON-123355496 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-29T17:06:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotNegativeTestJSON-Volume-600488160',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c5e98ef2-ed97-4db7-a222-4b73142f19d0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6108c27dda08453db57818a6dd9ae82a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T17:06:18Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T17:06:18Z,use_quota=True,user_id='434707b4a302435e8f78e32dbe9ed51d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(62b05900-93e3-4190-a88f-1d87324303d1),volume_type_id=62b05900-93e3-4190-a88f-1d87324303d1)}" {{(pid=84538) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 29 19:06:18 devstack cinder-volume[84538]: DEBUG cinder.volume.drivers.remotefs [None req-f3c77f95-6b67-4078-93cc-4c8a276377dc tempest-VolumesSnapshotNegativeTestJSON-123355496 None] Creating volume c5e98ef2-ed97-4db7-a222-4b73142f19d0 {{(pid=84538) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 29 19:06:18 devstack cinder-volume[84538]: DEBUG oslo_concurrency.lockutils [None req-f3c77f95-6b67-4078-93cc-4c8a276377dc tempest-VolumesSnapshotNegativeTestJSON-123355496 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 19:06:18 devstack cinder-volume[84538]: DEBUG oslo_concurrency.lockutils [None req-f3c77f95-6b67-4078-93cc-4c8a276377dc tempest-VolumesSnapshotNegativeTestJSON-123355496 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=84538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 19:06:18 devstack cinder-volume[84538]: DEBUG cinder.volume.drivers.quobyte [None req-f3c77f95-6b67-4078-93cc-4c8a276377dc tempest-VolumesSnapshotNegativeTestJSON-123355496 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-34312b00-dd6d-45bb-af98-75855cea8e48': None} {{(pid=84538) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 19:06:18 devstack cinder-volume[84538]: DEBUG cinder.volume.drivers.quobyte [None req-f3c77f95-6b67-4078-93cc-4c8a276377dc tempest-VolumesSnapshotNegativeTestJSON-123355496 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-34312b00-dd6d-45bb-af98-75855cea8e48'] {{(pid=84538) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 19:06:18 devstack cinder-volume[84538]: DEBUG oslo_concurrency.lockutils [None req-f3c77f95-6b67-4078-93cc-4c8a276377dc tempest-VolumesSnapshotNegativeTestJSON-123355496 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=84538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 19:06:18 devstack cinder-volume[84538]: DEBUG cinder.volume.drivers.quobyte [None req-f3c77f95-6b67-4078-93cc-4c8a276377dc tempest-VolumesSnapshotNegativeTestJSON-123355496 None] Selected osci02.corp.quobyte.com/cinder-vol-34312b00-dd6d-45bb-af98-75855cea8e48 as target Quobyte volume. {{(pid=84538) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 29 19:06:18 devstack cinder-volume[84538]: INFO cinder.volume.drivers.remotefs [None req-f3c77f95-6b67-4078-93cc-4c8a276377dc tempest-VolumesSnapshotNegativeTestJSON-123355496 None] casted to osci02.corp.quobyte.com/cinder-vol-34312b00-dd6d-45bb-af98-75855cea8e48 Apr 29 19:06:18 devstack cinder-volume[84538]: DEBUG oslo_concurrency.processutils [None req-f3c77f95-6b67-4078-93cc-4c8a276377dc tempest-VolumesSnapshotNegativeTestJSON-123355496 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-c5e98ef2-ed97-4db7-a222-4b73142f19d0 2147483648 {{(pid=84538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 19:06:18 devstack cinder-volume[84538]: DEBUG oslo_concurrency.lockutils [None req-a53d7723-1244-4489-8e2d-7e51c922ba0f tempest-VolumesGetTest-1123317664 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 19:06:18 devstack cinder-volume[84538]: DEBUG oslo_concurrency.lockutils [None req-a53d7723-1244-4489-8e2d-7e51c922ba0f tempest-VolumesGetTest-1123317664 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=84538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 19:06:18 devstack cinder-volume[84538]: DEBUG cinder.volume.drivers.quobyte [None req-a53d7723-1244-4489-8e2d-7e51c922ba0f tempest-VolumesGetTest-1123317664 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-34312b00-dd6d-45bb-af98-75855cea8e48': None} {{(pid=84538) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 19:06:18 devstack cinder-volume[84538]: DEBUG cinder.volume.drivers.quobyte [None req-a53d7723-1244-4489-8e2d-7e51c922ba0f tempest-VolumesGetTest-1123317664 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-34312b00-dd6d-45bb-af98-75855cea8e48'] {{(pid=84538) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 19:06:18 devstack cinder-volume[84538]: DEBUG oslo_concurrency.lockutils [None req-a53d7723-1244-4489-8e2d-7e51c922ba0f tempest-VolumesGetTest-1123317664 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=84538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 19:06:18 devstack cinder-volume[84538]: DEBUG oslo_concurrency.processutils [None req-a53d7723-1244-4489-8e2d-7e51c922ba0f tempest-VolumesGetTest-1123317664 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d {{(pid=84538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 19:06:18 devstack sudo[92802]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-c5e98ef2-ed97-4db7-a222-4b73142f19d0 2147483648 Apr 29 19:06:18 devstack sudo[92802]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 19:06:18 devstack sudo[92805]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d Apr 29 19:06:18 devstack sudo[92805]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 19:06:18 devstack sudo[92799]: pam_unix(sudo:session): session closed for user root Apr 29 19:06:18 devstack cinder-volume[84538]: DEBUG oslo_concurrency.processutils [None req-be5a5a80-edd5-4a8f-a59d-433ca4cc46cb tempest-CreateVolumesFromSourceVolumeTest-1124812184 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-4b924b80-52da-4699-be6a-1529743f41a1" returned: 0 in 0.707s {{(pid=84538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 19:06:18 devstack cinder-volume[84538]: DEBUG cinder.coordination [None req-be5a5a80-edd5-4a8f-a59d-433ca4cc46cb tempest-CreateVolumesFromSourceVolumeTest-1124812184 None] Lock "cinder-quobyte-4b924b80-52da-4699-be6a-1529743f41a1" released by "delete_volume" :: held 1.560s {{(pid=84538) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 19:06:18 devstack cinder-volume[84538]: DEBUG cinder.quota [None req-be5a5a80-edd5-4a8f-a59d-433ca4cc46cb tempest-CreateVolumesFromSourceVolumeTest-1124812184 None] Created reservations ['0dd33561-d428-4a2b-9b52-fd7c03acadb8', '74d6249a-e655-4ddc-a028-0155eb61010f', 'd6e97263-4a84-4766-bb93-8806c440a11f', '7c0a3d26-18ca-4baa-bc22-002e1ba54fd4'] {{(pid=84538) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 29 19:06:18 devstack cinder-volume[84538]: DEBUG oslo_concurrency.lockutils [None req-be5a5a80-edd5-4a8f-a59d-433ca4cc46cb tempest-CreateVolumesFromSourceVolumeTest-1124812184 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 19:06:18 devstack cinder-volume[84538]: DEBUG oslo_concurrency.lockutils [None req-be5a5a80-edd5-4a8f-a59d-433ca4cc46cb tempest-CreateVolumesFromSourceVolumeTest-1124812184 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 19:06:18 devstack cinder-volume[84538]: DEBUG cinder.volume.drivers.quobyte [None req-be5a5a80-edd5-4a8f-a59d-433ca4cc46cb tempest-CreateVolumesFromSourceVolumeTest-1124812184 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-34312b00-dd6d-45bb-af98-75855cea8e48': None} {{(pid=84538) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 19:06:18 devstack cinder-volume[84538]: DEBUG cinder.volume.drivers.quobyte [None req-be5a5a80-edd5-4a8f-a59d-433ca4cc46cb tempest-CreateVolumesFromSourceVolumeTest-1124812184 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-34312b00-dd6d-45bb-af98-75855cea8e48'] {{(pid=84538) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 19:06:18 devstack cinder-volume[84538]: DEBUG oslo_concurrency.lockutils [None req-be5a5a80-edd5-4a8f-a59d-433ca4cc46cb tempest-CreateVolumesFromSourceVolumeTest-1124812184 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=84538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 19:06:18 devstack cinder-volume[84538]: DEBUG oslo_concurrency.processutils [None req-be5a5a80-edd5-4a8f-a59d-433ca4cc46cb tempest-CreateVolumesFromSourceVolumeTest-1124812184 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d {{(pid=84538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 19:06:18 devstack cinder-volume[84538]: DEBUG cinder.coordination [None req-33770ef3-582b-4a7a-b6c6-2a49b6e665f9 tempest-VolumesGetTest-1123317664 None] Acquiring lock "cinder-ab721445-de20-4a57-9742-9f65ba62c259-delete_volume" by "delete_volume" {{(pid=84538) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 19:06:18 devstack sudo[92808]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d Apr 29 19:06:18 devstack sudo[92808]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 19:06:18 devstack cinder-volume[84538]: DEBUG cinder.coordination [None req-33770ef3-582b-4a7a-b6c6-2a49b6e665f9 tempest-VolumesGetTest-1123317664 None] Lock "cinder-ab721445-de20-4a57-9742-9f65ba62c259-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=84538) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 19:06:18 devstack cinder-volume[84538]: DEBUG cinder.coordination [None req-33770ef3-582b-4a7a-b6c6-2a49b6e665f9 tempest-VolumesGetTest-1123317664 None] Acquiring lock "cinder-quobyte-ab721445-de20-4a57-9742-9f65ba62c259" by "delete_volume" {{(pid=84538) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 19:06:18 devstack cinder-volume[84538]: DEBUG cinder.coordination [None req-33770ef3-582b-4a7a-b6c6-2a49b6e665f9 tempest-VolumesGetTest-1123317664 None] Lock "cinder-quobyte-ab721445-de20-4a57-9742-9f65ba62c259" acquired by "delete_volume" :: waited 0.023s {{(pid=84538) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 19:06:18 devstack cinder-volume[84538]: DEBUG oslo.privsep.daemon [-] privsep: reply[3aaf1d82-2c5b-49ee-9655-a86f9223cd4e]: (4, 'qcow2') {{(pid=85803) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 19:06:18 devstack cinder-volume[84538]: DEBUG oslo_concurrency.processutils [None req-33770ef3-582b-4a7a-b6c6-2a49b6e665f9 tempest-VolumesGetTest-1123317664 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-ab721445-de20-4a57-9742-9f65ba62c259 {{(pid=84538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 19:06:18 devstack sudo[92810]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-ab721445-de20-4a57-9742-9f65ba62c259 Apr 29 19:06:18 devstack sudo[92810]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 19:06:19 devstack sudo[92805]: pam_unix(sudo:session): session closed for user root Apr 29 19:06:19 devstack cinder-volume[84538]: DEBUG oslo_concurrency.processutils [None req-a53d7723-1244-4489-8e2d-7e51c922ba0f tempest-VolumesGetTest-1123317664 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d" returned: 0 in 0.742s {{(pid=84538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 19:06:19 devstack cinder-volume[84538]: DEBUG cinder.manager [None req-a53d7723-1244-4489-8e2d-7e51c922ba0f tempest-VolumesGetTest-1123317664 None] Notifying Schedulers of capabilities ... {{(pid=84538) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 29 19:06:19 devstack cinder-volume[84538]: INFO cinder.volume.manager [None req-a53d7723-1244-4489-8e2d-7e51c922ba0f tempest-VolumesGetTest-1123317664 None] Deleted volume successfully. Apr 29 19:06:19 devstack cinder-volume[84538]: DEBUG cinder.coordination [None req-39b65b20-beba-408a-992e-f8c75b8068c3 tempest-CreateVolumesFromSourceVolumeTest-1124812184 None] Acquiring lock "cinder-16c32655-8006-4faf-bd2a-33c9a749eb6b-delete_volume" by "delete_volume" {{(pid=84538) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 19:06:19 devstack cinder-volume[84538]: DEBUG cinder.coordination [None req-39b65b20-beba-408a-992e-f8c75b8068c3 tempest-CreateVolumesFromSourceVolumeTest-1124812184 None] Lock "cinder-16c32655-8006-4faf-bd2a-33c9a749eb6b-delete_volume" acquired by "delete_volume" :: waited 0.043s {{(pid=84538) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 19:06:19 devstack cinder-volume[84538]: DEBUG cinder.coordination [None req-a53d7723-1244-4489-8e2d-7e51c922ba0f tempest-VolumesGetTest-1123317664 None] Lock "cinder-ba5a2136-f4ac-483c-b333-cab3c0da6b96-delete_volume" released by "delete_volume" :: held 2.811s {{(pid=84538) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 19:06:19 devstack cinder-volume[84538]: DEBUG cinder.coordination [None req-39b65b20-beba-408a-992e-f8c75b8068c3 tempest-CreateVolumesFromSourceVolumeTest-1124812184 None] Acquiring lock "cinder-quobyte-16c32655-8006-4faf-bd2a-33c9a749eb6b" by "delete_volume" {{(pid=84538) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 19:06:19 devstack cinder-volume[84538]: DEBUG cinder.coordination [None req-39b65b20-beba-408a-992e-f8c75b8068c3 tempest-CreateVolumesFromSourceVolumeTest-1124812184 None] Lock "cinder-quobyte-16c32655-8006-4faf-bd2a-33c9a749eb6b" acquired by "delete_volume" :: waited 0.022s {{(pid=84538) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 19:06:19 devstack cinder-volume[84538]: DEBUG oslo.privsep.daemon [-] privsep: reply[a57a704f-fdea-4589-bb37-aaa6dac9ff8a]: (4, 'qcow2') {{(pid=85803) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 19:06:19 devstack cinder-volume[84538]: DEBUG oslo_concurrency.processutils [None req-39b65b20-beba-408a-992e-f8c75b8068c3 tempest-CreateVolumesFromSourceVolumeTest-1124812184 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-16c32655-8006-4faf-bd2a-33c9a749eb6b {{(pid=84538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 19:06:19 devstack sudo[92802]: pam_unix(sudo:session): session closed for user root Apr 29 19:06:19 devstack cinder-volume[84538]: DEBUG oslo_concurrency.processutils [None req-f3c77f95-6b67-4078-93cc-4c8a276377dc tempest-VolumesSnapshotNegativeTestJSON-123355496 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-c5e98ef2-ed97-4db7-a222-4b73142f19d0 2147483648" returned: 0 in 1.018s {{(pid=84538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 19:06:19 devstack cinder-volume[84538]: DEBUG oslo_concurrency.processutils [None req-f3c77f95-6b67-4078-93cc-4c8a276377dc tempest-VolumesSnapshotNegativeTestJSON-123355496 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-c5e98ef2-ed97-4db7-a222-4b73142f19d0 {{(pid=84538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 19:06:19 devstack sudo[92819]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-c5e98ef2-ed97-4db7-a222-4b73142f19d0 Apr 29 19:06:19 devstack sudo[92819]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 19:06:19 devstack sudo[92817]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-16c32655-8006-4faf-bd2a-33c9a749eb6b Apr 29 19:06:19 devstack sudo[92817]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 19:06:19 devstack sudo[92808]: pam_unix(sudo:session): session closed for user root Apr 29 19:06:19 devstack cinder-volume[84538]: DEBUG oslo_concurrency.processutils [None req-be5a5a80-edd5-4a8f-a59d-433ca4cc46cb tempest-CreateVolumesFromSourceVolumeTest-1124812184 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d" returned: 0 in 0.821s {{(pid=84538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 19:06:19 devstack cinder-volume[84538]: DEBUG cinder.manager [None req-be5a5a80-edd5-4a8f-a59d-433ca4cc46cb tempest-CreateVolumesFromSourceVolumeTest-1124812184 None] Notifying Schedulers of capabilities ... {{(pid=84538) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 29 19:06:19 devstack cinder-volume[84538]: INFO cinder.volume.manager [None req-be5a5a80-edd5-4a8f-a59d-433ca4cc46cb tempest-CreateVolumesFromSourceVolumeTest-1124812184 None] Deleted volume successfully. Apr 29 19:06:19 devstack cinder-volume[84538]: DEBUG cinder.coordination [None req-be5a5a80-edd5-4a8f-a59d-433ca4cc46cb tempest-CreateVolumesFromSourceVolumeTest-1124812184 None] Lock "cinder-4b924b80-52da-4699-be6a-1529743f41a1-delete_volume" released by "delete_volume" :: held 2.649s {{(pid=84538) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 19:06:19 devstack sudo[92810]: pam_unix(sudo:session): session closed for user root Apr 29 19:06:19 devstack cinder-volume[84538]: DEBUG oslo_concurrency.processutils [None req-33770ef3-582b-4a7a-b6c6-2a49b6e665f9 tempest-VolumesGetTest-1123317664 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-ab721445-de20-4a57-9742-9f65ba62c259" returned: 0 in 0.917s {{(pid=84538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 19:06:19 devstack cinder-volume[84538]: DEBUG oslo_concurrency.processutils [None req-33770ef3-582b-4a7a-b6c6-2a49b6e665f9 tempest-VolumesGetTest-1123317664 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-ab721445-de20-4a57-9742-9f65ba62c259 {{(pid=84538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 19:06:19 devstack sudo[92825]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-ab721445-de20-4a57-9742-9f65ba62c259 Apr 29 19:06:19 devstack sudo[92825]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 19:06:20 devstack sudo[92819]: pam_unix(sudo:session): session closed for user root Apr 29 19:06:20 devstack cinder-volume[84538]: DEBUG oslo_concurrency.processutils [None req-f3c77f95-6b67-4078-93cc-4c8a276377dc tempest-VolumesSnapshotNegativeTestJSON-123355496 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-c5e98ef2-ed97-4db7-a222-4b73142f19d0" returned: 0 in 0.682s {{(pid=84538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 19:06:20 devstack cinder-volume[84538]: DEBUG cinder.volume.drivers.quobyte [None req-f3c77f95-6b67-4078-93cc-4c8a276377dc tempest-VolumesSnapshotNegativeTestJSON-123355496 None] <== create_volume: return (1749ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-34312b00-dd6d-45bb-af98-75855cea8e48'} {{(pid=84538) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 29 19:06:20 devstack cinder-volume[84538]: DEBUG oslo_concurrency.lockutils [None req-f3c77f95-6b67-4078-93cc-4c8a276377dc tempest-VolumesSnapshotNegativeTestJSON-123355496 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.752s {{(pid=84538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 19:06:20 devstack sudo[92817]: pam_unix(sudo:session): session closed for user root Apr 29 19:06:20 devstack cinder-volume[84538]: DEBUG cinder.volume.manager [None req-f3c77f95-6b67-4078-93cc-4c8a276377dc tempest-VolumesSnapshotNegativeTestJSON-123355496 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7fb2afc1-3326-4791-8b20-93ed5c0604d8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c5e98ef2-ed97-4db7-a222-4b73142f19d0', 'volume_size': 2}' {{(pid=84538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 19:06:20 devstack cinder-volume[84538]: DEBUG cinder.volume.manager [None req-f3c77f95-6b67-4078-93cc-4c8a276377dc tempest-VolumesSnapshotNegativeTestJSON-123355496 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ee743183-585c-4784-a5f7-16366a5bb6cd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 19:06:20 devstack cinder-volume[84538]: DEBUG oslo_concurrency.processutils [None req-39b65b20-beba-408a-992e-f8c75b8068c3 tempest-CreateVolumesFromSourceVolumeTest-1124812184 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-16c32655-8006-4faf-bd2a-33c9a749eb6b" returned: 0 in 0.796s {{(pid=84538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 19:06:20 devstack cinder-volume[84538]: DEBUG oslo_concurrency.processutils [None req-39b65b20-beba-408a-992e-f8c75b8068c3 tempest-CreateVolumesFromSourceVolumeTest-1124812184 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-16c32655-8006-4faf-bd2a-33c9a749eb6b {{(pid=84538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 19:06:20 devstack cinder-volume[84538]: INFO cinder.volume.flows.manager.create_volume [None req-f3c77f95-6b67-4078-93cc-4c8a276377dc tempest-VolumesSnapshotNegativeTestJSON-123355496 None] Volume volume-c5e98ef2-ed97-4db7-a222-4b73142f19d0 (c5e98ef2-ed97-4db7-a222-4b73142f19d0): created successfully Apr 29 19:06:20 devstack sudo[92831]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-16c32655-8006-4faf-bd2a-33c9a749eb6b Apr 29 19:06:20 devstack cinder-volume[84538]: DEBUG cinder.volume.manager [None req-f3c77f95-6b67-4078-93cc-4c8a276377dc tempest-VolumesSnapshotNegativeTestJSON-123355496 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ee743183-585c-4784-a5f7-16366a5bb6cd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 19:06:20 devstack sudo[92831]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 19:06:20 devstack cinder-volume[84538]: DEBUG cinder.volume.manager [None req-f3c77f95-6b67-4078-93cc-4c8a276377dc tempest-VolumesSnapshotNegativeTestJSON-123355496 None] Flow 'volume_create_manager' (d5a4f3b6-9219-4513-9fcf-25ae75cb6d7c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84538) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 19:06:20 devstack cinder-volume[84538]: INFO cinder.volume.manager [None req-f3c77f95-6b67-4078-93cc-4c8a276377dc tempest-VolumesSnapshotNegativeTestJSON-123355496 None] Created volume successfully. Apr 29 19:06:20 devstack sudo[92825]: pam_unix(sudo:session): session closed for user root Apr 29 19:06:20 devstack cinder-volume[84538]: DEBUG oslo_concurrency.processutils [None req-33770ef3-582b-4a7a-b6c6-2a49b6e665f9 tempest-VolumesGetTest-1123317664 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-ab721445-de20-4a57-9742-9f65ba62c259" returned: 0 in 0.678s {{(pid=84538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 19:06:20 devstack cinder-volume[84538]: DEBUG cinder.coordination [None req-33770ef3-582b-4a7a-b6c6-2a49b6e665f9 tempest-VolumesGetTest-1123317664 None] Lock "cinder-quobyte-ab721445-de20-4a57-9742-9f65ba62c259" released by "delete_volume" :: held 1.645s {{(pid=84538) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 19:06:20 devstack cinder-volume[84538]: DEBUG cinder.quota [None req-33770ef3-582b-4a7a-b6c6-2a49b6e665f9 tempest-VolumesGetTest-1123317664 None] Created reservations ['5b9424a4-b469-4a41-90d4-b5b4c814d202', '62b8fedd-484a-4057-b7ff-df97cc40e743', '47cf2f86-1725-453c-bacd-1f486e14a425', '5a005a56-7e85-4872-b418-9ef56de860c3'] {{(pid=84538) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 29 19:06:20 devstack cinder-volume[84538]: DEBUG oslo_concurrency.lockutils [None req-33770ef3-582b-4a7a-b6c6-2a49b6e665f9 tempest-VolumesGetTest-1123317664 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 19:06:20 devstack cinder-volume[84538]: DEBUG oslo_concurrency.lockutils [None req-33770ef3-582b-4a7a-b6c6-2a49b6e665f9 tempest-VolumesGetTest-1123317664 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 19:06:20 devstack cinder-volume[84538]: DEBUG cinder.volume.drivers.quobyte [None req-33770ef3-582b-4a7a-b6c6-2a49b6e665f9 tempest-VolumesGetTest-1123317664 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-34312b00-dd6d-45bb-af98-75855cea8e48': None} {{(pid=84538) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 19:06:20 devstack cinder-volume[84538]: DEBUG cinder.volume.drivers.quobyte [None req-33770ef3-582b-4a7a-b6c6-2a49b6e665f9 tempest-VolumesGetTest-1123317664 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-34312b00-dd6d-45bb-af98-75855cea8e48'] {{(pid=84538) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 19:06:20 devstack cinder-volume[84538]: DEBUG oslo_concurrency.lockutils [None req-33770ef3-582b-4a7a-b6c6-2a49b6e665f9 tempest-VolumesGetTest-1123317664 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=84538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 19:06:20 devstack cinder-volume[84538]: DEBUG oslo_concurrency.processutils [None req-33770ef3-582b-4a7a-b6c6-2a49b6e665f9 tempest-VolumesGetTest-1123317664 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d {{(pid=84538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 19:06:20 devstack sudo[92834]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d Apr 29 19:06:20 devstack sudo[92834]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 19:06:20 devstack cinder-volume[84538]: DEBUG oslo_concurrency.lockutils [None req-6fc21711-0fc5-4542-b9ce-7c6ac6bab6d5 tempest-VolumesSnapshotNegativeTestJSON-123355496 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=84538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 19:06:20 devstack cinder-volume[84538]: DEBUG oslo_concurrency.lockutils [None req-6fc21711-0fc5-4542-b9ce-7c6ac6bab6d5 tempest-VolumesSnapshotNegativeTestJSON-123355496 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=84538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 19:06:20 devstack cinder-volume[84538]: DEBUG cinder.volume.drivers.remotefs [None req-6fc21711-0fc5-4542-b9ce-7c6ac6bab6d5 tempest-VolumesSnapshotNegativeTestJSON-123355496 None] Creating offline snapshot 9101e9ad-d451-47ad-9a7e-80102f758527 of volume c5e98ef2-ed97-4db7-a222-4b73142f19d0 {{(pid=84538) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}} Apr 29 19:06:20 devstack cinder-volume[84538]: DEBUG oslo.privsep.daemon [-] privsep: reply[2b78db70-fd97-43b6-a82a-bea8b3c1fbf6]: (4, 'qcow2') {{(pid=85803) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 19:06:20 devstack cinder-volume[84538]: DEBUG oslo_concurrency.processutils [None req-6fc21711-0fc5-4542-b9ce-7c6ac6bab6d5 tempest-VolumesSnapshotNegativeTestJSON-123355496 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-c5e98ef2-ed97-4db7-a222-4b73142f19d0 {{(pid=84538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 19:06:20 devstack sudo[92837]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-c5e98ef2-ed97-4db7-a222-4b73142f19d0 Apr 29 19:06:20 devstack sudo[92837]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 19:06:20 devstack sudo[92831]: pam_unix(sudo:session): session closed for user root Apr 29 19:06:20 devstack cinder-volume[84538]: DEBUG oslo_concurrency.processutils [None req-39b65b20-beba-408a-992e-f8c75b8068c3 tempest-CreateVolumesFromSourceVolumeTest-1124812184 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-16c32655-8006-4faf-bd2a-33c9a749eb6b" returned: 0 in 0.662s {{(pid=84538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 19:06:20 devstack cinder-volume[84538]: DEBUG cinder.coordination [None req-39b65b20-beba-408a-992e-f8c75b8068c3 tempest-CreateVolumesFromSourceVolumeTest-1124812184 None] Lock "cinder-quobyte-16c32655-8006-4faf-bd2a-33c9a749eb6b" released by "delete_volume" :: held 1.516s {{(pid=84538) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 19:06:20 devstack cinder-volume[84538]: DEBUG cinder.quota [None req-39b65b20-beba-408a-992e-f8c75b8068c3 tempest-CreateVolumesFromSourceVolumeTest-1124812184 None] Created reservations ['388ba402-9b47-40b4-909c-a04d0e2ad3e9', 'fd0f3ce8-fd2f-4fdc-b660-72c07a692fe6', 'cc37bc34-c2c4-4a00-800f-12bf4c9defc0', 'aa695d44-270e-41a8-adab-edb5bb560c0f'] {{(pid=84538) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 29 19:06:20 devstack cinder-volume[84538]: DEBUG oslo_concurrency.lockutils [None req-39b65b20-beba-408a-992e-f8c75b8068c3 tempest-CreateVolumesFromSourceVolumeTest-1124812184 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 19:06:20 devstack cinder-volume[84538]: DEBUG oslo_concurrency.lockutils [None req-39b65b20-beba-408a-992e-f8c75b8068c3 tempest-CreateVolumesFromSourceVolumeTest-1124812184 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 19:06:20 devstack cinder-volume[84538]: DEBUG cinder.volume.drivers.quobyte [None req-39b65b20-beba-408a-992e-f8c75b8068c3 tempest-CreateVolumesFromSourceVolumeTest-1124812184 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-34312b00-dd6d-45bb-af98-75855cea8e48': None} {{(pid=84538) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 19:06:20 devstack cinder-volume[84538]: DEBUG cinder.volume.drivers.quobyte [None req-39b65b20-beba-408a-992e-f8c75b8068c3 tempest-CreateVolumesFromSourceVolumeTest-1124812184 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-34312b00-dd6d-45bb-af98-75855cea8e48'] {{(pid=84538) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 19:06:20 devstack cinder-volume[84538]: DEBUG oslo_concurrency.lockutils [None req-39b65b20-beba-408a-992e-f8c75b8068c3 tempest-CreateVolumesFromSourceVolumeTest-1124812184 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=84538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 19:06:20 devstack cinder-volume[84538]: DEBUG oslo_concurrency.processutils [None req-39b65b20-beba-408a-992e-f8c75b8068c3 tempest-CreateVolumesFromSourceVolumeTest-1124812184 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d {{(pid=84538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 19:06:20 devstack sudo[92839]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d Apr 29 19:06:20 devstack sudo[92839]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 19:06:21 devstack sudo[92834]: pam_unix(sudo:session): session closed for user root Apr 29 19:06:21 devstack cinder-volume[84538]: DEBUG oslo_concurrency.processutils [None req-33770ef3-582b-4a7a-b6c6-2a49b6e665f9 tempest-VolumesGetTest-1123317664 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d" returned: 0 in 0.702s {{(pid=84538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 19:06:21 devstack cinder-volume[84538]: DEBUG cinder.manager [None req-33770ef3-582b-4a7a-b6c6-2a49b6e665f9 tempest-VolumesGetTest-1123317664 None] Notifying Schedulers of capabilities ... {{(pid=84538) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 29 19:06:21 devstack cinder-volume[84538]: INFO cinder.volume.manager [None req-33770ef3-582b-4a7a-b6c6-2a49b6e665f9 tempest-VolumesGetTest-1123317664 None] Deleted volume successfully. Apr 29 19:06:21 devstack cinder-volume[84538]: DEBUG cinder.coordination [None req-33770ef3-582b-4a7a-b6c6-2a49b6e665f9 tempest-VolumesGetTest-1123317664 None] Lock "cinder-ab721445-de20-4a57-9742-9f65ba62c259-delete_volume" released by "delete_volume" :: held 2.669s {{(pid=84538) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 19:06:21 devstack cinder-volume[84538]: DEBUG cinder.coordination [None req-74d52169-42af-405f-8025-862be21f5e6e tempest-CreateVolumesFromSourceVolumeTest-1124812184 None] Acquiring lock "cinder-99bceec9-47e0-415c-9c51-fb7b781ae55a-delete_volume" by "delete_volume" {{(pid=84538) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 19:06:21 devstack cinder-volume[84538]: DEBUG cinder.volume.flows.manager.create_volume [None req-bcadf09b-d8c8-4d6e-a63f-e75f058ff42a tempest-VolumesGetTest-1123317664 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84538) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Apr 29 19:06:21 devstack cinder-volume[84538]: DEBUG cinder.volume.manager [None req-bcadf09b-d8c8-4d6e-a63f-e75f058ff42a tempest-VolumesGetTest-1123317664 None] Flow 'volume_create_manager' (80b5babc-2673-44f2-bb35-f6756b7df483) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84538) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 19:06:21 devstack cinder-volume[84538]: DEBUG cinder.volume.manager [None req-bcadf09b-d8c8-4d6e-a63f-e75f058ff42a tempest-VolumesGetTest-1123317664 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ac61715c-03f6-48b8-a99a-7538ad2f95e4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 19:06:21 devstack cinder-volume[84538]: DEBUG cinder.volume.manager [None req-bcadf09b-d8c8-4d6e-a63f-e75f058ff42a tempest-VolumesGetTest-1123317664 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ac61715c-03f6-48b8-a99a-7538ad2f95e4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-29T17:06:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-1828668817',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=45f08e10-8cbe-4648-93eb-f78f3719bce1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='62ab81799a05449b9f5b7eb23c6c9071',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T17:06:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T17:06:21Z,use_quota=True,user_id='2c9aaf152c0f49d3887038450048a477',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(62b05900-93e3-4190-a88f-1d87324303d1),volume_type_id=62b05900-93e3-4190-a88f-1d87324303d1)' {{(pid=84538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 19:06:21 devstack cinder-volume[84538]: DEBUG cinder.volume.manager [None req-bcadf09b-d8c8-4d6e-a63f-e75f058ff42a tempest-VolumesGetTest-1123317664 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (694e714a-03a6-42bd-9ad8-fadf910bf47b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 19:06:21 devstack cinder-volume[84538]: DEBUG cinder.volume.manager [None req-bcadf09b-d8c8-4d6e-a63f-e75f058ff42a tempest-VolumesGetTest-1123317664 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (694e714a-03a6-42bd-9ad8-fadf910bf47b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 19:06:21 devstack cinder-volume[84538]: DEBUG cinder.volume.manager [None req-bcadf09b-d8c8-4d6e-a63f-e75f058ff42a tempest-VolumesGetTest-1123317664 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e728aaf6-e62f-4e25-aa6b-5cadab6f55db) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 19:06:21 devstack cinder-volume[84538]: DEBUG cinder.volume.manager [None req-bcadf09b-d8c8-4d6e-a63f-e75f058ff42a tempest-VolumesGetTest-1123317664 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e728aaf6-e62f-4e25-aa6b-5cadab6f55db) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '45f08e10-8cbe-4648-93eb-f78f3719bce1', 'volume_name': 'volume-45f08e10-8cbe-4648-93eb-f78f3719bce1', 'volume_size': 1}' {{(pid=84538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 19:06:21 devstack cinder-volume[84538]: DEBUG cinder.volume.manager [None req-bcadf09b-d8c8-4d6e-a63f-e75f058ff42a tempest-VolumesGetTest-1123317664 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d06f5fea-945e-4ff3-85b5-d5bd34d48712) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 19:06:21 devstack cinder-volume[84538]: DEBUG cinder.volume.manager [None req-bcadf09b-d8c8-4d6e-a63f-e75f058ff42a tempest-VolumesGetTest-1123317664 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d06f5fea-945e-4ff3-85b5-d5bd34d48712) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 19:06:21 devstack cinder-volume[84538]: DEBUG cinder.volume.manager [None req-bcadf09b-d8c8-4d6e-a63f-e75f058ff42a tempest-VolumesGetTest-1123317664 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0b3f1438-490b-4a8a-ab39-adead3bbd315) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 19:06:21 devstack cinder-volume[84538]: INFO cinder.volume.flows.manager.create_volume [None req-bcadf09b-d8c8-4d6e-a63f-e75f058ff42a tempest-VolumesGetTest-1123317664 None] Volume 45f08e10-8cbe-4648-93eb-f78f3719bce1: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-45f08e10-8cbe-4648-93eb-f78f3719bce1', 'volume_size': 1} Apr 29 19:06:21 devstack cinder-volume[84538]: DEBUG oslo_concurrency.lockutils [None req-bcadf09b-d8c8-4d6e-a63f-e75f058ff42a tempest-VolumesGetTest-1123317664 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 19:06:21 devstack cinder-volume[84538]: DEBUG cinder.coordination [None req-74d52169-42af-405f-8025-862be21f5e6e tempest-CreateVolumesFromSourceVolumeTest-1124812184 None] Lock "cinder-99bceec9-47e0-415c-9c51-fb7b781ae55a-delete_volume" acquired by "delete_volume" :: waited 0.095s {{(pid=84538) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 19:06:21 devstack sudo[92837]: pam_unix(sudo:session): session closed for user root Apr 29 19:06:21 devstack cinder-volume[84538]: DEBUG oslo_concurrency.processutils [None req-6fc21711-0fc5-4542-b9ce-7c6ac6bab6d5 tempest-VolumesSnapshotNegativeTestJSON-123355496 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-c5e98ef2-ed97-4db7-a222-4b73142f19d0" returned: 0 in 0.963s {{(pid=84538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 19:06:21 devstack cinder-volume[84538]: DEBUG oslo_concurrency.processutils [None req-6fc21711-0fc5-4542-b9ce-7c6ac6bab6d5 tempest-VolumesSnapshotNegativeTestJSON-123355496 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-c5e98ef2-ed97-4db7-a222-4b73142f19d0,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-c5e98ef2-ed97-4db7-a222-4b73142f19d0.9101e9ad-d451-47ad-9a7e-80102f758527 2G {{(pid=84538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 19:06:21 devstack cinder-volume[84538]: DEBUG cinder.coordination [None req-74d52169-42af-405f-8025-862be21f5e6e tempest-CreateVolumesFromSourceVolumeTest-1124812184 None] Acquiring lock "cinder-quobyte-99bceec9-47e0-415c-9c51-fb7b781ae55a" by "delete_volume" {{(pid=84538) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 19:06:21 devstack sudo[92845]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-c5e98ef2-ed97-4db7-a222-4b73142f19d0,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-c5e98ef2-ed97-4db7-a222-4b73142f19d0.9101e9ad-d451-47ad-9a7e-80102f758527 2G Apr 29 19:06:21 devstack sudo[92845]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 19:06:21 devstack cinder-volume[84538]: DEBUG cinder.coordination [None req-74d52169-42af-405f-8025-862be21f5e6e tempest-CreateVolumesFromSourceVolumeTest-1124812184 None] Lock "cinder-quobyte-99bceec9-47e0-415c-9c51-fb7b781ae55a" acquired by "delete_volume" :: waited 0.018s {{(pid=84538) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 19:06:21 devstack cinder-volume[84538]: DEBUG oslo.privsep.daemon [-] privsep: reply[1896f342-6c12-4e96-94ef-a340db033382]: (4, 'qcow2') {{(pid=85803) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 19:06:21 devstack cinder-volume[84538]: DEBUG oslo_concurrency.processutils [None req-74d52169-42af-405f-8025-862be21f5e6e tempest-CreateVolumesFromSourceVolumeTest-1124812184 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-99bceec9-47e0-415c-9c51-fb7b781ae55a {{(pid=84538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 19:06:21 devstack sudo[92839]: pam_unix(sudo:session): session closed for user root Apr 29 19:06:21 devstack cinder-volume[84538]: DEBUG oslo_concurrency.processutils [None req-39b65b20-beba-408a-992e-f8c75b8068c3 tempest-CreateVolumesFromSourceVolumeTest-1124812184 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d" returned: 0 in 0.844s {{(pid=84538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 19:06:21 devstack cinder-volume[84538]: DEBUG cinder.manager [None req-39b65b20-beba-408a-992e-f8c75b8068c3 tempest-CreateVolumesFromSourceVolumeTest-1124812184 None] Notifying Schedulers of capabilities ... {{(pid=84538) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 29 19:06:21 devstack sudo[92848]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-99bceec9-47e0-415c-9c51-fb7b781ae55a Apr 29 19:06:21 devstack sudo[92848]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 19:06:21 devstack cinder-volume[84538]: INFO cinder.volume.manager [None req-39b65b20-beba-408a-992e-f8c75b8068c3 tempest-CreateVolumesFromSourceVolumeTest-1124812184 None] Deleted volume successfully. Apr 29 19:06:21 devstack cinder-volume[84538]: DEBUG cinder.coordination [None req-39b65b20-beba-408a-992e-f8c75b8068c3 tempest-CreateVolumesFromSourceVolumeTest-1124812184 None] Lock "cinder-16c32655-8006-4faf-bd2a-33c9a749eb6b-delete_volume" released by "delete_volume" :: held 2.652s {{(pid=84538) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 19:06:22 devstack sudo[92845]: pam_unix(sudo:session): session closed for user root Apr 29 19:06:22 devstack cinder-volume[84538]: DEBUG oslo_concurrency.processutils [None req-6fc21711-0fc5-4542-b9ce-7c6ac6bab6d5 tempest-VolumesSnapshotNegativeTestJSON-123355496 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-c5e98ef2-ed97-4db7-a222-4b73142f19d0,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-c5e98ef2-ed97-4db7-a222-4b73142f19d0.9101e9ad-d451-47ad-9a7e-80102f758527 2G" returned: 0 in 0.772s {{(pid=84538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 19:06:22 devstack cinder-volume[84538]: DEBUG oslo_concurrency.processutils [None req-6fc21711-0fc5-4542-b9ce-7c6ac6bab6d5 tempest-VolumesSnapshotNegativeTestJSON-123355496 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c5e98ef2-ed97-4db7-a222-4b73142f19d0 -F qcow2 /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-c5e98ef2-ed97-4db7-a222-4b73142f19d0.9101e9ad-d451-47ad-9a7e-80102f758527 {{(pid=84538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 19:06:22 devstack sudo[92848]: pam_unix(sudo:session): session closed for user root Apr 29 19:06:22 devstack cinder-volume[84538]: DEBUG oslo_concurrency.processutils [None req-74d52169-42af-405f-8025-862be21f5e6e tempest-CreateVolumesFromSourceVolumeTest-1124812184 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-99bceec9-47e0-415c-9c51-fb7b781ae55a" returned: 0 in 0.730s {{(pid=84538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 19:06:22 devstack cinder-volume[84538]: DEBUG oslo_concurrency.processutils [None req-74d52169-42af-405f-8025-862be21f5e6e tempest-CreateVolumesFromSourceVolumeTest-1124812184 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-99bceec9-47e0-415c-9c51-fb7b781ae55a {{(pid=84538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 19:06:22 devstack sudo[92856]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c5e98ef2-ed97-4db7-a222-4b73142f19d0 -F qcow2 /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-c5e98ef2-ed97-4db7-a222-4b73142f19d0.9101e9ad-d451-47ad-9a7e-80102f758527 Apr 29 19:06:22 devstack sudo[92856]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 19:06:22 devstack sudo[92858]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-99bceec9-47e0-415c-9c51-fb7b781ae55a Apr 29 19:06:22 devstack sudo[92858]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 19:06:22 devstack sudo[92858]: pam_unix(sudo:session): session closed for user root Apr 29 19:06:22 devstack cinder-volume[84538]: DEBUG oslo_concurrency.processutils [None req-74d52169-42af-405f-8025-862be21f5e6e tempest-CreateVolumesFromSourceVolumeTest-1124812184 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-99bceec9-47e0-415c-9c51-fb7b781ae55a" returned: 0 in 0.619s {{(pid=84538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 19:06:22 devstack sudo[92856]: pam_unix(sudo:session): session closed for user root Apr 29 19:06:22 devstack cinder-volume[84538]: DEBUG oslo_concurrency.processutils [None req-6fc21711-0fc5-4542-b9ce-7c6ac6bab6d5 tempest-VolumesSnapshotNegativeTestJSON-123355496 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c5e98ef2-ed97-4db7-a222-4b73142f19d0 -F qcow2 /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-c5e98ef2-ed97-4db7-a222-4b73142f19d0.9101e9ad-d451-47ad-9a7e-80102f758527" returned: 0 in 0.659s {{(pid=84538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 19:06:22 devstack cinder-volume[84538]: WARNING cinder.volume.drivers.remotefs [None req-6fc21711-0fc5-4542-b9ce-7c6ac6bab6d5 tempest-VolumesSnapshotNegativeTestJSON-123355496 None] /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-c5e98ef2-ed97-4db7-a222-4b73142f19d0.9101e9ad-d451-47ad-9a7e-80102f758527 is being set with open permissions: ugo+rw Apr 29 19:06:22 devstack cinder-volume[84538]: DEBUG oslo_concurrency.processutils [None req-6fc21711-0fc5-4542-b9ce-7c6ac6bab6d5 tempest-VolumesSnapshotNegativeTestJSON-123355496 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-c5e98ef2-ed97-4db7-a222-4b73142f19d0.9101e9ad-d451-47ad-9a7e-80102f758527 {{(pid=84538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 19:06:22 devstack cinder-volume[84538]: DEBUG cinder.coordination [None req-74d52169-42af-405f-8025-862be21f5e6e tempest-CreateVolumesFromSourceVolumeTest-1124812184 None] Lock "cinder-quobyte-99bceec9-47e0-415c-9c51-fb7b781ae55a" released by "delete_volume" :: held 1.413s {{(pid=84538) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 19:06:23 devstack sudo[92864]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-c5e98ef2-ed97-4db7-a222-4b73142f19d0.9101e9ad-d451-47ad-9a7e-80102f758527 Apr 29 19:06:23 devstack sudo[92864]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 19:06:23 devstack cinder-volume[84538]: DEBUG cinder.quota [None req-74d52169-42af-405f-8025-862be21f5e6e tempest-CreateVolumesFromSourceVolumeTest-1124812184 None] Created reservations ['2edf7cb5-396c-40aa-8eee-18ba36da23cd', 'a3b705ab-a06b-4142-8552-c5f0a4e52093', '3492741d-c355-44db-9a43-699b8347b30b', 'ce8f0c74-f664-4ae7-906b-9161a14545ca'] {{(pid=84538) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 29 19:06:23 devstack cinder-volume[84538]: DEBUG oslo_concurrency.lockutils [None req-74d52169-42af-405f-8025-862be21f5e6e tempest-CreateVolumesFromSourceVolumeTest-1124812184 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 19:06:23 devstack cinder-volume[84538]: DEBUG oslo_concurrency.lockutils [None req-74d52169-42af-405f-8025-862be21f5e6e tempest-CreateVolumesFromSourceVolumeTest-1124812184 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 19:06:23 devstack cinder-volume[84538]: DEBUG cinder.volume.drivers.quobyte [None req-74d52169-42af-405f-8025-862be21f5e6e tempest-CreateVolumesFromSourceVolumeTest-1124812184 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-34312b00-dd6d-45bb-af98-75855cea8e48': None} {{(pid=84538) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 19:06:23 devstack cinder-volume[84538]: DEBUG cinder.volume.drivers.quobyte [None req-74d52169-42af-405f-8025-862be21f5e6e tempest-CreateVolumesFromSourceVolumeTest-1124812184 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-34312b00-dd6d-45bb-af98-75855cea8e48'] {{(pid=84538) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 19:06:23 devstack cinder-volume[84538]: DEBUG oslo_concurrency.lockutils [None req-74d52169-42af-405f-8025-862be21f5e6e tempest-CreateVolumesFromSourceVolumeTest-1124812184 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=84538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 19:06:23 devstack cinder-volume[84538]: DEBUG oslo_concurrency.processutils [None req-74d52169-42af-405f-8025-862be21f5e6e tempest-CreateVolumesFromSourceVolumeTest-1124812184 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d {{(pid=84538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 19:06:23 devstack sudo[92866]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d Apr 29 19:06:23 devstack sudo[92866]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 19:06:23 devstack sudo[92864]: pam_unix(sudo:session): session closed for user root Apr 29 19:06:23 devstack cinder-volume[84538]: DEBUG oslo_concurrency.processutils [None req-6fc21711-0fc5-4542-b9ce-7c6ac6bab6d5 tempest-VolumesSnapshotNegativeTestJSON-123355496 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-c5e98ef2-ed97-4db7-a222-4b73142f19d0.9101e9ad-d451-47ad-9a7e-80102f758527" returned: 0 in 0.630s {{(pid=84538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 19:06:23 devstack cinder-volume[84538]: DEBUG oslo_concurrency.processutils [None req-6fc21711-0fc5-4542-b9ce-7c6ac6bab6d5 tempest-VolumesSnapshotNegativeTestJSON-123355496 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-c5e98ef2-ed97-4db7-a222-4b73142f19d0.info {{(pid=84538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 19:06:23 devstack sudo[92870]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-c5e98ef2-ed97-4db7-a222-4b73142f19d0.info Apr 29 19:06:23 devstack sudo[92870]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 19:06:23 devstack sudo[92866]: pam_unix(sudo:session): session closed for user root Apr 29 19:06:23 devstack cinder-volume[84538]: DEBUG oslo_concurrency.processutils [None req-74d52169-42af-405f-8025-862be21f5e6e tempest-CreateVolumesFromSourceVolumeTest-1124812184 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d" returned: 0 in 0.612s {{(pid=84538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 19:06:23 devstack cinder-volume[84538]: DEBUG cinder.manager [None req-74d52169-42af-405f-8025-862be21f5e6e tempest-CreateVolumesFromSourceVolumeTest-1124812184 None] Notifying Schedulers of capabilities ... {{(pid=84538) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 29 19:06:23 devstack cinder-volume[84538]: INFO cinder.volume.manager [None req-74d52169-42af-405f-8025-862be21f5e6e tempest-CreateVolumesFromSourceVolumeTest-1124812184 None] Deleted volume successfully. Apr 29 19:06:23 devstack cinder-volume[84538]: DEBUG cinder.coordination [None req-74d52169-42af-405f-8025-862be21f5e6e tempest-CreateVolumesFromSourceVolumeTest-1124812184 None] Lock "cinder-99bceec9-47e0-415c-9c51-fb7b781ae55a-delete_volume" released by "delete_volume" :: held 2.258s {{(pid=84538) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 19:06:24 devstack sudo[92870]: pam_unix(sudo:session): session closed for user root Apr 29 19:06:24 devstack cinder-volume[84538]: DEBUG oslo_concurrency.processutils [None req-6fc21711-0fc5-4542-b9ce-7c6ac6bab6d5 tempest-VolumesSnapshotNegativeTestJSON-123355496 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-c5e98ef2-ed97-4db7-a222-4b73142f19d0.info" returned: 0 in 0.620s {{(pid=84538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 19:06:24 devstack cinder-volume[84538]: WARNING cinder.volume.drivers.remotefs [None req-6fc21711-0fc5-4542-b9ce-7c6ac6bab6d5 tempest-VolumesSnapshotNegativeTestJSON-123355496 None] /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-c5e98ef2-ed97-4db7-a222-4b73142f19d0.info is being set with open permissions: ugo+rw Apr 29 19:06:24 devstack cinder-volume[84538]: DEBUG oslo_concurrency.processutils [None req-6fc21711-0fc5-4542-b9ce-7c6ac6bab6d5 tempest-VolumesSnapshotNegativeTestJSON-123355496 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-c5e98ef2-ed97-4db7-a222-4b73142f19d0.info {{(pid=84538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 19:06:24 devstack sudo[92873]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-c5e98ef2-ed97-4db7-a222-4b73142f19d0.info Apr 29 19:06:24 devstack sudo[92873]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 19:06:24 devstack sudo[92873]: pam_unix(sudo:session): session closed for user root Apr 29 19:06:24 devstack cinder-volume[84538]: DEBUG oslo_concurrency.processutils [None req-6fc21711-0fc5-4542-b9ce-7c6ac6bab6d5 tempest-VolumesSnapshotNegativeTestJSON-123355496 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-c5e98ef2-ed97-4db7-a222-4b73142f19d0.info" returned: 0 in 0.638s {{(pid=84538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 19:06:24 devstack cinder-volume[84538]: DEBUG oslo_concurrency.lockutils [None req-6fc21711-0fc5-4542-b9ce-7c6ac6bab6d5 tempest-VolumesSnapshotNegativeTestJSON-123355496 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.390s {{(pid=84538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 19:06:24 devstack cinder-volume[84538]: DEBUG oslo_concurrency.lockutils [None req-bcadf09b-d8c8-4d6e-a63f-e75f058ff42a tempest-VolumesGetTest-1123317664 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.433s {{(pid=84538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 19:06:24 devstack cinder-volume[84538]: DEBUG cinder.volume.drivers.quobyte [None req-bcadf09b-d8c8-4d6e-a63f-e75f058ff42a tempest-VolumesGetTest-1123317664 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-29T17:06:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-1828668817',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=45f08e10-8cbe-4648-93eb-f78f3719bce1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='62ab81799a05449b9f5b7eb23c6c9071',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T17:06:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T17:06:21Z,use_quota=True,user_id='2c9aaf152c0f49d3887038450048a477',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(62b05900-93e3-4190-a88f-1d87324303d1),volume_type_id=62b05900-93e3-4190-a88f-1d87324303d1)}" {{(pid=84538) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 29 19:06:24 devstack cinder-volume[84538]: DEBUG cinder.volume.drivers.remotefs [None req-bcadf09b-d8c8-4d6e-a63f-e75f058ff42a tempest-VolumesGetTest-1123317664 None] Creating volume 45f08e10-8cbe-4648-93eb-f78f3719bce1 {{(pid=84538) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 29 19:06:24 devstack cinder-volume[84538]: DEBUG oslo_concurrency.lockutils [None req-bcadf09b-d8c8-4d6e-a63f-e75f058ff42a tempest-VolumesGetTest-1123317664 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 19:06:24 devstack cinder-volume[84538]: DEBUG oslo_concurrency.lockutils [None req-bcadf09b-d8c8-4d6e-a63f-e75f058ff42a tempest-VolumesGetTest-1123317664 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 19:06:24 devstack cinder-volume[84538]: DEBUG cinder.volume.drivers.quobyte [None req-bcadf09b-d8c8-4d6e-a63f-e75f058ff42a tempest-VolumesGetTest-1123317664 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-34312b00-dd6d-45bb-af98-75855cea8e48': None} {{(pid=84538) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 19:06:24 devstack cinder-volume[84538]: DEBUG cinder.volume.drivers.quobyte [None req-bcadf09b-d8c8-4d6e-a63f-e75f058ff42a tempest-VolumesGetTest-1123317664 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-34312b00-dd6d-45bb-af98-75855cea8e48'] {{(pid=84538) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 19:06:24 devstack cinder-volume[84538]: DEBUG oslo_concurrency.lockutils [None req-bcadf09b-d8c8-4d6e-a63f-e75f058ff42a tempest-VolumesGetTest-1123317664 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=84538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 19:06:24 devstack cinder-volume[84538]: DEBUG cinder.volume.drivers.quobyte [None req-bcadf09b-d8c8-4d6e-a63f-e75f058ff42a tempest-VolumesGetTest-1123317664 None] Selected osci02.corp.quobyte.com/cinder-vol-34312b00-dd6d-45bb-af98-75855cea8e48 as target Quobyte volume. {{(pid=84538) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 29 19:06:24 devstack cinder-volume[84538]: INFO cinder.volume.drivers.remotefs [None req-bcadf09b-d8c8-4d6e-a63f-e75f058ff42a tempest-VolumesGetTest-1123317664 None] casted to osci02.corp.quobyte.com/cinder-vol-34312b00-dd6d-45bb-af98-75855cea8e48 Apr 29 19:06:24 devstack cinder-volume[84538]: DEBUG oslo_concurrency.processutils [None req-bcadf09b-d8c8-4d6e-a63f-e75f058ff42a tempest-VolumesGetTest-1123317664 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-45f08e10-8cbe-4648-93eb-f78f3719bce1 1073741824 {{(pid=84538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 19:06:24 devstack sudo[92877]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-45f08e10-8cbe-4648-93eb-f78f3719bce1 1073741824 Apr 29 19:06:24 devstack sudo[92877]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 19:06:25 devstack cinder-volume[84538]: INFO cinder.volume.manager [None req-6fc21711-0fc5-4542-b9ce-7c6ac6bab6d5 tempest-VolumesSnapshotNegativeTestJSON-123355496 None] Create snapshot completed successfully Apr 29 19:06:25 devstack cinder-volume[84538]: DEBUG oslo_service.periodic_task [None req-a93183a6-1080-461c-84de-2fcb210d4f60 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=84538) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}} Apr 29 19:06:25 devstack cinder-volume[84538]: DEBUG oslo_concurrency.lockutils [None req-a93183a6-1080-461c-84de-2fcb210d4f60 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 19:06:25 devstack cinder-volume[84538]: DEBUG oslo_concurrency.lockutils [None req-a93183a6-1080-461c-84de-2fcb210d4f60 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 19:06:25 devstack cinder-volume[84538]: DEBUG cinder.volume.drivers.quobyte [None req-a93183a6-1080-461c-84de-2fcb210d4f60 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-34312b00-dd6d-45bb-af98-75855cea8e48': None} {{(pid=84538) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 19:06:25 devstack cinder-volume[84538]: DEBUG cinder.volume.drivers.quobyte [None req-a93183a6-1080-461c-84de-2fcb210d4f60 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-34312b00-dd6d-45bb-af98-75855cea8e48'] {{(pid=84538) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 19:06:25 devstack cinder-volume[84538]: DEBUG oslo_concurrency.lockutils [None req-a93183a6-1080-461c-84de-2fcb210d4f60 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=84538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 19:06:25 devstack cinder-volume[84538]: DEBUG oslo_concurrency.processutils [None req-a93183a6-1080-461c-84de-2fcb210d4f60 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d {{(pid=84538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 19:06:25 devstack sudo[92879]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d Apr 29 19:06:25 devstack sudo[92879]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 19:06:25 devstack sudo[92879]: pam_unix(sudo:session): session closed for user root Apr 29 19:06:25 devstack cinder-volume[84538]: DEBUG oslo_concurrency.processutils [None req-a93183a6-1080-461c-84de-2fcb210d4f60 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d" returned: 0 in 0.612s {{(pid=84538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 19:06:25 devstack cinder-volume[84538]: DEBUG cinder.manager [None req-a93183a6-1080-461c-84de-2fcb210d4f60 None None] Notifying Schedulers of capabilities ... {{(pid=84538) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 29 19:06:25 devstack sudo[92877]: pam_unix(sudo:session): session closed for user root Apr 29 19:06:25 devstack cinder-volume[84538]: DEBUG oslo_concurrency.processutils [None req-bcadf09b-d8c8-4d6e-a63f-e75f058ff42a tempest-VolumesGetTest-1123317664 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-45f08e10-8cbe-4648-93eb-f78f3719bce1 1073741824" returned: 0 in 0.827s {{(pid=84538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 19:06:25 devstack cinder-volume[84538]: DEBUG oslo_concurrency.processutils [None req-bcadf09b-d8c8-4d6e-a63f-e75f058ff42a tempest-VolumesGetTest-1123317664 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-45f08e10-8cbe-4648-93eb-f78f3719bce1 {{(pid=84538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 19:06:25 devstack cinder-volume[84538]: DEBUG cinder.coordination [None req-df799d48-e9a2-4799-82ca-7d6b2e0e3e34 tempest-VolumesSnapshotNegativeTestJSON-123355496 None] Acquiring lock "cinder-9101e9ad-d451-47ad-9a7e-80102f758527-delete_snapshot" by "delete_snapshot" {{(pid=84538) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 19:06:25 devstack sudo[92885]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-45f08e10-8cbe-4648-93eb-f78f3719bce1 Apr 29 19:06:25 devstack sudo[92885]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 19:06:25 devstack cinder-volume[84538]: DEBUG cinder.coordination [None req-df799d48-e9a2-4799-82ca-7d6b2e0e3e34 tempest-VolumesSnapshotNegativeTestJSON-123355496 None] Lock "cinder-9101e9ad-d451-47ad-9a7e-80102f758527-delete_snapshot" acquired by "delete_snapshot" :: waited 0.023s {{(pid=84538) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 19:06:25 devstack cinder-volume[84538]: DEBUG cinder.coordination [None req-df799d48-e9a2-4799-82ca-7d6b2e0e3e34 tempest-VolumesSnapshotNegativeTestJSON-123355496 None] Acquiring lock "cinder-quobyte-c5e98ef2-ed97-4db7-a222-4b73142f19d0" by "delete_snapshot" {{(pid=84538) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 19:06:25 devstack cinder-volume[84538]: DEBUG cinder.coordination [None req-df799d48-e9a2-4799-82ca-7d6b2e0e3e34 tempest-VolumesSnapshotNegativeTestJSON-123355496 None] Lock "cinder-quobyte-c5e98ef2-ed97-4db7-a222-4b73142f19d0" acquired by "delete_snapshot" :: waited 0.024s {{(pid=84538) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 19:06:25 devstack cinder-volume[84538]: DEBUG cinder.coordination [None req-df799d48-e9a2-4799-82ca-7d6b2e0e3e34 tempest-VolumesSnapshotNegativeTestJSON-123355496 None] Acquiring lock "cinder-quobyte-9101e9ad-d451-47ad-9a7e-80102f758527" by "_delete_snapshot" {{(pid=84538) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 19:06:25 devstack cinder-volume[84538]: DEBUG cinder.coordination [None req-df799d48-e9a2-4799-82ca-7d6b2e0e3e34 tempest-VolumesSnapshotNegativeTestJSON-123355496 None] Lock "cinder-quobyte-9101e9ad-d451-47ad-9a7e-80102f758527" acquired by "_delete_snapshot" :: waited 0.014s {{(pid=84538) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 19:06:25 devstack cinder-volume[84538]: DEBUG cinder.volume.drivers.remotefs [None req-df799d48-e9a2-4799-82ca-7d6b2e0e3e34 tempest-VolumesSnapshotNegativeTestJSON-123355496 None] Deleting offline snapshot 9101e9ad-d451-47ad-9a7e-80102f758527 of volume c5e98ef2-ed97-4db7-a222-4b73142f19d0 {{(pid=84538) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 29 19:06:25 devstack cinder-volume[84538]: DEBUG cinder.volume.drivers.remotefs [None req-df799d48-e9a2-4799-82ca-7d6b2e0e3e34 tempest-VolumesSnapshotNegativeTestJSON-123355496 None] snapshot_file for this snap is: volume-c5e98ef2-ed97-4db7-a222-4b73142f19d0.9101e9ad-d451-47ad-9a7e-80102f758527 {{(pid=84538) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 29 19:06:25 devstack cinder-volume[84538]: DEBUG oslo.privsep.daemon [-] privsep: reply[4cfc6fbf-8c28-4e7f-ab6b-2d261abffe5b]: (4, 'qcow2') {{(pid=85803) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 19:06:25 devstack cinder-volume[84538]: DEBUG oslo_concurrency.processutils [None req-df799d48-e9a2-4799-82ca-7d6b2e0e3e34 tempest-VolumesSnapshotNegativeTestJSON-123355496 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-c5e98ef2-ed97-4db7-a222-4b73142f19d0.9101e9ad-d451-47ad-9a7e-80102f758527 {{(pid=84538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 19:06:26 devstack sudo[92887]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-c5e98ef2-ed97-4db7-a222-4b73142f19d0.9101e9ad-d451-47ad-9a7e-80102f758527 Apr 29 19:06:26 devstack sudo[92887]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 19:06:26 devstack sudo[92885]: pam_unix(sudo:session): session closed for user root Apr 29 19:06:26 devstack cinder-volume[84538]: DEBUG oslo_concurrency.processutils [None req-bcadf09b-d8c8-4d6e-a63f-e75f058ff42a tempest-VolumesGetTest-1123317664 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-45f08e10-8cbe-4648-93eb-f78f3719bce1" returned: 0 in 0.631s {{(pid=84538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 19:06:26 devstack cinder-volume[84538]: DEBUG cinder.volume.drivers.quobyte [None req-bcadf09b-d8c8-4d6e-a63f-e75f058ff42a tempest-VolumesGetTest-1123317664 None] <== create_volume: return (1501ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-34312b00-dd6d-45bb-af98-75855cea8e48'} {{(pid=84538) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 29 19:06:26 devstack cinder-volume[84538]: DEBUG oslo_concurrency.lockutils [None req-bcadf09b-d8c8-4d6e-a63f-e75f058ff42a tempest-VolumesGetTest-1123317664 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.505s {{(pid=84538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 19:06:26 devstack cinder-volume[84538]: DEBUG cinder.volume.manager [None req-bcadf09b-d8c8-4d6e-a63f-e75f058ff42a tempest-VolumesGetTest-1123317664 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0b3f1438-490b-4a8a-ab39-adead3bbd315) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-45f08e10-8cbe-4648-93eb-f78f3719bce1', 'volume_size': 1}' {{(pid=84538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 19:06:26 devstack cinder-volume[84538]: DEBUG cinder.volume.manager [None req-bcadf09b-d8c8-4d6e-a63f-e75f058ff42a tempest-VolumesGetTest-1123317664 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f1fd74c0-586a-4242-929c-e93cddc2c335) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 19:06:26 devstack cinder-volume[84538]: INFO cinder.volume.flows.manager.create_volume [None req-bcadf09b-d8c8-4d6e-a63f-e75f058ff42a tempest-VolumesGetTest-1123317664 None] Volume volume-45f08e10-8cbe-4648-93eb-f78f3719bce1 (45f08e10-8cbe-4648-93eb-f78f3719bce1): created successfully Apr 29 19:06:26 devstack cinder-volume[84538]: DEBUG cinder.volume.manager [None req-bcadf09b-d8c8-4d6e-a63f-e75f058ff42a tempest-VolumesGetTest-1123317664 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f1fd74c0-586a-4242-929c-e93cddc2c335) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 19:06:26 devstack cinder-volume[84538]: DEBUG cinder.volume.manager [None req-bcadf09b-d8c8-4d6e-a63f-e75f058ff42a tempest-VolumesGetTest-1123317664 None] Flow 'volume_create_manager' (80b5babc-2673-44f2-bb35-f6756b7df483) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84538) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 19:06:26 devstack cinder-volume[84538]: INFO cinder.volume.manager [None req-bcadf09b-d8c8-4d6e-a63f-e75f058ff42a tempest-VolumesGetTest-1123317664 None] Created volume successfully. Apr 29 19:06:26 devstack sudo[92887]: pam_unix(sudo:session): session closed for user root Apr 29 19:06:26 devstack cinder-volume[84538]: DEBUG oslo_concurrency.processutils [None req-df799d48-e9a2-4799-82ca-7d6b2e0e3e34 tempest-VolumesSnapshotNegativeTestJSON-123355496 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-c5e98ef2-ed97-4db7-a222-4b73142f19d0.9101e9ad-d451-47ad-9a7e-80102f758527" returned: 0 in 0.752s {{(pid=84538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 19:06:26 devstack cinder-volume[84538]: DEBUG cinder.volume.drivers.remotefs [None req-df799d48-e9a2-4799-82ca-7d6b2e0e3e34 tempest-VolumesSnapshotNegativeTestJSON-123355496 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-c5e98ef2-ed97-4db7-a222-4b73142f19d0(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=84538) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 29 19:06:26 devstack cinder-volume[84538]: DEBUG oslo.privsep.daemon [-] privsep: reply[6afa8e6b-126a-48f6-b6a1-4442d92bac65]: (4, 'qcow2') {{(pid=85803) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 19:06:26 devstack cinder-volume[84538]: DEBUG oslo_concurrency.processutils [None req-df799d48-e9a2-4799-82ca-7d6b2e0e3e34 tempest-VolumesSnapshotNegativeTestJSON-123355496 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-c5e98ef2-ed97-4db7-a222-4b73142f19d0 {{(pid=84538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 19:06:26 devstack sudo[92893]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-c5e98ef2-ed97-4db7-a222-4b73142f19d0 Apr 29 19:06:26 devstack sudo[92893]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 19:06:27 devstack cinder-volume[84538]: DEBUG cinder.volume.flows.manager.create_volume [None req-92361894-7b61-4228-ab3b-2851f4f16a9e tempest-VolumesGetTest-1123317664 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84538) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Apr 29 19:06:27 devstack cinder-volume[84538]: DEBUG cinder.volume.manager [None req-92361894-7b61-4228-ab3b-2851f4f16a9e tempest-VolumesGetTest-1123317664 None] Flow 'volume_create_manager' (16634965-6b6e-4155-b10e-d51c1465bd5d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84538) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 19:06:27 devstack cinder-volume[84538]: DEBUG cinder.volume.manager [None req-92361894-7b61-4228-ab3b-2851f4f16a9e tempest-VolumesGetTest-1123317664 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8e35fb93-0892-4c97-a6b5-fe566e0f8b8a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 19:06:27 devstack cinder-volume[84538]: DEBUG cinder.volume.manager [None req-92361894-7b61-4228-ab3b-2851f4f16a9e tempest-VolumesGetTest-1123317664 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8e35fb93-0892-4c97-a6b5-fe566e0f8b8a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-29T17:06:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-508264574',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f68dd373-afd4-4845-bef1-aaafa452f2d0,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='62ab81799a05449b9f5b7eb23c6c9071',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T17:06:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=45f08e10-8cbe-4648-93eb-f78f3719bce1,status='creating',terminated_at=None,updated_at=2026-04-29T17:06:27Z,use_quota=True,user_id='2c9aaf152c0f49d3887038450048a477',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(62b05900-93e3-4190-a88f-1d87324303d1),volume_type_id=62b05900-93e3-4190-a88f-1d87324303d1)' {{(pid=84538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 19:06:27 devstack cinder-volume[84538]: DEBUG cinder.volume.manager [None req-92361894-7b61-4228-ab3b-2851f4f16a9e tempest-VolumesGetTest-1123317664 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1aff6c51-9e85-48e7-9058-0a9c1612c83a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 19:06:27 devstack cinder-volume[84538]: DEBUG cinder.volume.manager [None req-92361894-7b61-4228-ab3b-2851f4f16a9e tempest-VolumesGetTest-1123317664 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1aff6c51-9e85-48e7-9058-0a9c1612c83a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 19:06:27 devstack cinder-volume[84538]: DEBUG cinder.volume.manager [None req-92361894-7b61-4228-ab3b-2851f4f16a9e tempest-VolumesGetTest-1123317664 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (32cb29aa-c8dd-4a81-8613-aa577a99726c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 19:06:27 devstack cinder-volume[84538]: DEBUG cinder.volume.manager [None req-92361894-7b61-4228-ab3b-2851f4f16a9e tempest-VolumesGetTest-1123317664 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (32cb29aa-c8dd-4a81-8613-aa577a99726c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'source_vol', 'volume_id': 'f68dd373-afd4-4845-bef1-aaafa452f2d0', 'volume_name': 'volume-f68dd373-afd4-4845-bef1-aaafa452f2d0', 'volume_size': 1, 'source_volid': '45f08e10-8cbe-4648-93eb-f78f3719bce1', 'source_volstatus': 'available'}' {{(pid=84538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 19:06:27 devstack cinder-volume[84538]: DEBUG cinder.volume.manager [None req-92361894-7b61-4228-ab3b-2851f4f16a9e tempest-VolumesGetTest-1123317664 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (be14612f-72d4-4396-8d97-17ff8449c1c3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 19:06:27 devstack cinder-volume[84538]: DEBUG cinder.volume.manager [None req-92361894-7b61-4228-ab3b-2851f4f16a9e tempest-VolumesGetTest-1123317664 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (be14612f-72d4-4396-8d97-17ff8449c1c3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 19:06:27 devstack cinder-volume[84538]: DEBUG cinder.volume.manager [None req-92361894-7b61-4228-ab3b-2851f4f16a9e tempest-VolumesGetTest-1123317664 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a901aa47-140c-44c5-82a8-b1ef781fdede) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 19:06:27 devstack cinder-volume[84538]: INFO cinder.volume.flows.manager.create_volume [None req-92361894-7b61-4228-ab3b-2851f4f16a9e tempest-VolumesGetTest-1123317664 None] Volume f68dd373-afd4-4845-bef1-aaafa452f2d0: being created as source_vol with specification: {'status': 'creating', 'volume_name': 'volume-f68dd373-afd4-4845-bef1-aaafa452f2d0', 'volume_size': 1, 'source_volid': '45f08e10-8cbe-4648-93eb-f78f3719bce1', 'source_volstatus': 'available'} Apr 29 19:06:27 devstack cinder-volume[84538]: DEBUG oslo_concurrency.lockutils [None req-92361894-7b61-4228-ab3b-2851f4f16a9e tempest-VolumesGetTest-1123317664 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" {{(pid=84538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 19:06:27 devstack cinder-volume[84538]: DEBUG oslo_concurrency.lockutils [None req-92361894-7b61-4228-ab3b-2851f4f16a9e tempest-VolumesGetTest-1123317664 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: waited 0.001s {{(pid=84538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 19:06:27 devstack cinder-volume[84538]: INFO cinder.volume.drivers.remotefs [None req-92361894-7b61-4228-ab3b-2851f4f16a9e tempest-VolumesGetTest-1123317664 None] Cloning volume 45f08e10-8cbe-4648-93eb-f78f3719bce1 to volume f68dd373-afd4-4845-bef1-aaafa452f2d0 Apr 29 19:06:27 devstack cinder-volume[84538]: DEBUG cinder.volume.drivers.remotefs [None req-92361894-7b61-4228-ab3b-2851f4f16a9e tempest-VolumesGetTest-1123317664 None] Creating offline snapshot 42da5593-3557-4d1c-99d7-83b0697e84b0 of volume 45f08e10-8cbe-4648-93eb-f78f3719bce1 {{(pid=84538) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}} Apr 29 19:06:27 devstack cinder-volume[84538]: DEBUG oslo.privsep.daemon [-] privsep: reply[b81daf37-8643-45ce-8726-f40de3a6a5a6]: (4, 'qcow2') {{(pid=85803) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 19:06:27 devstack cinder-volume[84538]: DEBUG oslo_concurrency.processutils [None req-92361894-7b61-4228-ab3b-2851f4f16a9e tempest-VolumesGetTest-1123317664 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-45f08e10-8cbe-4648-93eb-f78f3719bce1 {{(pid=84538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 19:06:27 devstack sudo[92897]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-45f08e10-8cbe-4648-93eb-f78f3719bce1 Apr 29 19:06:27 devstack sudo[92897]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 19:06:27 devstack sudo[92893]: pam_unix(sudo:session): session closed for user root Apr 29 19:06:27 devstack cinder-volume[84538]: DEBUG oslo_concurrency.processutils [None req-df799d48-e9a2-4799-82ca-7d6b2e0e3e34 tempest-VolumesSnapshotNegativeTestJSON-123355496 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-c5e98ef2-ed97-4db7-a222-4b73142f19d0" returned: 0 in 0.767s {{(pid=84538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 19:06:27 devstack cinder-volume[84538]: DEBUG oslo_concurrency.processutils [None req-df799d48-e9a2-4799-82ca-7d6b2e0e3e34 tempest-VolumesSnapshotNegativeTestJSON-123355496 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-c5e98ef2-ed97-4db7-a222-4b73142f19d0.9101e9ad-d451-47ad-9a7e-80102f758527 {{(pid=84538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 19:06:27 devstack sudo[92900]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-c5e98ef2-ed97-4db7-a222-4b73142f19d0.9101e9ad-d451-47ad-9a7e-80102f758527 Apr 29 19:06:27 devstack sudo[92900]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 19:06:28 devstack sudo[92897]: pam_unix(sudo:session): session closed for user root Apr 29 19:06:28 devstack cinder-volume[84538]: DEBUG oslo_concurrency.processutils [None req-92361894-7b61-4228-ab3b-2851f4f16a9e tempest-VolumesGetTest-1123317664 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-45f08e10-8cbe-4648-93eb-f78f3719bce1" returned: 0 in 0.731s {{(pid=84538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 19:06:28 devstack cinder-volume[84538]: DEBUG oslo_concurrency.processutils [None req-92361894-7b61-4228-ab3b-2851f4f16a9e tempest-VolumesGetTest-1123317664 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-45f08e10-8cbe-4648-93eb-f78f3719bce1,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-45f08e10-8cbe-4648-93eb-f78f3719bce1.42da5593-3557-4d1c-99d7-83b0697e84b0 1G {{(pid=84538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 19:06:28 devstack sudo[92908]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-45f08e10-8cbe-4648-93eb-f78f3719bce1,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-45f08e10-8cbe-4648-93eb-f78f3719bce1.42da5593-3557-4d1c-99d7-83b0697e84b0 1G Apr 29 19:06:28 devstack sudo[92908]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 19:06:28 devstack sudo[92900]: pam_unix(sudo:session): session closed for user root Apr 29 19:06:28 devstack cinder-volume[84538]: DEBUG oslo_concurrency.processutils [None req-df799d48-e9a2-4799-82ca-7d6b2e0e3e34 tempest-VolumesSnapshotNegativeTestJSON-123355496 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-c5e98ef2-ed97-4db7-a222-4b73142f19d0.9101e9ad-d451-47ad-9a7e-80102f758527" returned: 0 in 0.683s {{(pid=84538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 19:06:28 devstack cinder-volume[84538]: DEBUG oslo_concurrency.processutils [None req-df799d48-e9a2-4799-82ca-7d6b2e0e3e34 tempest-VolumesSnapshotNegativeTestJSON-123355496 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-c5e98ef2-ed97-4db7-a222-4b73142f19d0.9101e9ad-d451-47ad-9a7e-80102f758527 {{(pid=84538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 19:06:28 devstack sudo[92910]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-c5e98ef2-ed97-4db7-a222-4b73142f19d0.9101e9ad-d451-47ad-9a7e-80102f758527 Apr 29 19:06:28 devstack sudo[92910]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 19:06:28 devstack sudo[92910]: pam_unix(sudo:session): session closed for user root Apr 29 19:06:28 devstack cinder-volume[84538]: DEBUG oslo_concurrency.processutils [None req-df799d48-e9a2-4799-82ca-7d6b2e0e3e34 tempest-VolumesSnapshotNegativeTestJSON-123355496 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-c5e98ef2-ed97-4db7-a222-4b73142f19d0.9101e9ad-d451-47ad-9a7e-80102f758527" returned: 0 in 0.609s {{(pid=84538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 19:06:28 devstack cinder-volume[84538]: DEBUG cinder.coordination [None req-df799d48-e9a2-4799-82ca-7d6b2e0e3e34 tempest-VolumesSnapshotNegativeTestJSON-123355496 None] Lock "cinder-quobyte-9101e9ad-d451-47ad-9a7e-80102f758527" released by "_delete_snapshot" :: held 2.937s {{(pid=84538) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 19:06:28 devstack cinder-volume[84538]: DEBUG cinder.coordination [None req-df799d48-e9a2-4799-82ca-7d6b2e0e3e34 tempest-VolumesSnapshotNegativeTestJSON-123355496 None] Lock "cinder-quobyte-c5e98ef2-ed97-4db7-a222-4b73142f19d0" released by "delete_snapshot" :: held 2.958s {{(pid=84538) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 19:06:28 devstack sudo[92908]: pam_unix(sudo:session): session closed for user root Apr 29 19:06:28 devstack cinder-volume[84538]: DEBUG oslo_concurrency.processutils [None req-92361894-7b61-4228-ab3b-2851f4f16a9e tempest-VolumesGetTest-1123317664 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-45f08e10-8cbe-4648-93eb-f78f3719bce1,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-45f08e10-8cbe-4648-93eb-f78f3719bce1.42da5593-3557-4d1c-99d7-83b0697e84b0 1G" returned: 0 in 0.751s {{(pid=84538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 19:06:28 devstack cinder-volume[84538]: DEBUG oslo_concurrency.processutils [None req-92361894-7b61-4228-ab3b-2851f4f16a9e tempest-VolumesGetTest-1123317664 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-45f08e10-8cbe-4648-93eb-f78f3719bce1 -F qcow2 /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-45f08e10-8cbe-4648-93eb-f78f3719bce1.42da5593-3557-4d1c-99d7-83b0697e84b0 {{(pid=84538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 19:06:28 devstack sudo[92917]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-45f08e10-8cbe-4648-93eb-f78f3719bce1 -F qcow2 /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-45f08e10-8cbe-4648-93eb-f78f3719bce1.42da5593-3557-4d1c-99d7-83b0697e84b0 Apr 29 19:06:28 devstack sudo[92917]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 19:06:28 devstack cinder-volume[84538]: DEBUG cinder.quota [None req-df799d48-e9a2-4799-82ca-7d6b2e0e3e34 tempest-VolumesSnapshotNegativeTestJSON-123355496 None] Created reservations ['f0a64010-0150-4d6d-adab-b6d395c92597', '470dd32f-557e-4ac6-8c1b-e237ebe7b0bd', '747f496c-9b11-4b2c-9709-f37bafe34e12', '3761bc67-72b4-4a8f-a912-289c2d68723e'] {{(pid=84538) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 29 19:06:28 devstack cinder-volume[84538]: INFO cinder.volume.manager [None req-df799d48-e9a2-4799-82ca-7d6b2e0e3e34 tempest-VolumesSnapshotNegativeTestJSON-123355496 None] Delete snapshot completed successfully. Apr 29 19:06:28 devstack cinder-volume[84538]: DEBUG cinder.coordination [None req-df799d48-e9a2-4799-82ca-7d6b2e0e3e34 tempest-VolumesSnapshotNegativeTestJSON-123355496 None] Lock "cinder-9101e9ad-d451-47ad-9a7e-80102f758527-delete_snapshot" released by "delete_snapshot" :: held 3.113s {{(pid=84538) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 19:06:29 devstack cinder-volume[84538]: DEBUG cinder.coordination [None req-3357c117-b58e-47d8-8ca8-050f8c7d4d62 tempest-VolumesSnapshotNegativeTestJSON-123355496 None] Acquiring lock "cinder-c5e98ef2-ed97-4db7-a222-4b73142f19d0-delete_volume" by "delete_volume" {{(pid=84538) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 19:06:29 devstack cinder-volume[84538]: DEBUG cinder.coordination [None req-3357c117-b58e-47d8-8ca8-050f8c7d4d62 tempest-VolumesSnapshotNegativeTestJSON-123355496 None] Lock "cinder-c5e98ef2-ed97-4db7-a222-4b73142f19d0-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=84538) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 19:06:29 devstack cinder-volume[84538]: DEBUG cinder.coordination [None req-3357c117-b58e-47d8-8ca8-050f8c7d4d62 tempest-VolumesSnapshotNegativeTestJSON-123355496 None] Acquiring lock "cinder-quobyte-c5e98ef2-ed97-4db7-a222-4b73142f19d0" by "delete_volume" {{(pid=84538) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 19:06:29 devstack cinder-volume[84538]: DEBUG cinder.coordination [None req-3357c117-b58e-47d8-8ca8-050f8c7d4d62 tempest-VolumesSnapshotNegativeTestJSON-123355496 None] Lock "cinder-quobyte-c5e98ef2-ed97-4db7-a222-4b73142f19d0" acquired by "delete_volume" :: waited 0.017s {{(pid=84538) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 19:06:29 devstack cinder-volume[84538]: DEBUG oslo.privsep.daemon [-] privsep: reply[c561cfc7-cc7e-4a4e-bb62-8fc6f4010872]: (4, 'qcow2') {{(pid=85803) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 19:06:29 devstack cinder-volume[84538]: DEBUG oslo_concurrency.processutils [None req-3357c117-b58e-47d8-8ca8-050f8c7d4d62 tempest-VolumesSnapshotNegativeTestJSON-123355496 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-c5e98ef2-ed97-4db7-a222-4b73142f19d0 {{(pid=84538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 19:06:29 devstack sudo[92919]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-c5e98ef2-ed97-4db7-a222-4b73142f19d0 Apr 29 19:06:29 devstack sudo[92919]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 19:06:29 devstack sudo[92917]: pam_unix(sudo:session): session closed for user root Apr 29 19:06:29 devstack cinder-volume[84538]: DEBUG oslo_concurrency.processutils [None req-92361894-7b61-4228-ab3b-2851f4f16a9e tempest-VolumesGetTest-1123317664 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-45f08e10-8cbe-4648-93eb-f78f3719bce1 -F qcow2 /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-45f08e10-8cbe-4648-93eb-f78f3719bce1.42da5593-3557-4d1c-99d7-83b0697e84b0" returned: 0 in 0.653s {{(pid=84538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 19:06:29 devstack cinder-volume[84538]: WARNING cinder.volume.drivers.remotefs [None req-92361894-7b61-4228-ab3b-2851f4f16a9e tempest-VolumesGetTest-1123317664 None] /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-45f08e10-8cbe-4648-93eb-f78f3719bce1.42da5593-3557-4d1c-99d7-83b0697e84b0 is being set with open permissions: ugo+rw Apr 29 19:06:29 devstack cinder-volume[84538]: DEBUG oslo_concurrency.processutils [None req-92361894-7b61-4228-ab3b-2851f4f16a9e tempest-VolumesGetTest-1123317664 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-45f08e10-8cbe-4648-93eb-f78f3719bce1.42da5593-3557-4d1c-99d7-83b0697e84b0 {{(pid=84538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 19:06:29 devstack sudo[92924]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-45f08e10-8cbe-4648-93eb-f78f3719bce1.42da5593-3557-4d1c-99d7-83b0697e84b0 Apr 29 19:06:29 devstack sudo[92924]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 19:06:29 devstack sudo[92919]: pam_unix(sudo:session): session closed for user root Apr 29 19:06:29 devstack cinder-volume[84538]: DEBUG oslo_concurrency.processutils [None req-3357c117-b58e-47d8-8ca8-050f8c7d4d62 tempest-VolumesSnapshotNegativeTestJSON-123355496 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-c5e98ef2-ed97-4db7-a222-4b73142f19d0" returned: 0 in 0.707s {{(pid=84538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 19:06:29 devstack cinder-volume[84538]: DEBUG oslo_concurrency.processutils [None req-3357c117-b58e-47d8-8ca8-050f8c7d4d62 tempest-VolumesSnapshotNegativeTestJSON-123355496 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-c5e98ef2-ed97-4db7-a222-4b73142f19d0 {{(pid=84538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 19:06:29 devstack sudo[92929]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-c5e98ef2-ed97-4db7-a222-4b73142f19d0 Apr 29 19:06:29 devstack sudo[92929]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 19:06:30 devstack sudo[92924]: pam_unix(sudo:session): session closed for user root Apr 29 19:06:30 devstack cinder-volume[84538]: DEBUG oslo_concurrency.processutils [None req-92361894-7b61-4228-ab3b-2851f4f16a9e tempest-VolumesGetTest-1123317664 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-45f08e10-8cbe-4648-93eb-f78f3719bce1.42da5593-3557-4d1c-99d7-83b0697e84b0" returned: 0 in 0.599s {{(pid=84538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 19:06:30 devstack cinder-volume[84538]: DEBUG oslo_concurrency.processutils [None req-92361894-7b61-4228-ab3b-2851f4f16a9e tempest-VolumesGetTest-1123317664 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-45f08e10-8cbe-4648-93eb-f78f3719bce1.info {{(pid=84538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 19:06:30 devstack sudo[92932]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-45f08e10-8cbe-4648-93eb-f78f3719bce1.info Apr 29 19:06:30 devstack sudo[92932]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 19:06:30 devstack sudo[92929]: pam_unix(sudo:session): session closed for user root Apr 29 19:06:30 devstack cinder-volume[84538]: DEBUG oslo_concurrency.processutils [None req-3357c117-b58e-47d8-8ca8-050f8c7d4d62 tempest-VolumesSnapshotNegativeTestJSON-123355496 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-c5e98ef2-ed97-4db7-a222-4b73142f19d0" returned: 0 in 0.613s {{(pid=84538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 19:06:30 devstack cinder-volume[84538]: DEBUG cinder.coordination [None req-3357c117-b58e-47d8-8ca8-050f8c7d4d62 tempest-VolumesSnapshotNegativeTestJSON-123355496 None] Lock "cinder-quobyte-c5e98ef2-ed97-4db7-a222-4b73142f19d0" released by "delete_volume" :: held 1.407s {{(pid=84538) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 19:06:30 devstack cinder-volume[84538]: DEBUG cinder.quota [None req-3357c117-b58e-47d8-8ca8-050f8c7d4d62 tempest-VolumesSnapshotNegativeTestJSON-123355496 None] Created reservations ['b685ee32-f241-4d5e-8ef1-cbd730ad7472', '81eba2b0-1e02-4111-af54-3831e799c6de', '34eef368-b955-4a4c-a3ff-9f877d61d780', '828bdae7-a296-4651-a65e-4fef428986bb'] {{(pid=84538) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 29 19:06:30 devstack cinder-volume[84538]: DEBUG oslo_concurrency.lockutils [None req-3357c117-b58e-47d8-8ca8-050f8c7d4d62 tempest-VolumesSnapshotNegativeTestJSON-123355496 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 19:06:30 devstack cinder-volume[84538]: DEBUG oslo_concurrency.lockutils [None req-3357c117-b58e-47d8-8ca8-050f8c7d4d62 tempest-VolumesSnapshotNegativeTestJSON-123355496 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 19:06:30 devstack cinder-volume[84538]: DEBUG cinder.volume.drivers.quobyte [None req-3357c117-b58e-47d8-8ca8-050f8c7d4d62 tempest-VolumesSnapshotNegativeTestJSON-123355496 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-34312b00-dd6d-45bb-af98-75855cea8e48': None} {{(pid=84538) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 19:06:30 devstack cinder-volume[84538]: DEBUG cinder.volume.drivers.quobyte [None req-3357c117-b58e-47d8-8ca8-050f8c7d4d62 tempest-VolumesSnapshotNegativeTestJSON-123355496 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-34312b00-dd6d-45bb-af98-75855cea8e48'] {{(pid=84538) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 19:06:30 devstack cinder-volume[84538]: DEBUG oslo_concurrency.lockutils [None req-3357c117-b58e-47d8-8ca8-050f8c7d4d62 tempest-VolumesSnapshotNegativeTestJSON-123355496 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=84538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 19:06:30 devstack cinder-volume[84538]: DEBUG oslo_concurrency.processutils [None req-3357c117-b58e-47d8-8ca8-050f8c7d4d62 tempest-VolumesSnapshotNegativeTestJSON-123355496 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d {{(pid=84538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 19:06:30 devstack sudo[92936]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d Apr 29 19:06:30 devstack sudo[92936]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 19:06:30 devstack sudo[92932]: pam_unix(sudo:session): session closed for user root Apr 29 19:06:30 devstack cinder-volume[84538]: DEBUG oslo_concurrency.processutils [None req-92361894-7b61-4228-ab3b-2851f4f16a9e tempest-VolumesGetTest-1123317664 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-45f08e10-8cbe-4648-93eb-f78f3719bce1.info" returned: 0 in 0.613s {{(pid=84538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 19:06:30 devstack cinder-volume[84538]: WARNING cinder.volume.drivers.remotefs [None req-92361894-7b61-4228-ab3b-2851f4f16a9e tempest-VolumesGetTest-1123317664 None] /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-45f08e10-8cbe-4648-93eb-f78f3719bce1.info is being set with open permissions: ugo+rw Apr 29 19:06:30 devstack cinder-volume[84538]: DEBUG oslo_concurrency.processutils [None req-92361894-7b61-4228-ab3b-2851f4f16a9e tempest-VolumesGetTest-1123317664 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-45f08e10-8cbe-4648-93eb-f78f3719bce1.info {{(pid=84538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 19:06:30 devstack sudo[92938]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-45f08e10-8cbe-4648-93eb-f78f3719bce1.info Apr 29 19:06:30 devstack sudo[92938]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 19:06:31 devstack sudo[92936]: pam_unix(sudo:session): session closed for user root Apr 29 19:06:31 devstack cinder-volume[84538]: DEBUG oslo_concurrency.processutils [None req-3357c117-b58e-47d8-8ca8-050f8c7d4d62 tempest-VolumesSnapshotNegativeTestJSON-123355496 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d" returned: 0 in 0.627s {{(pid=84538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 19:06:31 devstack cinder-volume[84538]: DEBUG cinder.manager [None req-3357c117-b58e-47d8-8ca8-050f8c7d4d62 tempest-VolumesSnapshotNegativeTestJSON-123355496 None] Notifying Schedulers of capabilities ... {{(pid=84538) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 29 19:06:31 devstack cinder-volume[84538]: INFO cinder.volume.manager [None req-3357c117-b58e-47d8-8ca8-050f8c7d4d62 tempest-VolumesSnapshotNegativeTestJSON-123355496 None] Deleted volume successfully. Apr 29 19:06:31 devstack sudo[92938]: pam_unix(sudo:session): session closed for user root Apr 29 19:06:31 devstack cinder-volume[84538]: DEBUG cinder.coordination [None req-3357c117-b58e-47d8-8ca8-050f8c7d4d62 tempest-VolumesSnapshotNegativeTestJSON-123355496 None] Lock "cinder-c5e98ef2-ed97-4db7-a222-4b73142f19d0-delete_volume" released by "delete_volume" :: held 2.246s {{(pid=84538) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 19:06:31 devstack cinder-volume[84538]: DEBUG oslo_concurrency.processutils [None req-92361894-7b61-4228-ab3b-2851f4f16a9e tempest-VolumesGetTest-1123317664 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-45f08e10-8cbe-4648-93eb-f78f3719bce1.info" returned: 0 in 0.630s {{(pid=84538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 19:06:31 devstack cinder-volume[84538]: DEBUG cinder.coordination [None req-92361894-7b61-4228-ab3b-2851f4f16a9e tempest-VolumesGetTest-1123317664 None] Acquiring lock "cinder-quobyte-f68dd373-afd4-4845-bef1-aaafa452f2d0" by "_copy_volume_from_snapshot" {{(pid=84538) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 19:06:31 devstack cinder-volume[84538]: DEBUG cinder.coordination [None req-92361894-7b61-4228-ab3b-2851f4f16a9e tempest-VolumesGetTest-1123317664 None] Lock "cinder-quobyte-f68dd373-afd4-4845-bef1-aaafa452f2d0" acquired by "_copy_volume_from_snapshot" :: waited 0.016s {{(pid=84538) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 19:06:31 devstack cinder-volume[84538]: DEBUG cinder.volume.drivers.quobyte [None req-92361894-7b61-4228-ab3b-2851f4f16a9e tempest-VolumesGetTest-1123317664 None] snapshot: 42da5593-3557-4d1c-99d7-83b0697e84b0, volume: f68dd373-afd4-4845-bef1-aaafa452f2d0, {{(pid=84538) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Apr 29 19:06:31 devstack cinder-volume[84538]: DEBUG oslo_concurrency.lockutils [None req-92361894-7b61-4228-ab3b-2851f4f16a9e tempest-VolumesGetTest-1123317664 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 19:06:31 devstack cinder-volume[84538]: DEBUG oslo_concurrency.lockutils [None req-92361894-7b61-4228-ab3b-2851f4f16a9e tempest-VolumesGetTest-1123317664 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 19:06:31 devstack cinder-volume[84538]: DEBUG cinder.volume.drivers.quobyte [None req-92361894-7b61-4228-ab3b-2851f4f16a9e tempest-VolumesGetTest-1123317664 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-34312b00-dd6d-45bb-af98-75855cea8e48': None} {{(pid=84538) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 19:06:31 devstack cinder-volume[84538]: DEBUG cinder.volume.drivers.quobyte [None req-92361894-7b61-4228-ab3b-2851f4f16a9e tempest-VolumesGetTest-1123317664 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-34312b00-dd6d-45bb-af98-75855cea8e48'] {{(pid=84538) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 19:06:31 devstack cinder-volume[84538]: DEBUG oslo_concurrency.lockutils [None req-92361894-7b61-4228-ab3b-2851f4f16a9e tempest-VolumesGetTest-1123317664 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=84538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 19:06:31 devstack cinder-volume[84538]: DEBUG oslo.privsep.daemon [-] privsep: reply[a0e27a59-f92f-488d-b885-83473ce5c4b7]: (4, 'qcow2') {{(pid=85803) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 19:06:31 devstack cinder-volume[84538]: DEBUG oslo_concurrency.processutils [None req-92361894-7b61-4228-ab3b-2851f4f16a9e tempest-VolumesGetTest-1123317664 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-45f08e10-8cbe-4648-93eb-f78f3719bce1.42da5593-3557-4d1c-99d7-83b0697e84b0 {{(pid=84538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 19:06:31 devstack sudo[92942]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-45f08e10-8cbe-4648-93eb-f78f3719bce1.42da5593-3557-4d1c-99d7-83b0697e84b0 Apr 29 19:06:31 devstack sudo[92942]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 19:06:32 devstack sudo[92942]: pam_unix(sudo:session): session closed for user root Apr 29 19:06:32 devstack cinder-volume[84538]: DEBUG oslo_concurrency.processutils [None req-92361894-7b61-4228-ab3b-2851f4f16a9e tempest-VolumesGetTest-1123317664 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-45f08e10-8cbe-4648-93eb-f78f3719bce1.42da5593-3557-4d1c-99d7-83b0697e84b0" returned: 0 in 0.764s {{(pid=84538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 19:06:32 devstack cinder-volume[84538]: DEBUG cinder.volume.drivers.remotefs [None req-92361894-7b61-4228-ab3b-2851f4f16a9e tempest-VolumesGetTest-1123317664 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-45f08e10-8cbe-4648-93eb-f78f3719bce1(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=84538) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 29 19:06:32 devstack cinder-volume[84538]: DEBUG cinder.volume.drivers.quobyte [None req-92361894-7b61-4228-ab3b-2851f4f16a9e tempest-VolumesGetTest-1123317664 None] will copy from snapshot at /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-45f08e10-8cbe-4648-93eb-f78f3719bce1 {{(pid=84538) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Apr 29 19:06:32 devstack cinder-volume[84538]: DEBUG cinder.volume.drivers.quobyte [None req-92361894-7b61-4228-ab3b-2851f4f16a9e tempest-VolumesGetTest-1123317664 None] Creating direct copy from snapshot {{(pid=84538) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Apr 29 19:06:32 devstack cinder-volume[84538]: DEBUG oslo.privsep.daemon [-] privsep: reply[fd212adb-e0c6-4a38-8f7e-ca93129094f1]: (4, 'qcow2') {{(pid=85803) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 19:06:32 devstack cinder-volume[84538]: DEBUG oslo_concurrency.processutils [None req-92361894-7b61-4228-ab3b-2851f4f16a9e tempest-VolumesGetTest-1123317664 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-45f08e10-8cbe-4648-93eb-f78f3719bce1 {{(pid=84538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 19:06:32 devstack sudo[92947]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-45f08e10-8cbe-4648-93eb-f78f3719bce1 Apr 29 19:06:32 devstack sudo[92947]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 19:06:32 devstack sudo[92947]: pam_unix(sudo:session): session closed for user root Apr 29 19:06:33 devstack cinder-volume[84538]: DEBUG oslo_concurrency.processutils [None req-92361894-7b61-4228-ab3b-2851f4f16a9e tempest-VolumesGetTest-1123317664 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-45f08e10-8cbe-4648-93eb-f78f3719bce1" returned: 0 in 0.759s {{(pid=84538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 19:06:33 devstack cinder-volume[84538]: DEBUG cinder.utils [None req-92361894-7b61-4228-ab3b-2851f4f16a9e tempest-VolumesGetTest-1123317664 None] Path /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-f68dd373-afd4-4845-bef1-aaafa452f2d0 not found in is_blk_device check {{(pid=84538) is_blk_device /opt/stack/cinder/cinder/utils.py:602}} Apr 29 19:06:33 devstack cinder-volume[84538]: DEBUG oslo_concurrency.processutils [None req-92361894-7b61-4228-ab3b-2851f4f16a9e tempest-VolumesGetTest-1123317664 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-45f08e10-8cbe-4648-93eb-f78f3719bce1 /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-f68dd373-afd4-4845-bef1-aaafa452f2d0 {{(pid=84538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 19:06:33 devstack sudo[92953]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-45f08e10-8cbe-4648-93eb-f78f3719bce1 /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-f68dd373-afd4-4845-bef1-aaafa452f2d0 Apr 29 19:06:33 devstack sudo[92953]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 19:06:34 devstack cinder-volume[84538]: DEBUG cinder.volume.flows.manager.create_volume [None req-d05cf30b-0c9d-4b6d-9e73-4bba5ab444b4 tempest-VolumeDependencyTests-1062757540 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84538) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Apr 29 19:06:34 devstack cinder-volume[84538]: DEBUG cinder.volume.manager [None req-d05cf30b-0c9d-4b6d-9e73-4bba5ab444b4 tempest-VolumeDependencyTests-1062757540 None] Flow 'volume_create_manager' (8553f841-3a34-42c8-b8e1-b0757aacb5ed) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84538) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 19:06:34 devstack cinder-volume[84538]: DEBUG cinder.volume.manager [None req-d05cf30b-0c9d-4b6d-9e73-4bba5ab444b4 tempest-VolumeDependencyTests-1062757540 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7e4a120a-8dbc-4f16-8a18-6b158a2760af) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 19:06:34 devstack cinder-volume[84538]: DEBUG cinder.volume.manager [None req-d05cf30b-0c9d-4b6d-9e73-4bba5ab444b4 tempest-VolumeDependencyTests-1062757540 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7e4a120a-8dbc-4f16-8a18-6b158a2760af) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-29T17:06:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-2003882180',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ca04e084-1b6b-4c31-ada9-fccf31334333,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='001d402393ae4453a65ebf0c689f4ce8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T17:06:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T17:06:34Z,use_quota=True,user_id='9f67a47c6d1a42818af1ea2d7da1b6ae',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(62b05900-93e3-4190-a88f-1d87324303d1),volume_type_id=62b05900-93e3-4190-a88f-1d87324303d1)' {{(pid=84538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 19:06:34 devstack cinder-volume[84538]: DEBUG cinder.volume.manager [None req-d05cf30b-0c9d-4b6d-9e73-4bba5ab444b4 tempest-VolumeDependencyTests-1062757540 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1b29afe8-70e8-493a-97f0-d2c8b0456cf2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 19:06:34 devstack cinder-volume[84538]: DEBUG cinder.volume.manager [None req-d05cf30b-0c9d-4b6d-9e73-4bba5ab444b4 tempest-VolumeDependencyTests-1062757540 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1b29afe8-70e8-493a-97f0-d2c8b0456cf2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 19:06:34 devstack cinder-volume[84538]: DEBUG cinder.volume.manager [None req-d05cf30b-0c9d-4b6d-9e73-4bba5ab444b4 tempest-VolumeDependencyTests-1062757540 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (730f4550-ea2f-41fa-8523-e7a4f43e3589) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 19:06:34 devstack cinder-volume[84538]: DEBUG cinder.volume.manager [None req-d05cf30b-0c9d-4b6d-9e73-4bba5ab444b4 tempest-VolumeDependencyTests-1062757540 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (730f4550-ea2f-41fa-8523-e7a4f43e3589) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ca04e084-1b6b-4c31-ada9-fccf31334333', 'volume_name': 'volume-ca04e084-1b6b-4c31-ada9-fccf31334333', 'volume_size': 1}' {{(pid=84538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 19:06:34 devstack cinder-volume[84538]: DEBUG cinder.volume.manager [None req-d05cf30b-0c9d-4b6d-9e73-4bba5ab444b4 tempest-VolumeDependencyTests-1062757540 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (169c9283-dbb2-4987-9a18-7a1d5679206a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 19:06:34 devstack cinder-volume[84538]: DEBUG cinder.volume.manager [None req-d05cf30b-0c9d-4b6d-9e73-4bba5ab444b4 tempest-VolumeDependencyTests-1062757540 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (169c9283-dbb2-4987-9a18-7a1d5679206a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 19:06:34 devstack cinder-volume[84538]: DEBUG cinder.volume.manager [None req-d05cf30b-0c9d-4b6d-9e73-4bba5ab444b4 tempest-VolumeDependencyTests-1062757540 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c7a034f5-fddb-4ad0-81e8-f2e0a4cc7e20) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 19:06:34 devstack cinder-volume[84538]: INFO cinder.volume.flows.manager.create_volume [None req-d05cf30b-0c9d-4b6d-9e73-4bba5ab444b4 tempest-VolumeDependencyTests-1062757540 None] Volume ca04e084-1b6b-4c31-ada9-fccf31334333: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ca04e084-1b6b-4c31-ada9-fccf31334333', 'volume_size': 1} Apr 29 19:06:34 devstack cinder-volume[84538]: DEBUG oslo_concurrency.lockutils [None req-d05cf30b-0c9d-4b6d-9e73-4bba5ab444b4 tempest-VolumeDependencyTests-1062757540 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 19:06:37 devstack sudo[92953]: pam_unix(sudo:session): session closed for user root Apr 29 19:06:37 devstack cinder-volume[84538]: DEBUG oslo_concurrency.processutils [None req-92361894-7b61-4228-ab3b-2851f4f16a9e tempest-VolumesGetTest-1123317664 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-45f08e10-8cbe-4648-93eb-f78f3719bce1 /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-f68dd373-afd4-4845-bef1-aaafa452f2d0" returned: 0 in 4.686s {{(pid=84538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 19:06:37 devstack cinder-volume[84538]: DEBUG oslo.privsep.daemon [-] privsep: reply[97e0c10c-6f2e-4e1f-963d-3e6fae08b956]: (4, 'qcow2') {{(pid=85803) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 19:06:37 devstack cinder-volume[84538]: DEBUG oslo_concurrency.processutils [None req-92361894-7b61-4228-ab3b-2851f4f16a9e tempest-VolumesGetTest-1123317664 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-45f08e10-8cbe-4648-93eb-f78f3719bce1 {{(pid=84538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 19:06:37 devstack sudo[92967]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-45f08e10-8cbe-4648-93eb-f78f3719bce1 Apr 29 19:06:37 devstack sudo[92967]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 19:06:38 devstack sudo[92967]: pam_unix(sudo:session): session closed for user root Apr 29 19:06:38 devstack cinder-volume[84538]: DEBUG oslo_concurrency.processutils [None req-92361894-7b61-4228-ab3b-2851f4f16a9e tempest-VolumesGetTest-1123317664 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-45f08e10-8cbe-4648-93eb-f78f3719bce1" returned: 0 in 0.864s {{(pid=84538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 19:06:38 devstack cinder-volume[84538]: DEBUG cinder.image.image_utils [None req-92361894-7b61-4228-ab3b-2851f4f16a9e tempest-VolumesGetTest-1123317664 None] Image conversion details: src /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-45f08e10-8cbe-4648-93eb-f78f3719bce1, size 1024.00 MB, duration 4.69 sec, destination /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-f68dd373-afd4-4845-bef1-aaafa452f2d0 {{(pid=84538) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}} Apr 29 19:06:38 devstack cinder-volume[84538]: INFO cinder.image.image_utils [None req-92361894-7b61-4228-ab3b-2851f4f16a9e tempest-VolumesGetTest-1123317664 None] Converted 1024.00 MB image at 218.48 MB/s Apr 29 19:06:38 devstack cinder-volume[84538]: WARNING cinder.volume.drivers.remotefs [None req-92361894-7b61-4228-ab3b-2851f4f16a9e tempest-VolumesGetTest-1123317664 None] /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-f68dd373-afd4-4845-bef1-aaafa452f2d0 is being set with open permissions: ugo+rw Apr 29 19:06:38 devstack cinder-volume[84538]: DEBUG oslo_concurrency.processutils [None req-92361894-7b61-4228-ab3b-2851f4f16a9e tempest-VolumesGetTest-1123317664 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-f68dd373-afd4-4845-bef1-aaafa452f2d0 {{(pid=84538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 19:06:38 devstack sudo[92974]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-f68dd373-afd4-4845-bef1-aaafa452f2d0 Apr 29 19:06:38 devstack sudo[92974]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 19:06:39 devstack sudo[92974]: pam_unix(sudo:session): session closed for user root Apr 29 19:06:39 devstack cinder-volume[84538]: DEBUG oslo_concurrency.processutils [None req-92361894-7b61-4228-ab3b-2851f4f16a9e tempest-VolumesGetTest-1123317664 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-f68dd373-afd4-4845-bef1-aaafa452f2d0" returned: 0 in 0.608s {{(pid=84538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 19:06:39 devstack cinder-volume[84538]: DEBUG cinder.coordination [None req-92361894-7b61-4228-ab3b-2851f4f16a9e tempest-VolumesGetTest-1123317664 None] Lock "cinder-quobyte-f68dd373-afd4-4845-bef1-aaafa452f2d0" released by "_copy_volume_from_snapshot" :: held 7.771s {{(pid=84538) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 19:06:39 devstack cinder-volume[84538]: DEBUG cinder.coordination [None req-92361894-7b61-4228-ab3b-2851f4f16a9e tempest-VolumesGetTest-1123317664 None] Acquiring lock "cinder-quobyte-42da5593-3557-4d1c-99d7-83b0697e84b0" by "_delete_snapshot" {{(pid=84538) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 19:06:39 devstack cinder-volume[84538]: DEBUG cinder.coordination [None req-92361894-7b61-4228-ab3b-2851f4f16a9e tempest-VolumesGetTest-1123317664 None] Lock "cinder-quobyte-42da5593-3557-4d1c-99d7-83b0697e84b0" acquired by "_delete_snapshot" :: waited 0.014s {{(pid=84538) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 19:06:39 devstack cinder-volume[84538]: DEBUG cinder.volume.drivers.remotefs [None req-92361894-7b61-4228-ab3b-2851f4f16a9e tempest-VolumesGetTest-1123317664 None] Deleting offline snapshot 42da5593-3557-4d1c-99d7-83b0697e84b0 of volume 45f08e10-8cbe-4648-93eb-f78f3719bce1 {{(pid=84538) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 29 19:06:39 devstack cinder-volume[84538]: DEBUG cinder.volume.drivers.remotefs [None req-92361894-7b61-4228-ab3b-2851f4f16a9e tempest-VolumesGetTest-1123317664 None] snapshot_file for this snap is: volume-45f08e10-8cbe-4648-93eb-f78f3719bce1.42da5593-3557-4d1c-99d7-83b0697e84b0 {{(pid=84538) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 29 19:06:39 devstack cinder-volume[84538]: DEBUG oslo.privsep.daemon [-] privsep: reply[364898a2-6572-4c4f-b5bb-2ca50e5a4f21]: (4, 'qcow2') {{(pid=85803) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 19:06:39 devstack cinder-volume[84538]: DEBUG oslo_concurrency.processutils [None req-92361894-7b61-4228-ab3b-2851f4f16a9e tempest-VolumesGetTest-1123317664 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-45f08e10-8cbe-4648-93eb-f78f3719bce1.42da5593-3557-4d1c-99d7-83b0697e84b0 {{(pid=84538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 19:06:39 devstack sudo[92977]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-45f08e10-8cbe-4648-93eb-f78f3719bce1.42da5593-3557-4d1c-99d7-83b0697e84b0 Apr 29 19:06:39 devstack sudo[92977]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 19:06:39 devstack sudo[92977]: pam_unix(sudo:session): session closed for user root Apr 29 19:06:39 devstack cinder-volume[84538]: DEBUG oslo_concurrency.processutils [None req-92361894-7b61-4228-ab3b-2851f4f16a9e tempest-VolumesGetTest-1123317664 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-45f08e10-8cbe-4648-93eb-f78f3719bce1.42da5593-3557-4d1c-99d7-83b0697e84b0" returned: 0 in 0.708s {{(pid=84538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 19:06:39 devstack cinder-volume[84538]: DEBUG cinder.volume.drivers.remotefs [None req-92361894-7b61-4228-ab3b-2851f4f16a9e tempest-VolumesGetTest-1123317664 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-45f08e10-8cbe-4648-93eb-f78f3719bce1(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=84538) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 29 19:06:39 devstack cinder-volume[84538]: DEBUG oslo.privsep.daemon [-] privsep: reply[668fc988-4ace-46a1-98f2-45fe0ef491c3]: (4, 'qcow2') {{(pid=85803) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 19:06:39 devstack cinder-volume[84538]: DEBUG oslo_concurrency.processutils [None req-92361894-7b61-4228-ab3b-2851f4f16a9e tempest-VolumesGetTest-1123317664 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-45f08e10-8cbe-4648-93eb-f78f3719bce1 {{(pid=84538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 19:06:40 devstack sudo[92982]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-45f08e10-8cbe-4648-93eb-f78f3719bce1 Apr 29 19:06:40 devstack sudo[92982]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 19:06:40 devstack sudo[92982]: pam_unix(sudo:session): session closed for user root Apr 29 19:06:40 devstack cinder-volume[84538]: DEBUG oslo_concurrency.processutils [None req-92361894-7b61-4228-ab3b-2851f4f16a9e tempest-VolumesGetTest-1123317664 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-45f08e10-8cbe-4648-93eb-f78f3719bce1" returned: 0 in 0.704s {{(pid=84538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 19:06:40 devstack cinder-volume[84538]: DEBUG oslo_concurrency.processutils [None req-92361894-7b61-4228-ab3b-2851f4f16a9e tempest-VolumesGetTest-1123317664 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-45f08e10-8cbe-4648-93eb-f78f3719bce1.42da5593-3557-4d1c-99d7-83b0697e84b0 {{(pid=84538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 19:06:40 devstack sudo[92987]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-45f08e10-8cbe-4648-93eb-f78f3719bce1.42da5593-3557-4d1c-99d7-83b0697e84b0 Apr 29 19:06:40 devstack sudo[92987]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 19:06:41 devstack sudo[92987]: pam_unix(sudo:session): session closed for user root Apr 29 19:06:41 devstack cinder-volume[84538]: DEBUG oslo_concurrency.processutils [None req-92361894-7b61-4228-ab3b-2851f4f16a9e tempest-VolumesGetTest-1123317664 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-45f08e10-8cbe-4648-93eb-f78f3719bce1.42da5593-3557-4d1c-99d7-83b0697e84b0" returned: 0 in 0.682s {{(pid=84538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 19:06:41 devstack cinder-volume[84538]: DEBUG oslo_concurrency.processutils [None req-92361894-7b61-4228-ab3b-2851f4f16a9e tempest-VolumesGetTest-1123317664 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-45f08e10-8cbe-4648-93eb-f78f3719bce1.42da5593-3557-4d1c-99d7-83b0697e84b0 {{(pid=84538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 19:06:41 devstack sudo[92994]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-45f08e10-8cbe-4648-93eb-f78f3719bce1.42da5593-3557-4d1c-99d7-83b0697e84b0 Apr 29 19:06:41 devstack sudo[92994]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 19:06:41 devstack sudo[92994]: pam_unix(sudo:session): session closed for user root Apr 29 19:06:41 devstack cinder-volume[84538]: DEBUG oslo_concurrency.processutils [None req-92361894-7b61-4228-ab3b-2851f4f16a9e tempest-VolumesGetTest-1123317664 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-45f08e10-8cbe-4648-93eb-f78f3719bce1.42da5593-3557-4d1c-99d7-83b0697e84b0" returned: 0 in 0.589s {{(pid=84538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 19:06:41 devstack cinder-volume[84538]: DEBUG cinder.coordination [None req-92361894-7b61-4228-ab3b-2851f4f16a9e tempest-VolumesGetTest-1123317664 None] Lock "cinder-quobyte-42da5593-3557-4d1c-99d7-83b0697e84b0" released by "_delete_snapshot" :: held 2.764s {{(pid=84538) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 19:06:42 devstack cinder-volume[84538]: DEBUG oslo_concurrency.lockutils [None req-92361894-7b61-4228-ab3b-2851f4f16a9e tempest-VolumesGetTest-1123317664 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: held 14.689s {{(pid=84538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 19:06:42 devstack cinder-volume[84538]: DEBUG oslo_concurrency.lockutils [None req-d05cf30b-0c9d-4b6d-9e73-4bba5ab444b4 tempest-VolumeDependencyTests-1062757540 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 7.303s {{(pid=84538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 19:06:42 devstack cinder-volume[84538]: DEBUG cinder.volume.drivers.quobyte [None req-d05cf30b-0c9d-4b6d-9e73-4bba5ab444b4 tempest-VolumeDependencyTests-1062757540 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-29T17:06:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-2003882180',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ca04e084-1b6b-4c31-ada9-fccf31334333,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='001d402393ae4453a65ebf0c689f4ce8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T17:06:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T17:06:34Z,use_quota=True,user_id='9f67a47c6d1a42818af1ea2d7da1b6ae',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(62b05900-93e3-4190-a88f-1d87324303d1),volume_type_id=62b05900-93e3-4190-a88f-1d87324303d1)}" {{(pid=84538) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 29 19:06:42 devstack cinder-volume[84538]: DEBUG cinder.volume.drivers.remotefs [None req-d05cf30b-0c9d-4b6d-9e73-4bba5ab444b4 tempest-VolumeDependencyTests-1062757540 None] Creating volume ca04e084-1b6b-4c31-ada9-fccf31334333 {{(pid=84538) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 29 19:06:42 devstack cinder-volume[84538]: DEBUG oslo_concurrency.lockutils [None req-d05cf30b-0c9d-4b6d-9e73-4bba5ab444b4 tempest-VolumeDependencyTests-1062757540 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 19:06:42 devstack cinder-volume[84538]: DEBUG oslo_concurrency.lockutils [None req-d05cf30b-0c9d-4b6d-9e73-4bba5ab444b4 tempest-VolumeDependencyTests-1062757540 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=84538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 19:06:42 devstack cinder-volume[84538]: DEBUG cinder.volume.drivers.quobyte [None req-d05cf30b-0c9d-4b6d-9e73-4bba5ab444b4 tempest-VolumeDependencyTests-1062757540 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-34312b00-dd6d-45bb-af98-75855cea8e48': None} {{(pid=84538) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 19:06:42 devstack cinder-volume[84538]: DEBUG cinder.volume.drivers.quobyte [None req-d05cf30b-0c9d-4b6d-9e73-4bba5ab444b4 tempest-VolumeDependencyTests-1062757540 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-34312b00-dd6d-45bb-af98-75855cea8e48'] {{(pid=84538) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 19:06:42 devstack cinder-volume[84538]: DEBUG oslo_concurrency.lockutils [None req-d05cf30b-0c9d-4b6d-9e73-4bba5ab444b4 tempest-VolumeDependencyTests-1062757540 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=84538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 19:06:42 devstack cinder-volume[84538]: DEBUG cinder.volume.drivers.quobyte [None req-d05cf30b-0c9d-4b6d-9e73-4bba5ab444b4 tempest-VolumeDependencyTests-1062757540 None] Selected osci02.corp.quobyte.com/cinder-vol-34312b00-dd6d-45bb-af98-75855cea8e48 as target Quobyte volume. {{(pid=84538) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 29 19:06:42 devstack cinder-volume[84538]: INFO cinder.volume.drivers.remotefs [None req-d05cf30b-0c9d-4b6d-9e73-4bba5ab444b4 tempest-VolumeDependencyTests-1062757540 None] casted to osci02.corp.quobyte.com/cinder-vol-34312b00-dd6d-45bb-af98-75855cea8e48 Apr 29 19:06:42 devstack cinder-volume[84538]: DEBUG oslo_concurrency.processutils [None req-d05cf30b-0c9d-4b6d-9e73-4bba5ab444b4 tempest-VolumeDependencyTests-1062757540 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-ca04e084-1b6b-4c31-ada9-fccf31334333 1073741824 {{(pid=84538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 19:06:42 devstack sudo[92997]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-ca04e084-1b6b-4c31-ada9-fccf31334333 1073741824 Apr 29 19:06:42 devstack sudo[92997]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 19:06:42 devstack cinder-volume[84538]: DEBUG cinder.volume.manager [None req-92361894-7b61-4228-ab3b-2851f4f16a9e tempest-VolumesGetTest-1123317664 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a901aa47-140c-44c5-82a8-b1ef781fdede) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f68dd373-afd4-4845-bef1-aaafa452f2d0', 'volume_size': 1, 'source_volid': '45f08e10-8cbe-4648-93eb-f78f3719bce1', 'source_volstatus': 'available'}' {{(pid=84538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 19:06:42 devstack cinder-volume[84538]: DEBUG cinder.volume.manager [None req-92361894-7b61-4228-ab3b-2851f4f16a9e tempest-VolumesGetTest-1123317664 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a654b600-aef6-44d5-9004-d202d65558d7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 19:06:42 devstack cinder-volume[84538]: INFO cinder.volume.flows.manager.create_volume [None req-92361894-7b61-4228-ab3b-2851f4f16a9e tempest-VolumesGetTest-1123317664 None] Volume volume-f68dd373-afd4-4845-bef1-aaafa452f2d0 (f68dd373-afd4-4845-bef1-aaafa452f2d0): created successfully Apr 29 19:06:42 devstack cinder-volume[84538]: DEBUG cinder.volume.manager [None req-92361894-7b61-4228-ab3b-2851f4f16a9e tempest-VolumesGetTest-1123317664 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a654b600-aef6-44d5-9004-d202d65558d7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 19:06:42 devstack cinder-volume[84538]: DEBUG cinder.volume.manager [None req-92361894-7b61-4228-ab3b-2851f4f16a9e tempest-VolumesGetTest-1123317664 None] Flow 'volume_create_manager' (16634965-6b6e-4155-b10e-d51c1465bd5d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84538) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 19:06:42 devstack cinder-volume[84538]: INFO cinder.volume.manager [None req-92361894-7b61-4228-ab3b-2851f4f16a9e tempest-VolumesGetTest-1123317664 None] Created volume successfully. Apr 29 19:06:42 devstack sudo[92997]: pam_unix(sudo:session): session closed for user root Apr 29 19:06:42 devstack cinder-volume[84538]: DEBUG oslo_concurrency.processutils [None req-d05cf30b-0c9d-4b6d-9e73-4bba5ab444b4 tempest-VolumeDependencyTests-1062757540 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-ca04e084-1b6b-4c31-ada9-fccf31334333 1073741824" returned: 0 in 0.797s {{(pid=84538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 19:06:42 devstack cinder-volume[84538]: DEBUG oslo_concurrency.processutils [None req-d05cf30b-0c9d-4b6d-9e73-4bba5ab444b4 tempest-VolumeDependencyTests-1062757540 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-ca04e084-1b6b-4c31-ada9-fccf31334333 {{(pid=84538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 19:06:42 devstack sudo[93005]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-ca04e084-1b6b-4c31-ada9-fccf31334333 Apr 29 19:06:42 devstack sudo[93005]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 19:06:42 devstack cinder-volume[84538]: DEBUG cinder.volume.flows.manager.create_volume [None req-20991d8a-8d8d-44b2-bbcb-730a513025c0 tempest-VolumesGetTest-1123317664 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84538) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Apr 29 19:06:42 devstack cinder-volume[84538]: DEBUG cinder.volume.manager [None req-20991d8a-8d8d-44b2-bbcb-730a513025c0 tempest-VolumesGetTest-1123317664 None] Flow 'volume_create_manager' (67c0f517-7d21-4ecd-be88-141ece1dfb4b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84538) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 19:06:42 devstack cinder-volume[84538]: DEBUG cinder.volume.manager [None req-20991d8a-8d8d-44b2-bbcb-730a513025c0 tempest-VolumesGetTest-1123317664 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8eed9a37-1c56-4b05-93d0-7bbefacd7b8b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 19:06:42 devstack cinder-volume[84538]: DEBUG cinder.volume.manager [None req-20991d8a-8d8d-44b2-bbcb-730a513025c0 tempest-VolumesGetTest-1123317664 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8eed9a37-1c56-4b05-93d0-7bbefacd7b8b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-29T17:06:43Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-1031562119',display_name='tempest-VolumesGetTest-Volume-32590770',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9d8c609f-25d2-4ff4-8faf-c8e9fecdde19,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='62ab81799a05449b9f5b7eb23c6c9071',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T17:06:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T17:06:43Z,use_quota=True,user_id='2c9aaf152c0f49d3887038450048a477',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(62b05900-93e3-4190-a88f-1d87324303d1),volume_type_id=62b05900-93e3-4190-a88f-1d87324303d1)' {{(pid=84538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 19:06:42 devstack cinder-volume[84538]: DEBUG cinder.volume.manager [None req-20991d8a-8d8d-44b2-bbcb-730a513025c0 tempest-VolumesGetTest-1123317664 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fc7579f3-7960-4cd6-b2ff-55ec2f4f60d7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 19:06:42 devstack cinder-volume[84538]: DEBUG cinder.volume.manager [None req-20991d8a-8d8d-44b2-bbcb-730a513025c0 tempest-VolumesGetTest-1123317664 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fc7579f3-7960-4cd6-b2ff-55ec2f4f60d7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 19:06:43 devstack cinder-volume[84538]: DEBUG cinder.volume.manager [None req-20991d8a-8d8d-44b2-bbcb-730a513025c0 tempest-VolumesGetTest-1123317664 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6e95b0a1-f5e2-4321-bf64-bb4eba3403c8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 19:06:43 devstack cinder-volume[84538]: DEBUG cinder.volume.manager [None req-20991d8a-8d8d-44b2-bbcb-730a513025c0 tempest-VolumesGetTest-1123317664 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6e95b0a1-f5e2-4321-bf64-bb4eba3403c8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9d8c609f-25d2-4ff4-8faf-c8e9fecdde19', 'volume_name': 'volume-9d8c609f-25d2-4ff4-8faf-c8e9fecdde19', 'volume_size': 1}' {{(pid=84538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 19:06:43 devstack cinder-volume[84538]: DEBUG cinder.volume.manager [None req-20991d8a-8d8d-44b2-bbcb-730a513025c0 tempest-VolumesGetTest-1123317664 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (72250b51-bc35-480c-83f0-2e24eeb6ca51) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 19:06:43 devstack cinder-volume[84538]: DEBUG cinder.volume.manager [None req-20991d8a-8d8d-44b2-bbcb-730a513025c0 tempest-VolumesGetTest-1123317664 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (72250b51-bc35-480c-83f0-2e24eeb6ca51) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 19:06:43 devstack cinder-volume[84538]: DEBUG cinder.volume.manager [None req-20991d8a-8d8d-44b2-bbcb-730a513025c0 tempest-VolumesGetTest-1123317664 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (164692f4-b4a2-4d7d-8cb9-62d9cc0c6e65) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 19:06:43 devstack cinder-volume[84538]: INFO cinder.volume.flows.manager.create_volume [None req-20991d8a-8d8d-44b2-bbcb-730a513025c0 tempest-VolumesGetTest-1123317664 None] Volume 9d8c609f-25d2-4ff4-8faf-c8e9fecdde19: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9d8c609f-25d2-4ff4-8faf-c8e9fecdde19', 'volume_size': 1} Apr 29 19:06:43 devstack cinder-volume[84538]: DEBUG oslo_concurrency.lockutils [None req-20991d8a-8d8d-44b2-bbcb-730a513025c0 tempest-VolumesGetTest-1123317664 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 19:06:43 devstack sudo[93005]: pam_unix(sudo:session): session closed for user root Apr 29 19:06:43 devstack cinder-volume[84538]: DEBUG oslo_concurrency.processutils [None req-d05cf30b-0c9d-4b6d-9e73-4bba5ab444b4 tempest-VolumeDependencyTests-1062757540 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-ca04e084-1b6b-4c31-ada9-fccf31334333" returned: 0 in 0.595s {{(pid=84538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 19:06:43 devstack cinder-volume[84538]: DEBUG cinder.volume.drivers.quobyte [None req-d05cf30b-0c9d-4b6d-9e73-4bba5ab444b4 tempest-VolumeDependencyTests-1062757540 None] <== create_volume: return (1435ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-34312b00-dd6d-45bb-af98-75855cea8e48'} {{(pid=84538) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 29 19:06:43 devstack cinder-volume[84538]: DEBUG oslo_concurrency.lockutils [None req-d05cf30b-0c9d-4b6d-9e73-4bba5ab444b4 tempest-VolumeDependencyTests-1062757540 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.438s {{(pid=84538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 19:06:43 devstack cinder-volume[84538]: DEBUG oslo_concurrency.lockutils [None req-20991d8a-8d8d-44b2-bbcb-730a513025c0 tempest-VolumesGetTest-1123317664 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.429s {{(pid=84538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 19:06:43 devstack cinder-volume[84538]: DEBUG cinder.volume.drivers.quobyte [None req-20991d8a-8d8d-44b2-bbcb-730a513025c0 tempest-VolumesGetTest-1123317664 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-29T17:06:43Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-1031562119',display_name='tempest-VolumesGetTest-Volume-32590770',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9d8c609f-25d2-4ff4-8faf-c8e9fecdde19,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='62ab81799a05449b9f5b7eb23c6c9071',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T17:06:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T17:06:43Z,use_quota=True,user_id='2c9aaf152c0f49d3887038450048a477',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(62b05900-93e3-4190-a88f-1d87324303d1),volume_type_id=62b05900-93e3-4190-a88f-1d87324303d1)}" {{(pid=84538) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 29 19:06:43 devstack cinder-volume[84538]: DEBUG cinder.volume.drivers.remotefs [None req-20991d8a-8d8d-44b2-bbcb-730a513025c0 tempest-VolumesGetTest-1123317664 None] Creating volume 9d8c609f-25d2-4ff4-8faf-c8e9fecdde19 {{(pid=84538) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 29 19:06:43 devstack cinder-volume[84538]: DEBUG oslo_concurrency.lockutils [None req-20991d8a-8d8d-44b2-bbcb-730a513025c0 tempest-VolumesGetTest-1123317664 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 19:06:43 devstack cinder-volume[84538]: DEBUG oslo_concurrency.lockutils [None req-20991d8a-8d8d-44b2-bbcb-730a513025c0 tempest-VolumesGetTest-1123317664 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=84538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 19:06:43 devstack cinder-volume[84538]: DEBUG cinder.volume.drivers.quobyte [None req-20991d8a-8d8d-44b2-bbcb-730a513025c0 tempest-VolumesGetTest-1123317664 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-34312b00-dd6d-45bb-af98-75855cea8e48': None} {{(pid=84538) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 19:06:43 devstack cinder-volume[84538]: DEBUG cinder.volume.drivers.quobyte [None req-20991d8a-8d8d-44b2-bbcb-730a513025c0 tempest-VolumesGetTest-1123317664 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-34312b00-dd6d-45bb-af98-75855cea8e48'] {{(pid=84538) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 19:06:43 devstack cinder-volume[84538]: DEBUG oslo_concurrency.lockutils [None req-20991d8a-8d8d-44b2-bbcb-730a513025c0 tempest-VolumesGetTest-1123317664 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=84538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 19:06:43 devstack cinder-volume[84538]: DEBUG cinder.volume.drivers.quobyte [None req-20991d8a-8d8d-44b2-bbcb-730a513025c0 tempest-VolumesGetTest-1123317664 None] Selected osci02.corp.quobyte.com/cinder-vol-34312b00-dd6d-45bb-af98-75855cea8e48 as target Quobyte volume. {{(pid=84538) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 29 19:06:43 devstack cinder-volume[84538]: INFO cinder.volume.drivers.remotefs [None req-20991d8a-8d8d-44b2-bbcb-730a513025c0 tempest-VolumesGetTest-1123317664 None] casted to osci02.corp.quobyte.com/cinder-vol-34312b00-dd6d-45bb-af98-75855cea8e48 Apr 29 19:06:43 devstack cinder-volume[84538]: DEBUG oslo_concurrency.processutils [None req-20991d8a-8d8d-44b2-bbcb-730a513025c0 tempest-VolumesGetTest-1123317664 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-9d8c609f-25d2-4ff4-8faf-c8e9fecdde19 1073741824 {{(pid=84538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 19:06:43 devstack cinder-volume[84538]: DEBUG cinder.volume.manager [None req-d05cf30b-0c9d-4b6d-9e73-4bba5ab444b4 tempest-VolumeDependencyTests-1062757540 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c7a034f5-fddb-4ad0-81e8-f2e0a4cc7e20) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ca04e084-1b6b-4c31-ada9-fccf31334333', 'volume_size': 1}' {{(pid=84538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 19:06:43 devstack sudo[93009]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-9d8c609f-25d2-4ff4-8faf-c8e9fecdde19 1073741824 Apr 29 19:06:43 devstack sudo[93009]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 19:06:43 devstack cinder-volume[84538]: DEBUG cinder.volume.manager [None req-d05cf30b-0c9d-4b6d-9e73-4bba5ab444b4 tempest-VolumeDependencyTests-1062757540 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7dfe55da-523e-4610-9047-67c7fb88c857) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 19:06:43 devstack cinder-volume[84538]: INFO cinder.volume.flows.manager.create_volume [None req-d05cf30b-0c9d-4b6d-9e73-4bba5ab444b4 tempest-VolumeDependencyTests-1062757540 None] Volume volume-ca04e084-1b6b-4c31-ada9-fccf31334333 (ca04e084-1b6b-4c31-ada9-fccf31334333): created successfully Apr 29 19:06:43 devstack cinder-volume[84538]: DEBUG cinder.volume.manager [None req-d05cf30b-0c9d-4b6d-9e73-4bba5ab444b4 tempest-VolumeDependencyTests-1062757540 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7dfe55da-523e-4610-9047-67c7fb88c857) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 19:06:43 devstack cinder-volume[84538]: DEBUG cinder.volume.manager [None req-d05cf30b-0c9d-4b6d-9e73-4bba5ab444b4 tempest-VolumeDependencyTests-1062757540 None] Flow 'volume_create_manager' (8553f841-3a34-42c8-b8e1-b0757aacb5ed) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84538) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 19:06:43 devstack cinder-volume[84538]: INFO cinder.volume.manager [None req-d05cf30b-0c9d-4b6d-9e73-4bba5ab444b4 tempest-VolumeDependencyTests-1062757540 None] Created volume successfully. Apr 29 19:06:44 devstack sudo[93009]: pam_unix(sudo:session): session closed for user root Apr 29 19:06:44 devstack cinder-volume[84538]: DEBUG oslo_concurrency.processutils [None req-20991d8a-8d8d-44b2-bbcb-730a513025c0 tempest-VolumesGetTest-1123317664 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-9d8c609f-25d2-4ff4-8faf-c8e9fecdde19 1073741824" returned: 0 in 0.772s {{(pid=84538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 19:06:44 devstack cinder-volume[84538]: DEBUG oslo_concurrency.processutils [None req-20991d8a-8d8d-44b2-bbcb-730a513025c0 tempest-VolumesGetTest-1123317664 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-9d8c609f-25d2-4ff4-8faf-c8e9fecdde19 {{(pid=84538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 19:06:44 devstack cinder-volume[84538]: DEBUG oslo_concurrency.lockutils [None req-52f24a2a-dd53-4be0-99e9-c873aa35cd0d tempest-VolumeDependencyTests-1062757540 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=84538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 19:06:44 devstack sudo[93015]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-9d8c609f-25d2-4ff4-8faf-c8e9fecdde19 Apr 29 19:06:44 devstack sudo[93015]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 19:06:44 devstack sudo[93015]: pam_unix(sudo:session): session closed for user root Apr 29 19:06:44 devstack cinder-volume[84538]: DEBUG oslo_concurrency.processutils [None req-20991d8a-8d8d-44b2-bbcb-730a513025c0 tempest-VolumesGetTest-1123317664 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-9d8c609f-25d2-4ff4-8faf-c8e9fecdde19" returned: 0 in 0.581s {{(pid=84538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 19:06:44 devstack cinder-volume[84538]: DEBUG cinder.volume.drivers.quobyte [None req-20991d8a-8d8d-44b2-bbcb-730a513025c0 tempest-VolumesGetTest-1123317664 None] <== create_volume: return (1417ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-34312b00-dd6d-45bb-af98-75855cea8e48'} {{(pid=84538) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 29 19:06:44 devstack cinder-volume[84538]: DEBUG oslo_concurrency.lockutils [None req-20991d8a-8d8d-44b2-bbcb-730a513025c0 tempest-VolumesGetTest-1123317664 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.420s {{(pid=84538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 19:06:44 devstack cinder-volume[84538]: DEBUG oslo_concurrency.lockutils [None req-52f24a2a-dd53-4be0-99e9-c873aa35cd0d tempest-VolumeDependencyTests-1062757540 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.576s {{(pid=84538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 19:06:44 devstack cinder-volume[84538]: DEBUG cinder.volume.manager [None req-20991d8a-8d8d-44b2-bbcb-730a513025c0 tempest-VolumesGetTest-1123317664 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (164692f4-b4a2-4d7d-8cb9-62d9cc0c6e65) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9d8c609f-25d2-4ff4-8faf-c8e9fecdde19', 'volume_size': 1}' {{(pid=84538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 19:06:44 devstack cinder-volume[84538]: DEBUG cinder.volume.manager [None req-20991d8a-8d8d-44b2-bbcb-730a513025c0 tempest-VolumesGetTest-1123317664 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2ae08233-de78-492a-93e3-6dbc17a3c115) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 19:06:44 devstack cinder-volume[84538]: DEBUG cinder.volume.drivers.remotefs [None req-52f24a2a-dd53-4be0-99e9-c873aa35cd0d tempest-VolumeDependencyTests-1062757540 None] Creating offline snapshot 8ce94956-a586-484a-8db6-5260369e963b of volume ca04e084-1b6b-4c31-ada9-fccf31334333 {{(pid=84538) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}} Apr 29 19:06:44 devstack cinder-volume[84538]: INFO cinder.volume.flows.manager.create_volume [None req-20991d8a-8d8d-44b2-bbcb-730a513025c0 tempest-VolumesGetTest-1123317664 None] Volume volume-9d8c609f-25d2-4ff4-8faf-c8e9fecdde19 (9d8c609f-25d2-4ff4-8faf-c8e9fecdde19): created successfully Apr 29 19:06:44 devstack cinder-volume[84538]: DEBUG cinder.volume.manager [None req-20991d8a-8d8d-44b2-bbcb-730a513025c0 tempest-VolumesGetTest-1123317664 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2ae08233-de78-492a-93e3-6dbc17a3c115) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 19:06:44 devstack cinder-volume[84538]: DEBUG cinder.volume.manager [None req-20991d8a-8d8d-44b2-bbcb-730a513025c0 tempest-VolumesGetTest-1123317664 None] Flow 'volume_create_manager' (67c0f517-7d21-4ecd-be88-141ece1dfb4b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84538) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 19:06:44 devstack cinder-volume[84538]: DEBUG oslo.privsep.daemon [-] privsep: reply[337ab708-9403-4a73-8e51-10cffabcc2da]: (4, 'qcow2') {{(pid=85803) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 19:06:44 devstack cinder-volume[84538]: DEBUG oslo_concurrency.processutils [None req-52f24a2a-dd53-4be0-99e9-c873aa35cd0d tempest-VolumeDependencyTests-1062757540 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-ca04e084-1b6b-4c31-ada9-fccf31334333 {{(pid=84538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 19:06:44 devstack cinder-volume[84538]: INFO cinder.volume.manager [None req-20991d8a-8d8d-44b2-bbcb-730a513025c0 tempest-VolumesGetTest-1123317664 None] Created volume successfully. Apr 29 19:06:45 devstack sudo[93018]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-ca04e084-1b6b-4c31-ada9-fccf31334333 Apr 29 19:06:45 devstack sudo[93018]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 19:06:45 devstack cinder-volume[84538]: DEBUG cinder.coordination [None req-ef2b9142-80e8-495a-9792-f68e9c304148 tempest-VolumesGetTest-1123317664 None] Acquiring lock "cinder-9d8c609f-25d2-4ff4-8faf-c8e9fecdde19-delete_volume" by "delete_volume" {{(pid=84538) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 19:06:45 devstack cinder-volume[84538]: DEBUG cinder.coordination [None req-ef2b9142-80e8-495a-9792-f68e9c304148 tempest-VolumesGetTest-1123317664 None] Lock "cinder-9d8c609f-25d2-4ff4-8faf-c8e9fecdde19-delete_volume" acquired by "delete_volume" :: waited 0.031s {{(pid=84538) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 19:06:45 devstack cinder-volume[84538]: DEBUG cinder.coordination [None req-ef2b9142-80e8-495a-9792-f68e9c304148 tempest-VolumesGetTest-1123317664 None] Acquiring lock "cinder-quobyte-9d8c609f-25d2-4ff4-8faf-c8e9fecdde19" by "delete_volume" {{(pid=84538) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 19:06:45 devstack cinder-volume[84538]: DEBUG cinder.coordination [None req-ef2b9142-80e8-495a-9792-f68e9c304148 tempest-VolumesGetTest-1123317664 None] Lock "cinder-quobyte-9d8c609f-25d2-4ff4-8faf-c8e9fecdde19" acquired by "delete_volume" :: waited 0.012s {{(pid=84538) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 19:06:45 devstack cinder-volume[84538]: DEBUG oslo.privsep.daemon [-] privsep: reply[49aa1db4-d62d-47da-ad91-b9b3c44554d0]: (4, 'qcow2') {{(pid=85803) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 19:06:45 devstack cinder-volume[84538]: DEBUG oslo_concurrency.processutils [None req-ef2b9142-80e8-495a-9792-f68e9c304148 tempest-VolumesGetTest-1123317664 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-9d8c609f-25d2-4ff4-8faf-c8e9fecdde19 {{(pid=84538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 19:06:45 devstack sudo[93020]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-9d8c609f-25d2-4ff4-8faf-c8e9fecdde19 Apr 29 19:06:45 devstack sudo[93020]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 19:06:45 devstack sudo[93018]: pam_unix(sudo:session): session closed for user root Apr 29 19:06:45 devstack cinder-volume[84538]: DEBUG oslo_concurrency.processutils [None req-52f24a2a-dd53-4be0-99e9-c873aa35cd0d tempest-VolumeDependencyTests-1062757540 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-ca04e084-1b6b-4c31-ada9-fccf31334333" returned: 0 in 0.751s {{(pid=84538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 19:06:45 devstack cinder-volume[84538]: DEBUG oslo_concurrency.processutils [None req-52f24a2a-dd53-4be0-99e9-c873aa35cd0d tempest-VolumeDependencyTests-1062757540 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-ca04e084-1b6b-4c31-ada9-fccf31334333,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-ca04e084-1b6b-4c31-ada9-fccf31334333.8ce94956-a586-484a-8db6-5260369e963b 1G {{(pid=84538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 19:06:45 devstack sudo[93025]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-ca04e084-1b6b-4c31-ada9-fccf31334333,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-ca04e084-1b6b-4c31-ada9-fccf31334333.8ce94956-a586-484a-8db6-5260369e963b 1G Apr 29 19:06:45 devstack sudo[93025]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 19:06:46 devstack sudo[93020]: pam_unix(sudo:session): session closed for user root Apr 29 19:06:46 devstack cinder-volume[84538]: DEBUG oslo_concurrency.processutils [None req-ef2b9142-80e8-495a-9792-f68e9c304148 tempest-VolumesGetTest-1123317664 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-9d8c609f-25d2-4ff4-8faf-c8e9fecdde19" returned: 0 in 0.715s {{(pid=84538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 19:06:46 devstack cinder-volume[84538]: DEBUG oslo_concurrency.processutils [None req-ef2b9142-80e8-495a-9792-f68e9c304148 tempest-VolumesGetTest-1123317664 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-9d8c609f-25d2-4ff4-8faf-c8e9fecdde19 {{(pid=84538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 19:06:46 devstack sudo[93030]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-9d8c609f-25d2-4ff4-8faf-c8e9fecdde19 Apr 29 19:06:46 devstack sudo[93030]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 19:06:46 devstack sudo[93025]: pam_unix(sudo:session): session closed for user root Apr 29 19:06:46 devstack cinder-volume[84538]: DEBUG oslo_concurrency.processutils [None req-52f24a2a-dd53-4be0-99e9-c873aa35cd0d tempest-VolumeDependencyTests-1062757540 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-ca04e084-1b6b-4c31-ada9-fccf31334333,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-ca04e084-1b6b-4c31-ada9-fccf31334333.8ce94956-a586-484a-8db6-5260369e963b 1G" returned: 0 in 0.790s {{(pid=84538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 19:06:46 devstack cinder-volume[84538]: DEBUG oslo_concurrency.processutils [None req-52f24a2a-dd53-4be0-99e9-c873aa35cd0d tempest-VolumeDependencyTests-1062757540 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ca04e084-1b6b-4c31-ada9-fccf31334333 -F qcow2 /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-ca04e084-1b6b-4c31-ada9-fccf31334333.8ce94956-a586-484a-8db6-5260369e963b {{(pid=84538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 19:06:46 devstack sudo[93036]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ca04e084-1b6b-4c31-ada9-fccf31334333 -F qcow2 /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-ca04e084-1b6b-4c31-ada9-fccf31334333.8ce94956-a586-484a-8db6-5260369e963b Apr 29 19:06:46 devstack sudo[93036]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 19:06:46 devstack sudo[93030]: pam_unix(sudo:session): session closed for user root Apr 29 19:06:46 devstack cinder-volume[84538]: DEBUG oslo_concurrency.processutils [None req-ef2b9142-80e8-495a-9792-f68e9c304148 tempest-VolumesGetTest-1123317664 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-9d8c609f-25d2-4ff4-8faf-c8e9fecdde19" returned: 0 in 0.594s {{(pid=84538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 19:06:46 devstack cinder-volume[84538]: DEBUG cinder.coordination [None req-ef2b9142-80e8-495a-9792-f68e9c304148 tempest-VolumesGetTest-1123317664 None] Lock "cinder-quobyte-9d8c609f-25d2-4ff4-8faf-c8e9fecdde19" released by "delete_volume" :: held 1.348s {{(pid=84538) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 19:06:46 devstack cinder-volume[84538]: DEBUG dbcounter [-] [84538] Writing DB stats cinder:SELECT=126,cinder:INSERT=49,cinder:UPDATE=194,cinder:DELETE=15 {{(pid=84538) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Apr 29 19:06:46 devstack cinder-volume[84538]: DEBUG dbcounter [-] [84538] Writing DB stats cinder:UPDATE=172,cinder:SELECT=145,cinder:DELETE=17,cinder:INSERT=41 {{(pid=84538) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Apr 29 19:06:46 devstack cinder-volume[84538]: DEBUG cinder.quota [None req-ef2b9142-80e8-495a-9792-f68e9c304148 tempest-VolumesGetTest-1123317664 None] Created reservations ['f0b3d7c4-6e4f-42d5-a5ba-be731b9c2f0a', 'a0f48461-5660-4e76-be0c-1edb735b213a', '4c90274b-18bc-4599-9b05-0e10b31b5e8b', 'd06ef1c8-0d8d-463b-949d-00dd3614d282'] {{(pid=84538) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 29 19:06:46 devstack cinder-volume[84538]: DEBUG oslo_concurrency.lockutils [None req-ef2b9142-80e8-495a-9792-f68e9c304148 tempest-VolumesGetTest-1123317664 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 19:06:46 devstack cinder-volume[84538]: DEBUG oslo_concurrency.lockutils [None req-ef2b9142-80e8-495a-9792-f68e9c304148 tempest-VolumesGetTest-1123317664 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 19:06:46 devstack cinder-volume[84538]: DEBUG cinder.volume.drivers.quobyte [None req-ef2b9142-80e8-495a-9792-f68e9c304148 tempest-VolumesGetTest-1123317664 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-34312b00-dd6d-45bb-af98-75855cea8e48': None} {{(pid=84538) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 19:06:46 devstack cinder-volume[84538]: DEBUG cinder.volume.drivers.quobyte [None req-ef2b9142-80e8-495a-9792-f68e9c304148 tempest-VolumesGetTest-1123317664 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-34312b00-dd6d-45bb-af98-75855cea8e48'] {{(pid=84538) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 19:06:46 devstack cinder-volume[84538]: DEBUG oslo_concurrency.lockutils [None req-ef2b9142-80e8-495a-9792-f68e9c304148 tempest-VolumesGetTest-1123317664 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=84538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 19:06:46 devstack cinder-volume[84538]: DEBUG oslo_concurrency.processutils [None req-ef2b9142-80e8-495a-9792-f68e9c304148 tempest-VolumesGetTest-1123317664 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d {{(pid=84538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 19:06:46 devstack sudo[93039]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d Apr 29 19:06:46 devstack sudo[93039]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 19:06:47 devstack sudo[93036]: pam_unix(sudo:session): session closed for user root Apr 29 19:06:47 devstack cinder-volume[84538]: DEBUG oslo_concurrency.processutils [None req-52f24a2a-dd53-4be0-99e9-c873aa35cd0d tempest-VolumeDependencyTests-1062757540 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ca04e084-1b6b-4c31-ada9-fccf31334333 -F qcow2 /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-ca04e084-1b6b-4c31-ada9-fccf31334333.8ce94956-a586-484a-8db6-5260369e963b" returned: 0 in 0.642s {{(pid=84538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 19:06:47 devstack cinder-volume[84538]: WARNING cinder.volume.drivers.remotefs [None req-52f24a2a-dd53-4be0-99e9-c873aa35cd0d tempest-VolumeDependencyTests-1062757540 None] /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-ca04e084-1b6b-4c31-ada9-fccf31334333.8ce94956-a586-484a-8db6-5260369e963b is being set with open permissions: ugo+rw Apr 29 19:06:47 devstack cinder-volume[84538]: DEBUG oslo_concurrency.processutils [None req-52f24a2a-dd53-4be0-99e9-c873aa35cd0d tempest-VolumeDependencyTests-1062757540 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-ca04e084-1b6b-4c31-ada9-fccf31334333.8ce94956-a586-484a-8db6-5260369e963b {{(pid=84538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 19:06:47 devstack sudo[93078]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-ca04e084-1b6b-4c31-ada9-fccf31334333.8ce94956-a586-484a-8db6-5260369e963b Apr 29 19:06:47 devstack sudo[93078]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 19:06:47 devstack sudo[93039]: pam_unix(sudo:session): session closed for user root Apr 29 19:06:47 devstack cinder-volume[84538]: DEBUG oslo_concurrency.processutils [None req-ef2b9142-80e8-495a-9792-f68e9c304148 tempest-VolumesGetTest-1123317664 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d" returned: 0 in 0.650s {{(pid=84538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 19:06:47 devstack cinder-volume[84538]: DEBUG cinder.manager [None req-ef2b9142-80e8-495a-9792-f68e9c304148 tempest-VolumesGetTest-1123317664 None] Notifying Schedulers of capabilities ... {{(pid=84538) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 29 19:06:47 devstack cinder-volume[84538]: INFO cinder.volume.manager [None req-ef2b9142-80e8-495a-9792-f68e9c304148 tempest-VolumesGetTest-1123317664 None] Deleted volume successfully. Apr 29 19:06:47 devstack cinder-volume[84538]: DEBUG cinder.coordination [None req-ef2b9142-80e8-495a-9792-f68e9c304148 tempest-VolumesGetTest-1123317664 None] Lock "cinder-9d8c609f-25d2-4ff4-8faf-c8e9fecdde19-delete_volume" released by "delete_volume" :: held 2.229s {{(pid=84538) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 19:06:47 devstack cinder-volume[84538]: DEBUG cinder.coordination [None req-a16a1ba9-4c6c-4836-bfb3-26e944072279 tempest-VolumesGetTest-1123317664 None] Acquiring lock "cinder-f68dd373-afd4-4845-bef1-aaafa452f2d0-delete_volume" by "delete_volume" {{(pid=84538) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 19:06:47 devstack cinder-volume[84538]: DEBUG cinder.coordination [None req-a16a1ba9-4c6c-4836-bfb3-26e944072279 tempest-VolumesGetTest-1123317664 None] Lock "cinder-f68dd373-afd4-4845-bef1-aaafa452f2d0-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=84538) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 19:06:47 devstack cinder-volume[84538]: DEBUG cinder.coordination [None req-a16a1ba9-4c6c-4836-bfb3-26e944072279 tempest-VolumesGetTest-1123317664 None] Acquiring lock "cinder-quobyte-f68dd373-afd4-4845-bef1-aaafa452f2d0" by "delete_volume" {{(pid=84538) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 19:06:47 devstack cinder-volume[84538]: DEBUG cinder.coordination [None req-a16a1ba9-4c6c-4836-bfb3-26e944072279 tempest-VolumesGetTest-1123317664 None] Lock "cinder-quobyte-f68dd373-afd4-4845-bef1-aaafa452f2d0" acquired by "delete_volume" :: waited 0.015s {{(pid=84538) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 19:06:47 devstack cinder-volume[84538]: DEBUG oslo.privsep.daemon [-] privsep: reply[6a40b6da-b0e8-48cb-93c0-0b2953f8c1da]: (4, 'qcow2') {{(pid=85803) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 19:06:47 devstack cinder-volume[84538]: DEBUG oslo_concurrency.processutils [None req-a16a1ba9-4c6c-4836-bfb3-26e944072279 tempest-VolumesGetTest-1123317664 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-f68dd373-afd4-4845-bef1-aaafa452f2d0 {{(pid=84538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 19:06:47 devstack sudo[93078]: pam_unix(sudo:session): session closed for user root Apr 29 19:06:47 devstack cinder-volume[84538]: DEBUG oslo_concurrency.processutils [None req-52f24a2a-dd53-4be0-99e9-c873aa35cd0d tempest-VolumeDependencyTests-1062757540 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-ca04e084-1b6b-4c31-ada9-fccf31334333.8ce94956-a586-484a-8db6-5260369e963b" returned: 0 in 0.637s {{(pid=84538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 19:06:47 devstack sudo[93084]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-f68dd373-afd4-4845-bef1-aaafa452f2d0 Apr 29 19:06:47 devstack sudo[93084]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 19:06:47 devstack cinder-volume[84538]: DEBUG oslo_concurrency.processutils [None req-52f24a2a-dd53-4be0-99e9-c873aa35cd0d tempest-VolumeDependencyTests-1062757540 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-ca04e084-1b6b-4c31-ada9-fccf31334333.info {{(pid=84538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 19:06:47 devstack sudo[93086]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-ca04e084-1b6b-4c31-ada9-fccf31334333.info Apr 29 19:06:47 devstack sudo[93086]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 19:06:48 devstack sudo[93084]: pam_unix(sudo:session): session closed for user root Apr 29 19:06:48 devstack cinder-volume[84538]: DEBUG oslo_concurrency.processutils [None req-a16a1ba9-4c6c-4836-bfb3-26e944072279 tempest-VolumesGetTest-1123317664 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-f68dd373-afd4-4845-bef1-aaafa452f2d0" returned: 0 in 0.693s {{(pid=84538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 19:06:48 devstack cinder-volume[84538]: DEBUG oslo_concurrency.processutils [None req-a16a1ba9-4c6c-4836-bfb3-26e944072279 tempest-VolumesGetTest-1123317664 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-f68dd373-afd4-4845-bef1-aaafa452f2d0 {{(pid=84538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 19:06:48 devstack sudo[93086]: pam_unix(sudo:session): session closed for user root Apr 29 19:06:48 devstack cinder-volume[84538]: DEBUG oslo_concurrency.processutils [None req-52f24a2a-dd53-4be0-99e9-c873aa35cd0d tempest-VolumeDependencyTests-1062757540 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-ca04e084-1b6b-4c31-ada9-fccf31334333.info" returned: 0 in 0.602s {{(pid=84538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 19:06:48 devstack cinder-volume[84538]: WARNING cinder.volume.drivers.remotefs [None req-52f24a2a-dd53-4be0-99e9-c873aa35cd0d tempest-VolumeDependencyTests-1062757540 None] /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-ca04e084-1b6b-4c31-ada9-fccf31334333.info is being set with open permissions: ugo+rw Apr 29 19:06:48 devstack cinder-volume[84538]: DEBUG oslo_concurrency.processutils [None req-52f24a2a-dd53-4be0-99e9-c873aa35cd0d tempest-VolumeDependencyTests-1062757540 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-ca04e084-1b6b-4c31-ada9-fccf31334333.info {{(pid=84538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 19:06:48 devstack sudo[93092]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-f68dd373-afd4-4845-bef1-aaafa452f2d0 Apr 29 19:06:48 devstack sudo[93092]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 19:06:48 devstack sudo[93095]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-ca04e084-1b6b-4c31-ada9-fccf31334333.info Apr 29 19:06:48 devstack sudo[93095]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 19:06:48 devstack sudo[93092]: pam_unix(sudo:session): session closed for user root Apr 29 19:06:48 devstack cinder-volume[84538]: DEBUG oslo_concurrency.processutils [None req-a16a1ba9-4c6c-4836-bfb3-26e944072279 tempest-VolumesGetTest-1123317664 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-f68dd373-afd4-4845-bef1-aaafa452f2d0" returned: 0 in 0.623s {{(pid=84538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 19:06:48 devstack sudo[93095]: pam_unix(sudo:session): session closed for user root Apr 29 19:06:49 devstack cinder-volume[84538]: DEBUG oslo_concurrency.processutils [None req-52f24a2a-dd53-4be0-99e9-c873aa35cd0d tempest-VolumeDependencyTests-1062757540 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-ca04e084-1b6b-4c31-ada9-fccf31334333.info" returned: 0 in 0.608s {{(pid=84538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 19:06:49 devstack cinder-volume[84538]: DEBUG oslo_concurrency.lockutils [None req-52f24a2a-dd53-4be0-99e9-c873aa35cd0d tempest-VolumeDependencyTests-1062757540 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.141s {{(pid=84538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 19:06:49 devstack cinder-volume[84538]: DEBUG cinder.coordination [None req-a16a1ba9-4c6c-4836-bfb3-26e944072279 tempest-VolumesGetTest-1123317664 None] Lock "cinder-quobyte-f68dd373-afd4-4845-bef1-aaafa452f2d0" released by "delete_volume" :: held 1.373s {{(pid=84538) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 19:06:49 devstack cinder-volume[84538]: INFO cinder.volume.manager [None req-52f24a2a-dd53-4be0-99e9-c873aa35cd0d tempest-VolumeDependencyTests-1062757540 None] Create snapshot completed successfully Apr 29 19:06:49 devstack cinder-volume[84538]: DEBUG cinder.quota [None req-a16a1ba9-4c6c-4836-bfb3-26e944072279 tempest-VolumesGetTest-1123317664 None] Created reservations ['65327da2-d3b6-4c86-9944-75beb608b9bb', 'cfea125a-c71b-4bac-8bde-daa9362800f8', '95c1cbdf-84ce-4e3a-98f1-183fb6402251', '954db4af-48aa-4985-ad66-ab5d029d8a5f'] {{(pid=84538) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 29 19:06:49 devstack cinder-volume[84538]: DEBUG oslo_concurrency.lockutils [None req-a16a1ba9-4c6c-4836-bfb3-26e944072279 tempest-VolumesGetTest-1123317664 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 19:06:49 devstack cinder-volume[84538]: DEBUG oslo_concurrency.lockutils [None req-a16a1ba9-4c6c-4836-bfb3-26e944072279 tempest-VolumesGetTest-1123317664 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 19:06:49 devstack cinder-volume[84538]: DEBUG cinder.volume.drivers.quobyte [None req-a16a1ba9-4c6c-4836-bfb3-26e944072279 tempest-VolumesGetTest-1123317664 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-34312b00-dd6d-45bb-af98-75855cea8e48': None} {{(pid=84538) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 19:06:49 devstack cinder-volume[84538]: DEBUG cinder.volume.drivers.quobyte [None req-a16a1ba9-4c6c-4836-bfb3-26e944072279 tempest-VolumesGetTest-1123317664 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-34312b00-dd6d-45bb-af98-75855cea8e48'] {{(pid=84538) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 19:06:49 devstack cinder-volume[84538]: DEBUG oslo_concurrency.lockutils [None req-a16a1ba9-4c6c-4836-bfb3-26e944072279 tempest-VolumesGetTest-1123317664 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=84538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 19:06:49 devstack cinder-volume[84538]: DEBUG oslo_concurrency.processutils [None req-a16a1ba9-4c6c-4836-bfb3-26e944072279 tempest-VolumesGetTest-1123317664 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d {{(pid=84538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 19:06:49 devstack sudo[93099]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d Apr 29 19:06:49 devstack sudo[93099]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 19:06:49 devstack sudo[93099]: pam_unix(sudo:session): session closed for user root Apr 29 19:06:49 devstack cinder-volume[84538]: DEBUG oslo_concurrency.processutils [None req-a16a1ba9-4c6c-4836-bfb3-26e944072279 tempest-VolumesGetTest-1123317664 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d" returned: 0 in 0.600s {{(pid=84538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 19:06:49 devstack cinder-volume[84538]: DEBUG cinder.manager [None req-a16a1ba9-4c6c-4836-bfb3-26e944072279 tempest-VolumesGetTest-1123317664 None] Notifying Schedulers of capabilities ... {{(pid=84538) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 29 19:06:49 devstack cinder-volume[84538]: INFO cinder.volume.manager [None req-a16a1ba9-4c6c-4836-bfb3-26e944072279 tempest-VolumesGetTest-1123317664 None] Deleted volume successfully. Apr 29 19:06:49 devstack cinder-volume[84538]: DEBUG cinder.coordination [None req-a16a1ba9-4c6c-4836-bfb3-26e944072279 tempest-VolumesGetTest-1123317664 None] Lock "cinder-f68dd373-afd4-4845-bef1-aaafa452f2d0-delete_volume" released by "delete_volume" :: held 2.186s {{(pid=84538) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 19:06:49 devstack cinder-volume[84538]: DEBUG cinder.coordination [None req-02e2c88b-5475-4edf-ac11-d6cb7fb724ee tempest-VolumesGetTest-1123317664 None] Acquiring lock "cinder-45f08e10-8cbe-4648-93eb-f78f3719bce1-delete_volume" by "delete_volume" {{(pid=84538) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 19:06:49 devstack cinder-volume[84538]: DEBUG cinder.coordination [None req-02e2c88b-5475-4edf-ac11-d6cb7fb724ee tempest-VolumesGetTest-1123317664 None] Lock "cinder-45f08e10-8cbe-4648-93eb-f78f3719bce1-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=84538) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 19:06:49 devstack cinder-volume[84538]: DEBUG cinder.volume.flows.manager.create_volume [None req-41c19e72-c3c8-478c-8055-0880cd7bb175 tempest-VolumeDependencyTests-1062757540 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84538) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Apr 29 19:06:49 devstack cinder-volume[84538]: DEBUG cinder.coordination [None req-02e2c88b-5475-4edf-ac11-d6cb7fb724ee tempest-VolumesGetTest-1123317664 None] Acquiring lock "cinder-quobyte-45f08e10-8cbe-4648-93eb-f78f3719bce1" by "delete_volume" {{(pid=84538) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 19:06:49 devstack cinder-volume[84538]: DEBUG cinder.coordination [None req-02e2c88b-5475-4edf-ac11-d6cb7fb724ee tempest-VolumesGetTest-1123317664 None] Lock "cinder-quobyte-45f08e10-8cbe-4648-93eb-f78f3719bce1" acquired by "delete_volume" :: waited 0.014s {{(pid=84538) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 19:06:50 devstack cinder-volume[84538]: DEBUG cinder.volume.manager [None req-41c19e72-c3c8-478c-8055-0880cd7bb175 tempest-VolumeDependencyTests-1062757540 None] Flow 'volume_create_manager' (d8de99e8-4efb-447c-8a69-e129ff2a10f1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84538) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 19:06:50 devstack cinder-volume[84538]: DEBUG cinder.volume.manager [None req-41c19e72-c3c8-478c-8055-0880cd7bb175 tempest-VolumeDependencyTests-1062757540 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (28fbc86e-eb25-409c-9860-02fed396bd55) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 19:06:50 devstack cinder-volume[84538]: DEBUG oslo.privsep.daemon [-] privsep: reply[09493a07-4235-430a-bead-88e30ebbc4b6]: (4, 'qcow2') {{(pid=85803) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 19:06:50 devstack cinder-volume[84538]: DEBUG oslo_concurrency.processutils [None req-02e2c88b-5475-4edf-ac11-d6cb7fb724ee tempest-VolumesGetTest-1123317664 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-45f08e10-8cbe-4648-93eb-f78f3719bce1 {{(pid=84538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 19:06:50 devstack cinder-volume[84538]: DEBUG cinder.volume.manager [None req-41c19e72-c3c8-478c-8055-0880cd7bb175 tempest-VolumeDependencyTests-1062757540 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (28fbc86e-eb25-409c-9860-02fed396bd55) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-29T17:06:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-1937050893',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=235eb4f3-03c9-4cdd-98f4-867934ccd0d6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='001d402393ae4453a65ebf0c689f4ce8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T17:06:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=8ce94956-a586-484a-8db6-5260369e963b,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T17:06:50Z,use_quota=True,user_id='9f67a47c6d1a42818af1ea2d7da1b6ae',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(62b05900-93e3-4190-a88f-1d87324303d1),volume_type_id=62b05900-93e3-4190-a88f-1d87324303d1)' {{(pid=84538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 19:06:50 devstack cinder-volume[84538]: DEBUG cinder.volume.manager [None req-41c19e72-c3c8-478c-8055-0880cd7bb175 tempest-VolumeDependencyTests-1062757540 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (467a6808-64c0-484f-a741-676e527dc6ed) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 19:06:50 devstack cinder-volume[84538]: DEBUG cinder.volume.manager [None req-41c19e72-c3c8-478c-8055-0880cd7bb175 tempest-VolumeDependencyTests-1062757540 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (467a6808-64c0-484f-a741-676e527dc6ed) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 19:06:50 devstack cinder-volume[84538]: DEBUG cinder.volume.manager [None req-41c19e72-c3c8-478c-8055-0880cd7bb175 tempest-VolumeDependencyTests-1062757540 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (153c5016-1c7d-49c5-b7d4-a661d6c61c94) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 19:06:50 devstack cinder-volume[84538]: DEBUG cinder.volume.manager [None req-41c19e72-c3c8-478c-8055-0880cd7bb175 tempest-VolumeDependencyTests-1062757540 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (153c5016-1c7d-49c5-b7d4-a661d6c61c94) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '235eb4f3-03c9-4cdd-98f4-867934ccd0d6', 'volume_name': 'volume-235eb4f3-03c9-4cdd-98f4-867934ccd0d6', 'volume_size': 1, 'snapshot_id': '8ce94956-a586-484a-8db6-5260369e963b'}' {{(pid=84538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 19:06:50 devstack cinder-volume[84538]: DEBUG cinder.volume.manager [None req-41c19e72-c3c8-478c-8055-0880cd7bb175 tempest-VolumeDependencyTests-1062757540 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (126b2c77-a628-4cc5-b62d-b9111d56bfd3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 19:06:50 devstack cinder-volume[84538]: DEBUG cinder.volume.manager [None req-41c19e72-c3c8-478c-8055-0880cd7bb175 tempest-VolumeDependencyTests-1062757540 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (126b2c77-a628-4cc5-b62d-b9111d56bfd3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 19:06:50 devstack cinder-volume[84538]: DEBUG cinder.volume.manager [None req-41c19e72-c3c8-478c-8055-0880cd7bb175 tempest-VolumeDependencyTests-1062757540 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6f52a026-b6d9-402a-a58b-38a2871f969e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 19:06:50 devstack cinder-volume[84538]: INFO cinder.volume.flows.manager.create_volume [None req-41c19e72-c3c8-478c-8055-0880cd7bb175 tempest-VolumeDependencyTests-1062757540 None] Volume 235eb4f3-03c9-4cdd-98f4-867934ccd0d6: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-235eb4f3-03c9-4cdd-98f4-867934ccd0d6', 'volume_size': 1, 'snapshot_id': '8ce94956-a586-484a-8db6-5260369e963b'} Apr 29 19:06:50 devstack cinder-volume[84538]: DEBUG oslo_concurrency.lockutils [None req-41c19e72-c3c8-478c-8055-0880cd7bb175 tempest-VolumeDependencyTests-1062757540 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=84538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 19:06:50 devstack cinder-volume[84538]: DEBUG oslo_concurrency.lockutils [None req-41c19e72-c3c8-478c-8055-0880cd7bb175 tempest-VolumeDependencyTests-1062757540 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=84538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 19:06:50 devstack cinder-volume[84538]: DEBUG cinder.coordination [None req-41c19e72-c3c8-478c-8055-0880cd7bb175 tempest-VolumeDependencyTests-1062757540 None] Acquiring lock "cinder-quobyte-8ce94956-a586-484a-8db6-5260369e963b-235eb4f3-03c9-4cdd-98f4-867934ccd0d6" by "_create_volume_from_snapshot" {{(pid=84538) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 19:06:50 devstack cinder-volume[84538]: DEBUG cinder.coordination [None req-41c19e72-c3c8-478c-8055-0880cd7bb175 tempest-VolumeDependencyTests-1062757540 None] Lock "cinder-quobyte-8ce94956-a586-484a-8db6-5260369e963b-235eb4f3-03c9-4cdd-98f4-867934ccd0d6" acquired by "_create_volume_from_snapshot" :: waited 0.014s {{(pid=84538) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 19:06:50 devstack cinder-volume[84538]: DEBUG cinder.volume.drivers.quobyte [None req-41c19e72-c3c8-478c-8055-0880cd7bb175 tempest-VolumeDependencyTests-1062757540 None] Creating volume 235eb4f3-03c9-4cdd-98f4-867934ccd0d6 from snapshot 8ce94956-a586-484a-8db6-5260369e963b {{(pid=84538) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:356}} Apr 29 19:06:50 devstack cinder-volume[84538]: DEBUG oslo_concurrency.lockutils [None req-41c19e72-c3c8-478c-8055-0880cd7bb175 tempest-VolumeDependencyTests-1062757540 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 19:06:50 devstack cinder-volume[84538]: DEBUG oslo_concurrency.lockutils [None req-41c19e72-c3c8-478c-8055-0880cd7bb175 tempest-VolumeDependencyTests-1062757540 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=84538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 19:06:50 devstack cinder-volume[84538]: DEBUG cinder.volume.drivers.quobyte [None req-41c19e72-c3c8-478c-8055-0880cd7bb175 tempest-VolumeDependencyTests-1062757540 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-34312b00-dd6d-45bb-af98-75855cea8e48': None} {{(pid=84538) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 19:06:50 devstack cinder-volume[84538]: DEBUG cinder.volume.drivers.quobyte [None req-41c19e72-c3c8-478c-8055-0880cd7bb175 tempest-VolumeDependencyTests-1062757540 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-34312b00-dd6d-45bb-af98-75855cea8e48'] {{(pid=84538) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 19:06:50 devstack cinder-volume[84538]: DEBUG oslo_concurrency.lockutils [None req-41c19e72-c3c8-478c-8055-0880cd7bb175 tempest-VolumeDependencyTests-1062757540 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=84538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 19:06:50 devstack cinder-volume[84538]: DEBUG cinder.volume.drivers.quobyte [None req-41c19e72-c3c8-478c-8055-0880cd7bb175 tempest-VolumeDependencyTests-1062757540 None] Selected osci02.corp.quobyte.com/cinder-vol-34312b00-dd6d-45bb-af98-75855cea8e48 as target Quobyte volume. {{(pid=84538) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 29 19:06:50 devstack cinder-volume[84538]: DEBUG cinder.coordination [None req-41c19e72-c3c8-478c-8055-0880cd7bb175 tempest-VolumeDependencyTests-1062757540 None] Acquiring lock "cinder-quobyte-235eb4f3-03c9-4cdd-98f4-867934ccd0d6" by "_copy_volume_from_snapshot" {{(pid=84538) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 19:06:50 devstack cinder-volume[84538]: DEBUG cinder.coordination [None req-41c19e72-c3c8-478c-8055-0880cd7bb175 tempest-VolumeDependencyTests-1062757540 None] Lock "cinder-quobyte-235eb4f3-03c9-4cdd-98f4-867934ccd0d6" acquired by "_copy_volume_from_snapshot" :: waited 0.014s {{(pid=84538) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 19:06:50 devstack cinder-volume[84538]: DEBUG cinder.volume.drivers.quobyte [None req-41c19e72-c3c8-478c-8055-0880cd7bb175 tempest-VolumeDependencyTests-1062757540 None] snapshot: 8ce94956-a586-484a-8db6-5260369e963b, volume: 235eb4f3-03c9-4cdd-98f4-867934ccd0d6, {{(pid=84538) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Apr 29 19:06:50 devstack sudo[93102]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-45f08e10-8cbe-4648-93eb-f78f3719bce1 Apr 29 19:06:50 devstack sudo[93102]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 19:06:50 devstack cinder-volume[84538]: DEBUG oslo_concurrency.lockutils [None req-41c19e72-c3c8-478c-8055-0880cd7bb175 tempest-VolumeDependencyTests-1062757540 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 19:06:50 devstack cinder-volume[84538]: DEBUG oslo_concurrency.lockutils [None req-41c19e72-c3c8-478c-8055-0880cd7bb175 tempest-VolumeDependencyTests-1062757540 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 19:06:50 devstack cinder-volume[84538]: DEBUG cinder.volume.drivers.quobyte [None req-41c19e72-c3c8-478c-8055-0880cd7bb175 tempest-VolumeDependencyTests-1062757540 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-34312b00-dd6d-45bb-af98-75855cea8e48': None} {{(pid=84538) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 19:06:50 devstack cinder-volume[84538]: DEBUG cinder.volume.drivers.quobyte [None req-41c19e72-c3c8-478c-8055-0880cd7bb175 tempest-VolumeDependencyTests-1062757540 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-34312b00-dd6d-45bb-af98-75855cea8e48'] {{(pid=84538) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 19:06:50 devstack cinder-volume[84538]: DEBUG oslo_concurrency.lockutils [None req-41c19e72-c3c8-478c-8055-0880cd7bb175 tempest-VolumeDependencyTests-1062757540 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=84538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 19:06:50 devstack cinder-volume[84538]: DEBUG oslo.privsep.daemon [-] privsep: reply[2c839801-073b-4ccd-a9b9-ac85d43a33c1]: (4, 'qcow2') {{(pid=85803) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 19:06:50 devstack cinder-volume[84538]: DEBUG oslo_concurrency.processutils [None req-41c19e72-c3c8-478c-8055-0880cd7bb175 tempest-VolumeDependencyTests-1062757540 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-ca04e084-1b6b-4c31-ada9-fccf31334333.8ce94956-a586-484a-8db6-5260369e963b {{(pid=84538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 19:06:50 devstack sudo[93104]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-ca04e084-1b6b-4c31-ada9-fccf31334333.8ce94956-a586-484a-8db6-5260369e963b Apr 29 19:06:50 devstack sudo[93104]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 19:06:50 devstack sudo[93102]: pam_unix(sudo:session): session closed for user root Apr 29 19:06:50 devstack cinder-volume[84538]: DEBUG oslo_concurrency.processutils [None req-02e2c88b-5475-4edf-ac11-d6cb7fb724ee tempest-VolumesGetTest-1123317664 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-45f08e10-8cbe-4648-93eb-f78f3719bce1" returned: 0 in 0.743s {{(pid=84538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 19:06:50 devstack cinder-volume[84538]: DEBUG oslo_concurrency.processutils [None req-02e2c88b-5475-4edf-ac11-d6cb7fb724ee tempest-VolumesGetTest-1123317664 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-45f08e10-8cbe-4648-93eb-f78f3719bce1 {{(pid=84538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 19:06:50 devstack sudo[93112]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-45f08e10-8cbe-4648-93eb-f78f3719bce1 Apr 29 19:06:50 devstack sudo[93112]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 19:06:50 devstack sudo[93104]: pam_unix(sudo:session): session closed for user root Apr 29 19:06:50 devstack cinder-volume[84538]: DEBUG oslo_concurrency.processutils [None req-41c19e72-c3c8-478c-8055-0880cd7bb175 tempest-VolumeDependencyTests-1062757540 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-ca04e084-1b6b-4c31-ada9-fccf31334333.8ce94956-a586-484a-8db6-5260369e963b" returned: 0 in 0.687s {{(pid=84538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 19:06:50 devstack cinder-volume[84538]: DEBUG cinder.volume.drivers.remotefs [None req-41c19e72-c3c8-478c-8055-0880cd7bb175 tempest-VolumeDependencyTests-1062757540 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-ca04e084-1b6b-4c31-ada9-fccf31334333(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=84538) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 29 19:06:50 devstack cinder-volume[84538]: DEBUG cinder.volume.drivers.quobyte [None req-41c19e72-c3c8-478c-8055-0880cd7bb175 tempest-VolumeDependencyTests-1062757540 None] will copy from snapshot at /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-ca04e084-1b6b-4c31-ada9-fccf31334333 {{(pid=84538) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Apr 29 19:06:50 devstack cinder-volume[84538]: DEBUG cinder.volume.drivers.quobyte [None req-41c19e72-c3c8-478c-8055-0880cd7bb175 tempest-VolumeDependencyTests-1062757540 None] Creating direct copy from snapshot {{(pid=84538) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Apr 29 19:06:50 devstack cinder-volume[84538]: DEBUG oslo.privsep.daemon [-] privsep: reply[bcabcd7a-65e2-4598-a0fc-1fc83b4a023f]: (4, 'qcow2') {{(pid=85803) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 19:06:50 devstack cinder-volume[84538]: DEBUG oslo_concurrency.processutils [None req-41c19e72-c3c8-478c-8055-0880cd7bb175 tempest-VolumeDependencyTests-1062757540 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-ca04e084-1b6b-4c31-ada9-fccf31334333 {{(pid=84538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 19:06:50 devstack sudo[93114]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-ca04e084-1b6b-4c31-ada9-fccf31334333 Apr 29 19:06:50 devstack sudo[93114]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 19:06:51 devstack sudo[93112]: pam_unix(sudo:session): session closed for user root Apr 29 19:06:51 devstack cinder-volume[84538]: DEBUG oslo_concurrency.processutils [None req-02e2c88b-5475-4edf-ac11-d6cb7fb724ee tempest-VolumesGetTest-1123317664 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-45f08e10-8cbe-4648-93eb-f78f3719bce1" returned: 0 in 0.617s {{(pid=84538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 19:06:51 devstack cinder-volume[84538]: DEBUG cinder.coordination [None req-02e2c88b-5475-4edf-ac11-d6cb7fb724ee tempest-VolumesGetTest-1123317664 None] Lock "cinder-quobyte-45f08e10-8cbe-4648-93eb-f78f3719bce1" released by "delete_volume" :: held 1.431s {{(pid=84538) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 19:06:51 devstack cinder-volume[84538]: DEBUG cinder.quota [None req-02e2c88b-5475-4edf-ac11-d6cb7fb724ee tempest-VolumesGetTest-1123317664 None] Created reservations ['79e3c4a1-4f65-437e-afb2-8fc2eeb17cce', '89f67239-56be-405d-bf09-fdbc5bf8bbe9', '450c7ad4-0ba0-48b6-a9fa-45b8ee036b5a', 'c9089f89-b145-4628-beb0-0dd76943f0a0'] {{(pid=84538) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 29 19:06:51 devstack cinder-volume[84538]: DEBUG oslo_concurrency.lockutils [None req-02e2c88b-5475-4edf-ac11-d6cb7fb724ee tempest-VolumesGetTest-1123317664 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 19:06:51 devstack cinder-volume[84538]: DEBUG oslo_concurrency.lockutils [None req-02e2c88b-5475-4edf-ac11-d6cb7fb724ee tempest-VolumesGetTest-1123317664 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 19:06:51 devstack cinder-volume[84538]: DEBUG cinder.volume.drivers.quobyte [None req-02e2c88b-5475-4edf-ac11-d6cb7fb724ee tempest-VolumesGetTest-1123317664 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-34312b00-dd6d-45bb-af98-75855cea8e48': None} {{(pid=84538) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 19:06:51 devstack cinder-volume[84538]: DEBUG cinder.volume.drivers.quobyte [None req-02e2c88b-5475-4edf-ac11-d6cb7fb724ee tempest-VolumesGetTest-1123317664 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-34312b00-dd6d-45bb-af98-75855cea8e48'] {{(pid=84538) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 19:06:51 devstack cinder-volume[84538]: DEBUG oslo_concurrency.lockutils [None req-02e2c88b-5475-4edf-ac11-d6cb7fb724ee tempest-VolumesGetTest-1123317664 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=84538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 19:06:51 devstack cinder-volume[84538]: DEBUG oslo_concurrency.processutils [None req-02e2c88b-5475-4edf-ac11-d6cb7fb724ee tempest-VolumesGetTest-1123317664 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d {{(pid=84538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 19:06:51 devstack sudo[93120]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d Apr 29 19:06:51 devstack sudo[93120]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 19:06:51 devstack sudo[93114]: pam_unix(sudo:session): session closed for user root Apr 29 19:06:51 devstack cinder-volume[84538]: DEBUG oslo_concurrency.processutils [None req-41c19e72-c3c8-478c-8055-0880cd7bb175 tempest-VolumeDependencyTests-1062757540 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-ca04e084-1b6b-4c31-ada9-fccf31334333" returned: 0 in 0.732s {{(pid=84538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 19:06:51 devstack cinder-volume[84538]: DEBUG cinder.utils [None req-41c19e72-c3c8-478c-8055-0880cd7bb175 tempest-VolumeDependencyTests-1062757540 None] Path /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-235eb4f3-03c9-4cdd-98f4-867934ccd0d6 not found in is_blk_device check {{(pid=84538) is_blk_device /opt/stack/cinder/cinder/utils.py:602}} Apr 29 19:06:51 devstack cinder-volume[84538]: DEBUG oslo_concurrency.processutils [None req-41c19e72-c3c8-478c-8055-0880cd7bb175 tempest-VolumeDependencyTests-1062757540 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-ca04e084-1b6b-4c31-ada9-fccf31334333 /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-235eb4f3-03c9-4cdd-98f4-867934ccd0d6 {{(pid=84538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 19:06:51 devstack sudo[93122]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-ca04e084-1b6b-4c31-ada9-fccf31334333 /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-235eb4f3-03c9-4cdd-98f4-867934ccd0d6 Apr 29 19:06:51 devstack sudo[93122]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 19:06:52 devstack sudo[93120]: pam_unix(sudo:session): session closed for user root Apr 29 19:06:52 devstack cinder-volume[84538]: DEBUG oslo_concurrency.processutils [None req-02e2c88b-5475-4edf-ac11-d6cb7fb724ee tempest-VolumesGetTest-1123317664 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d" returned: 0 in 0.639s {{(pid=84538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 19:06:52 devstack cinder-volume[84538]: DEBUG cinder.manager [None req-02e2c88b-5475-4edf-ac11-d6cb7fb724ee tempest-VolumesGetTest-1123317664 None] Notifying Schedulers of capabilities ... {{(pid=84538) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 29 19:06:52 devstack cinder-volume[84538]: INFO cinder.volume.manager [None req-02e2c88b-5475-4edf-ac11-d6cb7fb724ee tempest-VolumesGetTest-1123317664 None] Deleted volume successfully. Apr 29 19:06:52 devstack cinder-volume[84538]: DEBUG cinder.coordination [None req-02e2c88b-5475-4edf-ac11-d6cb7fb724ee tempest-VolumesGetTest-1123317664 None] Lock "cinder-45f08e10-8cbe-4648-93eb-f78f3719bce1-delete_volume" released by "delete_volume" :: held 2.283s {{(pid=84538) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 19:06:53 devstack cinder-volume[84538]: DEBUG cinder.volume.flows.manager.create_volume [None req-268fe71f-ce36-4765-a3eb-263d8bce444d tempest-VolumesGetTest-1123317664 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84538) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Apr 29 19:06:53 devstack cinder-volume[84538]: DEBUG cinder.volume.manager [None req-268fe71f-ce36-4765-a3eb-263d8bce444d tempest-VolumesGetTest-1123317664 None] Flow 'volume_create_manager' (c06ea9f1-0329-4a16-91c2-929d5db7b337) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84538) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 19:06:53 devstack cinder-volume[84538]: DEBUG cinder.volume.manager [None req-268fe71f-ce36-4765-a3eb-263d8bce444d tempest-VolumesGetTest-1123317664 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fd393c0a-8e1b-4d01-9a9e-f86d3a5e5357) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 19:06:53 devstack cinder-volume[84538]: DEBUG cinder.volume.manager [None req-268fe71f-ce36-4765-a3eb-263d8bce444d tempest-VolumesGetTest-1123317664 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fd393c0a-8e1b-4d01-9a9e-f86d3a5e5357) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-29T17:06:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-423077539',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=179e2c93-6df9-40f4-88d6-88c3cb9bf54b,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='62ab81799a05449b9f5b7eb23c6c9071',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T17:06:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T17:06:53Z,use_quota=True,user_id='2c9aaf152c0f49d3887038450048a477',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(62b05900-93e3-4190-a88f-1d87324303d1),volume_type_id=62b05900-93e3-4190-a88f-1d87324303d1)' {{(pid=84538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 19:06:53 devstack cinder-volume[84538]: DEBUG cinder.volume.manager [None req-268fe71f-ce36-4765-a3eb-263d8bce444d tempest-VolumesGetTest-1123317664 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (72a00be0-ed9c-4754-b93c-848db8042969) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 19:06:53 devstack cinder-volume[84538]: DEBUG cinder.volume.manager [None req-268fe71f-ce36-4765-a3eb-263d8bce444d tempest-VolumesGetTest-1123317664 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (72a00be0-ed9c-4754-b93c-848db8042969) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 19:06:53 devstack cinder-volume[84538]: DEBUG cinder.volume.manager [None req-268fe71f-ce36-4765-a3eb-263d8bce444d tempest-VolumesGetTest-1123317664 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0ae83160-eca4-4d0c-9902-75d25c802763) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 19:06:53 devstack cinder-volume[84538]: DEBUG cinder.image.glance [None req-268fe71f-ce36-4765-a3eb-263d8bce444d tempest-VolumesGetTest-1123317664 None] Creating Keystone auth plugin from conf {{(pid=84538) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Apr 29 19:06:54 devstack cinder-volume[84538]: DEBUG cinder.volume.manager [None req-268fe71f-ce36-4765-a3eb-263d8bce444d tempest-VolumesGetTest-1123317664 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0ae83160-eca4-4d0c-9902-75d25c802763) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '179e2c93-6df9-40f4-88d6-88c3cb9bf54b', 'volume_name': 'volume-179e2c93-6df9-40f4-88d6-88c3cb9bf54b', 'volume_size': 1, 'image_id': '11605644-0a6a-4a0a-b123-c09ab01cd4db', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/11605644-0a6a-4a0a-b123-c09ab01cd4db', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '853afc5ea27148009f8c02d351cf4d80', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '11605644-0a6a-4a0a-b123-c09ab01cd4db', 'created_at': datetime.datetime(2026, 4, 29, 16, 52, 8, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 4, 29, 16, 52, 10, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/11605644-0a6a-4a0a-b123-c09ab01cd4db/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=84538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 19:06:54 devstack cinder-volume[84538]: DEBUG cinder.volume.manager [None req-268fe71f-ce36-4765-a3eb-263d8bce444d tempest-VolumesGetTest-1123317664 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3178fb27-f7ee-4066-aa14-14495c26333e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 19:06:54 devstack cinder-volume[84538]: DEBUG cinder.volume.manager [None req-268fe71f-ce36-4765-a3eb-263d8bce444d tempest-VolumesGetTest-1123317664 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3178fb27-f7ee-4066-aa14-14495c26333e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 19:06:54 devstack cinder-volume[84538]: DEBUG cinder.volume.manager [None req-268fe71f-ce36-4765-a3eb-263d8bce444d tempest-VolumesGetTest-1123317664 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d3ce60e2-9053-44a1-8288-fed63eaea161) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 19:06:54 devstack cinder-volume[84538]: INFO cinder.volume.flows.manager.create_volume [None req-268fe71f-ce36-4765-a3eb-263d8bce444d tempest-VolumesGetTest-1123317664 None] Volume 179e2c93-6df9-40f4-88d6-88c3cb9bf54b: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-179e2c93-6df9-40f4-88d6-88c3cb9bf54b', 'volume_size': 1, 'image_id': '11605644-0a6a-4a0a-b123-c09ab01cd4db', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/11605644-0a6a-4a0a-b123-c09ab01cd4db', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '853afc5ea27148009f8c02d351cf4d80', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '11605644-0a6a-4a0a-b123-c09ab01cd4db', 'created_at': datetime.datetime(2026, 4, 29, 16, 52, 8, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 4, 29, 16, 52, 10, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/11605644-0a6a-4a0a-b123-c09ab01cd4db/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': } Apr 29 19:06:54 devstack cinder-volume[84538]: DEBUG cinder.volume.flows.manager.create_volume [None req-268fe71f-ce36-4765-a3eb-263d8bce444d tempest-VolumesGetTest-1123317664 None] Trying to clone 179e2c93-6df9-40f4-88d6-88c3cb9bf54b from image 11605644-0a6a-4a0a-b123-c09ab01cd4db at location (None, [{'url': 'file:///opt/stack/data/glance/images/11605644-0a6a-4a0a-b123-c09ab01cd4db', 'metadata': {}}]). {{(pid=84538) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1082}} Apr 29 19:06:54 devstack cinder-volume[84538]: DEBUG cinder.image.image_utils [None req-268fe71f-ce36-4765-a3eb-263d8bce444d tempest-VolumesGetTest-1123317664 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_11605644-0a6a-4a0a-b123-c09ab01cd4db_boychseidevstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=84538) fetch /opt/stack/cinder/cinder/image/image_utils.py:732}} Apr 29 19:06:54 devstack cinder-volume[84538]: INFO cinder.image.image_utils [None req-268fe71f-ce36-4765-a3eb-263d8bce444d tempest-VolumesGetTest-1123317664 None] Image download 20.69 MB at 20.69 MB/s Apr 29 19:06:55 devstack cinder-volume[84538]: DEBUG oslo.privsep.daemon [-] privsep: reply[96ae1acf-e8c7-4bdc-802d-3a1a1e7f7bcb]: (4, 'qcow2') {{(pid=85803) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 19:06:55 devstack cinder-volume[84538]: DEBUG oslo_concurrency.processutils [None req-268fe71f-ce36-4765-a3eb-263d8bce444d tempest-VolumesGetTest-1123317664 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_11605644-0a6a-4a0a-b123-c09ab01cd4db_boychseidevstack@QuobyteHD {{(pid=84538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 19:06:55 devstack sudo[93143]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_11605644-0a6a-4a0a-b123-c09ab01cd4db_boychseidevstack@QuobyteHD Apr 29 19:06:55 devstack sudo[93143]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 19:06:56 devstack sudo[93143]: pam_unix(sudo:session): session closed for user root Apr 29 19:06:56 devstack cinder-volume[84538]: DEBUG oslo_concurrency.processutils [None req-268fe71f-ce36-4765-a3eb-263d8bce444d tempest-VolumesGetTest-1123317664 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_11605644-0a6a-4a0a-b123-c09ab01cd4db_boychseidevstack@QuobyteHD" returned: 0 in 1.657s {{(pid=84538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 19:06:56 devstack cinder-volume[84538]: DEBUG cinder.image.image_utils [None req-268fe71f-ce36-4765-a3eb-263d8bce444d tempest-VolumesGetTest-1123317664 None] Temporary image 11605644-0a6a-4a0a-b123-c09ab01cd4db is fetched for user 2c9aaf152c0f49d3887038450048a477. {{(pid=84538) fetch /opt/stack/cinder/cinder/image/image_utils.py:1431}} Apr 29 19:06:56 devstack sudo[93122]: pam_unix(sudo:session): session closed for user root Apr 29 19:06:56 devstack cinder-volume[84538]: DEBUG oslo_concurrency.processutils [None req-41c19e72-c3c8-478c-8055-0880cd7bb175 tempest-VolumeDependencyTests-1062757540 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-ca04e084-1b6b-4c31-ada9-fccf31334333 /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-235eb4f3-03c9-4cdd-98f4-867934ccd0d6" returned: 0 in 5.140s {{(pid=84538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 19:06:56 devstack cinder-volume[84538]: DEBUG oslo.privsep.daemon [-] privsep: reply[cd5cd727-665a-40af-bbf5-ca20cef73eb2]: (4, 'qcow2') {{(pid=85803) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 19:06:56 devstack cinder-volume[84538]: DEBUG oslo_concurrency.processutils [None req-41c19e72-c3c8-478c-8055-0880cd7bb175 tempest-VolumeDependencyTests-1062757540 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-ca04e084-1b6b-4c31-ada9-fccf31334333 {{(pid=84538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 19:06:56 devstack cinder-volume[84538]: DEBUG oslo.privsep.daemon [-] privsep: reply[0ad613ac-c117-4c55-a1ab-cc41721a50c7]: (4, 'qcow2') {{(pid=85803) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 19:06:56 devstack cinder-volume[84538]: DEBUG oslo_concurrency.processutils [None req-268fe71f-ce36-4765-a3eb-263d8bce444d tempest-VolumesGetTest-1123317664 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_11605644-0a6a-4a0a-b123-c09ab01cd4db_boychseidevstack@QuobyteHD {{(pid=84538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 19:06:56 devstack sudo[93150]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-ca04e084-1b6b-4c31-ada9-fccf31334333 Apr 29 19:06:56 devstack sudo[93150]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 19:06:56 devstack sudo[93151]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_11605644-0a6a-4a0a-b123-c09ab01cd4db_boychseidevstack@QuobyteHD Apr 29 19:06:56 devstack sudo[93151]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 19:06:57 devstack sudo[93151]: pam_unix(sudo:session): session closed for user root Apr 29 19:06:57 devstack cinder-volume[84538]: DEBUG oslo_concurrency.processutils [None req-268fe71f-ce36-4765-a3eb-263d8bce444d tempest-VolumesGetTest-1123317664 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_11605644-0a6a-4a0a-b123-c09ab01cd4db_boychseidevstack@QuobyteHD" returned: 0 in 0.722s {{(pid=84538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 19:06:57 devstack cinder-volume[84538]: DEBUG oslo_concurrency.lockutils [None req-268fe71f-ce36-4765-a3eb-263d8bce444d tempest-VolumesGetTest-1123317664 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 19:06:57 devstack sudo[93150]: pam_unix(sudo:session): session closed for user root Apr 29 19:06:57 devstack cinder-volume[84538]: DEBUG oslo_concurrency.processutils [None req-41c19e72-c3c8-478c-8055-0880cd7bb175 tempest-VolumeDependencyTests-1062757540 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-ca04e084-1b6b-4c31-ada9-fccf31334333" returned: 0 in 0.905s {{(pid=84538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 19:06:57 devstack cinder-volume[84538]: DEBUG cinder.image.image_utils [None req-41c19e72-c3c8-478c-8055-0880cd7bb175 tempest-VolumeDependencyTests-1062757540 None] Image conversion details: src /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-ca04e084-1b6b-4c31-ada9-fccf31334333, size 1024.00 MB, duration 5.14 sec, destination /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-235eb4f3-03c9-4cdd-98f4-867934ccd0d6 {{(pid=84538) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}} Apr 29 19:06:57 devstack cinder-volume[84538]: INFO cinder.image.image_utils [None req-41c19e72-c3c8-478c-8055-0880cd7bb175 tempest-VolumeDependencyTests-1062757540 None] Converted 1024.00 MB image at 199.19 MB/s Apr 29 19:06:57 devstack cinder-volume[84538]: WARNING cinder.volume.drivers.remotefs [None req-41c19e72-c3c8-478c-8055-0880cd7bb175 tempest-VolumeDependencyTests-1062757540 None] /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-235eb4f3-03c9-4cdd-98f4-867934ccd0d6 is being set with open permissions: ugo+rw Apr 29 19:06:57 devstack cinder-volume[84538]: DEBUG oslo_concurrency.processutils [None req-41c19e72-c3c8-478c-8055-0880cd7bb175 tempest-VolumeDependencyTests-1062757540 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-235eb4f3-03c9-4cdd-98f4-867934ccd0d6 {{(pid=84538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 19:06:57 devstack sudo[93160]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-235eb4f3-03c9-4cdd-98f4-867934ccd0d6 Apr 29 19:06:57 devstack sudo[93160]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 19:06:58 devstack sudo[93160]: pam_unix(sudo:session): session closed for user root Apr 29 19:06:58 devstack cinder-volume[84538]: DEBUG oslo_concurrency.processutils [None req-41c19e72-c3c8-478c-8055-0880cd7bb175 tempest-VolumeDependencyTests-1062757540 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-235eb4f3-03c9-4cdd-98f4-867934ccd0d6" returned: 0 in 0.596s {{(pid=84538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 19:06:58 devstack cinder-volume[84538]: DEBUG cinder.coordination [None req-41c19e72-c3c8-478c-8055-0880cd7bb175 tempest-VolumeDependencyTests-1062757540 None] Lock "cinder-quobyte-235eb4f3-03c9-4cdd-98f4-867934ccd0d6" released by "_copy_volume_from_snapshot" :: held 8.157s {{(pid=84538) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 19:06:58 devstack cinder-volume[84538]: DEBUG cinder.coordination [None req-41c19e72-c3c8-478c-8055-0880cd7bb175 tempest-VolumeDependencyTests-1062757540 None] Lock "cinder-quobyte-8ce94956-a586-484a-8db6-5260369e963b-235eb4f3-03c9-4cdd-98f4-867934ccd0d6" released by "_create_volume_from_snapshot" :: held 8.190s {{(pid=84538) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 19:06:58 devstack cinder-volume[84538]: DEBUG oslo_concurrency.lockutils [None req-41c19e72-c3c8-478c-8055-0880cd7bb175 tempest-VolumeDependencyTests-1062757540 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 8.206s {{(pid=84538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 19:06:58 devstack cinder-volume[84538]: DEBUG oslo_concurrency.lockutils [None req-268fe71f-ce36-4765-a3eb-263d8bce444d tempest-VolumesGetTest-1123317664 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.770s {{(pid=84538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 19:06:58 devstack cinder-volume[84538]: DEBUG cinder.volume.drivers.quobyte [None req-268fe71f-ce36-4765-a3eb-263d8bce444d tempest-VolumesGetTest-1123317664 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-29T17:06:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-423077539',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=179e2c93-6df9-40f4-88d6-88c3cb9bf54b,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='62ab81799a05449b9f5b7eb23c6c9071',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T17:06:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T17:06:53Z,use_quota=True,user_id='2c9aaf152c0f49d3887038450048a477',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(62b05900-93e3-4190-a88f-1d87324303d1),volume_type_id=62b05900-93e3-4190-a88f-1d87324303d1)}" {{(pid=84538) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 29 19:06:58 devstack cinder-volume[84538]: DEBUG cinder.volume.drivers.remotefs [None req-268fe71f-ce36-4765-a3eb-263d8bce444d tempest-VolumesGetTest-1123317664 None] Creating volume 179e2c93-6df9-40f4-88d6-88c3cb9bf54b {{(pid=84538) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 29 19:06:58 devstack cinder-volume[84538]: DEBUG oslo_concurrency.lockutils [None req-268fe71f-ce36-4765-a3eb-263d8bce444d tempest-VolumesGetTest-1123317664 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 19:06:58 devstack cinder-volume[84538]: DEBUG oslo_concurrency.lockutils [None req-268fe71f-ce36-4765-a3eb-263d8bce444d tempest-VolumesGetTest-1123317664 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 19:06:58 devstack cinder-volume[84538]: DEBUG cinder.volume.drivers.quobyte [None req-268fe71f-ce36-4765-a3eb-263d8bce444d tempest-VolumesGetTest-1123317664 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-34312b00-dd6d-45bb-af98-75855cea8e48': None} {{(pid=84538) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 19:06:58 devstack cinder-volume[84538]: DEBUG cinder.volume.drivers.quobyte [None req-268fe71f-ce36-4765-a3eb-263d8bce444d tempest-VolumesGetTest-1123317664 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-34312b00-dd6d-45bb-af98-75855cea8e48'] {{(pid=84538) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 19:06:58 devstack cinder-volume[84538]: DEBUG oslo_concurrency.lockutils [None req-268fe71f-ce36-4765-a3eb-263d8bce444d tempest-VolumesGetTest-1123317664 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=84538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 19:06:58 devstack cinder-volume[84538]: DEBUG cinder.volume.drivers.quobyte [None req-268fe71f-ce36-4765-a3eb-263d8bce444d tempest-VolumesGetTest-1123317664 None] Selected osci02.corp.quobyte.com/cinder-vol-34312b00-dd6d-45bb-af98-75855cea8e48 as target Quobyte volume. {{(pid=84538) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 29 19:06:58 devstack cinder-volume[84538]: INFO cinder.volume.drivers.remotefs [None req-268fe71f-ce36-4765-a3eb-263d8bce444d tempest-VolumesGetTest-1123317664 None] casted to osci02.corp.quobyte.com/cinder-vol-34312b00-dd6d-45bb-af98-75855cea8e48 Apr 29 19:06:58 devstack cinder-volume[84538]: DEBUG oslo_concurrency.processutils [None req-268fe71f-ce36-4765-a3eb-263d8bce444d tempest-VolumesGetTest-1123317664 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-179e2c93-6df9-40f4-88d6-88c3cb9bf54b 1073741824 {{(pid=84538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 19:06:58 devstack sudo[93163]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-179e2c93-6df9-40f4-88d6-88c3cb9bf54b 1073741824 Apr 29 19:06:58 devstack sudo[93163]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 19:06:58 devstack cinder-volume[84538]: DEBUG cinder.volume.manager [None req-41c19e72-c3c8-478c-8055-0880cd7bb175 tempest-VolumeDependencyTests-1062757540 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6f52a026-b6d9-402a-a58b-38a2871f969e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-235eb4f3-03c9-4cdd-98f4-867934ccd0d6', 'volume_size': 1, 'snapshot_id': '8ce94956-a586-484a-8db6-5260369e963b'}' {{(pid=84538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 19:06:58 devstack cinder-volume[84538]: DEBUG cinder.volume.manager [None req-41c19e72-c3c8-478c-8055-0880cd7bb175 tempest-VolumeDependencyTests-1062757540 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8f913bb4-7d51-4a67-89d2-8325b10e835b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 19:06:58 devstack cinder-volume[84538]: INFO cinder.volume.flows.manager.create_volume [None req-41c19e72-c3c8-478c-8055-0880cd7bb175 tempest-VolumeDependencyTests-1062757540 None] Volume volume-235eb4f3-03c9-4cdd-98f4-867934ccd0d6 (235eb4f3-03c9-4cdd-98f4-867934ccd0d6): created successfully Apr 29 19:06:58 devstack cinder-volume[84538]: DEBUG cinder.volume.manager [None req-41c19e72-c3c8-478c-8055-0880cd7bb175 tempest-VolumeDependencyTests-1062757540 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8f913bb4-7d51-4a67-89d2-8325b10e835b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 19:06:58 devstack cinder-volume[84538]: DEBUG cinder.volume.manager [None req-41c19e72-c3c8-478c-8055-0880cd7bb175 tempest-VolumeDependencyTests-1062757540 None] Flow 'volume_create_manager' (d8de99e8-4efb-447c-8a69-e129ff2a10f1) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84538) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 19:06:58 devstack cinder-volume[84538]: INFO cinder.volume.manager [None req-41c19e72-c3c8-478c-8055-0880cd7bb175 tempest-VolumeDependencyTests-1062757540 None] Created volume successfully. Apr 29 19:06:58 devstack cinder-volume[84538]: DEBUG cinder.coordination [None req-f9c861e8-9e91-4653-b970-49b0993d5aa6 tempest-VolumeDependencyTests-1062757540 None] Acquiring lock "cinder-8ce94956-a586-484a-8db6-5260369e963b-delete_snapshot" by "delete_snapshot" {{(pid=84538) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 19:06:58 devstack cinder-volume[84538]: DEBUG cinder.coordination [None req-f9c861e8-9e91-4653-b970-49b0993d5aa6 tempest-VolumeDependencyTests-1062757540 None] Lock "cinder-8ce94956-a586-484a-8db6-5260369e963b-delete_snapshot" acquired by "delete_snapshot" :: waited 0.022s {{(pid=84538) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 19:06:58 devstack cinder-volume[84538]: DEBUG cinder.coordination [None req-f9c861e8-9e91-4653-b970-49b0993d5aa6 tempest-VolumeDependencyTests-1062757540 None] Acquiring lock "cinder-quobyte-ca04e084-1b6b-4c31-ada9-fccf31334333" by "delete_snapshot" {{(pid=84538) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 19:06:58 devstack cinder-volume[84538]: DEBUG cinder.coordination [None req-f9c861e8-9e91-4653-b970-49b0993d5aa6 tempest-VolumeDependencyTests-1062757540 None] Lock "cinder-quobyte-ca04e084-1b6b-4c31-ada9-fccf31334333" acquired by "delete_snapshot" :: waited 0.014s {{(pid=84538) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 19:06:58 devstack cinder-volume[84538]: DEBUG cinder.coordination [None req-f9c861e8-9e91-4653-b970-49b0993d5aa6 tempest-VolumeDependencyTests-1062757540 None] Acquiring lock "cinder-quobyte-8ce94956-a586-484a-8db6-5260369e963b" by "_delete_snapshot" {{(pid=84538) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 19:06:58 devstack cinder-volume[84538]: DEBUG cinder.coordination [None req-f9c861e8-9e91-4653-b970-49b0993d5aa6 tempest-VolumeDependencyTests-1062757540 None] Lock "cinder-quobyte-8ce94956-a586-484a-8db6-5260369e963b" acquired by "_delete_snapshot" :: waited 0.016s {{(pid=84538) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 19:06:58 devstack cinder-volume[84538]: DEBUG cinder.volume.drivers.remotefs [None req-f9c861e8-9e91-4653-b970-49b0993d5aa6 tempest-VolumeDependencyTests-1062757540 None] Deleting offline snapshot 8ce94956-a586-484a-8db6-5260369e963b of volume ca04e084-1b6b-4c31-ada9-fccf31334333 {{(pid=84538) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 29 19:06:58 devstack cinder-volume[84538]: DEBUG cinder.volume.drivers.remotefs [None req-f9c861e8-9e91-4653-b970-49b0993d5aa6 tempest-VolumeDependencyTests-1062757540 None] snapshot_file for this snap is: volume-ca04e084-1b6b-4c31-ada9-fccf31334333.8ce94956-a586-484a-8db6-5260369e963b {{(pid=84538) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 29 19:06:58 devstack cinder-volume[84538]: DEBUG oslo.privsep.daemon [-] privsep: reply[74ce3160-9cd5-42c7-a206-a3601b8548d3]: (4, 'qcow2') {{(pid=85803) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 19:06:58 devstack cinder-volume[84538]: DEBUG oslo_concurrency.processutils [None req-f9c861e8-9e91-4653-b970-49b0993d5aa6 tempest-VolumeDependencyTests-1062757540 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-ca04e084-1b6b-4c31-ada9-fccf31334333.8ce94956-a586-484a-8db6-5260369e963b {{(pid=84538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 19:06:59 devstack sudo[93170]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-ca04e084-1b6b-4c31-ada9-fccf31334333.8ce94956-a586-484a-8db6-5260369e963b Apr 29 19:06:59 devstack sudo[93170]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 19:06:59 devstack sudo[93163]: pam_unix(sudo:session): session closed for user root Apr 29 19:06:59 devstack cinder-volume[84538]: DEBUG oslo_concurrency.processutils [None req-268fe71f-ce36-4765-a3eb-263d8bce444d tempest-VolumesGetTest-1123317664 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-179e2c93-6df9-40f4-88d6-88c3cb9bf54b 1073741824" returned: 0 in 0.795s {{(pid=84538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 19:06:59 devstack cinder-volume[84538]: DEBUG oslo_concurrency.processutils [None req-268fe71f-ce36-4765-a3eb-263d8bce444d tempest-VolumesGetTest-1123317664 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-179e2c93-6df9-40f4-88d6-88c3cb9bf54b {{(pid=84538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 19:06:59 devstack sudo[93172]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-179e2c93-6df9-40f4-88d6-88c3cb9bf54b Apr 29 19:06:59 devstack sudo[93172]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 19:06:59 devstack sudo[93170]: pam_unix(sudo:session): session closed for user root Apr 29 19:06:59 devstack cinder-volume[84538]: DEBUG oslo_concurrency.processutils [None req-f9c861e8-9e91-4653-b970-49b0993d5aa6 tempest-VolumeDependencyTests-1062757540 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-ca04e084-1b6b-4c31-ada9-fccf31334333.8ce94956-a586-484a-8db6-5260369e963b" returned: 0 in 0.734s {{(pid=84538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 19:06:59 devstack cinder-volume[84538]: DEBUG cinder.volume.drivers.remotefs [None req-f9c861e8-9e91-4653-b970-49b0993d5aa6 tempest-VolumeDependencyTests-1062757540 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-ca04e084-1b6b-4c31-ada9-fccf31334333(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=84538) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 29 19:06:59 devstack cinder-volume[84538]: DEBUG oslo.privsep.daemon [-] privsep: reply[e364f9a0-e169-42af-968c-f096c3d9c3c0]: (4, 'qcow2') {{(pid=85803) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 19:06:59 devstack cinder-volume[84538]: DEBUG oslo_concurrency.processutils [None req-f9c861e8-9e91-4653-b970-49b0993d5aa6 tempest-VolumeDependencyTests-1062757540 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-ca04e084-1b6b-4c31-ada9-fccf31334333 {{(pid=84538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 19:06:59 devstack sudo[93172]: pam_unix(sudo:session): session closed for user root Apr 29 19:06:59 devstack cinder-volume[84538]: DEBUG oslo_concurrency.processutils [None req-268fe71f-ce36-4765-a3eb-263d8bce444d tempest-VolumesGetTest-1123317664 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-179e2c93-6df9-40f4-88d6-88c3cb9bf54b" returned: 0 in 0.584s {{(pid=84538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 19:06:59 devstack cinder-volume[84538]: DEBUG cinder.volume.drivers.quobyte [None req-268fe71f-ce36-4765-a3eb-263d8bce444d tempest-VolumesGetTest-1123317664 None] <== create_volume: return (1429ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-34312b00-dd6d-45bb-af98-75855cea8e48'} {{(pid=84538) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 29 19:06:59 devstack cinder-volume[84538]: DEBUG oslo_concurrency.lockutils [None req-268fe71f-ce36-4765-a3eb-263d8bce444d tempest-VolumesGetTest-1123317664 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.433s {{(pid=84538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 19:06:59 devstack cinder-volume[84538]: DEBUG cinder.volume.volume_utils [None req-268fe71f-ce36-4765-a3eb-263d8bce444d tempest-VolumesGetTest-1123317664 None] Attempting download of 11605644-0a6a-4a0a-b123-c09ab01cd4db ((None, [{'url': 'file:///opt/stack/data/glance/images/11605644-0a6a-4a0a-b123-c09ab01cd4db', 'metadata': {}}])) to volume 179e2c93-6df9-40f4-88d6-88c3cb9bf54b. {{(pid=84538) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1189}} Apr 29 19:06:59 devstack cinder-volume[84538]: DEBUG oslo.privsep.daemon [-] privsep: reply[28e8a008-f462-4c36-910e-8f1745570c50]: (4, 'raw') {{(pid=85803) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 19:06:59 devstack cinder-volume[84538]: DEBUG oslo_concurrency.processutils [None req-268fe71f-ce36-4765-a3eb-263d8bce444d tempest-VolumesGetTest-1123317664 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_11605644-0a6a-4a0a-b123-c09ab01cd4db_5dnyz1wq {{(pid=84538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 19:06:59 devstack sudo[93178]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-ca04e084-1b6b-4c31-ada9-fccf31334333 Apr 29 19:06:59 devstack sudo[93178]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 19:06:59 devstack sudo[93179]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_11605644-0a6a-4a0a-b123-c09ab01cd4db_5dnyz1wq Apr 29 19:06:59 devstack sudo[93179]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 19:07:00 devstack sudo[93178]: pam_unix(sudo:session): session closed for user root Apr 29 19:07:00 devstack cinder-volume[84538]: DEBUG oslo_concurrency.processutils [None req-f9c861e8-9e91-4653-b970-49b0993d5aa6 tempest-VolumeDependencyTests-1062757540 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-ca04e084-1b6b-4c31-ada9-fccf31334333" returned: 0 in 0.757s {{(pid=84538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 19:07:00 devstack cinder-volume[84538]: DEBUG oslo_concurrency.processutils [None req-f9c861e8-9e91-4653-b970-49b0993d5aa6 tempest-VolumeDependencyTests-1062757540 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-ca04e084-1b6b-4c31-ada9-fccf31334333.8ce94956-a586-484a-8db6-5260369e963b {{(pid=84538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 19:07:00 devstack sudo[93179]: pam_unix(sudo:session): session closed for user root Apr 29 19:07:00 devstack cinder-volume[84538]: DEBUG oslo_concurrency.processutils [None req-268fe71f-ce36-4765-a3eb-263d8bce444d tempest-VolumesGetTest-1123317664 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_11605644-0a6a-4a0a-b123-c09ab01cd4db_5dnyz1wq" returned: 0 in 0.656s {{(pid=84538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 19:07:00 devstack cinder-volume[84538]: DEBUG oslo_concurrency.processutils [None req-268fe71f-ce36-4765-a3eb-263d8bce444d tempest-VolumesGetTest-1123317664 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_11605644-0a6a-4a0a-b123-c09ab01cd4db_5dnyz1wq {{(pid=84538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 19:07:00 devstack sudo[93187]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-ca04e084-1b6b-4c31-ada9-fccf31334333.8ce94956-a586-484a-8db6-5260369e963b Apr 29 19:07:00 devstack sudo[93187]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 19:07:00 devstack sudo[93189]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_11605644-0a6a-4a0a-b123-c09ab01cd4db_5dnyz1wq Apr 29 19:07:00 devstack sudo[93189]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 19:07:01 devstack sudo[93187]: pam_unix(sudo:session): session closed for user root Apr 29 19:07:01 devstack cinder-volume[84538]: DEBUG oslo_concurrency.processutils [None req-f9c861e8-9e91-4653-b970-49b0993d5aa6 tempest-VolumeDependencyTests-1062757540 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-ca04e084-1b6b-4c31-ada9-fccf31334333.8ce94956-a586-484a-8db6-5260369e963b" returned: 0 in 0.694s {{(pid=84538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 19:07:01 devstack cinder-volume[84538]: DEBUG oslo_concurrency.processutils [None req-f9c861e8-9e91-4653-b970-49b0993d5aa6 tempest-VolumeDependencyTests-1062757540 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-ca04e084-1b6b-4c31-ada9-fccf31334333.8ce94956-a586-484a-8db6-5260369e963b {{(pid=84538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 19:07:01 devstack sudo[93196]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-ca04e084-1b6b-4c31-ada9-fccf31334333.8ce94956-a586-484a-8db6-5260369e963b Apr 29 19:07:01 devstack sudo[93196]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 19:07:01 devstack sudo[93189]: pam_unix(sudo:session): session closed for user root Apr 29 19:07:01 devstack cinder-volume[84538]: DEBUG oslo_concurrency.processutils [None req-268fe71f-ce36-4765-a3eb-263d8bce444d tempest-VolumesGetTest-1123317664 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_11605644-0a6a-4a0a-b123-c09ab01cd4db_5dnyz1wq" returned: 1 in 0.711s {{(pid=84538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 19:07:01 devstack cinder-volume[84538]: DEBUG oslo_concurrency.processutils [None req-268fe71f-ce36-4765-a3eb-263d8bce444d tempest-VolumesGetTest-1123317664 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_11605644-0a6a-4a0a-b123-c09ab01cd4db_5dnyz1wq' failed. Not Retrying. {{(pid=84538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Apr 29 19:07:01 devstack cinder-volume[84538]: DEBUG oslo.privsep.daemon [-] privsep: reply[5df8a4c8-ab46-4c7e-a777-03473c414f49]: (4, 'qcow2') {{(pid=85803) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 19:07:01 devstack cinder-volume[84538]: DEBUG oslo_concurrency.processutils [None req-268fe71f-ce36-4765-a3eb-263d8bce444d tempest-VolumesGetTest-1123317664 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_11605644-0a6a-4a0a-b123-c09ab01cd4db_boychseidevstack@QuobyteHD {{(pid=84538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 19:07:01 devstack sudo[93198]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_11605644-0a6a-4a0a-b123-c09ab01cd4db_boychseidevstack@QuobyteHD Apr 29 19:07:01 devstack sudo[93198]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 19:07:01 devstack sudo[93196]: pam_unix(sudo:session): session closed for user root Apr 29 19:07:01 devstack cinder-volume[84538]: DEBUG oslo_concurrency.processutils [None req-f9c861e8-9e91-4653-b970-49b0993d5aa6 tempest-VolumeDependencyTests-1062757540 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-ca04e084-1b6b-4c31-ada9-fccf31334333.8ce94956-a586-484a-8db6-5260369e963b" returned: 0 in 0.610s {{(pid=84538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 19:07:01 devstack cinder-volume[84538]: DEBUG cinder.coordination [None req-f9c861e8-9e91-4653-b970-49b0993d5aa6 tempest-VolumeDependencyTests-1062757540 None] Lock "cinder-quobyte-8ce94956-a586-484a-8db6-5260369e963b" released by "_delete_snapshot" :: held 2.922s {{(pid=84538) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 19:07:01 devstack cinder-volume[84538]: DEBUG cinder.coordination [None req-f9c861e8-9e91-4653-b970-49b0993d5aa6 tempest-VolumeDependencyTests-1062757540 None] Lock "cinder-quobyte-ca04e084-1b6b-4c31-ada9-fccf31334333" released by "delete_snapshot" :: held 2.953s {{(pid=84538) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 19:07:01 devstack cinder-volume[84538]: DEBUG cinder.quota [None req-f9c861e8-9e91-4653-b970-49b0993d5aa6 tempest-VolumeDependencyTests-1062757540 None] Created reservations ['891bafd6-539f-4984-b980-f991c2828ff2', '1cbaa1b5-cd2e-4b3e-9b37-7b4dd3b3c49f', '8ee77140-a2f5-4f1c-82d0-e92e4162131d', '3e3e4134-5b9c-4afe-a169-50c13e588009'] {{(pid=84538) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 29 19:07:01 devstack sudo[93198]: pam_unix(sudo:session): session closed for user root Apr 29 19:07:01 devstack cinder-volume[84538]: DEBUG oslo_concurrency.processutils [None req-268fe71f-ce36-4765-a3eb-263d8bce444d tempest-VolumesGetTest-1123317664 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_11605644-0a6a-4a0a-b123-c09ab01cd4db_boychseidevstack@QuobyteHD" returned: 0 in 0.764s {{(pid=84538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 19:07:01 devstack cinder-volume[84538]: DEBUG cinder.image.image_utils [None req-268fe71f-ce36-4765-a3eb-263d8bce444d tempest-VolumesGetTest-1123317664 None] 11605644-0a6a-4a0a-b123-c09ab01cd4db was qcow2, converting to raw {{(pid=84538) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1120}} Apr 29 19:07:01 devstack cinder-volume[84538]: DEBUG oslo_concurrency.processutils [None req-268fe71f-ce36-4765-a3eb-263d8bce444d tempest-VolumesGetTest-1123317664 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_11605644-0a6a-4a0a-b123-c09ab01cd4db_boychseidevstack@QuobyteHD /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-179e2c93-6df9-40f4-88d6-88c3cb9bf54b {{(pid=84538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 19:07:01 devstack cinder-volume[84538]: INFO cinder.volume.manager [None req-f9c861e8-9e91-4653-b970-49b0993d5aa6 tempest-VolumeDependencyTests-1062757540 None] Delete snapshot completed successfully. Apr 29 19:07:02 devstack cinder-volume[84538]: DEBUG cinder.coordination [None req-f9c861e8-9e91-4653-b970-49b0993d5aa6 tempest-VolumeDependencyTests-1062757540 None] Lock "cinder-8ce94956-a586-484a-8db6-5260369e963b-delete_snapshot" released by "delete_snapshot" :: held 3.132s {{(pid=84538) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 19:07:02 devstack sudo[93204]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_11605644-0a6a-4a0a-b123-c09ab01cd4db_boychseidevstack@QuobyteHD /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-179e2c93-6df9-40f4-88d6-88c3cb9bf54b Apr 29 19:07:02 devstack sudo[93204]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 19:07:02 devstack cinder-volume[84538]: DEBUG cinder.coordination [None req-94296a5c-292d-4942-ad96-e2b312345b3e tempest-VolumeDependencyTests-1062757540 None] Acquiring lock "cinder-ca04e084-1b6b-4c31-ada9-fccf31334333-delete_volume" by "delete_volume" {{(pid=84538) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 19:07:02 devstack cinder-volume[84538]: DEBUG cinder.coordination [None req-94296a5c-292d-4942-ad96-e2b312345b3e tempest-VolumeDependencyTests-1062757540 None] Lock "cinder-ca04e084-1b6b-4c31-ada9-fccf31334333-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=84538) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 19:07:02 devstack cinder-volume[84538]: DEBUG cinder.coordination [None req-94296a5c-292d-4942-ad96-e2b312345b3e tempest-VolumeDependencyTests-1062757540 None] Acquiring lock "cinder-quobyte-ca04e084-1b6b-4c31-ada9-fccf31334333" by "delete_volume" {{(pid=84538) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 19:07:02 devstack cinder-volume[84538]: DEBUG cinder.coordination [None req-94296a5c-292d-4942-ad96-e2b312345b3e tempest-VolumeDependencyTests-1062757540 None] Lock "cinder-quobyte-ca04e084-1b6b-4c31-ada9-fccf31334333" acquired by "delete_volume" :: waited 0.018s {{(pid=84538) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 19:07:02 devstack cinder-volume[84538]: DEBUG oslo.privsep.daemon [-] privsep: reply[077d027b-c8a2-417d-be9a-7f69c02e974d]: (4, 'qcow2') {{(pid=85803) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 19:07:02 devstack cinder-volume[84538]: DEBUG oslo_concurrency.processutils [None req-94296a5c-292d-4942-ad96-e2b312345b3e tempest-VolumeDependencyTests-1062757540 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-ca04e084-1b6b-4c31-ada9-fccf31334333 {{(pid=84538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 19:07:02 devstack sudo[93206]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-ca04e084-1b6b-4c31-ada9-fccf31334333 Apr 29 19:07:02 devstack sudo[93206]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 19:07:03 devstack sudo[93206]: pam_unix(sudo:session): session closed for user root Apr 29 19:07:03 devstack cinder-volume[84538]: DEBUG oslo_concurrency.processutils [None req-94296a5c-292d-4942-ad96-e2b312345b3e tempest-VolumeDependencyTests-1062757540 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-ca04e084-1b6b-4c31-ada9-fccf31334333" returned: 0 in 0.835s {{(pid=84538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 19:07:03 devstack cinder-volume[84538]: DEBUG oslo_concurrency.processutils [None req-94296a5c-292d-4942-ad96-e2b312345b3e tempest-VolumeDependencyTests-1062757540 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-ca04e084-1b6b-4c31-ada9-fccf31334333 {{(pid=84538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 19:07:03 devstack sudo[93223]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-ca04e084-1b6b-4c31-ada9-fccf31334333 Apr 29 19:07:03 devstack sudo[93223]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 19:07:03 devstack sudo[93223]: pam_unix(sudo:session): session closed for user root Apr 29 19:07:03 devstack cinder-volume[84538]: DEBUG oslo_concurrency.processutils [None req-94296a5c-292d-4942-ad96-e2b312345b3e tempest-VolumeDependencyTests-1062757540 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-ca04e084-1b6b-4c31-ada9-fccf31334333" returned: 0 in 0.639s {{(pid=84538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 19:07:03 devstack cinder-volume[84538]: DEBUG cinder.coordination [None req-94296a5c-292d-4942-ad96-e2b312345b3e tempest-VolumeDependencyTests-1062757540 None] Lock "cinder-quobyte-ca04e084-1b6b-4c31-ada9-fccf31334333" released by "delete_volume" :: held 1.548s {{(pid=84538) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 19:07:03 devstack cinder-volume[84538]: DEBUG cinder.quota [None req-94296a5c-292d-4942-ad96-e2b312345b3e tempest-VolumeDependencyTests-1062757540 None] Created reservations ['9e977af8-86a9-412e-9887-c9459b9b8589', '023fc201-f724-4ad8-929a-336b7f55ce57', 'fdb2d626-e1bd-4e31-9dd9-e3abb2eaeab2', '842c6752-8274-4251-9236-9df8c29ee719'] {{(pid=84538) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 29 19:07:03 devstack cinder-volume[84538]: DEBUG oslo_concurrency.lockutils [None req-94296a5c-292d-4942-ad96-e2b312345b3e tempest-VolumeDependencyTests-1062757540 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 19:07:03 devstack cinder-volume[84538]: DEBUG oslo_concurrency.lockutils [None req-94296a5c-292d-4942-ad96-e2b312345b3e tempest-VolumeDependencyTests-1062757540 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 19:07:03 devstack cinder-volume[84538]: DEBUG cinder.volume.drivers.quobyte [None req-94296a5c-292d-4942-ad96-e2b312345b3e tempest-VolumeDependencyTests-1062757540 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-34312b00-dd6d-45bb-af98-75855cea8e48': None} {{(pid=84538) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 19:07:03 devstack cinder-volume[84538]: DEBUG cinder.volume.drivers.quobyte [None req-94296a5c-292d-4942-ad96-e2b312345b3e tempest-VolumeDependencyTests-1062757540 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-34312b00-dd6d-45bb-af98-75855cea8e48'] {{(pid=84538) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 19:07:03 devstack cinder-volume[84538]: DEBUG oslo_concurrency.lockutils [None req-94296a5c-292d-4942-ad96-e2b312345b3e tempest-VolumeDependencyTests-1062757540 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=84538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 19:07:03 devstack cinder-volume[84538]: DEBUG oslo_concurrency.processutils [None req-94296a5c-292d-4942-ad96-e2b312345b3e tempest-VolumeDependencyTests-1062757540 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d {{(pid=84538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 19:07:03 devstack sudo[93226]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d Apr 29 19:07:03 devstack sudo[93226]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 19:07:03 devstack sudo[93204]: pam_unix(sudo:session): session closed for user root Apr 29 19:07:03 devstack cinder-volume[84538]: DEBUG oslo_concurrency.processutils [None req-268fe71f-ce36-4765-a3eb-263d8bce444d tempest-VolumesGetTest-1123317664 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_11605644-0a6a-4a0a-b123-c09ab01cd4db_boychseidevstack@QuobyteHD /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-179e2c93-6df9-40f4-88d6-88c3cb9bf54b" returned: 0 in 1.961s {{(pid=84538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 19:07:03 devstack cinder-volume[84538]: DEBUG cinder.image.image_utils [None req-268fe71f-ce36-4765-a3eb-263d8bce444d tempest-VolumesGetTest-1123317664 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_11605644-0a6a-4a0a-b123-c09ab01cd4db_boychseidevstack@QuobyteHD, size 112.00 MB, duration 1.96 sec, destination /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-179e2c93-6df9-40f4-88d6-88c3cb9bf54b {{(pid=84538) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}} Apr 29 19:07:03 devstack cinder-volume[84538]: INFO cinder.image.image_utils [None req-268fe71f-ce36-4765-a3eb-263d8bce444d tempest-VolumesGetTest-1123317664 None] Converted 112.00 MB image at 57.07 MB/s Apr 29 19:07:03 devstack cinder-volume[84538]: DEBUG oslo_concurrency.processutils [None req-268fe71f-ce36-4765-a3eb-263d8bce444d tempest-VolumesGetTest-1123317664 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-179e2c93-6df9-40f4-88d6-88c3cb9bf54b 1G {{(pid=84538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 19:07:03 devstack sudo[93228]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-179e2c93-6df9-40f4-88d6-88c3cb9bf54b 1G Apr 29 19:07:03 devstack sudo[93228]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 19:07:04 devstack sudo[93226]: pam_unix(sudo:session): session closed for user root Apr 29 19:07:04 devstack cinder-volume[84538]: DEBUG oslo_concurrency.processutils [None req-94296a5c-292d-4942-ad96-e2b312345b3e tempest-VolumeDependencyTests-1062757540 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d" returned: 0 in 0.607s {{(pid=84538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 19:07:04 devstack cinder-volume[84538]: DEBUG cinder.manager [None req-94296a5c-292d-4942-ad96-e2b312345b3e tempest-VolumeDependencyTests-1062757540 None] Notifying Schedulers of capabilities ... {{(pid=84538) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 29 19:07:04 devstack cinder-volume[84538]: INFO cinder.volume.manager [None req-94296a5c-292d-4942-ad96-e2b312345b3e tempest-VolumeDependencyTests-1062757540 None] Deleted volume successfully. Apr 29 19:07:04 devstack cinder-volume[84538]: DEBUG cinder.coordination [None req-94296a5c-292d-4942-ad96-e2b312345b3e tempest-VolumeDependencyTests-1062757540 None] Lock "cinder-ca04e084-1b6b-4c31-ada9-fccf31334333-delete_volume" released by "delete_volume" :: held 2.372s {{(pid=84538) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 19:07:04 devstack sudo[93228]: pam_unix(sudo:session): session closed for user root Apr 29 19:07:04 devstack cinder-volume[84538]: DEBUG oslo_concurrency.processutils [None req-268fe71f-ce36-4765-a3eb-263d8bce444d tempest-VolumesGetTest-1123317664 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-179e2c93-6df9-40f4-88d6-88c3cb9bf54b 1G" returned: 0 in 0.708s {{(pid=84538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 19:07:04 devstack cinder-volume[84538]: DEBUG oslo.privsep.daemon [-] privsep: reply[4b92233b-11a3-4273-8c68-41e709b1578c]: (4, 'raw') {{(pid=85803) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 19:07:04 devstack cinder-volume[84538]: DEBUG oslo_concurrency.processutils [None req-268fe71f-ce36-4765-a3eb-263d8bce444d tempest-VolumesGetTest-1123317664 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-179e2c93-6df9-40f4-88d6-88c3cb9bf54b {{(pid=84538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 19:07:04 devstack cinder-volume[84538]: DEBUG cinder.volume.flows.manager.create_volume [None req-1994987a-8f7e-4449-bb11-7072b988c5a3 tempest-VolumeDependencyTests-1062757540 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84538) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Apr 29 19:07:04 devstack cinder-volume[84538]: DEBUG cinder.volume.manager [None req-1994987a-8f7e-4449-bb11-7072b988c5a3 tempest-VolumeDependencyTests-1062757540 None] Flow 'volume_create_manager' (d2a6efe8-5b84-4f86-874c-15f30ac4872b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84538) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 19:07:04 devstack cinder-volume[84538]: DEBUG cinder.volume.manager [None req-1994987a-8f7e-4449-bb11-7072b988c5a3 tempest-VolumeDependencyTests-1062757540 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (437661e1-73cb-4555-a268-e0ad5a39834e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 19:07:04 devstack cinder-volume[84538]: DEBUG cinder.volume.manager [None req-1994987a-8f7e-4449-bb11-7072b988c5a3 tempest-VolumeDependencyTests-1062757540 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (437661e1-73cb-4555-a268-e0ad5a39834e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-29T17:07:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-1120818247',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bb0348af-f082-44d7-9d93-4ea30ea8028b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='001d402393ae4453a65ebf0c689f4ce8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T17:07:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T17:07:05Z,use_quota=True,user_id='9f67a47c6d1a42818af1ea2d7da1b6ae',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(62b05900-93e3-4190-a88f-1d87324303d1),volume_type_id=62b05900-93e3-4190-a88f-1d87324303d1)' {{(pid=84538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 19:07:04 devstack cinder-volume[84538]: DEBUG cinder.volume.manager [None req-1994987a-8f7e-4449-bb11-7072b988c5a3 tempest-VolumeDependencyTests-1062757540 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (adb867e1-6ee1-4490-8980-379548d8c0e6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 19:07:04 devstack cinder-volume[84538]: DEBUG cinder.volume.manager [None req-1994987a-8f7e-4449-bb11-7072b988c5a3 tempest-VolumeDependencyTests-1062757540 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (adb867e1-6ee1-4490-8980-379548d8c0e6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 19:07:04 devstack cinder-volume[84538]: DEBUG cinder.volume.manager [None req-1994987a-8f7e-4449-bb11-7072b988c5a3 tempest-VolumeDependencyTests-1062757540 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2c299a8e-86d5-46eb-a7fe-b1b122ff77ac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 19:07:04 devstack cinder-volume[84538]: DEBUG cinder.volume.manager [None req-1994987a-8f7e-4449-bb11-7072b988c5a3 tempest-VolumeDependencyTests-1062757540 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2c299a8e-86d5-46eb-a7fe-b1b122ff77ac) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'bb0348af-f082-44d7-9d93-4ea30ea8028b', 'volume_name': 'volume-bb0348af-f082-44d7-9d93-4ea30ea8028b', 'volume_size': 1}' {{(pid=84538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 19:07:04 devstack sudo[93234]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-179e2c93-6df9-40f4-88d6-88c3cb9bf54b Apr 29 19:07:04 devstack sudo[93234]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 19:07:04 devstack cinder-volume[84538]: DEBUG cinder.volume.manager [None req-1994987a-8f7e-4449-bb11-7072b988c5a3 tempest-VolumeDependencyTests-1062757540 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4a9238b3-0099-4f28-8ec0-474aabc15343) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 19:07:04 devstack cinder-volume[84538]: DEBUG cinder.volume.manager [None req-1994987a-8f7e-4449-bb11-7072b988c5a3 tempest-VolumeDependencyTests-1062757540 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4a9238b3-0099-4f28-8ec0-474aabc15343) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 19:07:04 devstack cinder-volume[84538]: DEBUG cinder.volume.manager [None req-1994987a-8f7e-4449-bb11-7072b988c5a3 tempest-VolumeDependencyTests-1062757540 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cd4e422e-ec58-4aef-af6b-3ac0d9db9186) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 19:07:04 devstack cinder-volume[84538]: INFO cinder.volume.flows.manager.create_volume [None req-1994987a-8f7e-4449-bb11-7072b988c5a3 tempest-VolumeDependencyTests-1062757540 None] Volume bb0348af-f082-44d7-9d93-4ea30ea8028b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-bb0348af-f082-44d7-9d93-4ea30ea8028b', 'volume_size': 1} Apr 29 19:07:04 devstack cinder-volume[84538]: DEBUG oslo_concurrency.lockutils [None req-1994987a-8f7e-4449-bb11-7072b988c5a3 tempest-VolumeDependencyTests-1062757540 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 19:07:04 devstack cinder-volume[84538]: DEBUG oslo_concurrency.lockutils [None req-1994987a-8f7e-4449-bb11-7072b988c5a3 tempest-VolumeDependencyTests-1062757540 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=84538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 19:07:04 devstack cinder-volume[84538]: DEBUG cinder.volume.drivers.quobyte [None req-1994987a-8f7e-4449-bb11-7072b988c5a3 tempest-VolumeDependencyTests-1062757540 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-29T17:07:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-1120818247',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bb0348af-f082-44d7-9d93-4ea30ea8028b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='001d402393ae4453a65ebf0c689f4ce8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T17:07:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T17:07:05Z,use_quota=True,user_id='9f67a47c6d1a42818af1ea2d7da1b6ae',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(62b05900-93e3-4190-a88f-1d87324303d1),volume_type_id=62b05900-93e3-4190-a88f-1d87324303d1)}" {{(pid=84538) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 29 19:07:04 devstack cinder-volume[84538]: DEBUG cinder.volume.drivers.remotefs [None req-1994987a-8f7e-4449-bb11-7072b988c5a3 tempest-VolumeDependencyTests-1062757540 None] Creating volume bb0348af-f082-44d7-9d93-4ea30ea8028b {{(pid=84538) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 29 19:07:04 devstack cinder-volume[84538]: DEBUG oslo_concurrency.lockutils [None req-1994987a-8f7e-4449-bb11-7072b988c5a3 tempest-VolumeDependencyTests-1062757540 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 19:07:04 devstack cinder-volume[84538]: DEBUG oslo_concurrency.lockutils [None req-1994987a-8f7e-4449-bb11-7072b988c5a3 tempest-VolumeDependencyTests-1062757540 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 19:07:04 devstack cinder-volume[84538]: DEBUG cinder.volume.drivers.quobyte [None req-1994987a-8f7e-4449-bb11-7072b988c5a3 tempest-VolumeDependencyTests-1062757540 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-34312b00-dd6d-45bb-af98-75855cea8e48': None} {{(pid=84538) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 19:07:04 devstack cinder-volume[84538]: DEBUG cinder.volume.drivers.quobyte [None req-1994987a-8f7e-4449-bb11-7072b988c5a3 tempest-VolumeDependencyTests-1062757540 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-34312b00-dd6d-45bb-af98-75855cea8e48'] {{(pid=84538) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 19:07:04 devstack cinder-volume[84538]: DEBUG oslo_concurrency.lockutils [None req-1994987a-8f7e-4449-bb11-7072b988c5a3 tempest-VolumeDependencyTests-1062757540 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=84538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 19:07:04 devstack cinder-volume[84538]: DEBUG cinder.volume.drivers.quobyte [None req-1994987a-8f7e-4449-bb11-7072b988c5a3 tempest-VolumeDependencyTests-1062757540 None] Selected osci02.corp.quobyte.com/cinder-vol-34312b00-dd6d-45bb-af98-75855cea8e48 as target Quobyte volume. {{(pid=84538) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 29 19:07:04 devstack cinder-volume[84538]: INFO cinder.volume.drivers.remotefs [None req-1994987a-8f7e-4449-bb11-7072b988c5a3 tempest-VolumeDependencyTests-1062757540 None] casted to osci02.corp.quobyte.com/cinder-vol-34312b00-dd6d-45bb-af98-75855cea8e48 Apr 29 19:07:04 devstack cinder-volume[84538]: DEBUG oslo_concurrency.processutils [None req-1994987a-8f7e-4449-bb11-7072b988c5a3 tempest-VolumeDependencyTests-1062757540 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-bb0348af-f082-44d7-9d93-4ea30ea8028b 1073741824 {{(pid=84538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 19:07:04 devstack sudo[93236]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-bb0348af-f082-44d7-9d93-4ea30ea8028b 1073741824 Apr 29 19:07:04 devstack sudo[93236]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 19:07:05 devstack sudo[93234]: pam_unix(sudo:session): session closed for user root Apr 29 19:07:05 devstack cinder-volume[84538]: DEBUG oslo_concurrency.processutils [None req-268fe71f-ce36-4765-a3eb-263d8bce444d tempest-VolumesGetTest-1123317664 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-179e2c93-6df9-40f4-88d6-88c3cb9bf54b" returned: 0 in 0.700s {{(pid=84538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 19:07:05 devstack cinder-volume[84538]: DEBUG oslo_concurrency.processutils [None req-268fe71f-ce36-4765-a3eb-263d8bce444d tempest-VolumesGetTest-1123317664 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-179e2c93-6df9-40f4-88d6-88c3cb9bf54b {{(pid=84538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 19:07:05 devstack sudo[93243]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-179e2c93-6df9-40f4-88d6-88c3cb9bf54b Apr 29 19:07:05 devstack sudo[93243]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 19:07:05 devstack sudo[93236]: pam_unix(sudo:session): session closed for user root Apr 29 19:07:05 devstack cinder-volume[84538]: DEBUG oslo_concurrency.processutils [None req-1994987a-8f7e-4449-bb11-7072b988c5a3 tempest-VolumeDependencyTests-1062757540 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-bb0348af-f082-44d7-9d93-4ea30ea8028b 1073741824" returned: 0 in 0.800s {{(pid=84538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 19:07:05 devstack cinder-volume[84538]: DEBUG oslo_concurrency.processutils [None req-1994987a-8f7e-4449-bb11-7072b988c5a3 tempest-VolumeDependencyTests-1062757540 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-bb0348af-f082-44d7-9d93-4ea30ea8028b {{(pid=84538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 19:07:05 devstack sudo[93246]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-bb0348af-f082-44d7-9d93-4ea30ea8028b Apr 29 19:07:05 devstack sudo[93246]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 19:07:06 devstack sudo[93243]: pam_unix(sudo:session): session closed for user root Apr 29 19:07:06 devstack cinder-volume[84538]: DEBUG oslo_concurrency.processutils [None req-268fe71f-ce36-4765-a3eb-263d8bce444d tempest-VolumesGetTest-1123317664 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-179e2c93-6df9-40f4-88d6-88c3cb9bf54b" returned: 1 in 0.751s {{(pid=84538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 19:07:06 devstack cinder-volume[84538]: DEBUG oslo_concurrency.processutils [None req-268fe71f-ce36-4765-a3eb-263d8bce444d tempest-VolumesGetTest-1123317664 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-179e2c93-6df9-40f4-88d6-88c3cb9bf54b' failed. Not Retrying. {{(pid=84538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Apr 29 19:07:06 devstack cinder-volume[84538]: DEBUG cinder.volume.volume_utils [None req-268fe71f-ce36-4765-a3eb-263d8bce444d tempest-VolumesGetTest-1123317664 None] Downloaded image 11605644-0a6a-4a0a-b123-c09ab01cd4db ((None, [{'url': 'file:///opt/stack/data/glance/images/11605644-0a6a-4a0a-b123-c09ab01cd4db', 'metadata': {}}])) to volume 179e2c93-6df9-40f4-88d6-88c3cb9bf54b successfully. {{(pid=84538) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1234}} Apr 29 19:07:06 devstack cinder-volume[84538]: DEBUG cinder.image.image_utils [None req-268fe71f-ce36-4765-a3eb-263d8bce444d tempest-VolumesGetTest-1123317664 None] Temporary image 11605644-0a6a-4a0a-b123-c09ab01cd4db for user 2c9aaf152c0f49d3887038450048a477 is deleted. {{(pid=84538) fetch /opt/stack/cinder/cinder/image/image_utils.py:1435}} Apr 29 19:07:06 devstack cinder-volume[84538]: DEBUG cinder.volume.volume_utils [None req-268fe71f-ce36-4765-a3eb-263d8bce444d tempest-VolumesGetTest-1123317664 None] Marking volume 179e2c93-6df9-40f4-88d6-88c3cb9bf54b as bootable. {{(pid=84538) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1138}} Apr 29 19:07:06 devstack cinder-volume[84538]: DEBUG cinder.volume.flows.manager.create_volume [None req-268fe71f-ce36-4765-a3eb-263d8bce444d tempest-VolumesGetTest-1123317664 None] Copying metadata from image 11605644-0a6a-4a0a-b123-c09ab01cd4db to 179e2c93-6df9-40f4-88d6-88c3cb9bf54b. {{(pid=84538) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Apr 29 19:07:06 devstack cinder-volume[84538]: DEBUG cinder.volume.flows.manager.create_volume [None req-268fe71f-ce36-4765-a3eb-263d8bce444d tempest-VolumesGetTest-1123317664 None] Creating volume glance metadata for volume 179e2c93-6df9-40f4-88d6-88c3cb9bf54b backed by image 11605644-0a6a-4a0a-b123-c09ab01cd4db with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': '11605644-0a6a-4a0a-b123-c09ab01cd4db', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=84538) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Apr 29 19:07:06 devstack cinder-volume[84538]: DEBUG cinder.volume.manager [None req-268fe71f-ce36-4765-a3eb-263d8bce444d tempest-VolumesGetTest-1123317664 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d3ce60e2-9053-44a1-8288-fed63eaea161) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-179e2c93-6df9-40f4-88d6-88c3cb9bf54b', 'volume_size': 1, 'image_id': '11605644-0a6a-4a0a-b123-c09ab01cd4db', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/11605644-0a6a-4a0a-b123-c09ab01cd4db', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '853afc5ea27148009f8c02d351cf4d80', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '11605644-0a6a-4a0a-b123-c09ab01cd4db', 'created_at': datetime.datetime(2026, 4, 29, 16, 52, 8, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 4, 29, 16, 52, 10, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/11605644-0a6a-4a0a-b123-c09ab01cd4db/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=84538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 19:07:06 devstack cinder-volume[84538]: DEBUG cinder.volume.manager [None req-268fe71f-ce36-4765-a3eb-263d8bce444d tempest-VolumesGetTest-1123317664 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (72e3fa0a-2162-43c4-808b-006e3ac0eb49) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 19:07:06 devstack cinder-volume[84538]: INFO cinder.volume.flows.manager.create_volume [None req-268fe71f-ce36-4765-a3eb-263d8bce444d tempest-VolumesGetTest-1123317664 None] Volume volume-179e2c93-6df9-40f4-88d6-88c3cb9bf54b (179e2c93-6df9-40f4-88d6-88c3cb9bf54b): created successfully Apr 29 19:07:06 devstack cinder-volume[84538]: DEBUG cinder.volume.manager [None req-268fe71f-ce36-4765-a3eb-263d8bce444d tempest-VolumesGetTest-1123317664 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (72e3fa0a-2162-43c4-808b-006e3ac0eb49) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 19:07:06 devstack cinder-volume[84538]: DEBUG cinder.volume.manager [None req-268fe71f-ce36-4765-a3eb-263d8bce444d tempest-VolumesGetTest-1123317664 None] Flow 'volume_create_manager' (c06ea9f1-0329-4a16-91c2-929d5db7b337) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84538) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 19:07:06 devstack cinder-volume[84538]: INFO cinder.volume.manager [None req-268fe71f-ce36-4765-a3eb-263d8bce444d tempest-VolumesGetTest-1123317664 None] Created volume successfully. Apr 29 19:07:06 devstack sudo[93246]: pam_unix(sudo:session): session closed for user root Apr 29 19:07:06 devstack cinder-volume[84538]: DEBUG oslo_concurrency.processutils [None req-1994987a-8f7e-4449-bb11-7072b988c5a3 tempest-VolumeDependencyTests-1062757540 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-bb0348af-f082-44d7-9d93-4ea30ea8028b" returned: 0 in 0.661s {{(pid=84538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 19:07:06 devstack cinder-volume[84538]: DEBUG cinder.volume.drivers.quobyte [None req-1994987a-8f7e-4449-bb11-7072b988c5a3 tempest-VolumeDependencyTests-1062757540 None] <== create_volume: return (1512ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-34312b00-dd6d-45bb-af98-75855cea8e48'} {{(pid=84538) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 29 19:07:06 devstack cinder-volume[84538]: DEBUG oslo_concurrency.lockutils [None req-1994987a-8f7e-4449-bb11-7072b988c5a3 tempest-VolumeDependencyTests-1062757540 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.515s {{(pid=84538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 19:07:06 devstack cinder-volume[84538]: DEBUG cinder.volume.manager [None req-1994987a-8f7e-4449-bb11-7072b988c5a3 tempest-VolumeDependencyTests-1062757540 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cd4e422e-ec58-4aef-af6b-3ac0d9db9186) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-bb0348af-f082-44d7-9d93-4ea30ea8028b', 'volume_size': 1}' {{(pid=84538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 19:07:06 devstack cinder-volume[84538]: DEBUG cinder.volume.manager [None req-1994987a-8f7e-4449-bb11-7072b988c5a3 tempest-VolumeDependencyTests-1062757540 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (572e0e90-3b35-4981-a867-5ba320f97d03) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 19:07:06 devstack cinder-volume[84538]: INFO cinder.volume.flows.manager.create_volume [None req-1994987a-8f7e-4449-bb11-7072b988c5a3 tempest-VolumeDependencyTests-1062757540 None] Volume volume-bb0348af-f082-44d7-9d93-4ea30ea8028b (bb0348af-f082-44d7-9d93-4ea30ea8028b): created successfully Apr 29 19:07:06 devstack cinder-volume[84538]: DEBUG cinder.volume.manager [None req-1994987a-8f7e-4449-bb11-7072b988c5a3 tempest-VolumeDependencyTests-1062757540 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (572e0e90-3b35-4981-a867-5ba320f97d03) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 19:07:06 devstack cinder-volume[84538]: DEBUG cinder.volume.manager [None req-1994987a-8f7e-4449-bb11-7072b988c5a3 tempest-VolumeDependencyTests-1062757540 None] Flow 'volume_create_manager' (d2a6efe8-5b84-4f86-874c-15f30ac4872b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84538) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 19:07:06 devstack cinder-volume[84538]: INFO cinder.volume.manager [None req-1994987a-8f7e-4449-bb11-7072b988c5a3 tempest-VolumeDependencyTests-1062757540 None] Created volume successfully. Apr 29 19:07:07 devstack cinder-volume[84538]: DEBUG cinder.volume.flows.manager.create_volume [None req-a7d9727c-24a9-494d-83e4-76184cd2a472 tempest-VolumeDependencyTests-1062757540 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84538) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Apr 29 19:07:07 devstack cinder-volume[84538]: DEBUG cinder.volume.manager [None req-a7d9727c-24a9-494d-83e4-76184cd2a472 tempest-VolumeDependencyTests-1062757540 None] Flow 'volume_create_manager' (ac6bca7b-5897-4c3b-b0f3-6037779d4342) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84538) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 19:07:07 devstack cinder-volume[84538]: DEBUG cinder.volume.manager [None req-a7d9727c-24a9-494d-83e4-76184cd2a472 tempest-VolumeDependencyTests-1062757540 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0b276d47-94e4-4ac1-90b7-f2f5df681bf2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 19:07:07 devstack cinder-volume[84538]: DEBUG cinder.volume.manager [None req-a7d9727c-24a9-494d-83e4-76184cd2a472 tempest-VolumeDependencyTests-1062757540 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0b276d47-94e4-4ac1-90b7-f2f5df681bf2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-29T17:07:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-1200134036',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fb433e82-fba2-46c2-a11a-a5ed97f5294f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='001d402393ae4453a65ebf0c689f4ce8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T17:07:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=bb0348af-f082-44d7-9d93-4ea30ea8028b,status='creating',terminated_at=None,updated_at=2026-04-29T17:07:07Z,use_quota=True,user_id='9f67a47c6d1a42818af1ea2d7da1b6ae',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(62b05900-93e3-4190-a88f-1d87324303d1),volume_type_id=62b05900-93e3-4190-a88f-1d87324303d1)' {{(pid=84538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 19:07:07 devstack cinder-volume[84538]: DEBUG cinder.volume.manager [None req-a7d9727c-24a9-494d-83e4-76184cd2a472 tempest-VolumeDependencyTests-1062757540 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (425b26e9-6930-4dad-893b-824828c856f7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 19:07:07 devstack cinder-volume[84538]: DEBUG cinder.volume.manager [None req-a7d9727c-24a9-494d-83e4-76184cd2a472 tempest-VolumeDependencyTests-1062757540 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (425b26e9-6930-4dad-893b-824828c856f7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 19:07:07 devstack cinder-volume[84538]: DEBUG cinder.volume.manager [None req-a7d9727c-24a9-494d-83e4-76184cd2a472 tempest-VolumeDependencyTests-1062757540 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (47f7288a-a90d-4461-9068-827c709d8aff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 19:07:07 devstack cinder-volume[84538]: DEBUG cinder.volume.manager [None req-a7d9727c-24a9-494d-83e4-76184cd2a472 tempest-VolumeDependencyTests-1062757540 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (47f7288a-a90d-4461-9068-827c709d8aff) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'source_vol', 'volume_id': 'fb433e82-fba2-46c2-a11a-a5ed97f5294f', 'volume_name': 'volume-fb433e82-fba2-46c2-a11a-a5ed97f5294f', 'volume_size': 1, 'source_volid': 'bb0348af-f082-44d7-9d93-4ea30ea8028b', 'source_volstatus': 'available'}' {{(pid=84538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 19:07:07 devstack cinder-volume[84538]: DEBUG cinder.volume.manager [None req-a7d9727c-24a9-494d-83e4-76184cd2a472 tempest-VolumeDependencyTests-1062757540 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2169fa3a-f630-4c5d-916b-333b83abf86b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 19:07:07 devstack cinder-volume[84538]: DEBUG cinder.volume.manager [None req-a7d9727c-24a9-494d-83e4-76184cd2a472 tempest-VolumeDependencyTests-1062757540 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2169fa3a-f630-4c5d-916b-333b83abf86b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 19:07:07 devstack cinder-volume[84538]: DEBUG cinder.volume.manager [None req-a7d9727c-24a9-494d-83e4-76184cd2a472 tempest-VolumeDependencyTests-1062757540 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (aaadcec9-7e57-4088-a498-3bff2ba26d62) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 19:07:07 devstack cinder-volume[84538]: INFO cinder.volume.flows.manager.create_volume [None req-a7d9727c-24a9-494d-83e4-76184cd2a472 tempest-VolumeDependencyTests-1062757540 None] Volume fb433e82-fba2-46c2-a11a-a5ed97f5294f: being created as source_vol with specification: {'status': 'creating', 'volume_name': 'volume-fb433e82-fba2-46c2-a11a-a5ed97f5294f', 'volume_size': 1, 'source_volid': 'bb0348af-f082-44d7-9d93-4ea30ea8028b', 'source_volstatus': 'available'} Apr 29 19:07:07 devstack cinder-volume[84538]: DEBUG oslo_concurrency.lockutils [None req-a7d9727c-24a9-494d-83e4-76184cd2a472 tempest-VolumeDependencyTests-1062757540 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" {{(pid=84538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 19:07:07 devstack cinder-volume[84538]: DEBUG oslo_concurrency.lockutils [None req-a7d9727c-24a9-494d-83e4-76184cd2a472 tempest-VolumeDependencyTests-1062757540 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: waited 0.001s {{(pid=84538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 19:07:07 devstack cinder-volume[84538]: INFO cinder.volume.drivers.remotefs [None req-a7d9727c-24a9-494d-83e4-76184cd2a472 tempest-VolumeDependencyTests-1062757540 None] Cloning volume bb0348af-f082-44d7-9d93-4ea30ea8028b to volume fb433e82-fba2-46c2-a11a-a5ed97f5294f Apr 29 19:07:07 devstack cinder-volume[84538]: DEBUG cinder.volume.drivers.remotefs [None req-a7d9727c-24a9-494d-83e4-76184cd2a472 tempest-VolumeDependencyTests-1062757540 None] Creating offline snapshot 701ccb30-b9db-43e5-af03-508485ba6e01 of volume bb0348af-f082-44d7-9d93-4ea30ea8028b {{(pid=84538) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}} Apr 29 19:07:07 devstack cinder-volume[84538]: DEBUG oslo.privsep.daemon [-] privsep: reply[e70a3f3d-d0c2-46ff-b73e-3037bbbac6d2]: (4, 'qcow2') {{(pid=85803) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 19:07:07 devstack cinder-volume[84538]: DEBUG oslo_concurrency.processutils [None req-a7d9727c-24a9-494d-83e4-76184cd2a472 tempest-VolumeDependencyTests-1062757540 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-bb0348af-f082-44d7-9d93-4ea30ea8028b {{(pid=84538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 19:07:07 devstack sudo[93252]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-bb0348af-f082-44d7-9d93-4ea30ea8028b Apr 29 19:07:07 devstack sudo[93252]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 19:07:07 devstack cinder-volume[84538]: DEBUG cinder.volume.flows.manager.create_volume [None req-eabdc885-58c1-45fc-bef9-ae1a0b23d410 tempest-VolumesGetTest-1123317664 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84538) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Apr 29 19:07:07 devstack cinder-volume[84538]: DEBUG cinder.volume.manager [None req-eabdc885-58c1-45fc-bef9-ae1a0b23d410 tempest-VolumesGetTest-1123317664 None] Flow 'volume_create_manager' (28e2f27a-8967-404a-ba20-fa70f69ec9bb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84538) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 19:07:07 devstack cinder-volume[84538]: DEBUG cinder.volume.manager [None req-eabdc885-58c1-45fc-bef9-ae1a0b23d410 tempest-VolumesGetTest-1123317664 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1a107b31-a451-4113-af8d-c74e78fe65ee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 19:07:07 devstack cinder-volume[84538]: DEBUG cinder.volume.manager [None req-eabdc885-58c1-45fc-bef9-ae1a0b23d410 tempest-VolumesGetTest-1123317664 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1a107b31-a451-4113-af8d-c74e78fe65ee) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-29T17:07:08Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-197162041',display_name='tempest-VolumesGetTest-Volume-2056102901',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=559e72e2-f6d4-4f1a-adab-545cbad0ebb3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='62ab81799a05449b9f5b7eb23c6c9071',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T17:07:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T17:07:08Z,use_quota=True,user_id='2c9aaf152c0f49d3887038450048a477',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(62b05900-93e3-4190-a88f-1d87324303d1),volume_type_id=62b05900-93e3-4190-a88f-1d87324303d1)' {{(pid=84538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 19:07:07 devstack cinder-volume[84538]: DEBUG cinder.volume.manager [None req-eabdc885-58c1-45fc-bef9-ae1a0b23d410 tempest-VolumesGetTest-1123317664 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0c8eba84-45c7-4616-9a16-a56d7ec84dea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 19:07:07 devstack cinder-volume[84538]: DEBUG cinder.volume.manager [None req-eabdc885-58c1-45fc-bef9-ae1a0b23d410 tempest-VolumesGetTest-1123317664 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0c8eba84-45c7-4616-9a16-a56d7ec84dea) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 19:07:07 devstack cinder-volume[84538]: DEBUG cinder.volume.manager [None req-eabdc885-58c1-45fc-bef9-ae1a0b23d410 tempest-VolumesGetTest-1123317664 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a033e418-50ff-48b2-8653-dec33f29464d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 19:07:07 devstack cinder-volume[84538]: DEBUG cinder.volume.manager [None req-eabdc885-58c1-45fc-bef9-ae1a0b23d410 tempest-VolumesGetTest-1123317664 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a033e418-50ff-48b2-8653-dec33f29464d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '559e72e2-f6d4-4f1a-adab-545cbad0ebb3', 'volume_name': 'volume-559e72e2-f6d4-4f1a-adab-545cbad0ebb3', 'volume_size': 1}' {{(pid=84538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 19:07:07 devstack cinder-volume[84538]: DEBUG cinder.volume.manager [None req-eabdc885-58c1-45fc-bef9-ae1a0b23d410 tempest-VolumesGetTest-1123317664 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3ff2dbf6-7ff7-4e84-9912-3bac95dc1571) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 19:07:07 devstack cinder-volume[84538]: DEBUG cinder.volume.manager [None req-eabdc885-58c1-45fc-bef9-ae1a0b23d410 tempest-VolumesGetTest-1123317664 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3ff2dbf6-7ff7-4e84-9912-3bac95dc1571) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 19:07:07 devstack cinder-volume[84538]: DEBUG cinder.volume.manager [None req-eabdc885-58c1-45fc-bef9-ae1a0b23d410 tempest-VolumesGetTest-1123317664 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (50dee34b-ce42-4c01-994c-78bf4d0d23ea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 19:07:07 devstack cinder-volume[84538]: INFO cinder.volume.flows.manager.create_volume [None req-eabdc885-58c1-45fc-bef9-ae1a0b23d410 tempest-VolumesGetTest-1123317664 None] Volume 559e72e2-f6d4-4f1a-adab-545cbad0ebb3: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-559e72e2-f6d4-4f1a-adab-545cbad0ebb3', 'volume_size': 1} Apr 29 19:07:07 devstack cinder-volume[84538]: DEBUG oslo_concurrency.lockutils [None req-eabdc885-58c1-45fc-bef9-ae1a0b23d410 tempest-VolumesGetTest-1123317664 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 19:07:08 devstack sudo[93252]: pam_unix(sudo:session): session closed for user root Apr 29 19:07:08 devstack cinder-volume[84538]: DEBUG oslo_concurrency.processutils [None req-a7d9727c-24a9-494d-83e4-76184cd2a472 tempest-VolumeDependencyTests-1062757540 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-bb0348af-f082-44d7-9d93-4ea30ea8028b" returned: 0 in 0.714s {{(pid=84538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 19:07:08 devstack cinder-volume[84538]: DEBUG oslo_concurrency.processutils [None req-a7d9727c-24a9-494d-83e4-76184cd2a472 tempest-VolumeDependencyTests-1062757540 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-bb0348af-f082-44d7-9d93-4ea30ea8028b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-bb0348af-f082-44d7-9d93-4ea30ea8028b.701ccb30-b9db-43e5-af03-508485ba6e01 1G {{(pid=84538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 19:07:08 devstack sudo[93257]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-bb0348af-f082-44d7-9d93-4ea30ea8028b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-bb0348af-f082-44d7-9d93-4ea30ea8028b.701ccb30-b9db-43e5-af03-508485ba6e01 1G Apr 29 19:07:08 devstack sudo[93257]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 19:07:08 devstack sudo[93257]: pam_unix(sudo:session): session closed for user root Apr 29 19:07:08 devstack cinder-volume[84538]: DEBUG oslo_concurrency.processutils [None req-a7d9727c-24a9-494d-83e4-76184cd2a472 tempest-VolumeDependencyTests-1062757540 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-bb0348af-f082-44d7-9d93-4ea30ea8028b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-bb0348af-f082-44d7-9d93-4ea30ea8028b.701ccb30-b9db-43e5-af03-508485ba6e01 1G" returned: 0 in 0.714s {{(pid=84538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 19:07:08 devstack cinder-volume[84538]: DEBUG oslo_concurrency.processutils [None req-a7d9727c-24a9-494d-83e4-76184cd2a472 tempest-VolumeDependencyTests-1062757540 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-bb0348af-f082-44d7-9d93-4ea30ea8028b -F qcow2 /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-bb0348af-f082-44d7-9d93-4ea30ea8028b.701ccb30-b9db-43e5-af03-508485ba6e01 {{(pid=84538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 19:07:08 devstack sudo[93263]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-bb0348af-f082-44d7-9d93-4ea30ea8028b -F qcow2 /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-bb0348af-f082-44d7-9d93-4ea30ea8028b.701ccb30-b9db-43e5-af03-508485ba6e01 Apr 29 19:07:08 devstack sudo[93263]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 19:07:09 devstack sudo[93263]: pam_unix(sudo:session): session closed for user root Apr 29 19:07:09 devstack cinder-volume[84538]: DEBUG oslo_concurrency.processutils [None req-a7d9727c-24a9-494d-83e4-76184cd2a472 tempest-VolumeDependencyTests-1062757540 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-bb0348af-f082-44d7-9d93-4ea30ea8028b -F qcow2 /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-bb0348af-f082-44d7-9d93-4ea30ea8028b.701ccb30-b9db-43e5-af03-508485ba6e01" returned: 0 in 0.638s {{(pid=84538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 19:07:09 devstack cinder-volume[84538]: WARNING cinder.volume.drivers.remotefs [None req-a7d9727c-24a9-494d-83e4-76184cd2a472 tempest-VolumeDependencyTests-1062757540 None] /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-bb0348af-f082-44d7-9d93-4ea30ea8028b.701ccb30-b9db-43e5-af03-508485ba6e01 is being set with open permissions: ugo+rw Apr 29 19:07:09 devstack cinder-volume[84538]: DEBUG oslo_concurrency.processutils [None req-a7d9727c-24a9-494d-83e4-76184cd2a472 tempest-VolumeDependencyTests-1062757540 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-bb0348af-f082-44d7-9d93-4ea30ea8028b.701ccb30-b9db-43e5-af03-508485ba6e01 {{(pid=84538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 19:07:09 devstack sudo[93268]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-bb0348af-f082-44d7-9d93-4ea30ea8028b.701ccb30-b9db-43e5-af03-508485ba6e01 Apr 29 19:07:09 devstack sudo[93268]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 19:07:10 devstack sudo[93268]: pam_unix(sudo:session): session closed for user root Apr 29 19:07:10 devstack cinder-volume[84538]: DEBUG oslo_concurrency.processutils [None req-a7d9727c-24a9-494d-83e4-76184cd2a472 tempest-VolumeDependencyTests-1062757540 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-bb0348af-f082-44d7-9d93-4ea30ea8028b.701ccb30-b9db-43e5-af03-508485ba6e01" returned: 0 in 0.638s {{(pid=84538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 19:07:10 devstack cinder-volume[84538]: DEBUG oslo_concurrency.processutils [None req-a7d9727c-24a9-494d-83e4-76184cd2a472 tempest-VolumeDependencyTests-1062757540 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-bb0348af-f082-44d7-9d93-4ea30ea8028b.info {{(pid=84538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 19:07:10 devstack sudo[93271]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-bb0348af-f082-44d7-9d93-4ea30ea8028b.info Apr 29 19:07:10 devstack sudo[93271]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 19:07:10 devstack sudo[93271]: pam_unix(sudo:session): session closed for user root Apr 29 19:07:10 devstack cinder-volume[84538]: DEBUG oslo_concurrency.processutils [None req-a7d9727c-24a9-494d-83e4-76184cd2a472 tempest-VolumeDependencyTests-1062757540 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-bb0348af-f082-44d7-9d93-4ea30ea8028b.info" returned: 0 in 0.607s {{(pid=84538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 19:07:10 devstack cinder-volume[84538]: WARNING cinder.volume.drivers.remotefs [None req-a7d9727c-24a9-494d-83e4-76184cd2a472 tempest-VolumeDependencyTests-1062757540 None] /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-bb0348af-f082-44d7-9d93-4ea30ea8028b.info is being set with open permissions: ugo+rw Apr 29 19:07:10 devstack cinder-volume[84538]: DEBUG oslo_concurrency.processutils [None req-a7d9727c-24a9-494d-83e4-76184cd2a472 tempest-VolumeDependencyTests-1062757540 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-bb0348af-f082-44d7-9d93-4ea30ea8028b.info {{(pid=84538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 19:07:10 devstack sudo[93274]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-bb0348af-f082-44d7-9d93-4ea30ea8028b.info Apr 29 19:07:10 devstack sudo[93274]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 19:07:11 devstack sudo[93274]: pam_unix(sudo:session): session closed for user root Apr 29 19:07:11 devstack cinder-volume[84538]: DEBUG oslo_concurrency.processutils [None req-a7d9727c-24a9-494d-83e4-76184cd2a472 tempest-VolumeDependencyTests-1062757540 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-bb0348af-f082-44d7-9d93-4ea30ea8028b.info" returned: 0 in 0.598s {{(pid=84538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 19:07:11 devstack cinder-volume[84538]: DEBUG cinder.coordination [None req-a7d9727c-24a9-494d-83e4-76184cd2a472 tempest-VolumeDependencyTests-1062757540 None] Acquiring lock "cinder-quobyte-fb433e82-fba2-46c2-a11a-a5ed97f5294f" by "_copy_volume_from_snapshot" {{(pid=84538) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 19:07:11 devstack cinder-volume[84538]: DEBUG cinder.coordination [None req-a7d9727c-24a9-494d-83e4-76184cd2a472 tempest-VolumeDependencyTests-1062757540 None] Lock "cinder-quobyte-fb433e82-fba2-46c2-a11a-a5ed97f5294f" acquired by "_copy_volume_from_snapshot" :: waited 0.018s {{(pid=84538) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 19:07:11 devstack cinder-volume[84538]: DEBUG cinder.volume.drivers.quobyte [None req-a7d9727c-24a9-494d-83e4-76184cd2a472 tempest-VolumeDependencyTests-1062757540 None] snapshot: 701ccb30-b9db-43e5-af03-508485ba6e01, volume: fb433e82-fba2-46c2-a11a-a5ed97f5294f, {{(pid=84538) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Apr 29 19:07:11 devstack cinder-volume[84538]: DEBUG oslo_concurrency.lockutils [None req-a7d9727c-24a9-494d-83e4-76184cd2a472 tempest-VolumeDependencyTests-1062757540 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 19:07:11 devstack cinder-volume[84538]: DEBUG oslo_concurrency.lockutils [None req-a7d9727c-24a9-494d-83e4-76184cd2a472 tempest-VolumeDependencyTests-1062757540 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 19:07:11 devstack cinder-volume[84538]: DEBUG cinder.volume.drivers.quobyte [None req-a7d9727c-24a9-494d-83e4-76184cd2a472 tempest-VolumeDependencyTests-1062757540 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-34312b00-dd6d-45bb-af98-75855cea8e48': None} {{(pid=84538) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 19:07:11 devstack cinder-volume[84538]: DEBUG cinder.volume.drivers.quobyte [None req-a7d9727c-24a9-494d-83e4-76184cd2a472 tempest-VolumeDependencyTests-1062757540 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-34312b00-dd6d-45bb-af98-75855cea8e48'] {{(pid=84538) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 19:07:11 devstack cinder-volume[84538]: DEBUG oslo_concurrency.lockutils [None req-a7d9727c-24a9-494d-83e4-76184cd2a472 tempest-VolumeDependencyTests-1062757540 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=84538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 19:07:11 devstack cinder-volume[84538]: DEBUG oslo.privsep.daemon [-] privsep: reply[db46eced-8db6-4002-8e5b-27ede5e20192]: (4, 'qcow2') {{(pid=85803) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 19:07:11 devstack cinder-volume[84538]: DEBUG oslo_concurrency.processutils [None req-a7d9727c-24a9-494d-83e4-76184cd2a472 tempest-VolumeDependencyTests-1062757540 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-bb0348af-f082-44d7-9d93-4ea30ea8028b.701ccb30-b9db-43e5-af03-508485ba6e01 {{(pid=84538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 19:07:11 devstack sudo[93277]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-bb0348af-f082-44d7-9d93-4ea30ea8028b.701ccb30-b9db-43e5-af03-508485ba6e01 Apr 29 19:07:11 devstack sudo[93277]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 19:07:12 devstack sudo[93277]: pam_unix(sudo:session): session closed for user root Apr 29 19:07:12 devstack cinder-volume[84538]: DEBUG oslo_concurrency.processutils [None req-a7d9727c-24a9-494d-83e4-76184cd2a472 tempest-VolumeDependencyTests-1062757540 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-bb0348af-f082-44d7-9d93-4ea30ea8028b.701ccb30-b9db-43e5-af03-508485ba6e01" returned: 0 in 0.723s {{(pid=84538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 19:07:12 devstack cinder-volume[84538]: DEBUG cinder.volume.drivers.remotefs [None req-a7d9727c-24a9-494d-83e4-76184cd2a472 tempest-VolumeDependencyTests-1062757540 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-bb0348af-f082-44d7-9d93-4ea30ea8028b(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=84538) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 29 19:07:12 devstack cinder-volume[84538]: DEBUG cinder.volume.drivers.quobyte [None req-a7d9727c-24a9-494d-83e4-76184cd2a472 tempest-VolumeDependencyTests-1062757540 None] will copy from snapshot at /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-bb0348af-f082-44d7-9d93-4ea30ea8028b {{(pid=84538) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Apr 29 19:07:12 devstack cinder-volume[84538]: DEBUG cinder.volume.drivers.quobyte [None req-a7d9727c-24a9-494d-83e4-76184cd2a472 tempest-VolumeDependencyTests-1062757540 None] Creating direct copy from snapshot {{(pid=84538) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Apr 29 19:07:12 devstack cinder-volume[84538]: DEBUG oslo.privsep.daemon [-] privsep: reply[dddb9f96-9a13-42dc-9042-023436a17cbc]: (4, 'qcow2') {{(pid=85803) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 19:07:12 devstack cinder-volume[84538]: DEBUG oslo_concurrency.processutils [None req-a7d9727c-24a9-494d-83e4-76184cd2a472 tempest-VolumeDependencyTests-1062757540 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-bb0348af-f082-44d7-9d93-4ea30ea8028b {{(pid=84538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 19:07:12 devstack sudo[93282]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-bb0348af-f082-44d7-9d93-4ea30ea8028b Apr 29 19:07:12 devstack sudo[93282]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 19:07:12 devstack sudo[93282]: pam_unix(sudo:session): session closed for user root Apr 29 19:07:12 devstack cinder-volume[84538]: DEBUG oslo_concurrency.processutils [None req-a7d9727c-24a9-494d-83e4-76184cd2a472 tempest-VolumeDependencyTests-1062757540 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-bb0348af-f082-44d7-9d93-4ea30ea8028b" returned: 0 in 0.709s {{(pid=84538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 19:07:12 devstack cinder-volume[84538]: DEBUG cinder.utils [None req-a7d9727c-24a9-494d-83e4-76184cd2a472 tempest-VolumeDependencyTests-1062757540 None] Path /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-fb433e82-fba2-46c2-a11a-a5ed97f5294f not found in is_blk_device check {{(pid=84538) is_blk_device /opt/stack/cinder/cinder/utils.py:602}} Apr 29 19:07:12 devstack cinder-volume[84538]: DEBUG oslo_concurrency.processutils [None req-a7d9727c-24a9-494d-83e4-76184cd2a472 tempest-VolumeDependencyTests-1062757540 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-bb0348af-f082-44d7-9d93-4ea30ea8028b /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-fb433e82-fba2-46c2-a11a-a5ed97f5294f {{(pid=84538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 19:07:12 devstack sudo[93287]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-bb0348af-f082-44d7-9d93-4ea30ea8028b /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-fb433e82-fba2-46c2-a11a-a5ed97f5294f Apr 29 19:07:12 devstack sudo[93287]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 19:07:17 devstack sudo[93287]: pam_unix(sudo:session): session closed for user root Apr 29 19:07:17 devstack cinder-volume[84538]: DEBUG oslo_concurrency.processutils [None req-a7d9727c-24a9-494d-83e4-76184cd2a472 tempest-VolumeDependencyTests-1062757540 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-bb0348af-f082-44d7-9d93-4ea30ea8028b /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-fb433e82-fba2-46c2-a11a-a5ed97f5294f" returned: 0 in 4.526s {{(pid=84538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 19:07:17 devstack cinder-volume[84538]: DEBUG oslo.privsep.daemon [-] privsep: reply[3bf9b650-8ecc-4a29-b817-29051d5b86aa]: (4, 'qcow2') {{(pid=85803) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 19:07:17 devstack cinder-volume[84538]: DEBUG oslo_concurrency.processutils [None req-a7d9727c-24a9-494d-83e4-76184cd2a472 tempest-VolumeDependencyTests-1062757540 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-bb0348af-f082-44d7-9d93-4ea30ea8028b {{(pid=84538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 19:07:17 devstack sudo[93300]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-bb0348af-f082-44d7-9d93-4ea30ea8028b Apr 29 19:07:17 devstack sudo[93300]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 19:07:18 devstack sudo[93300]: pam_unix(sudo:session): session closed for user root Apr 29 19:07:18 devstack cinder-volume[84538]: DEBUG oslo_concurrency.processutils [None req-a7d9727c-24a9-494d-83e4-76184cd2a472 tempest-VolumeDependencyTests-1062757540 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-bb0348af-f082-44d7-9d93-4ea30ea8028b" returned: 0 in 0.888s {{(pid=84538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 19:07:18 devstack cinder-volume[84538]: DEBUG cinder.image.image_utils [None req-a7d9727c-24a9-494d-83e4-76184cd2a472 tempest-VolumeDependencyTests-1062757540 None] Image conversion details: src /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-bb0348af-f082-44d7-9d93-4ea30ea8028b, size 1024.00 MB, duration 4.53 sec, destination /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-fb433e82-fba2-46c2-a11a-a5ed97f5294f {{(pid=84538) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}} Apr 29 19:07:18 devstack cinder-volume[84538]: INFO cinder.image.image_utils [None req-a7d9727c-24a9-494d-83e4-76184cd2a472 tempest-VolumeDependencyTests-1062757540 None] Converted 1024.00 MB image at 226.21 MB/s Apr 29 19:07:18 devstack cinder-volume[84538]: WARNING cinder.volume.drivers.remotefs [None req-a7d9727c-24a9-494d-83e4-76184cd2a472 tempest-VolumeDependencyTests-1062757540 None] /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-fb433e82-fba2-46c2-a11a-a5ed97f5294f is being set with open permissions: ugo+rw Apr 29 19:07:18 devstack cinder-volume[84538]: DEBUG oslo_concurrency.processutils [None req-a7d9727c-24a9-494d-83e4-76184cd2a472 tempest-VolumeDependencyTests-1062757540 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-fb433e82-fba2-46c2-a11a-a5ed97f5294f {{(pid=84538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 19:07:18 devstack sudo[93305]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-fb433e82-fba2-46c2-a11a-a5ed97f5294f Apr 29 19:07:18 devstack sudo[93305]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 19:07:18 devstack sudo[93305]: pam_unix(sudo:session): session closed for user root Apr 29 19:07:18 devstack cinder-volume[84538]: DEBUG oslo_concurrency.processutils [None req-a7d9727c-24a9-494d-83e4-76184cd2a472 tempest-VolumeDependencyTests-1062757540 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-fb433e82-fba2-46c2-a11a-a5ed97f5294f" returned: 0 in 0.583s {{(pid=84538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 19:07:18 devstack cinder-volume[84538]: DEBUG cinder.coordination [None req-a7d9727c-24a9-494d-83e4-76184cd2a472 tempest-VolumeDependencyTests-1062757540 None] Lock "cinder-quobyte-fb433e82-fba2-46c2-a11a-a5ed97f5294f" released by "_copy_volume_from_snapshot" :: held 7.511s {{(pid=84538) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 19:07:18 devstack cinder-volume[84538]: DEBUG cinder.coordination [None req-a7d9727c-24a9-494d-83e4-76184cd2a472 tempest-VolumeDependencyTests-1062757540 None] Acquiring lock "cinder-quobyte-701ccb30-b9db-43e5-af03-508485ba6e01" by "_delete_snapshot" {{(pid=84538) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 19:07:18 devstack cinder-volume[84538]: DEBUG cinder.coordination [None req-a7d9727c-24a9-494d-83e4-76184cd2a472 tempest-VolumeDependencyTests-1062757540 None] Lock "cinder-quobyte-701ccb30-b9db-43e5-af03-508485ba6e01" acquired by "_delete_snapshot" :: waited 0.015s {{(pid=84538) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 19:07:18 devstack cinder-volume[84538]: DEBUG cinder.volume.drivers.remotefs [None req-a7d9727c-24a9-494d-83e4-76184cd2a472 tempest-VolumeDependencyTests-1062757540 None] Deleting offline snapshot 701ccb30-b9db-43e5-af03-508485ba6e01 of volume bb0348af-f082-44d7-9d93-4ea30ea8028b {{(pid=84538) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 29 19:07:18 devstack cinder-volume[84538]: DEBUG cinder.volume.drivers.remotefs [None req-a7d9727c-24a9-494d-83e4-76184cd2a472 tempest-VolumeDependencyTests-1062757540 None] snapshot_file for this snap is: volume-bb0348af-f082-44d7-9d93-4ea30ea8028b.701ccb30-b9db-43e5-af03-508485ba6e01 {{(pid=84538) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 29 19:07:18 devstack cinder-volume[84538]: DEBUG oslo.privsep.daemon [-] privsep: reply[0e5ef2f9-d0a1-4f26-9189-f55228603ce0]: (4, 'qcow2') {{(pid=85803) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 19:07:18 devstack cinder-volume[84538]: DEBUG oslo_concurrency.processutils [None req-a7d9727c-24a9-494d-83e4-76184cd2a472 tempest-VolumeDependencyTests-1062757540 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-bb0348af-f082-44d7-9d93-4ea30ea8028b.701ccb30-b9db-43e5-af03-508485ba6e01 {{(pid=84538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 19:07:19 devstack sudo[93309]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-bb0348af-f082-44d7-9d93-4ea30ea8028b.701ccb30-b9db-43e5-af03-508485ba6e01 Apr 29 19:07:19 devstack sudo[93309]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 19:07:19 devstack sudo[93309]: pam_unix(sudo:session): session closed for user root Apr 29 19:07:19 devstack cinder-volume[84538]: DEBUG oslo_concurrency.processutils [None req-a7d9727c-24a9-494d-83e4-76184cd2a472 tempest-VolumeDependencyTests-1062757540 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-bb0348af-f082-44d7-9d93-4ea30ea8028b.701ccb30-b9db-43e5-af03-508485ba6e01" returned: 0 in 0.693s {{(pid=84538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 19:07:19 devstack cinder-volume[84538]: DEBUG cinder.volume.drivers.remotefs [None req-a7d9727c-24a9-494d-83e4-76184cd2a472 tempest-VolumeDependencyTests-1062757540 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-bb0348af-f082-44d7-9d93-4ea30ea8028b(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=84538) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 29 19:07:19 devstack cinder-volume[84538]: DEBUG oslo.privsep.daemon [-] privsep: reply[de693192-e034-416e-aad2-5564e4fa870b]: (4, 'qcow2') {{(pid=85803) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 19:07:19 devstack cinder-volume[84538]: DEBUG oslo_concurrency.processutils [None req-a7d9727c-24a9-494d-83e4-76184cd2a472 tempest-VolumeDependencyTests-1062757540 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-bb0348af-f082-44d7-9d93-4ea30ea8028b {{(pid=84538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 19:07:19 devstack sudo[93314]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-bb0348af-f082-44d7-9d93-4ea30ea8028b Apr 29 19:07:19 devstack sudo[93314]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 19:07:20 devstack sudo[93314]: pam_unix(sudo:session): session closed for user root Apr 29 19:07:20 devstack cinder-volume[84538]: DEBUG oslo_concurrency.processutils [None req-a7d9727c-24a9-494d-83e4-76184cd2a472 tempest-VolumeDependencyTests-1062757540 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-bb0348af-f082-44d7-9d93-4ea30ea8028b" returned: 0 in 0.690s {{(pid=84538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 19:07:20 devstack cinder-volume[84538]: DEBUG oslo_concurrency.processutils [None req-a7d9727c-24a9-494d-83e4-76184cd2a472 tempest-VolumeDependencyTests-1062757540 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-bb0348af-f082-44d7-9d93-4ea30ea8028b.701ccb30-b9db-43e5-af03-508485ba6e01 {{(pid=84538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 19:07:20 devstack sudo[93319]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-bb0348af-f082-44d7-9d93-4ea30ea8028b.701ccb30-b9db-43e5-af03-508485ba6e01 Apr 29 19:07:20 devstack sudo[93319]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 19:07:21 devstack sudo[93319]: pam_unix(sudo:session): session closed for user root Apr 29 19:07:21 devstack cinder-volume[84538]: DEBUG oslo_concurrency.processutils [None req-a7d9727c-24a9-494d-83e4-76184cd2a472 tempest-VolumeDependencyTests-1062757540 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-bb0348af-f082-44d7-9d93-4ea30ea8028b.701ccb30-b9db-43e5-af03-508485ba6e01" returned: 0 in 0.668s {{(pid=84538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 19:07:21 devstack cinder-volume[84538]: DEBUG oslo_concurrency.processutils [None req-a7d9727c-24a9-494d-83e4-76184cd2a472 tempest-VolumeDependencyTests-1062757540 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-bb0348af-f082-44d7-9d93-4ea30ea8028b.701ccb30-b9db-43e5-af03-508485ba6e01 {{(pid=84538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 19:07:21 devstack sudo[93324]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-bb0348af-f082-44d7-9d93-4ea30ea8028b.701ccb30-b9db-43e5-af03-508485ba6e01 Apr 29 19:07:21 devstack sudo[93324]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 19:07:21 devstack sudo[93324]: pam_unix(sudo:session): session closed for user root Apr 29 19:07:21 devstack cinder-volume[84538]: DEBUG oslo_concurrency.processutils [None req-a7d9727c-24a9-494d-83e4-76184cd2a472 tempest-VolumeDependencyTests-1062757540 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-bb0348af-f082-44d7-9d93-4ea30ea8028b.701ccb30-b9db-43e5-af03-508485ba6e01" returned: 0 in 0.592s {{(pid=84538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 19:07:21 devstack cinder-volume[84538]: DEBUG cinder.coordination [None req-a7d9727c-24a9-494d-83e4-76184cd2a472 tempest-VolumeDependencyTests-1062757540 None] Lock "cinder-quobyte-701ccb30-b9db-43e5-af03-508485ba6e01" released by "_delete_snapshot" :: held 2.734s {{(pid=84538) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 19:07:21 devstack cinder-volume[84538]: DEBUG oslo_concurrency.lockutils [None req-a7d9727c-24a9-494d-83e4-76184cd2a472 tempest-VolumeDependencyTests-1062757540 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: held 14.339s {{(pid=84538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 19:07:21 devstack cinder-volume[84538]: DEBUG oslo_concurrency.lockutils [None req-eabdc885-58c1-45fc-bef9-ae1a0b23d410 tempest-VolumesGetTest-1123317664 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 13.734s {{(pid=84538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 19:07:21 devstack cinder-volume[84538]: DEBUG cinder.volume.drivers.quobyte [None req-eabdc885-58c1-45fc-bef9-ae1a0b23d410 tempest-VolumesGetTest-1123317664 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-29T17:07:08Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-197162041',display_name='tempest-VolumesGetTest-Volume-2056102901',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=559e72e2-f6d4-4f1a-adab-545cbad0ebb3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='62ab81799a05449b9f5b7eb23c6c9071',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T17:07:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T17:07:08Z,use_quota=True,user_id='2c9aaf152c0f49d3887038450048a477',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(62b05900-93e3-4190-a88f-1d87324303d1),volume_type_id=62b05900-93e3-4190-a88f-1d87324303d1)}" {{(pid=84538) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 29 19:07:21 devstack cinder-volume[84538]: DEBUG cinder.volume.drivers.remotefs [None req-eabdc885-58c1-45fc-bef9-ae1a0b23d410 tempest-VolumesGetTest-1123317664 None] Creating volume 559e72e2-f6d4-4f1a-adab-545cbad0ebb3 {{(pid=84538) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 29 19:07:21 devstack cinder-volume[84538]: DEBUG oslo_concurrency.lockutils [None req-eabdc885-58c1-45fc-bef9-ae1a0b23d410 tempest-VolumesGetTest-1123317664 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 19:07:21 devstack cinder-volume[84538]: DEBUG oslo_concurrency.lockutils [None req-eabdc885-58c1-45fc-bef9-ae1a0b23d410 tempest-VolumesGetTest-1123317664 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=84538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 19:07:21 devstack cinder-volume[84538]: DEBUG cinder.volume.drivers.quobyte [None req-eabdc885-58c1-45fc-bef9-ae1a0b23d410 tempest-VolumesGetTest-1123317664 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-34312b00-dd6d-45bb-af98-75855cea8e48': None} {{(pid=84538) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 19:07:21 devstack cinder-volume[84538]: DEBUG cinder.volume.drivers.quobyte [None req-eabdc885-58c1-45fc-bef9-ae1a0b23d410 tempest-VolumesGetTest-1123317664 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-34312b00-dd6d-45bb-af98-75855cea8e48'] {{(pid=84538) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 19:07:21 devstack cinder-volume[84538]: DEBUG oslo_concurrency.lockutils [None req-eabdc885-58c1-45fc-bef9-ae1a0b23d410 tempest-VolumesGetTest-1123317664 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=84538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 19:07:21 devstack cinder-volume[84538]: DEBUG cinder.volume.drivers.quobyte [None req-eabdc885-58c1-45fc-bef9-ae1a0b23d410 tempest-VolumesGetTest-1123317664 None] Selected osci02.corp.quobyte.com/cinder-vol-34312b00-dd6d-45bb-af98-75855cea8e48 as target Quobyte volume. {{(pid=84538) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 29 19:07:21 devstack cinder-volume[84538]: INFO cinder.volume.drivers.remotefs [None req-eabdc885-58c1-45fc-bef9-ae1a0b23d410 tempest-VolumesGetTest-1123317664 None] casted to osci02.corp.quobyte.com/cinder-vol-34312b00-dd6d-45bb-af98-75855cea8e48 Apr 29 19:07:21 devstack cinder-volume[84538]: DEBUG oslo_concurrency.processutils [None req-eabdc885-58c1-45fc-bef9-ae1a0b23d410 tempest-VolumesGetTest-1123317664 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-559e72e2-f6d4-4f1a-adab-545cbad0ebb3 1073741824 {{(pid=84538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 19:07:21 devstack cinder-volume[84538]: DEBUG cinder.volume.manager [None req-a7d9727c-24a9-494d-83e4-76184cd2a472 tempest-VolumeDependencyTests-1062757540 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (aaadcec9-7e57-4088-a498-3bff2ba26d62) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-fb433e82-fba2-46c2-a11a-a5ed97f5294f', 'volume_size': 1, 'source_volid': 'bb0348af-f082-44d7-9d93-4ea30ea8028b', 'source_volstatus': 'available'}' {{(pid=84538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 19:07:21 devstack sudo[93327]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-559e72e2-f6d4-4f1a-adab-545cbad0ebb3 1073741824 Apr 29 19:07:21 devstack sudo[93327]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 19:07:21 devstack cinder-volume[84538]: DEBUG cinder.volume.manager [None req-a7d9727c-24a9-494d-83e4-76184cd2a472 tempest-VolumeDependencyTests-1062757540 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c7c1b1a9-a601-4da9-8bf3-f616203a7965) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 19:07:21 devstack cinder-volume[84538]: INFO cinder.volume.flows.manager.create_volume [None req-a7d9727c-24a9-494d-83e4-76184cd2a472 tempest-VolumeDependencyTests-1062757540 None] Volume volume-fb433e82-fba2-46c2-a11a-a5ed97f5294f (fb433e82-fba2-46c2-a11a-a5ed97f5294f): created successfully Apr 29 19:07:21 devstack cinder-volume[84538]: DEBUG cinder.volume.manager [None req-a7d9727c-24a9-494d-83e4-76184cd2a472 tempest-VolumeDependencyTests-1062757540 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c7c1b1a9-a601-4da9-8bf3-f616203a7965) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 19:07:21 devstack cinder-volume[84538]: DEBUG cinder.volume.manager [None req-a7d9727c-24a9-494d-83e4-76184cd2a472 tempest-VolumeDependencyTests-1062757540 None] Flow 'volume_create_manager' (ac6bca7b-5897-4c3b-b0f3-6037779d4342) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84538) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 19:07:21 devstack cinder-volume[84538]: INFO cinder.volume.manager [None req-a7d9727c-24a9-494d-83e4-76184cd2a472 tempest-VolumeDependencyTests-1062757540 None] Created volume successfully. Apr 29 19:07:22 devstack cinder-volume[84538]: DEBUG cinder.coordination [None req-ca2f20e5-35e1-4819-b305-12b1fda8a5ad tempest-VolumeDependencyTests-1062757540 None] Acquiring lock "cinder-bb0348af-f082-44d7-9d93-4ea30ea8028b-delete_volume" by "delete_volume" {{(pid=84538) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 19:07:22 devstack cinder-volume[84538]: DEBUG cinder.coordination [None req-ca2f20e5-35e1-4819-b305-12b1fda8a5ad tempest-VolumeDependencyTests-1062757540 None] Lock "cinder-bb0348af-f082-44d7-9d93-4ea30ea8028b-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=84538) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 19:07:22 devstack cinder-volume[84538]: DEBUG cinder.coordination [None req-ca2f20e5-35e1-4819-b305-12b1fda8a5ad tempest-VolumeDependencyTests-1062757540 None] Acquiring lock "cinder-quobyte-bb0348af-f082-44d7-9d93-4ea30ea8028b" by "delete_volume" {{(pid=84538) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 19:07:22 devstack cinder-volume[84538]: DEBUG cinder.coordination [None req-ca2f20e5-35e1-4819-b305-12b1fda8a5ad tempest-VolumeDependencyTests-1062757540 None] Lock "cinder-quobyte-bb0348af-f082-44d7-9d93-4ea30ea8028b" acquired by "delete_volume" :: waited 0.017s {{(pid=84538) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 19:07:22 devstack cinder-volume[84538]: DEBUG oslo.privsep.daemon [-] privsep: reply[344ee9ac-c419-425d-908d-5e1886dda183]: (4, 'qcow2') {{(pid=85803) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 19:07:22 devstack cinder-volume[84538]: DEBUG oslo_concurrency.processutils [None req-ca2f20e5-35e1-4819-b305-12b1fda8a5ad tempest-VolumeDependencyTests-1062757540 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-bb0348af-f082-44d7-9d93-4ea30ea8028b {{(pid=84538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 19:07:22 devstack sudo[93327]: pam_unix(sudo:session): session closed for user root Apr 29 19:07:22 devstack cinder-volume[84538]: DEBUG oslo_concurrency.processutils [None req-eabdc885-58c1-45fc-bef9-ae1a0b23d410 tempest-VolumesGetTest-1123317664 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-559e72e2-f6d4-4f1a-adab-545cbad0ebb3 1073741824" returned: 0 in 0.823s {{(pid=84538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 19:07:22 devstack cinder-volume[84538]: DEBUG oslo_concurrency.processutils [None req-eabdc885-58c1-45fc-bef9-ae1a0b23d410 tempest-VolumesGetTest-1123317664 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-559e72e2-f6d4-4f1a-adab-545cbad0ebb3 {{(pid=84538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 19:07:22 devstack sudo[93333]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-bb0348af-f082-44d7-9d93-4ea30ea8028b Apr 29 19:07:22 devstack sudo[93333]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 19:07:22 devstack sudo[93334]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-559e72e2-f6d4-4f1a-adab-545cbad0ebb3 Apr 29 19:07:22 devstack sudo[93334]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 19:07:23 devstack sudo[93333]: pam_unix(sudo:session): session closed for user root Apr 29 19:07:23 devstack cinder-volume[84538]: DEBUG oslo_concurrency.processutils [None req-ca2f20e5-35e1-4819-b305-12b1fda8a5ad tempest-VolumeDependencyTests-1062757540 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-bb0348af-f082-44d7-9d93-4ea30ea8028b" returned: 0 in 0.699s {{(pid=84538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 19:07:23 devstack cinder-volume[84538]: DEBUG oslo_concurrency.processutils [None req-ca2f20e5-35e1-4819-b305-12b1fda8a5ad tempest-VolumeDependencyTests-1062757540 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-bb0348af-f082-44d7-9d93-4ea30ea8028b {{(pid=84538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 19:07:23 devstack sudo[93341]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-bb0348af-f082-44d7-9d93-4ea30ea8028b Apr 29 19:07:23 devstack sudo[93341]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 19:07:23 devstack sudo[93334]: pam_unix(sudo:session): session closed for user root Apr 29 19:07:23 devstack cinder-volume[84538]: DEBUG oslo_concurrency.processutils [None req-eabdc885-58c1-45fc-bef9-ae1a0b23d410 tempest-VolumesGetTest-1123317664 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-559e72e2-f6d4-4f1a-adab-545cbad0ebb3" returned: 0 in 0.633s {{(pid=84538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 19:07:23 devstack cinder-volume[84538]: DEBUG cinder.volume.drivers.quobyte [None req-eabdc885-58c1-45fc-bef9-ae1a0b23d410 tempest-VolumesGetTest-1123317664 None] <== create_volume: return (1493ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-34312b00-dd6d-45bb-af98-75855cea8e48'} {{(pid=84538) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 29 19:07:23 devstack cinder-volume[84538]: DEBUG oslo_concurrency.lockutils [None req-eabdc885-58c1-45fc-bef9-ae1a0b23d410 tempest-VolumesGetTest-1123317664 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.497s {{(pid=84538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 19:07:23 devstack cinder-volume[84538]: DEBUG cinder.volume.manager [None req-eabdc885-58c1-45fc-bef9-ae1a0b23d410 tempest-VolumesGetTest-1123317664 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (50dee34b-ce42-4c01-994c-78bf4d0d23ea) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-559e72e2-f6d4-4f1a-adab-545cbad0ebb3', 'volume_size': 1}' {{(pid=84538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 19:07:23 devstack cinder-volume[84538]: DEBUG cinder.volume.manager [None req-eabdc885-58c1-45fc-bef9-ae1a0b23d410 tempest-VolumesGetTest-1123317664 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3cc5412f-2cac-438e-9105-088eee3d5a31) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 19:07:23 devstack cinder-volume[84538]: INFO cinder.volume.flows.manager.create_volume [None req-eabdc885-58c1-45fc-bef9-ae1a0b23d410 tempest-VolumesGetTest-1123317664 None] Volume volume-559e72e2-f6d4-4f1a-adab-545cbad0ebb3 (559e72e2-f6d4-4f1a-adab-545cbad0ebb3): created successfully Apr 29 19:07:23 devstack cinder-volume[84538]: DEBUG cinder.volume.manager [None req-eabdc885-58c1-45fc-bef9-ae1a0b23d410 tempest-VolumesGetTest-1123317664 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3cc5412f-2cac-438e-9105-088eee3d5a31) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 19:07:23 devstack cinder-volume[84538]: DEBUG cinder.volume.manager [None req-eabdc885-58c1-45fc-bef9-ae1a0b23d410 tempest-VolumesGetTest-1123317664 None] Flow 'volume_create_manager' (28e2f27a-8967-404a-ba20-fa70f69ec9bb) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84538) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 19:07:23 devstack cinder-volume[84538]: INFO cinder.volume.manager [None req-eabdc885-58c1-45fc-bef9-ae1a0b23d410 tempest-VolumesGetTest-1123317664 None] Created volume successfully. Apr 29 19:07:23 devstack sudo[93341]: pam_unix(sudo:session): session closed for user root Apr 29 19:07:23 devstack cinder-volume[84538]: DEBUG oslo_concurrency.processutils [None req-ca2f20e5-35e1-4819-b305-12b1fda8a5ad tempest-VolumeDependencyTests-1062757540 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-bb0348af-f082-44d7-9d93-4ea30ea8028b" returned: 0 in 0.585s {{(pid=84538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 19:07:23 devstack cinder-volume[84538]: DEBUG cinder.coordination [None req-ca2f20e5-35e1-4819-b305-12b1fda8a5ad tempest-VolumeDependencyTests-1062757540 None] Lock "cinder-quobyte-bb0348af-f082-44d7-9d93-4ea30ea8028b" released by "delete_volume" :: held 1.347s {{(pid=84538) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 19:07:23 devstack cinder-volume[84538]: DEBUG cinder.quota [None req-ca2f20e5-35e1-4819-b305-12b1fda8a5ad tempest-VolumeDependencyTests-1062757540 None] Created reservations ['c17e9a63-dfab-40ac-8a46-5efeaa1b2c96', '91d8f020-e127-4850-bd38-c73b19f4b381', '32383f4c-5c8d-44ee-8438-8b5e5c2528aa', 'a1c7b71d-a9b8-42cc-9ae3-e47e1135dc4e'] {{(pid=84538) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 29 19:07:23 devstack cinder-volume[84538]: DEBUG oslo_concurrency.lockutils [None req-ca2f20e5-35e1-4819-b305-12b1fda8a5ad tempest-VolumeDependencyTests-1062757540 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 19:07:23 devstack cinder-volume[84538]: DEBUG oslo_concurrency.lockutils [None req-ca2f20e5-35e1-4819-b305-12b1fda8a5ad tempest-VolumeDependencyTests-1062757540 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 19:07:23 devstack cinder-volume[84538]: DEBUG cinder.volume.drivers.quobyte [None req-ca2f20e5-35e1-4819-b305-12b1fda8a5ad tempest-VolumeDependencyTests-1062757540 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-34312b00-dd6d-45bb-af98-75855cea8e48': None} {{(pid=84538) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 19:07:23 devstack cinder-volume[84538]: DEBUG cinder.volume.drivers.quobyte [None req-ca2f20e5-35e1-4819-b305-12b1fda8a5ad tempest-VolumeDependencyTests-1062757540 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-34312b00-dd6d-45bb-af98-75855cea8e48'] {{(pid=84538) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 19:07:23 devstack cinder-volume[84538]: DEBUG oslo_concurrency.lockutils [None req-ca2f20e5-35e1-4819-b305-12b1fda8a5ad tempest-VolumeDependencyTests-1062757540 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=84538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 19:07:23 devstack cinder-volume[84538]: DEBUG oslo_concurrency.processutils [None req-ca2f20e5-35e1-4819-b305-12b1fda8a5ad tempest-VolumeDependencyTests-1062757540 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d {{(pid=84538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 19:07:23 devstack sudo[93344]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d Apr 29 19:07:23 devstack sudo[93344]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 19:07:24 devstack cinder-volume[84538]: DEBUG cinder.coordination [None req-05bb9133-67d4-46c4-b1d9-480f490e537d tempest-VolumesGetTest-1123317664 None] Acquiring lock "cinder-559e72e2-f6d4-4f1a-adab-545cbad0ebb3-delete_volume" by "delete_volume" {{(pid=84538) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 19:07:24 devstack cinder-volume[84538]: DEBUG cinder.coordination [None req-05bb9133-67d4-46c4-b1d9-480f490e537d tempest-VolumesGetTest-1123317664 None] Lock "cinder-559e72e2-f6d4-4f1a-adab-545cbad0ebb3-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=84538) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 19:07:24 devstack cinder-volume[84538]: DEBUG cinder.coordination [None req-05bb9133-67d4-46c4-b1d9-480f490e537d tempest-VolumesGetTest-1123317664 None] Acquiring lock "cinder-quobyte-559e72e2-f6d4-4f1a-adab-545cbad0ebb3" by "delete_volume" {{(pid=84538) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 19:07:24 devstack cinder-volume[84538]: DEBUG cinder.coordination [None req-05bb9133-67d4-46c4-b1d9-480f490e537d tempest-VolumesGetTest-1123317664 None] Lock "cinder-quobyte-559e72e2-f6d4-4f1a-adab-545cbad0ebb3" acquired by "delete_volume" :: waited 0.020s {{(pid=84538) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 19:07:24 devstack cinder-volume[84538]: DEBUG oslo.privsep.daemon [-] privsep: reply[d35c3ecd-27ce-46cf-ab29-6508d99563d3]: (4, 'qcow2') {{(pid=85803) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 19:07:24 devstack cinder-volume[84538]: DEBUG oslo_concurrency.processutils [None req-05bb9133-67d4-46c4-b1d9-480f490e537d tempest-VolumesGetTest-1123317664 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-559e72e2-f6d4-4f1a-adab-545cbad0ebb3 {{(pid=84538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 19:07:24 devstack sudo[93346]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-559e72e2-f6d4-4f1a-adab-545cbad0ebb3 Apr 29 19:07:24 devstack sudo[93346]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 19:07:24 devstack sudo[93344]: pam_unix(sudo:session): session closed for user root Apr 29 19:07:24 devstack cinder-volume[84538]: DEBUG oslo_concurrency.processutils [None req-ca2f20e5-35e1-4819-b305-12b1fda8a5ad tempest-VolumeDependencyTests-1062757540 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d" returned: 0 in 0.613s {{(pid=84538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 19:07:24 devstack cinder-volume[84538]: DEBUG cinder.manager [None req-ca2f20e5-35e1-4819-b305-12b1fda8a5ad tempest-VolumeDependencyTests-1062757540 None] Notifying Schedulers of capabilities ... {{(pid=84538) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 29 19:07:24 devstack cinder-volume[84538]: INFO cinder.volume.manager [None req-ca2f20e5-35e1-4819-b305-12b1fda8a5ad tempest-VolumeDependencyTests-1062757540 None] Deleted volume successfully. Apr 29 19:07:24 devstack cinder-volume[84538]: DEBUG cinder.coordination [None req-ca2f20e5-35e1-4819-b305-12b1fda8a5ad tempest-VolumeDependencyTests-1062757540 None] Lock "cinder-bb0348af-f082-44d7-9d93-4ea30ea8028b-delete_volume" released by "delete_volume" :: held 2.157s {{(pid=84538) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 19:07:24 devstack cinder-volume[84538]: DEBUG cinder.coordination [None req-4b6aad91-7af2-49a4-a9db-1add17287c85 tempest-VolumeDependencyTests-1062757540 None] Acquiring lock "cinder-fb433e82-fba2-46c2-a11a-a5ed97f5294f-delete_volume" by "delete_volume" {{(pid=84538) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 19:07:24 devstack cinder-volume[84538]: DEBUG cinder.coordination [None req-4b6aad91-7af2-49a4-a9db-1add17287c85 tempest-VolumeDependencyTests-1062757540 None] Lock "cinder-fb433e82-fba2-46c2-a11a-a5ed97f5294f-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=84538) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 19:07:24 devstack cinder-volume[84538]: DEBUG cinder.coordination [None req-4b6aad91-7af2-49a4-a9db-1add17287c85 tempest-VolumeDependencyTests-1062757540 None] Acquiring lock "cinder-quobyte-fb433e82-fba2-46c2-a11a-a5ed97f5294f" by "delete_volume" {{(pid=84538) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 19:07:24 devstack cinder-volume[84538]: DEBUG cinder.coordination [None req-4b6aad91-7af2-49a4-a9db-1add17287c85 tempest-VolumeDependencyTests-1062757540 None] Lock "cinder-quobyte-fb433e82-fba2-46c2-a11a-a5ed97f5294f" acquired by "delete_volume" :: waited 0.018s {{(pid=84538) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 19:07:24 devstack cinder-volume[84538]: DEBUG oslo.privsep.daemon [-] privsep: reply[0b0ccb02-18f6-4f56-8e41-154b07615e48]: (4, 'qcow2') {{(pid=85803) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 19:07:24 devstack cinder-volume[84538]: DEBUG oslo_concurrency.processutils [None req-4b6aad91-7af2-49a4-a9db-1add17287c85 tempest-VolumeDependencyTests-1062757540 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-fb433e82-fba2-46c2-a11a-a5ed97f5294f {{(pid=84538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 19:07:24 devstack sudo[93349]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-fb433e82-fba2-46c2-a11a-a5ed97f5294f Apr 29 19:07:24 devstack sudo[93349]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 19:07:25 devstack sudo[93346]: pam_unix(sudo:session): session closed for user root Apr 29 19:07:25 devstack cinder-volume[84538]: DEBUG oslo_concurrency.processutils [None req-05bb9133-67d4-46c4-b1d9-480f490e537d tempest-VolumesGetTest-1123317664 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-559e72e2-f6d4-4f1a-adab-545cbad0ebb3" returned: 0 in 0.749s {{(pid=84538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 19:07:25 devstack cinder-volume[84538]: DEBUG oslo_concurrency.processutils [None req-05bb9133-67d4-46c4-b1d9-480f490e537d tempest-VolumesGetTest-1123317664 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-559e72e2-f6d4-4f1a-adab-545cbad0ebb3 {{(pid=84538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 19:07:25 devstack sudo[93354]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-559e72e2-f6d4-4f1a-adab-545cbad0ebb3 Apr 29 19:07:25 devstack sudo[93354]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 19:07:25 devstack cinder-volume[84538]: DEBUG oslo_service.periodic_task [None req-a93183a6-1080-461c-84de-2fcb210d4f60 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=84538) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}} Apr 29 19:07:25 devstack cinder-volume[84538]: DEBUG oslo_concurrency.lockutils [None req-a93183a6-1080-461c-84de-2fcb210d4f60 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 19:07:25 devstack cinder-volume[84538]: DEBUG oslo_concurrency.lockutils [None req-a93183a6-1080-461c-84de-2fcb210d4f60 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=84538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 19:07:25 devstack cinder-volume[84538]: DEBUG cinder.volume.drivers.quobyte [None req-a93183a6-1080-461c-84de-2fcb210d4f60 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-34312b00-dd6d-45bb-af98-75855cea8e48': None} {{(pid=84538) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 19:07:25 devstack cinder-volume[84538]: DEBUG cinder.volume.drivers.quobyte [None req-a93183a6-1080-461c-84de-2fcb210d4f60 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-34312b00-dd6d-45bb-af98-75855cea8e48'] {{(pid=84538) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 19:07:25 devstack cinder-volume[84538]: DEBUG oslo_concurrency.lockutils [None req-a93183a6-1080-461c-84de-2fcb210d4f60 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=84538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 19:07:25 devstack cinder-volume[84538]: DEBUG oslo_concurrency.processutils [None req-a93183a6-1080-461c-84de-2fcb210d4f60 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d {{(pid=84538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 19:07:25 devstack sudo[93356]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d Apr 29 19:07:25 devstack sudo[93356]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 19:07:25 devstack sudo[93349]: pam_unix(sudo:session): session closed for user root Apr 29 19:07:25 devstack cinder-volume[84538]: DEBUG oslo_concurrency.processutils [None req-4b6aad91-7af2-49a4-a9db-1add17287c85 tempest-VolumeDependencyTests-1062757540 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-fb433e82-fba2-46c2-a11a-a5ed97f5294f" returned: 0 in 0.740s {{(pid=84538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 19:07:25 devstack cinder-volume[84538]: DEBUG oslo_concurrency.processutils [None req-4b6aad91-7af2-49a4-a9db-1add17287c85 tempest-VolumeDependencyTests-1062757540 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-fb433e82-fba2-46c2-a11a-a5ed97f5294f {{(pid=84538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 19:07:25 devstack sudo[93361]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-fb433e82-fba2-46c2-a11a-a5ed97f5294f Apr 29 19:07:25 devstack sudo[93361]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 19:07:25 devstack sudo[93354]: pam_unix(sudo:session): session closed for user root Apr 29 19:07:25 devstack cinder-volume[84538]: DEBUG oslo_concurrency.processutils [None req-05bb9133-67d4-46c4-b1d9-480f490e537d tempest-VolumesGetTest-1123317664 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-559e72e2-f6d4-4f1a-adab-545cbad0ebb3" returned: 0 in 0.654s {{(pid=84538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 19:07:25 devstack cinder-volume[84538]: DEBUG cinder.coordination [None req-05bb9133-67d4-46c4-b1d9-480f490e537d tempest-VolumesGetTest-1123317664 None] Lock "cinder-quobyte-559e72e2-f6d4-4f1a-adab-545cbad0ebb3" released by "delete_volume" :: held 1.448s {{(pid=84538) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 19:07:25 devstack sudo[93356]: pam_unix(sudo:session): session closed for user root Apr 29 19:07:25 devstack cinder-volume[84538]: DEBUG oslo_concurrency.processutils [None req-a93183a6-1080-461c-84de-2fcb210d4f60 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d" returned: 0 in 0.613s {{(pid=84538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 19:07:25 devstack cinder-volume[84538]: DEBUG cinder.manager [None req-a93183a6-1080-461c-84de-2fcb210d4f60 None None] Notifying Schedulers of capabilities ... {{(pid=84538) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 29 19:07:25 devstack cinder-volume[84538]: DEBUG cinder.quota [None req-05bb9133-67d4-46c4-b1d9-480f490e537d tempest-VolumesGetTest-1123317664 None] Created reservations ['31288b04-2624-4b75-ab79-fcdb9a9f7865', 'c59917de-567a-4a1e-8859-ffc4eef76584', 'ee489c3f-4b0f-43b8-88ff-7cf2fff8ed20', '66d16db5-34af-464f-b40f-86279b1af93f'] {{(pid=84538) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 29 19:07:25 devstack cinder-volume[84538]: DEBUG oslo_concurrency.lockutils [None req-05bb9133-67d4-46c4-b1d9-480f490e537d tempest-VolumesGetTest-1123317664 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 19:07:25 devstack cinder-volume[84538]: DEBUG oslo_concurrency.lockutils [None req-05bb9133-67d4-46c4-b1d9-480f490e537d tempest-VolumesGetTest-1123317664 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 19:07:25 devstack cinder-volume[84538]: DEBUG cinder.volume.drivers.quobyte [None req-05bb9133-67d4-46c4-b1d9-480f490e537d tempest-VolumesGetTest-1123317664 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-34312b00-dd6d-45bb-af98-75855cea8e48': None} {{(pid=84538) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 19:07:25 devstack cinder-volume[84538]: DEBUG cinder.volume.drivers.quobyte [None req-05bb9133-67d4-46c4-b1d9-480f490e537d tempest-VolumesGetTest-1123317664 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-34312b00-dd6d-45bb-af98-75855cea8e48'] {{(pid=84538) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 19:07:25 devstack cinder-volume[84538]: DEBUG oslo_concurrency.lockutils [None req-05bb9133-67d4-46c4-b1d9-480f490e537d tempest-VolumesGetTest-1123317664 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=84538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 19:07:25 devstack cinder-volume[84538]: DEBUG oslo_concurrency.processutils [None req-05bb9133-67d4-46c4-b1d9-480f490e537d tempest-VolumesGetTest-1123317664 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d {{(pid=84538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 19:07:25 devstack sudo[93365]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d Apr 29 19:07:25 devstack sudo[93365]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 19:07:26 devstack sudo[93361]: pam_unix(sudo:session): session closed for user root Apr 29 19:07:26 devstack cinder-volume[84538]: DEBUG oslo_concurrency.processutils [None req-4b6aad91-7af2-49a4-a9db-1add17287c85 tempest-VolumeDependencyTests-1062757540 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-fb433e82-fba2-46c2-a11a-a5ed97f5294f" returned: 0 in 0.607s {{(pid=84538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 19:07:26 devstack cinder-volume[84538]: DEBUG cinder.coordination [None req-4b6aad91-7af2-49a4-a9db-1add17287c85 tempest-VolumeDependencyTests-1062757540 None] Lock "cinder-quobyte-fb433e82-fba2-46c2-a11a-a5ed97f5294f" released by "delete_volume" :: held 1.389s {{(pid=84538) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 19:07:26 devstack cinder-volume[84538]: DEBUG cinder.quota [None req-4b6aad91-7af2-49a4-a9db-1add17287c85 tempest-VolumeDependencyTests-1062757540 None] Created reservations ['10420ea0-4c19-4d3e-b464-330bc6b586a1', 'de393330-0879-4af2-87d1-b024b158b312', 'c2e8c64d-657c-4ff4-b196-9673401eda92', 'f1df96ef-c38d-4a8d-9907-914d4dd8133a'] {{(pid=84538) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 29 19:07:26 devstack cinder-volume[84538]: DEBUG oslo_concurrency.lockutils [None req-4b6aad91-7af2-49a4-a9db-1add17287c85 tempest-VolumeDependencyTests-1062757540 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 19:07:26 devstack cinder-volume[84538]: DEBUG oslo_concurrency.lockutils [None req-4b6aad91-7af2-49a4-a9db-1add17287c85 tempest-VolumeDependencyTests-1062757540 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 19:07:26 devstack cinder-volume[84538]: DEBUG cinder.volume.drivers.quobyte [None req-4b6aad91-7af2-49a4-a9db-1add17287c85 tempest-VolumeDependencyTests-1062757540 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-34312b00-dd6d-45bb-af98-75855cea8e48': None} {{(pid=84538) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 19:07:26 devstack cinder-volume[84538]: DEBUG cinder.volume.drivers.quobyte [None req-4b6aad91-7af2-49a4-a9db-1add17287c85 tempest-VolumeDependencyTests-1062757540 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-34312b00-dd6d-45bb-af98-75855cea8e48'] {{(pid=84538) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 19:07:26 devstack cinder-volume[84538]: DEBUG oslo_concurrency.lockutils [None req-4b6aad91-7af2-49a4-a9db-1add17287c85 tempest-VolumeDependencyTests-1062757540 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=84538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 19:07:26 devstack cinder-volume[84538]: DEBUG oslo_concurrency.processutils [None req-4b6aad91-7af2-49a4-a9db-1add17287c85 tempest-VolumeDependencyTests-1062757540 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d {{(pid=84538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 19:07:26 devstack sudo[93368]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d Apr 29 19:07:26 devstack sudo[93368]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 19:07:26 devstack sudo[93365]: pam_unix(sudo:session): session closed for user root Apr 29 19:07:26 devstack cinder-volume[84538]: DEBUG oslo_concurrency.processutils [None req-05bb9133-67d4-46c4-b1d9-480f490e537d tempest-VolumesGetTest-1123317664 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d" returned: 0 in 0.617s {{(pid=84538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 19:07:26 devstack cinder-volume[84538]: DEBUG cinder.manager [None req-05bb9133-67d4-46c4-b1d9-480f490e537d tempest-VolumesGetTest-1123317664 None] Notifying Schedulers of capabilities ... {{(pid=84538) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 29 19:07:26 devstack cinder-volume[84538]: INFO cinder.volume.manager [None req-05bb9133-67d4-46c4-b1d9-480f490e537d tempest-VolumesGetTest-1123317664 None] Deleted volume successfully. Apr 29 19:07:26 devstack cinder-volume[84538]: DEBUG cinder.coordination [None req-9a685dde-35e9-41d9-a134-2255bc0a4770 tempest-VolumesGetTest-1123317664 None] Acquiring lock "cinder-179e2c93-6df9-40f4-88d6-88c3cb9bf54b-delete_volume" by "delete_volume" {{(pid=84538) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 19:07:26 devstack cinder-volume[84538]: DEBUG cinder.coordination [None req-05bb9133-67d4-46c4-b1d9-480f490e537d tempest-VolumesGetTest-1123317664 None] Lock "cinder-559e72e2-f6d4-4f1a-adab-545cbad0ebb3-delete_volume" released by "delete_volume" :: held 2.318s {{(pid=84538) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 19:07:26 devstack cinder-volume[84538]: DEBUG cinder.coordination [None req-9a685dde-35e9-41d9-a134-2255bc0a4770 tempest-VolumesGetTest-1123317664 None] Lock "cinder-179e2c93-6df9-40f4-88d6-88c3cb9bf54b-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=84538) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 19:07:26 devstack cinder-volume[84538]: DEBUG cinder.coordination [None req-9a685dde-35e9-41d9-a134-2255bc0a4770 tempest-VolumesGetTest-1123317664 None] Acquiring lock "cinder-quobyte-179e2c93-6df9-40f4-88d6-88c3cb9bf54b" by "delete_volume" {{(pid=84538) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 19:07:26 devstack cinder-volume[84538]: DEBUG cinder.coordination [None req-9a685dde-35e9-41d9-a134-2255bc0a4770 tempest-VolumesGetTest-1123317664 None] Lock "cinder-quobyte-179e2c93-6df9-40f4-88d6-88c3cb9bf54b" acquired by "delete_volume" :: waited 0.015s {{(pid=84538) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 19:07:26 devstack cinder-volume[84538]: DEBUG oslo.privsep.daemon [-] privsep: reply[fc8d6430-b711-463e-b404-fca725ba934d]: (4, 'raw') {{(pid=85803) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 19:07:26 devstack cinder-volume[84538]: DEBUG oslo_concurrency.processutils [None req-9a685dde-35e9-41d9-a134-2255bc0a4770 tempest-VolumesGetTest-1123317664 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-179e2c93-6df9-40f4-88d6-88c3cb9bf54b {{(pid=84538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 19:07:26 devstack sudo[93371]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-179e2c93-6df9-40f4-88d6-88c3cb9bf54b Apr 29 19:07:26 devstack sudo[93371]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 19:07:26 devstack sudo[93368]: pam_unix(sudo:session): session closed for user root Apr 29 19:07:26 devstack cinder-volume[84538]: DEBUG oslo_concurrency.processutils [None req-4b6aad91-7af2-49a4-a9db-1add17287c85 tempest-VolumeDependencyTests-1062757540 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d" returned: 0 in 0.635s {{(pid=84538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 19:07:26 devstack cinder-volume[84538]: DEBUG cinder.manager [None req-4b6aad91-7af2-49a4-a9db-1add17287c85 tempest-VolumeDependencyTests-1062757540 None] Notifying Schedulers of capabilities ... {{(pid=84538) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 29 19:07:26 devstack cinder-volume[84538]: INFO cinder.volume.manager [None req-4b6aad91-7af2-49a4-a9db-1add17287c85 tempest-VolumeDependencyTests-1062757540 None] Deleted volume successfully. Apr 29 19:07:26 devstack cinder-volume[84538]: DEBUG cinder.coordination [None req-4b6aad91-7af2-49a4-a9db-1add17287c85 tempest-VolumeDependencyTests-1062757540 None] Lock "cinder-fb433e82-fba2-46c2-a11a-a5ed97f5294f-delete_volume" released by "delete_volume" :: held 2.224s {{(pid=84538) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 19:07:26 devstack cinder-volume[84538]: DEBUG cinder.coordination [None req-ef09f4d0-ef35-4121-b085-687cee4213c4 tempest-VolumeDependencyTests-1062757540 None] Acquiring lock "cinder-235eb4f3-03c9-4cdd-98f4-867934ccd0d6-delete_volume" by "delete_volume" {{(pid=84538) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 19:07:26 devstack cinder-volume[84538]: DEBUG cinder.coordination [None req-ef09f4d0-ef35-4121-b085-687cee4213c4 tempest-VolumeDependencyTests-1062757540 None] Lock "cinder-235eb4f3-03c9-4cdd-98f4-867934ccd0d6-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=84538) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 19:07:26 devstack cinder-volume[84538]: DEBUG cinder.coordination [None req-ef09f4d0-ef35-4121-b085-687cee4213c4 tempest-VolumeDependencyTests-1062757540 None] Acquiring lock "cinder-quobyte-235eb4f3-03c9-4cdd-98f4-867934ccd0d6" by "delete_volume" {{(pid=84538) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 19:07:26 devstack cinder-volume[84538]: DEBUG cinder.coordination [None req-ef09f4d0-ef35-4121-b085-687cee4213c4 tempest-VolumeDependencyTests-1062757540 None] Lock "cinder-quobyte-235eb4f3-03c9-4cdd-98f4-867934ccd0d6" acquired by "delete_volume" :: waited 0.019s {{(pid=84538) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 19:07:27 devstack cinder-volume[84538]: DEBUG oslo.privsep.daemon [-] privsep: reply[21665141-5d42-4cc9-9b3e-ea9c63e51b68]: (4, 'qcow2') {{(pid=85803) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 19:07:27 devstack cinder-volume[84538]: DEBUG oslo_concurrency.processutils [None req-ef09f4d0-ef35-4121-b085-687cee4213c4 tempest-VolumeDependencyTests-1062757540 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-235eb4f3-03c9-4cdd-98f4-867934ccd0d6 {{(pid=84538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 19:07:27 devstack sudo[93375]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-235eb4f3-03c9-4cdd-98f4-867934ccd0d6 Apr 29 19:07:27 devstack sudo[93375]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 19:07:27 devstack sudo[93371]: pam_unix(sudo:session): session closed for user root Apr 29 19:07:27 devstack cinder-volume[84538]: DEBUG oslo_concurrency.processutils [None req-9a685dde-35e9-41d9-a134-2255bc0a4770 tempest-VolumesGetTest-1123317664 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-179e2c93-6df9-40f4-88d6-88c3cb9bf54b" returned: 0 in 0.718s {{(pid=84538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 19:07:27 devstack cinder-volume[84538]: DEBUG oslo_concurrency.processutils [None req-9a685dde-35e9-41d9-a134-2255bc0a4770 tempest-VolumesGetTest-1123317664 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-179e2c93-6df9-40f4-88d6-88c3cb9bf54b {{(pid=84538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 19:07:27 devstack sudo[93379]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-179e2c93-6df9-40f4-88d6-88c3cb9bf54b Apr 29 19:07:27 devstack sudo[93379]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 19:07:27 devstack sudo[93375]: pam_unix(sudo:session): session closed for user root Apr 29 19:07:27 devstack cinder-volume[84538]: DEBUG oslo_concurrency.processutils [None req-ef09f4d0-ef35-4121-b085-687cee4213c4 tempest-VolumeDependencyTests-1062757540 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-235eb4f3-03c9-4cdd-98f4-867934ccd0d6" returned: 0 in 0.734s {{(pid=84538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 19:07:27 devstack cinder-volume[84538]: DEBUG oslo_concurrency.processutils [None req-ef09f4d0-ef35-4121-b085-687cee4213c4 tempest-VolumeDependencyTests-1062757540 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-235eb4f3-03c9-4cdd-98f4-867934ccd0d6 {{(pid=84538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 19:07:27 devstack sudo[93384]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-235eb4f3-03c9-4cdd-98f4-867934ccd0d6 Apr 29 19:07:27 devstack sudo[93384]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 19:07:28 devstack sudo[93379]: pam_unix(sudo:session): session closed for user root Apr 29 19:07:28 devstack cinder-volume[84538]: DEBUG oslo_concurrency.processutils [None req-9a685dde-35e9-41d9-a134-2255bc0a4770 tempest-VolumesGetTest-1123317664 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-179e2c93-6df9-40f4-88d6-88c3cb9bf54b" returned: 1 in 0.697s {{(pid=84538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 19:07:28 devstack cinder-volume[84538]: DEBUG oslo_concurrency.processutils [None req-9a685dde-35e9-41d9-a134-2255bc0a4770 tempest-VolumesGetTest-1123317664 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-179e2c93-6df9-40f4-88d6-88c3cb9bf54b' failed. Not Retrying. {{(pid=84538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Apr 29 19:07:28 devstack cinder-volume[84538]: DEBUG oslo_concurrency.processutils [None req-9a685dde-35e9-41d9-a134-2255bc0a4770 tempest-VolumesGetTest-1123317664 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-179e2c93-6df9-40f4-88d6-88c3cb9bf54b {{(pid=84538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 19:07:28 devstack sudo[93389]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-179e2c93-6df9-40f4-88d6-88c3cb9bf54b Apr 29 19:07:28 devstack sudo[93389]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 19:07:28 devstack sudo[93384]: pam_unix(sudo:session): session closed for user root Apr 29 19:07:28 devstack cinder-volume[84538]: DEBUG oslo_concurrency.processutils [None req-ef09f4d0-ef35-4121-b085-687cee4213c4 tempest-VolumeDependencyTests-1062757540 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-235eb4f3-03c9-4cdd-98f4-867934ccd0d6" returned: 0 in 0.624s {{(pid=84538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 19:07:28 devstack cinder-volume[84538]: DEBUG cinder.coordination [None req-ef09f4d0-ef35-4121-b085-687cee4213c4 tempest-VolumeDependencyTests-1062757540 None] Lock "cinder-quobyte-235eb4f3-03c9-4cdd-98f4-867934ccd0d6" released by "delete_volume" :: held 1.402s {{(pid=84538) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 19:07:28 devstack cinder-volume[84538]: DEBUG cinder.quota [None req-ef09f4d0-ef35-4121-b085-687cee4213c4 tempest-VolumeDependencyTests-1062757540 None] Created reservations ['2722503e-e5be-41b5-9dcf-da673eaed96b', '31c2f151-6def-4025-a1d9-f067e52334d5', 'b75cd2cc-8ac7-4dde-8e20-13d4d81aa2c6', '69018ec3-42f2-434b-95c2-85f02a06a1c0'] {{(pid=84538) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 29 19:07:28 devstack cinder-volume[84538]: DEBUG oslo_concurrency.lockutils [None req-ef09f4d0-ef35-4121-b085-687cee4213c4 tempest-VolumeDependencyTests-1062757540 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 19:07:28 devstack cinder-volume[84538]: DEBUG oslo_concurrency.lockutils [None req-ef09f4d0-ef35-4121-b085-687cee4213c4 tempest-VolumeDependencyTests-1062757540 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 19:07:28 devstack cinder-volume[84538]: DEBUG cinder.volume.drivers.quobyte [None req-ef09f4d0-ef35-4121-b085-687cee4213c4 tempest-VolumeDependencyTests-1062757540 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-34312b00-dd6d-45bb-af98-75855cea8e48': None} {{(pid=84538) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 19:07:28 devstack cinder-volume[84538]: DEBUG cinder.volume.drivers.quobyte [None req-ef09f4d0-ef35-4121-b085-687cee4213c4 tempest-VolumeDependencyTests-1062757540 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-34312b00-dd6d-45bb-af98-75855cea8e48'] {{(pid=84538) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 19:07:28 devstack cinder-volume[84538]: DEBUG oslo_concurrency.lockutils [None req-ef09f4d0-ef35-4121-b085-687cee4213c4 tempest-VolumeDependencyTests-1062757540 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=84538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 19:07:28 devstack cinder-volume[84538]: DEBUG oslo_concurrency.processutils [None req-ef09f4d0-ef35-4121-b085-687cee4213c4 tempest-VolumeDependencyTests-1062757540 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d {{(pid=84538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 19:07:28 devstack sudo[93393]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d Apr 29 19:07:28 devstack sudo[93393]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 19:07:28 devstack sudo[93389]: pam_unix(sudo:session): session closed for user root Apr 29 19:07:28 devstack cinder-volume[84538]: DEBUG oslo_concurrency.processutils [None req-9a685dde-35e9-41d9-a134-2255bc0a4770 tempest-VolumesGetTest-1123317664 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-179e2c93-6df9-40f4-88d6-88c3cb9bf54b" returned: 0 in 0.640s {{(pid=84538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 19:07:28 devstack cinder-volume[84538]: DEBUG cinder.coordination [None req-9a685dde-35e9-41d9-a134-2255bc0a4770 tempest-VolumesGetTest-1123317664 None] Lock "cinder-quobyte-179e2c93-6df9-40f4-88d6-88c3cb9bf54b" released by "delete_volume" :: held 2.118s {{(pid=84538) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 19:07:28 devstack cinder-volume[84538]: DEBUG cinder.quota [None req-9a685dde-35e9-41d9-a134-2255bc0a4770 tempest-VolumesGetTest-1123317664 None] Created reservations ['4f9d1fc8-f79e-4ee6-87f9-f55b736a2f49', '796b4711-94d6-44a0-ac7f-10de5f3771a3', '451da34e-dd42-4fc0-979c-2103d85bef84', '616703d5-63bb-4456-a7db-db599c813869'] {{(pid=84538) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 29 19:07:28 devstack cinder-volume[84538]: DEBUG oslo_concurrency.lockutils [None req-9a685dde-35e9-41d9-a134-2255bc0a4770 tempest-VolumesGetTest-1123317664 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 19:07:28 devstack cinder-volume[84538]: DEBUG oslo_concurrency.lockutils [None req-9a685dde-35e9-41d9-a134-2255bc0a4770 tempest-VolumesGetTest-1123317664 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 19:07:28 devstack cinder-volume[84538]: DEBUG cinder.volume.drivers.quobyte [None req-9a685dde-35e9-41d9-a134-2255bc0a4770 tempest-VolumesGetTest-1123317664 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-34312b00-dd6d-45bb-af98-75855cea8e48': None} {{(pid=84538) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 19:07:28 devstack cinder-volume[84538]: DEBUG cinder.volume.drivers.quobyte [None req-9a685dde-35e9-41d9-a134-2255bc0a4770 tempest-VolumesGetTest-1123317664 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-34312b00-dd6d-45bb-af98-75855cea8e48'] {{(pid=84538) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 19:07:28 devstack cinder-volume[84538]: DEBUG oslo_concurrency.lockutils [None req-9a685dde-35e9-41d9-a134-2255bc0a4770 tempest-VolumesGetTest-1123317664 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=84538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 19:07:28 devstack cinder-volume[84538]: DEBUG oslo_concurrency.processutils [None req-9a685dde-35e9-41d9-a134-2255bc0a4770 tempest-VolumesGetTest-1123317664 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d {{(pid=84538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 19:07:28 devstack sudo[93396]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d Apr 29 19:07:28 devstack sudo[93396]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 19:07:29 devstack sudo[93393]: pam_unix(sudo:session): session closed for user root Apr 29 19:07:29 devstack cinder-volume[84538]: DEBUG oslo_concurrency.processutils [None req-ef09f4d0-ef35-4121-b085-687cee4213c4 tempest-VolumeDependencyTests-1062757540 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d" returned: 0 in 0.630s {{(pid=84538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 19:07:29 devstack cinder-volume[84538]: DEBUG cinder.manager [None req-ef09f4d0-ef35-4121-b085-687cee4213c4 tempest-VolumeDependencyTests-1062757540 None] Notifying Schedulers of capabilities ... {{(pid=84538) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 29 19:07:29 devstack cinder-volume[84538]: INFO cinder.volume.manager [None req-ef09f4d0-ef35-4121-b085-687cee4213c4 tempest-VolumeDependencyTests-1062757540 None] Deleted volume successfully. Apr 29 19:07:29 devstack cinder-volume[84538]: DEBUG cinder.coordination [None req-ef09f4d0-ef35-4121-b085-687cee4213c4 tempest-VolumeDependencyTests-1062757540 None] Lock "cinder-235eb4f3-03c9-4cdd-98f4-867934ccd0d6-delete_volume" released by "delete_volume" :: held 2.250s {{(pid=84538) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 19:07:29 devstack sudo[93396]: pam_unix(sudo:session): session closed for user root Apr 29 19:07:29 devstack cinder-volume[84538]: DEBUG oslo_concurrency.processutils [None req-9a685dde-35e9-41d9-a134-2255bc0a4770 tempest-VolumesGetTest-1123317664 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d" returned: 0 in 0.607s {{(pid=84538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 19:07:29 devstack cinder-volume[84538]: DEBUG cinder.manager [None req-9a685dde-35e9-41d9-a134-2255bc0a4770 tempest-VolumesGetTest-1123317664 None] Notifying Schedulers of capabilities ... {{(pid=84538) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 29 19:07:29 devstack cinder-volume[84538]: INFO cinder.volume.manager [None req-9a685dde-35e9-41d9-a134-2255bc0a4770 tempest-VolumesGetTest-1123317664 None] Deleted volume successfully. Apr 29 19:07:29 devstack cinder-volume[84538]: DEBUG cinder.coordination [None req-9a685dde-35e9-41d9-a134-2255bc0a4770 tempest-VolumesGetTest-1123317664 None] Lock "cinder-179e2c93-6df9-40f4-88d6-88c3cb9bf54b-delete_volume" released by "delete_volume" :: held 2.909s {{(pid=84538) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 19:07:32 devstack cinder-volume[84538]: DEBUG cinder.volume.flows.manager.create_volume [None req-58523399-0c50-4788-8e33-1064bb6ed148 tempest-CreateVolumesFromSnapshotTest-1225283416 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84538) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Apr 29 19:07:32 devstack cinder-volume[84538]: DEBUG cinder.volume.manager [None req-58523399-0c50-4788-8e33-1064bb6ed148 tempest-CreateVolumesFromSnapshotTest-1225283416 None] Flow 'volume_create_manager' (37d69f3b-0486-403e-ad2a-81cac620cd0e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84538) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 19:07:32 devstack cinder-volume[84538]: DEBUG cinder.volume.manager [None req-58523399-0c50-4788-8e33-1064bb6ed148 tempest-CreateVolumesFromSnapshotTest-1225283416 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5aee5bca-6e13-41eb-8f60-ac7712156ee0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 19:07:32 devstack cinder-volume[84538]: DEBUG cinder.volume.manager [None req-58523399-0c50-4788-8e33-1064bb6ed148 tempest-CreateVolumesFromSnapshotTest-1225283416 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5aee5bca-6e13-41eb-8f60-ac7712156ee0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-29T17:07:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-372082228',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0b41e26d-fb31-4b53-8974-4617d108edba,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bd3faae15a554f6dae855a923e039db9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T17:07:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T17:07:32Z,use_quota=True,user_id='4548792545884e54ac5240e402b4cf15',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(62b05900-93e3-4190-a88f-1d87324303d1),volume_type_id=62b05900-93e3-4190-a88f-1d87324303d1)' {{(pid=84538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 19:07:32 devstack cinder-volume[84538]: DEBUG cinder.volume.manager [None req-58523399-0c50-4788-8e33-1064bb6ed148 tempest-CreateVolumesFromSnapshotTest-1225283416 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d995459f-a375-4943-8e6a-b6aea56b506e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 19:07:32 devstack cinder-volume[84538]: DEBUG cinder.volume.manager [None req-58523399-0c50-4788-8e33-1064bb6ed148 tempest-CreateVolumesFromSnapshotTest-1225283416 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d995459f-a375-4943-8e6a-b6aea56b506e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 19:07:32 devstack cinder-volume[84538]: DEBUG cinder.volume.manager [None req-58523399-0c50-4788-8e33-1064bb6ed148 tempest-CreateVolumesFromSnapshotTest-1225283416 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e310b0d1-a8e3-4e0a-b13c-47f6d025f279) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 19:07:32 devstack cinder-volume[84538]: DEBUG cinder.volume.manager [None req-58523399-0c50-4788-8e33-1064bb6ed148 tempest-CreateVolumesFromSnapshotTest-1225283416 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e310b0d1-a8e3-4e0a-b13c-47f6d025f279) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0b41e26d-fb31-4b53-8974-4617d108edba', 'volume_name': 'volume-0b41e26d-fb31-4b53-8974-4617d108edba', 'volume_size': 1}' {{(pid=84538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 19:07:32 devstack cinder-volume[84538]: DEBUG cinder.volume.manager [None req-58523399-0c50-4788-8e33-1064bb6ed148 tempest-CreateVolumesFromSnapshotTest-1225283416 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (982b65b5-7ac1-45cb-9246-98065ce2bd96) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 19:07:32 devstack cinder-volume[84538]: DEBUG cinder.volume.manager [None req-58523399-0c50-4788-8e33-1064bb6ed148 tempest-CreateVolumesFromSnapshotTest-1225283416 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (982b65b5-7ac1-45cb-9246-98065ce2bd96) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 19:07:32 devstack cinder-volume[84538]: DEBUG cinder.volume.manager [None req-58523399-0c50-4788-8e33-1064bb6ed148 tempest-CreateVolumesFromSnapshotTest-1225283416 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0780ea84-ef7c-4d2f-995a-524aa7f24fe8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 19:07:32 devstack cinder-volume[84538]: INFO cinder.volume.flows.manager.create_volume [None req-58523399-0c50-4788-8e33-1064bb6ed148 tempest-CreateVolumesFromSnapshotTest-1225283416 None] Volume 0b41e26d-fb31-4b53-8974-4617d108edba: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0b41e26d-fb31-4b53-8974-4617d108edba', 'volume_size': 1} Apr 29 19:07:32 devstack cinder-volume[84538]: DEBUG oslo_concurrency.lockutils [None req-58523399-0c50-4788-8e33-1064bb6ed148 tempest-CreateVolumesFromSnapshotTest-1225283416 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 19:07:32 devstack cinder-volume[84538]: DEBUG oslo_concurrency.lockutils [None req-58523399-0c50-4788-8e33-1064bb6ed148 tempest-CreateVolumesFromSnapshotTest-1225283416 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=84538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 19:07:32 devstack cinder-volume[84538]: DEBUG cinder.volume.drivers.quobyte [None req-58523399-0c50-4788-8e33-1064bb6ed148 tempest-CreateVolumesFromSnapshotTest-1225283416 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-29T17:07:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-372082228',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0b41e26d-fb31-4b53-8974-4617d108edba,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bd3faae15a554f6dae855a923e039db9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T17:07:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T17:07:32Z,use_quota=True,user_id='4548792545884e54ac5240e402b4cf15',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(62b05900-93e3-4190-a88f-1d87324303d1),volume_type_id=62b05900-93e3-4190-a88f-1d87324303d1)}" {{(pid=84538) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 29 19:07:32 devstack cinder-volume[84538]: DEBUG cinder.volume.drivers.remotefs [None req-58523399-0c50-4788-8e33-1064bb6ed148 tempest-CreateVolumesFromSnapshotTest-1225283416 None] Creating volume 0b41e26d-fb31-4b53-8974-4617d108edba {{(pid=84538) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 29 19:07:32 devstack cinder-volume[84538]: DEBUG oslo_concurrency.lockutils [None req-58523399-0c50-4788-8e33-1064bb6ed148 tempest-CreateVolumesFromSnapshotTest-1225283416 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 19:07:32 devstack cinder-volume[84538]: DEBUG oslo_concurrency.lockutils [None req-58523399-0c50-4788-8e33-1064bb6ed148 tempest-CreateVolumesFromSnapshotTest-1225283416 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=84538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 19:07:32 devstack cinder-volume[84538]: DEBUG cinder.volume.drivers.quobyte [None req-58523399-0c50-4788-8e33-1064bb6ed148 tempest-CreateVolumesFromSnapshotTest-1225283416 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-34312b00-dd6d-45bb-af98-75855cea8e48': None} {{(pid=84538) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 19:07:32 devstack cinder-volume[84538]: DEBUG cinder.volume.drivers.quobyte [None req-58523399-0c50-4788-8e33-1064bb6ed148 tempest-CreateVolumesFromSnapshotTest-1225283416 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-34312b00-dd6d-45bb-af98-75855cea8e48'] {{(pid=84538) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 19:07:32 devstack cinder-volume[84538]: DEBUG oslo_concurrency.lockutils [None req-58523399-0c50-4788-8e33-1064bb6ed148 tempest-CreateVolumesFromSnapshotTest-1225283416 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=84538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 19:07:32 devstack cinder-volume[84538]: DEBUG cinder.volume.drivers.quobyte [None req-58523399-0c50-4788-8e33-1064bb6ed148 tempest-CreateVolumesFromSnapshotTest-1225283416 None] Selected osci02.corp.quobyte.com/cinder-vol-34312b00-dd6d-45bb-af98-75855cea8e48 as target Quobyte volume. {{(pid=84538) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 29 19:07:32 devstack cinder-volume[84538]: INFO cinder.volume.drivers.remotefs [None req-58523399-0c50-4788-8e33-1064bb6ed148 tempest-CreateVolumesFromSnapshotTest-1225283416 None] casted to osci02.corp.quobyte.com/cinder-vol-34312b00-dd6d-45bb-af98-75855cea8e48 Apr 29 19:07:32 devstack cinder-volume[84538]: DEBUG oslo_concurrency.processutils [None req-58523399-0c50-4788-8e33-1064bb6ed148 tempest-CreateVolumesFromSnapshotTest-1225283416 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-0b41e26d-fb31-4b53-8974-4617d108edba 1073741824 {{(pid=84538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 19:07:32 devstack sudo[93401]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-0b41e26d-fb31-4b53-8974-4617d108edba 1073741824 Apr 29 19:07:32 devstack sudo[93401]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 19:07:33 devstack sudo[93401]: pam_unix(sudo:session): session closed for user root Apr 29 19:07:33 devstack cinder-volume[84538]: DEBUG oslo_concurrency.processutils [None req-58523399-0c50-4788-8e33-1064bb6ed148 tempest-CreateVolumesFromSnapshotTest-1225283416 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-0b41e26d-fb31-4b53-8974-4617d108edba 1073741824" returned: 0 in 0.740s {{(pid=84538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 19:07:33 devstack cinder-volume[84538]: DEBUG oslo_concurrency.processutils [None req-58523399-0c50-4788-8e33-1064bb6ed148 tempest-CreateVolumesFromSnapshotTest-1225283416 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-0b41e26d-fb31-4b53-8974-4617d108edba {{(pid=84538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 19:07:33 devstack sudo[93406]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-0b41e26d-fb31-4b53-8974-4617d108edba Apr 29 19:07:33 devstack sudo[93406]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 19:07:33 devstack sudo[93406]: pam_unix(sudo:session): session closed for user root Apr 29 19:07:33 devstack cinder-volume[84538]: DEBUG oslo_concurrency.processutils [None req-58523399-0c50-4788-8e33-1064bb6ed148 tempest-CreateVolumesFromSnapshotTest-1225283416 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-0b41e26d-fb31-4b53-8974-4617d108edba" returned: 0 in 0.591s {{(pid=84538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 19:07:33 devstack cinder-volume[84538]: DEBUG cinder.volume.drivers.quobyte [None req-58523399-0c50-4788-8e33-1064bb6ed148 tempest-CreateVolumesFromSnapshotTest-1225283416 None] <== create_volume: return (1367ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-34312b00-dd6d-45bb-af98-75855cea8e48'} {{(pid=84538) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 29 19:07:33 devstack cinder-volume[84538]: DEBUG oslo_concurrency.lockutils [None req-58523399-0c50-4788-8e33-1064bb6ed148 tempest-CreateVolumesFromSnapshotTest-1225283416 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.370s {{(pid=84538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 19:07:33 devstack cinder-volume[84538]: DEBUG cinder.volume.manager [None req-58523399-0c50-4788-8e33-1064bb6ed148 tempest-CreateVolumesFromSnapshotTest-1225283416 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0780ea84-ef7c-4d2f-995a-524aa7f24fe8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0b41e26d-fb31-4b53-8974-4617d108edba', 'volume_size': 1}' {{(pid=84538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 19:07:33 devstack cinder-volume[84538]: DEBUG cinder.volume.manager [None req-58523399-0c50-4788-8e33-1064bb6ed148 tempest-CreateVolumesFromSnapshotTest-1225283416 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ce697c4d-59ed-4c1c-9f64-1d43a1f878e1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 19:07:33 devstack cinder-volume[84538]: INFO cinder.volume.flows.manager.create_volume [None req-58523399-0c50-4788-8e33-1064bb6ed148 tempest-CreateVolumesFromSnapshotTest-1225283416 None] Volume volume-0b41e26d-fb31-4b53-8974-4617d108edba (0b41e26d-fb31-4b53-8974-4617d108edba): created successfully Apr 29 19:07:33 devstack cinder-volume[84538]: DEBUG cinder.volume.manager [None req-58523399-0c50-4788-8e33-1064bb6ed148 tempest-CreateVolumesFromSnapshotTest-1225283416 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ce697c4d-59ed-4c1c-9f64-1d43a1f878e1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 19:07:33 devstack cinder-volume[84538]: DEBUG cinder.volume.manager [None req-58523399-0c50-4788-8e33-1064bb6ed148 tempest-CreateVolumesFromSnapshotTest-1225283416 None] Flow 'volume_create_manager' (37d69f3b-0486-403e-ad2a-81cac620cd0e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84538) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 19:07:33 devstack cinder-volume[84538]: INFO cinder.volume.manager [None req-58523399-0c50-4788-8e33-1064bb6ed148 tempest-CreateVolumesFromSnapshotTest-1225283416 None] Created volume successfully. Apr 29 19:07:34 devstack cinder-volume[84538]: DEBUG oslo_concurrency.lockutils [None req-688384c9-1dbf-4869-a064-30f22aaddcb5 tempest-CreateVolumesFromSnapshotTest-1225283416 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=84538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 19:07:34 devstack cinder-volume[84538]: DEBUG oslo_concurrency.lockutils [None req-688384c9-1dbf-4869-a064-30f22aaddcb5 tempest-CreateVolumesFromSnapshotTest-1225283416 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=84538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 19:07:34 devstack cinder-volume[84538]: DEBUG cinder.volume.drivers.remotefs [None req-688384c9-1dbf-4869-a064-30f22aaddcb5 tempest-CreateVolumesFromSnapshotTest-1225283416 None] Creating offline snapshot 1a178f8d-a84e-45ca-b886-2e524ba74d85 of volume 0b41e26d-fb31-4b53-8974-4617d108edba {{(pid=84538) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}} Apr 29 19:07:34 devstack cinder-volume[84538]: DEBUG oslo.privsep.daemon [-] privsep: reply[d78cf39a-6afa-4524-99f7-e2b4d4fdd91c]: (4, 'qcow2') {{(pid=85803) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 19:07:34 devstack cinder-volume[84538]: DEBUG oslo_concurrency.processutils [None req-688384c9-1dbf-4869-a064-30f22aaddcb5 tempest-CreateVolumesFromSnapshotTest-1225283416 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-0b41e26d-fb31-4b53-8974-4617d108edba {{(pid=84538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 19:07:34 devstack sudo[93409]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-0b41e26d-fb31-4b53-8974-4617d108edba Apr 29 19:07:34 devstack sudo[93409]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 19:07:35 devstack sudo[93409]: pam_unix(sudo:session): session closed for user root Apr 29 19:07:35 devstack cinder-volume[84538]: DEBUG oslo_concurrency.processutils [None req-688384c9-1dbf-4869-a064-30f22aaddcb5 tempest-CreateVolumesFromSnapshotTest-1225283416 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-0b41e26d-fb31-4b53-8974-4617d108edba" returned: 0 in 0.695s {{(pid=84538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 19:07:35 devstack cinder-volume[84538]: DEBUG oslo_concurrency.processutils [None req-688384c9-1dbf-4869-a064-30f22aaddcb5 tempest-CreateVolumesFromSnapshotTest-1225283416 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-0b41e26d-fb31-4b53-8974-4617d108edba,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-0b41e26d-fb31-4b53-8974-4617d108edba.1a178f8d-a84e-45ca-b886-2e524ba74d85 1G {{(pid=84538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 19:07:35 devstack sudo[93414]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-0b41e26d-fb31-4b53-8974-4617d108edba,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-0b41e26d-fb31-4b53-8974-4617d108edba.1a178f8d-a84e-45ca-b886-2e524ba74d85 1G Apr 29 19:07:35 devstack sudo[93414]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 19:07:36 devstack sudo[93414]: pam_unix(sudo:session): session closed for user root Apr 29 19:07:36 devstack cinder-volume[84538]: DEBUG oslo_concurrency.processutils [None req-688384c9-1dbf-4869-a064-30f22aaddcb5 tempest-CreateVolumesFromSnapshotTest-1225283416 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-0b41e26d-fb31-4b53-8974-4617d108edba,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-0b41e26d-fb31-4b53-8974-4617d108edba.1a178f8d-a84e-45ca-b886-2e524ba74d85 1G" returned: 0 in 0.730s {{(pid=84538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 19:07:36 devstack cinder-volume[84538]: DEBUG oslo_concurrency.processutils [None req-688384c9-1dbf-4869-a064-30f22aaddcb5 tempest-CreateVolumesFromSnapshotTest-1225283416 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-0b41e26d-fb31-4b53-8974-4617d108edba -F qcow2 /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-0b41e26d-fb31-4b53-8974-4617d108edba.1a178f8d-a84e-45ca-b886-2e524ba74d85 {{(pid=84538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 19:07:36 devstack sudo[93420]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-0b41e26d-fb31-4b53-8974-4617d108edba -F qcow2 /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-0b41e26d-fb31-4b53-8974-4617d108edba.1a178f8d-a84e-45ca-b886-2e524ba74d85 Apr 29 19:07:36 devstack sudo[93420]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 19:07:36 devstack sudo[93420]: pam_unix(sudo:session): session closed for user root Apr 29 19:07:36 devstack cinder-volume[84538]: DEBUG oslo_concurrency.processutils [None req-688384c9-1dbf-4869-a064-30f22aaddcb5 tempest-CreateVolumesFromSnapshotTest-1225283416 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-0b41e26d-fb31-4b53-8974-4617d108edba -F qcow2 /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-0b41e26d-fb31-4b53-8974-4617d108edba.1a178f8d-a84e-45ca-b886-2e524ba74d85" returned: 0 in 0.624s {{(pid=84538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 19:07:36 devstack cinder-volume[84538]: WARNING cinder.volume.drivers.remotefs [None req-688384c9-1dbf-4869-a064-30f22aaddcb5 tempest-CreateVolumesFromSnapshotTest-1225283416 None] /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-0b41e26d-fb31-4b53-8974-4617d108edba.1a178f8d-a84e-45ca-b886-2e524ba74d85 is being set with open permissions: ugo+rw Apr 29 19:07:36 devstack cinder-volume[84538]: DEBUG oslo_concurrency.processutils [None req-688384c9-1dbf-4869-a064-30f22aaddcb5 tempest-CreateVolumesFromSnapshotTest-1225283416 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-0b41e26d-fb31-4b53-8974-4617d108edba.1a178f8d-a84e-45ca-b886-2e524ba74d85 {{(pid=84538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 19:07:36 devstack sudo[93425]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-0b41e26d-fb31-4b53-8974-4617d108edba.1a178f8d-a84e-45ca-b886-2e524ba74d85 Apr 29 19:07:36 devstack sudo[93425]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 19:07:37 devstack sudo[93425]: pam_unix(sudo:session): session closed for user root Apr 29 19:07:37 devstack cinder-volume[84538]: DEBUG oslo_concurrency.processutils [None req-688384c9-1dbf-4869-a064-30f22aaddcb5 tempest-CreateVolumesFromSnapshotTest-1225283416 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-0b41e26d-fb31-4b53-8974-4617d108edba.1a178f8d-a84e-45ca-b886-2e524ba74d85" returned: 0 in 0.583s {{(pid=84538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 19:07:37 devstack cinder-volume[84538]: DEBUG oslo_concurrency.processutils [None req-688384c9-1dbf-4869-a064-30f22aaddcb5 tempest-CreateVolumesFromSnapshotTest-1225283416 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-0b41e26d-fb31-4b53-8974-4617d108edba.info {{(pid=84538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 19:07:37 devstack sudo[93428]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-0b41e26d-fb31-4b53-8974-4617d108edba.info Apr 29 19:07:37 devstack sudo[93428]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 19:07:37 devstack sudo[93428]: pam_unix(sudo:session): session closed for user root Apr 29 19:07:37 devstack cinder-volume[84538]: DEBUG oslo_concurrency.processutils [None req-688384c9-1dbf-4869-a064-30f22aaddcb5 tempest-CreateVolumesFromSnapshotTest-1225283416 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-0b41e26d-fb31-4b53-8974-4617d108edba.info" returned: 0 in 0.586s {{(pid=84538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 19:07:37 devstack cinder-volume[84538]: WARNING cinder.volume.drivers.remotefs [None req-688384c9-1dbf-4869-a064-30f22aaddcb5 tempest-CreateVolumesFromSnapshotTest-1225283416 None] /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-0b41e26d-fb31-4b53-8974-4617d108edba.info is being set with open permissions: ugo+rw Apr 29 19:07:37 devstack cinder-volume[84538]: DEBUG oslo_concurrency.processutils [None req-688384c9-1dbf-4869-a064-30f22aaddcb5 tempest-CreateVolumesFromSnapshotTest-1225283416 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-0b41e26d-fb31-4b53-8974-4617d108edba.info {{(pid=84538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 19:07:37 devstack sudo[93431]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-0b41e26d-fb31-4b53-8974-4617d108edba.info Apr 29 19:07:37 devstack sudo[93431]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 19:07:38 devstack sudo[93431]: pam_unix(sudo:session): session closed for user root Apr 29 19:07:38 devstack cinder-volume[84538]: DEBUG oslo_concurrency.processutils [None req-688384c9-1dbf-4869-a064-30f22aaddcb5 tempest-CreateVolumesFromSnapshotTest-1225283416 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-0b41e26d-fb31-4b53-8974-4617d108edba.info" returned: 0 in 0.583s {{(pid=84538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 19:07:38 devstack cinder-volume[84538]: DEBUG oslo_concurrency.lockutils [None req-688384c9-1dbf-4869-a064-30f22aaddcb5 tempest-CreateVolumesFromSnapshotTest-1225283416 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.886s {{(pid=84538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 19:07:38 devstack cinder-volume[84538]: INFO cinder.volume.manager [None req-688384c9-1dbf-4869-a064-30f22aaddcb5 tempest-CreateVolumesFromSnapshotTest-1225283416 None] Create snapshot completed successfully Apr 29 19:07:39 devstack cinder-volume[84538]: DEBUG cinder.volume.flows.manager.create_volume [None req-f82ee420-dad9-4bbd-ae9c-c4946376ed09 tempest-CreateVolumesFromSnapshotTest-1225283416 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84538) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Apr 29 19:07:39 devstack cinder-volume[84538]: DEBUG cinder.volume.manager [None req-f82ee420-dad9-4bbd-ae9c-c4946376ed09 tempest-CreateVolumesFromSnapshotTest-1225283416 None] Flow 'volume_create_manager' (bbd3c43e-051e-455d-bb3f-c43640e2cb04) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84538) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 19:07:39 devstack cinder-volume[84538]: DEBUG cinder.volume.manager [None req-f82ee420-dad9-4bbd-ae9c-c4946376ed09 tempest-CreateVolumesFromSnapshotTest-1225283416 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (eac72376-156c-4c5b-9048-a1dd66dfb148) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 19:07:39 devstack cinder-volume[84538]: DEBUG cinder.volume.manager [None req-f82ee420-dad9-4bbd-ae9c-c4946376ed09 tempest-CreateVolumesFromSnapshotTest-1225283416 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (eac72376-156c-4c5b-9048-a1dd66dfb148) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-29T17:07:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-671045305',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c5ec4aa8-2064-4627-82d8-e65a47df0d4e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bd3faae15a554f6dae855a923e039db9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T17:07:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T17:07:39Z,use_quota=True,user_id='4548792545884e54ac5240e402b4cf15',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(62b05900-93e3-4190-a88f-1d87324303d1),volume_type_id=62b05900-93e3-4190-a88f-1d87324303d1)' {{(pid=84538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 19:07:39 devstack cinder-volume[84538]: DEBUG cinder.volume.manager [None req-f82ee420-dad9-4bbd-ae9c-c4946376ed09 tempest-CreateVolumesFromSnapshotTest-1225283416 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (055dfba2-be7a-4eaa-b778-d33afb486b6d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 19:07:39 devstack cinder-volume[84538]: DEBUG cinder.volume.manager [None req-f82ee420-dad9-4bbd-ae9c-c4946376ed09 tempest-CreateVolumesFromSnapshotTest-1225283416 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (055dfba2-be7a-4eaa-b778-d33afb486b6d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 19:07:39 devstack cinder-volume[84538]: DEBUG cinder.volume.manager [None req-f82ee420-dad9-4bbd-ae9c-c4946376ed09 tempest-CreateVolumesFromSnapshotTest-1225283416 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3892b340-81d5-4e01-a8f6-3cfd5a99a8ef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 19:07:39 devstack cinder-volume[84538]: DEBUG cinder.volume.manager [None req-f82ee420-dad9-4bbd-ae9c-c4946376ed09 tempest-CreateVolumesFromSnapshotTest-1225283416 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3892b340-81d5-4e01-a8f6-3cfd5a99a8ef) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c5ec4aa8-2064-4627-82d8-e65a47df0d4e', 'volume_name': 'volume-c5ec4aa8-2064-4627-82d8-e65a47df0d4e', 'volume_size': 1}' {{(pid=84538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 19:07:39 devstack cinder-volume[84538]: DEBUG cinder.volume.manager [None req-f82ee420-dad9-4bbd-ae9c-c4946376ed09 tempest-CreateVolumesFromSnapshotTest-1225283416 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (57ec5c72-1096-429d-8b49-85d260075f53) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 19:07:39 devstack cinder-volume[84538]: DEBUG cinder.volume.manager [None req-f82ee420-dad9-4bbd-ae9c-c4946376ed09 tempest-CreateVolumesFromSnapshotTest-1225283416 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (57ec5c72-1096-429d-8b49-85d260075f53) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 19:07:39 devstack cinder-volume[84538]: DEBUG cinder.volume.manager [None req-f82ee420-dad9-4bbd-ae9c-c4946376ed09 tempest-CreateVolumesFromSnapshotTest-1225283416 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ca7aa53e-86b9-47b3-8495-e6dbae7afd4f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 19:07:39 devstack cinder-volume[84538]: INFO cinder.volume.flows.manager.create_volume [None req-f82ee420-dad9-4bbd-ae9c-c4946376ed09 tempest-CreateVolumesFromSnapshotTest-1225283416 None] Volume c5ec4aa8-2064-4627-82d8-e65a47df0d4e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c5ec4aa8-2064-4627-82d8-e65a47df0d4e', 'volume_size': 1} Apr 29 19:07:39 devstack cinder-volume[84538]: DEBUG oslo_concurrency.lockutils [None req-f82ee420-dad9-4bbd-ae9c-c4946376ed09 tempest-CreateVolumesFromSnapshotTest-1225283416 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 19:07:39 devstack cinder-volume[84538]: DEBUG oslo_concurrency.lockutils [None req-f82ee420-dad9-4bbd-ae9c-c4946376ed09 tempest-CreateVolumesFromSnapshotTest-1225283416 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=84538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 19:07:39 devstack cinder-volume[84538]: DEBUG cinder.volume.drivers.quobyte [None req-f82ee420-dad9-4bbd-ae9c-c4946376ed09 tempest-CreateVolumesFromSnapshotTest-1225283416 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-29T17:07:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-671045305',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c5ec4aa8-2064-4627-82d8-e65a47df0d4e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bd3faae15a554f6dae855a923e039db9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T17:07:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T17:07:39Z,use_quota=True,user_id='4548792545884e54ac5240e402b4cf15',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(62b05900-93e3-4190-a88f-1d87324303d1),volume_type_id=62b05900-93e3-4190-a88f-1d87324303d1)}" {{(pid=84538) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 29 19:07:39 devstack cinder-volume[84538]: DEBUG cinder.volume.drivers.remotefs [None req-f82ee420-dad9-4bbd-ae9c-c4946376ed09 tempest-CreateVolumesFromSnapshotTest-1225283416 None] Creating volume c5ec4aa8-2064-4627-82d8-e65a47df0d4e {{(pid=84538) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 29 19:07:39 devstack cinder-volume[84538]: DEBUG oslo_concurrency.lockutils [None req-f82ee420-dad9-4bbd-ae9c-c4946376ed09 tempest-CreateVolumesFromSnapshotTest-1225283416 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 19:07:39 devstack cinder-volume[84538]: DEBUG oslo_concurrency.lockutils [None req-f82ee420-dad9-4bbd-ae9c-c4946376ed09 tempest-CreateVolumesFromSnapshotTest-1225283416 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 19:07:39 devstack cinder-volume[84538]: DEBUG cinder.volume.drivers.quobyte [None req-f82ee420-dad9-4bbd-ae9c-c4946376ed09 tempest-CreateVolumesFromSnapshotTest-1225283416 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-34312b00-dd6d-45bb-af98-75855cea8e48': None} {{(pid=84538) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 19:07:39 devstack cinder-volume[84538]: DEBUG cinder.volume.drivers.quobyte [None req-f82ee420-dad9-4bbd-ae9c-c4946376ed09 tempest-CreateVolumesFromSnapshotTest-1225283416 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-34312b00-dd6d-45bb-af98-75855cea8e48'] {{(pid=84538) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 19:07:39 devstack cinder-volume[84538]: DEBUG oslo_concurrency.lockutils [None req-f82ee420-dad9-4bbd-ae9c-c4946376ed09 tempest-CreateVolumesFromSnapshotTest-1225283416 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=84538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 19:07:39 devstack cinder-volume[84538]: DEBUG cinder.volume.drivers.quobyte [None req-f82ee420-dad9-4bbd-ae9c-c4946376ed09 tempest-CreateVolumesFromSnapshotTest-1225283416 None] Selected osci02.corp.quobyte.com/cinder-vol-34312b00-dd6d-45bb-af98-75855cea8e48 as target Quobyte volume. {{(pid=84538) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 29 19:07:39 devstack cinder-volume[84538]: INFO cinder.volume.drivers.remotefs [None req-f82ee420-dad9-4bbd-ae9c-c4946376ed09 tempest-CreateVolumesFromSnapshotTest-1225283416 None] casted to osci02.corp.quobyte.com/cinder-vol-34312b00-dd6d-45bb-af98-75855cea8e48 Apr 29 19:07:39 devstack cinder-volume[84538]: DEBUG oslo_concurrency.processutils [None req-f82ee420-dad9-4bbd-ae9c-c4946376ed09 tempest-CreateVolumesFromSnapshotTest-1225283416 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-c5ec4aa8-2064-4627-82d8-e65a47df0d4e 1073741824 {{(pid=84538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 19:07:39 devstack sudo[93436]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-c5ec4aa8-2064-4627-82d8-e65a47df0d4e 1073741824 Apr 29 19:07:39 devstack sudo[93436]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 19:07:39 devstack cinder-volume[84538]: DEBUG cinder.volume.flows.manager.create_volume [None req-91178d19-dbd0-4943-bc31-89679f9754cd tempest-CreateVolumesFromSnapshotTest-1225283416 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84538) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Apr 29 19:07:39 devstack cinder-volume[84538]: DEBUG cinder.volume.manager [None req-91178d19-dbd0-4943-bc31-89679f9754cd tempest-CreateVolumesFromSnapshotTest-1225283416 None] Flow 'volume_create_manager' (7b0bff70-4089-40c5-baeb-9cc778299d21) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84538) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 19:07:39 devstack cinder-volume[84538]: DEBUG cinder.volume.manager [None req-91178d19-dbd0-4943-bc31-89679f9754cd tempest-CreateVolumesFromSnapshotTest-1225283416 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (37cc5c2c-c184-4b72-8321-d439e6a34e84) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 19:07:39 devstack cinder-volume[84538]: DEBUG cinder.volume.manager [None req-91178d19-dbd0-4943-bc31-89679f9754cd tempest-CreateVolumesFromSnapshotTest-1225283416 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (37cc5c2c-c184-4b72-8321-d439e6a34e84) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-29T17:07:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1514983716',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=16789a85-97f2-44b6-849b-e6fb494cac24,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bd3faae15a554f6dae855a923e039db9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T17:07:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T17:07:39Z,use_quota=True,user_id='4548792545884e54ac5240e402b4cf15',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(62b05900-93e3-4190-a88f-1d87324303d1),volume_type_id=62b05900-93e3-4190-a88f-1d87324303d1)' {{(pid=84538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 19:07:39 devstack cinder-volume[84538]: DEBUG cinder.volume.manager [None req-91178d19-dbd0-4943-bc31-89679f9754cd tempest-CreateVolumesFromSnapshotTest-1225283416 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8407e22f-332f-49e7-a2c5-ac1fdbbd85c4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 19:07:39 devstack cinder-volume[84538]: DEBUG cinder.volume.manager [None req-91178d19-dbd0-4943-bc31-89679f9754cd tempest-CreateVolumesFromSnapshotTest-1225283416 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8407e22f-332f-49e7-a2c5-ac1fdbbd85c4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 19:07:39 devstack cinder-volume[84538]: DEBUG cinder.volume.manager [None req-91178d19-dbd0-4943-bc31-89679f9754cd tempest-CreateVolumesFromSnapshotTest-1225283416 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b24caf6d-3d27-4367-bb37-4b0b7039c7b6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 19:07:39 devstack cinder-volume[84538]: DEBUG cinder.volume.manager [None req-91178d19-dbd0-4943-bc31-89679f9754cd tempest-CreateVolumesFromSnapshotTest-1225283416 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b24caf6d-3d27-4367-bb37-4b0b7039c7b6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '16789a85-97f2-44b6-849b-e6fb494cac24', 'volume_name': 'volume-16789a85-97f2-44b6-849b-e6fb494cac24', 'volume_size': 1}' {{(pid=84538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 19:07:39 devstack cinder-volume[84538]: DEBUG cinder.volume.manager [None req-91178d19-dbd0-4943-bc31-89679f9754cd tempest-CreateVolumesFromSnapshotTest-1225283416 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7514e96e-e776-4b8c-a6e3-702cb211b36f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 19:07:39 devstack cinder-volume[84538]: DEBUG cinder.volume.manager [None req-91178d19-dbd0-4943-bc31-89679f9754cd tempest-CreateVolumesFromSnapshotTest-1225283416 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7514e96e-e776-4b8c-a6e3-702cb211b36f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 19:07:39 devstack cinder-volume[84538]: DEBUG cinder.volume.manager [None req-91178d19-dbd0-4943-bc31-89679f9754cd tempest-CreateVolumesFromSnapshotTest-1225283416 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9138093a-d9f5-4708-81d9-a82c4a4d6271) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 19:07:39 devstack cinder-volume[84538]: INFO cinder.volume.flows.manager.create_volume [None req-91178d19-dbd0-4943-bc31-89679f9754cd tempest-CreateVolumesFromSnapshotTest-1225283416 None] Volume 16789a85-97f2-44b6-849b-e6fb494cac24: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-16789a85-97f2-44b6-849b-e6fb494cac24', 'volume_size': 1} Apr 29 19:07:39 devstack cinder-volume[84538]: DEBUG oslo_concurrency.lockutils [None req-91178d19-dbd0-4943-bc31-89679f9754cd tempest-CreateVolumesFromSnapshotTest-1225283416 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 19:07:39 devstack cinder-volume[84538]: DEBUG cinder.volume.flows.manager.create_volume [None req-c6a373c3-100c-40e2-8daf-772490c64e4b tempest-CreateVolumesFromSnapshotTest-1225283416 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84538) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Apr 29 19:07:39 devstack cinder-volume[84538]: DEBUG cinder.volume.manager [None req-c6a373c3-100c-40e2-8daf-772490c64e4b tempest-CreateVolumesFromSnapshotTest-1225283416 None] Flow 'volume_create_manager' (a258387d-d4bf-4b40-b582-54149f048cbb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84538) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 19:07:39 devstack cinder-volume[84538]: DEBUG cinder.volume.manager [None req-c6a373c3-100c-40e2-8daf-772490c64e4b tempest-CreateVolumesFromSnapshotTest-1225283416 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1dc1e8af-ac18-43ee-aaf7-5bd41a8bf35e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 19:07:39 devstack cinder-volume[84538]: DEBUG cinder.volume.manager [None req-c6a373c3-100c-40e2-8daf-772490c64e4b tempest-CreateVolumesFromSnapshotTest-1225283416 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1dc1e8af-ac18-43ee-aaf7-5bd41a8bf35e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-29T17:07:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-403905381',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=27cc19a5-9a9d-4846-9399-c3b5144863ba,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bd3faae15a554f6dae855a923e039db9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T17:07:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T17:07:40Z,use_quota=True,user_id='4548792545884e54ac5240e402b4cf15',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(62b05900-93e3-4190-a88f-1d87324303d1),volume_type_id=62b05900-93e3-4190-a88f-1d87324303d1)' {{(pid=84538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 19:07:39 devstack cinder-volume[84538]: DEBUG cinder.volume.manager [None req-c6a373c3-100c-40e2-8daf-772490c64e4b tempest-CreateVolumesFromSnapshotTest-1225283416 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2cb05c96-4046-41f3-817b-eb652b4cdd8c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 19:07:39 devstack cinder-volume[84538]: DEBUG cinder.volume.manager [None req-c6a373c3-100c-40e2-8daf-772490c64e4b tempest-CreateVolumesFromSnapshotTest-1225283416 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2cb05c96-4046-41f3-817b-eb652b4cdd8c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 19:07:39 devstack cinder-volume[84538]: DEBUG cinder.volume.manager [None req-c6a373c3-100c-40e2-8daf-772490c64e4b tempest-CreateVolumesFromSnapshotTest-1225283416 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (57ec880f-f73d-474a-8b1c-545fd1e92517) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 19:07:39 devstack cinder-volume[84538]: DEBUG cinder.volume.manager [None req-c6a373c3-100c-40e2-8daf-772490c64e4b tempest-CreateVolumesFromSnapshotTest-1225283416 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (57ec880f-f73d-474a-8b1c-545fd1e92517) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '27cc19a5-9a9d-4846-9399-c3b5144863ba', 'volume_name': 'volume-27cc19a5-9a9d-4846-9399-c3b5144863ba', 'volume_size': 1}' {{(pid=84538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 19:07:39 devstack cinder-volume[84538]: DEBUG cinder.volume.manager [None req-c6a373c3-100c-40e2-8daf-772490c64e4b tempest-CreateVolumesFromSnapshotTest-1225283416 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ccfbfbc2-a2f1-40f3-a69a-69786caceb99) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 19:07:39 devstack cinder-volume[84538]: DEBUG cinder.volume.manager [None req-c6a373c3-100c-40e2-8daf-772490c64e4b tempest-CreateVolumesFromSnapshotTest-1225283416 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ccfbfbc2-a2f1-40f3-a69a-69786caceb99) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 19:07:39 devstack cinder-volume[84538]: DEBUG cinder.volume.manager [None req-c6a373c3-100c-40e2-8daf-772490c64e4b tempest-CreateVolumesFromSnapshotTest-1225283416 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c42314be-9dd2-4786-9c2f-12a6a7727b9b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 19:07:39 devstack cinder-volume[84538]: INFO cinder.volume.flows.manager.create_volume [None req-c6a373c3-100c-40e2-8daf-772490c64e4b tempest-CreateVolumesFromSnapshotTest-1225283416 None] Volume 27cc19a5-9a9d-4846-9399-c3b5144863ba: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-27cc19a5-9a9d-4846-9399-c3b5144863ba', 'volume_size': 1} Apr 29 19:07:39 devstack cinder-volume[84538]: DEBUG oslo_concurrency.lockutils [None req-c6a373c3-100c-40e2-8daf-772490c64e4b tempest-CreateVolumesFromSnapshotTest-1225283416 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 19:07:40 devstack sudo[93436]: pam_unix(sudo:session): session closed for user root Apr 29 19:07:40 devstack cinder-volume[84538]: DEBUG oslo_concurrency.processutils [None req-f82ee420-dad9-4bbd-ae9c-c4946376ed09 tempest-CreateVolumesFromSnapshotTest-1225283416 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-c5ec4aa8-2064-4627-82d8-e65a47df0d4e 1073741824" returned: 0 in 0.883s {{(pid=84538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 19:07:40 devstack cinder-volume[84538]: DEBUG oslo_concurrency.processutils [None req-f82ee420-dad9-4bbd-ae9c-c4946376ed09 tempest-CreateVolumesFromSnapshotTest-1225283416 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-c5ec4aa8-2064-4627-82d8-e65a47df0d4e {{(pid=84538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 19:07:40 devstack sudo[93442]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-c5ec4aa8-2064-4627-82d8-e65a47df0d4e Apr 29 19:07:40 devstack sudo[93442]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 19:07:40 devstack cinder-volume[84538]: DEBUG cinder.volume.flows.manager.create_volume [None req-b0daf435-c1e9-4fc6-bed9-8fbe6bc372ec tempest-CreateVolumesFromSnapshotTest-1225283416 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84538) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Apr 29 19:07:40 devstack cinder-volume[84538]: DEBUG cinder.volume.manager [None req-b0daf435-c1e9-4fc6-bed9-8fbe6bc372ec tempest-CreateVolumesFromSnapshotTest-1225283416 None] Flow 'volume_create_manager' (03883f32-823a-4f92-a9cf-cd7d777d3c03) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84538) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 19:07:40 devstack cinder-volume[84538]: DEBUG cinder.volume.manager [None req-b0daf435-c1e9-4fc6-bed9-8fbe6bc372ec tempest-CreateVolumesFromSnapshotTest-1225283416 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0f4b971b-9a19-4af0-aa5a-9b8ceb67d570) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 19:07:40 devstack cinder-volume[84538]: DEBUG cinder.volume.manager [None req-b0daf435-c1e9-4fc6-bed9-8fbe6bc372ec tempest-CreateVolumesFromSnapshotTest-1225283416 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0f4b971b-9a19-4af0-aa5a-9b8ceb67d570) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-29T17:07:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-447667768',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=be9cd419-0460-43cb-8077-0065c7dc7ef7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bd3faae15a554f6dae855a923e039db9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T17:07:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T17:07:40Z,use_quota=True,user_id='4548792545884e54ac5240e402b4cf15',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(62b05900-93e3-4190-a88f-1d87324303d1),volume_type_id=62b05900-93e3-4190-a88f-1d87324303d1)' {{(pid=84538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 19:07:40 devstack cinder-volume[84538]: DEBUG cinder.volume.manager [None req-b0daf435-c1e9-4fc6-bed9-8fbe6bc372ec tempest-CreateVolumesFromSnapshotTest-1225283416 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c6026d3e-72e4-420a-980b-4751979ad10c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 19:07:40 devstack cinder-volume[84538]: DEBUG cinder.volume.manager [None req-b0daf435-c1e9-4fc6-bed9-8fbe6bc372ec tempest-CreateVolumesFromSnapshotTest-1225283416 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c6026d3e-72e4-420a-980b-4751979ad10c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 19:07:40 devstack cinder-volume[84538]: DEBUG cinder.volume.manager [None req-b0daf435-c1e9-4fc6-bed9-8fbe6bc372ec tempest-CreateVolumesFromSnapshotTest-1225283416 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1580686d-63c4-4023-9108-324dfadf913a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 19:07:40 devstack cinder-volume[84538]: DEBUG cinder.volume.manager [None req-b0daf435-c1e9-4fc6-bed9-8fbe6bc372ec tempest-CreateVolumesFromSnapshotTest-1225283416 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1580686d-63c4-4023-9108-324dfadf913a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'be9cd419-0460-43cb-8077-0065c7dc7ef7', 'volume_name': 'volume-be9cd419-0460-43cb-8077-0065c7dc7ef7', 'volume_size': 1}' {{(pid=84538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 19:07:40 devstack cinder-volume[84538]: DEBUG cinder.volume.manager [None req-b0daf435-c1e9-4fc6-bed9-8fbe6bc372ec tempest-CreateVolumesFromSnapshotTest-1225283416 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ad2428fc-818b-41c5-9215-f9ec96d80484) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 19:07:40 devstack cinder-volume[84538]: DEBUG cinder.volume.manager [None req-b0daf435-c1e9-4fc6-bed9-8fbe6bc372ec tempest-CreateVolumesFromSnapshotTest-1225283416 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ad2428fc-818b-41c5-9215-f9ec96d80484) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 19:07:40 devstack cinder-volume[84538]: DEBUG cinder.volume.manager [None req-b0daf435-c1e9-4fc6-bed9-8fbe6bc372ec tempest-CreateVolumesFromSnapshotTest-1225283416 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (19b25a4e-cd4a-4556-87ee-37fa29c067a2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 19:07:40 devstack cinder-volume[84538]: INFO cinder.volume.flows.manager.create_volume [None req-b0daf435-c1e9-4fc6-bed9-8fbe6bc372ec tempest-CreateVolumesFromSnapshotTest-1225283416 None] Volume be9cd419-0460-43cb-8077-0065c7dc7ef7: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-be9cd419-0460-43cb-8077-0065c7dc7ef7', 'volume_size': 1} Apr 29 19:07:40 devstack cinder-volume[84538]: DEBUG oslo_concurrency.lockutils [None req-b0daf435-c1e9-4fc6-bed9-8fbe6bc372ec tempest-CreateVolumesFromSnapshotTest-1225283416 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 19:07:40 devstack cinder-volume[84538]: DEBUG cinder.volume.flows.manager.create_volume [None req-283b1e64-bff2-4f4e-b22b-f41f79a419f7 tempest-CreateVolumesFromSnapshotTest-1225283416 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84538) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Apr 29 19:07:40 devstack cinder-volume[84538]: DEBUG cinder.volume.manager [None req-283b1e64-bff2-4f4e-b22b-f41f79a419f7 tempest-CreateVolumesFromSnapshotTest-1225283416 None] Flow 'volume_create_manager' (4046307e-daa1-4aae-ac24-54df9e43a8e6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84538) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 19:07:40 devstack cinder-volume[84538]: DEBUG cinder.volume.manager [None req-283b1e64-bff2-4f4e-b22b-f41f79a419f7 tempest-CreateVolumesFromSnapshotTest-1225283416 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d640e84b-c8af-4148-a52f-bbca8d480ffa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 19:07:40 devstack cinder-volume[84538]: DEBUG cinder.volume.manager [None req-283b1e64-bff2-4f4e-b22b-f41f79a419f7 tempest-CreateVolumesFromSnapshotTest-1225283416 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d640e84b-c8af-4148-a52f-bbca8d480ffa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-29T17:07:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-201974948',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0fa37d77-e177-4e95-9b3e-44bc32d5fff9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bd3faae15a554f6dae855a923e039db9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T17:07:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T17:07:41Z,use_quota=True,user_id='4548792545884e54ac5240e402b4cf15',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(62b05900-93e3-4190-a88f-1d87324303d1),volume_type_id=62b05900-93e3-4190-a88f-1d87324303d1)' {{(pid=84538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 19:07:40 devstack cinder-volume[84538]: DEBUG cinder.volume.manager [None req-283b1e64-bff2-4f4e-b22b-f41f79a419f7 tempest-CreateVolumesFromSnapshotTest-1225283416 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (de8cee2d-5ce5-4dc9-b881-827a55576fb2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 19:07:40 devstack cinder-volume[84538]: DEBUG cinder.volume.manager [None req-283b1e64-bff2-4f4e-b22b-f41f79a419f7 tempest-CreateVolumesFromSnapshotTest-1225283416 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (de8cee2d-5ce5-4dc9-b881-827a55576fb2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 19:07:40 devstack cinder-volume[84538]: DEBUG cinder.volume.manager [None req-283b1e64-bff2-4f4e-b22b-f41f79a419f7 tempest-CreateVolumesFromSnapshotTest-1225283416 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f3291d51-004d-4f92-9a5f-e7c5e0e4c1d9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 19:07:40 devstack cinder-volume[84538]: DEBUG cinder.volume.manager [None req-283b1e64-bff2-4f4e-b22b-f41f79a419f7 tempest-CreateVolumesFromSnapshotTest-1225283416 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f3291d51-004d-4f92-9a5f-e7c5e0e4c1d9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0fa37d77-e177-4e95-9b3e-44bc32d5fff9', 'volume_name': 'volume-0fa37d77-e177-4e95-9b3e-44bc32d5fff9', 'volume_size': 1}' {{(pid=84538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 19:07:40 devstack cinder-volume[84538]: DEBUG cinder.volume.manager [None req-283b1e64-bff2-4f4e-b22b-f41f79a419f7 tempest-CreateVolumesFromSnapshotTest-1225283416 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (51b1bda6-b11b-4827-8b0a-9e3324f969f2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 19:07:40 devstack cinder-volume[84538]: DEBUG cinder.volume.manager [None req-283b1e64-bff2-4f4e-b22b-f41f79a419f7 tempest-CreateVolumesFromSnapshotTest-1225283416 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (51b1bda6-b11b-4827-8b0a-9e3324f969f2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 19:07:40 devstack cinder-volume[84538]: DEBUG cinder.volume.manager [None req-283b1e64-bff2-4f4e-b22b-f41f79a419f7 tempest-CreateVolumesFromSnapshotTest-1225283416 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3022d371-57b4-4822-a7ef-c919ededa847) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 19:07:40 devstack cinder-volume[84538]: INFO cinder.volume.flows.manager.create_volume [None req-283b1e64-bff2-4f4e-b22b-f41f79a419f7 tempest-CreateVolumesFromSnapshotTest-1225283416 None] Volume 0fa37d77-e177-4e95-9b3e-44bc32d5fff9: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0fa37d77-e177-4e95-9b3e-44bc32d5fff9', 'volume_size': 1} Apr 29 19:07:40 devstack cinder-volume[84538]: DEBUG oslo_concurrency.lockutils [None req-283b1e64-bff2-4f4e-b22b-f41f79a419f7 tempest-CreateVolumesFromSnapshotTest-1225283416 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 19:07:40 devstack sudo[93442]: pam_unix(sudo:session): session closed for user root Apr 29 19:07:40 devstack cinder-volume[84538]: DEBUG oslo_concurrency.processutils [None req-f82ee420-dad9-4bbd-ae9c-c4946376ed09 tempest-CreateVolumesFromSnapshotTest-1225283416 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-c5ec4aa8-2064-4627-82d8-e65a47df0d4e" returned: 0 in 0.627s {{(pid=84538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 19:07:40 devstack cinder-volume[84538]: DEBUG cinder.volume.drivers.quobyte [None req-f82ee420-dad9-4bbd-ae9c-c4946376ed09 tempest-CreateVolumesFromSnapshotTest-1225283416 None] <== create_volume: return (1582ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-34312b00-dd6d-45bb-af98-75855cea8e48'} {{(pid=84538) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 29 19:07:40 devstack cinder-volume[84538]: DEBUG oslo_concurrency.lockutils [None req-f82ee420-dad9-4bbd-ae9c-c4946376ed09 tempest-CreateVolumesFromSnapshotTest-1225283416 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.585s {{(pid=84538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 19:07:40 devstack cinder-volume[84538]: DEBUG oslo_concurrency.lockutils [None req-91178d19-dbd0-4943-bc31-89679f9754cd tempest-CreateVolumesFromSnapshotTest-1225283416 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.253s {{(pid=84538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 19:07:40 devstack cinder-volume[84538]: DEBUG cinder.volume.drivers.quobyte [None req-91178d19-dbd0-4943-bc31-89679f9754cd tempest-CreateVolumesFromSnapshotTest-1225283416 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-29T17:07:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1514983716',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=16789a85-97f2-44b6-849b-e6fb494cac24,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bd3faae15a554f6dae855a923e039db9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T17:07:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T17:07:39Z,use_quota=True,user_id='4548792545884e54ac5240e402b4cf15',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(62b05900-93e3-4190-a88f-1d87324303d1),volume_type_id=62b05900-93e3-4190-a88f-1d87324303d1)}" {{(pid=84538) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 29 19:07:40 devstack cinder-volume[84538]: DEBUG cinder.volume.drivers.remotefs [None req-91178d19-dbd0-4943-bc31-89679f9754cd tempest-CreateVolumesFromSnapshotTest-1225283416 None] Creating volume 16789a85-97f2-44b6-849b-e6fb494cac24 {{(pid=84538) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 29 19:07:40 devstack cinder-volume[84538]: DEBUG oslo_concurrency.lockutils [None req-91178d19-dbd0-4943-bc31-89679f9754cd tempest-CreateVolumesFromSnapshotTest-1225283416 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 19:07:40 devstack cinder-volume[84538]: DEBUG oslo_concurrency.lockutils [None req-91178d19-dbd0-4943-bc31-89679f9754cd tempest-CreateVolumesFromSnapshotTest-1225283416 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=84538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 19:07:40 devstack cinder-volume[84538]: DEBUG cinder.volume.drivers.quobyte [None req-91178d19-dbd0-4943-bc31-89679f9754cd tempest-CreateVolumesFromSnapshotTest-1225283416 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-34312b00-dd6d-45bb-af98-75855cea8e48': None} {{(pid=84538) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 19:07:40 devstack cinder-volume[84538]: DEBUG cinder.volume.drivers.quobyte [None req-91178d19-dbd0-4943-bc31-89679f9754cd tempest-CreateVolumesFromSnapshotTest-1225283416 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-34312b00-dd6d-45bb-af98-75855cea8e48'] {{(pid=84538) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 19:07:40 devstack cinder-volume[84538]: DEBUG oslo_concurrency.lockutils [None req-91178d19-dbd0-4943-bc31-89679f9754cd tempest-CreateVolumesFromSnapshotTest-1225283416 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=84538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 19:07:40 devstack cinder-volume[84538]: DEBUG cinder.volume.drivers.quobyte [None req-91178d19-dbd0-4943-bc31-89679f9754cd tempest-CreateVolumesFromSnapshotTest-1225283416 None] Selected osci02.corp.quobyte.com/cinder-vol-34312b00-dd6d-45bb-af98-75855cea8e48 as target Quobyte volume. {{(pid=84538) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 29 19:07:40 devstack cinder-volume[84538]: INFO cinder.volume.drivers.remotefs [None req-91178d19-dbd0-4943-bc31-89679f9754cd tempest-CreateVolumesFromSnapshotTest-1225283416 None] casted to osci02.corp.quobyte.com/cinder-vol-34312b00-dd6d-45bb-af98-75855cea8e48 Apr 29 19:07:40 devstack cinder-volume[84538]: DEBUG oslo_concurrency.processutils [None req-91178d19-dbd0-4943-bc31-89679f9754cd tempest-CreateVolumesFromSnapshotTest-1225283416 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-16789a85-97f2-44b6-849b-e6fb494cac24 1073741824 {{(pid=84538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 19:07:40 devstack cinder-volume[84538]: DEBUG cinder.volume.manager [None req-f82ee420-dad9-4bbd-ae9c-c4946376ed09 tempest-CreateVolumesFromSnapshotTest-1225283416 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ca7aa53e-86b9-47b3-8495-e6dbae7afd4f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c5ec4aa8-2064-4627-82d8-e65a47df0d4e', 'volume_size': 1}' {{(pid=84538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 19:07:40 devstack sudo[93447]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-16789a85-97f2-44b6-849b-e6fb494cac24 1073741824 Apr 29 19:07:40 devstack sudo[93447]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 19:07:40 devstack cinder-volume[84538]: DEBUG cinder.volume.manager [None req-f82ee420-dad9-4bbd-ae9c-c4946376ed09 tempest-CreateVolumesFromSnapshotTest-1225283416 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e5a8b92d-aef1-4615-942f-fbb1d24cc128) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 19:07:40 devstack cinder-volume[84538]: INFO cinder.volume.flows.manager.create_volume [None req-f82ee420-dad9-4bbd-ae9c-c4946376ed09 tempest-CreateVolumesFromSnapshotTest-1225283416 None] Volume volume-c5ec4aa8-2064-4627-82d8-e65a47df0d4e (c5ec4aa8-2064-4627-82d8-e65a47df0d4e): created successfully Apr 29 19:07:40 devstack cinder-volume[84538]: DEBUG cinder.volume.manager [None req-f82ee420-dad9-4bbd-ae9c-c4946376ed09 tempest-CreateVolumesFromSnapshotTest-1225283416 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e5a8b92d-aef1-4615-942f-fbb1d24cc128) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 19:07:40 devstack cinder-volume[84538]: DEBUG cinder.volume.manager [None req-f82ee420-dad9-4bbd-ae9c-c4946376ed09 tempest-CreateVolumesFromSnapshotTest-1225283416 None] Flow 'volume_create_manager' (bbd3c43e-051e-455d-bb3f-c43640e2cb04) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84538) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 19:07:40 devstack cinder-volume[84538]: INFO cinder.volume.manager [None req-f82ee420-dad9-4bbd-ae9c-c4946376ed09 tempest-CreateVolumesFromSnapshotTest-1225283416 None] Created volume successfully. Apr 29 19:07:41 devstack sudo[93447]: pam_unix(sudo:session): session closed for user root Apr 29 19:07:41 devstack cinder-volume[84538]: DEBUG oslo_concurrency.processutils [None req-91178d19-dbd0-4943-bc31-89679f9754cd tempest-CreateVolumesFromSnapshotTest-1225283416 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-16789a85-97f2-44b6-849b-e6fb494cac24 1073741824" returned: 0 in 0.789s {{(pid=84538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 19:07:41 devstack cinder-volume[84538]: DEBUG oslo_concurrency.processutils [None req-91178d19-dbd0-4943-bc31-89679f9754cd tempest-CreateVolumesFromSnapshotTest-1225283416 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-16789a85-97f2-44b6-849b-e6fb494cac24 {{(pid=84538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 19:07:41 devstack sudo[93453]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-16789a85-97f2-44b6-849b-e6fb494cac24 Apr 29 19:07:41 devstack sudo[93453]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 19:07:42 devstack sudo[93453]: pam_unix(sudo:session): session closed for user root Apr 29 19:07:42 devstack cinder-volume[84538]: DEBUG oslo_concurrency.processutils [None req-91178d19-dbd0-4943-bc31-89679f9754cd tempest-CreateVolumesFromSnapshotTest-1225283416 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-16789a85-97f2-44b6-849b-e6fb494cac24" returned: 0 in 0.587s {{(pid=84538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 19:07:42 devstack cinder-volume[84538]: DEBUG cinder.volume.drivers.quobyte [None req-91178d19-dbd0-4943-bc31-89679f9754cd tempest-CreateVolumesFromSnapshotTest-1225283416 None] <== create_volume: return (1417ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-34312b00-dd6d-45bb-af98-75855cea8e48'} {{(pid=84538) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 29 19:07:42 devstack cinder-volume[84538]: DEBUG oslo_concurrency.lockutils [None req-91178d19-dbd0-4943-bc31-89679f9754cd tempest-CreateVolumesFromSnapshotTest-1225283416 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.419s {{(pid=84538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 19:07:42 devstack cinder-volume[84538]: DEBUG oslo_concurrency.lockutils [None req-c6a373c3-100c-40e2-8daf-772490c64e4b tempest-CreateVolumesFromSnapshotTest-1225283416 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.322s {{(pid=84538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 19:07:42 devstack cinder-volume[84538]: DEBUG cinder.volume.drivers.quobyte [None req-c6a373c3-100c-40e2-8daf-772490c64e4b tempest-CreateVolumesFromSnapshotTest-1225283416 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-29T17:07:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-403905381',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=27cc19a5-9a9d-4846-9399-c3b5144863ba,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bd3faae15a554f6dae855a923e039db9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T17:07:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T17:07:40Z,use_quota=True,user_id='4548792545884e54ac5240e402b4cf15',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(62b05900-93e3-4190-a88f-1d87324303d1),volume_type_id=62b05900-93e3-4190-a88f-1d87324303d1)}" {{(pid=84538) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 29 19:07:42 devstack cinder-volume[84538]: DEBUG cinder.volume.drivers.remotefs [None req-c6a373c3-100c-40e2-8daf-772490c64e4b tempest-CreateVolumesFromSnapshotTest-1225283416 None] Creating volume 27cc19a5-9a9d-4846-9399-c3b5144863ba {{(pid=84538) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 29 19:07:42 devstack cinder-volume[84538]: DEBUG oslo_concurrency.lockutils [None req-c6a373c3-100c-40e2-8daf-772490c64e4b tempest-CreateVolumesFromSnapshotTest-1225283416 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 19:07:42 devstack cinder-volume[84538]: DEBUG oslo_concurrency.lockutils [None req-c6a373c3-100c-40e2-8daf-772490c64e4b tempest-CreateVolumesFromSnapshotTest-1225283416 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 19:07:42 devstack cinder-volume[84538]: DEBUG cinder.volume.drivers.quobyte [None req-c6a373c3-100c-40e2-8daf-772490c64e4b tempest-CreateVolumesFromSnapshotTest-1225283416 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-34312b00-dd6d-45bb-af98-75855cea8e48': None} {{(pid=84538) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 19:07:42 devstack cinder-volume[84538]: DEBUG cinder.volume.drivers.quobyte [None req-c6a373c3-100c-40e2-8daf-772490c64e4b tempest-CreateVolumesFromSnapshotTest-1225283416 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-34312b00-dd6d-45bb-af98-75855cea8e48'] {{(pid=84538) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 19:07:42 devstack cinder-volume[84538]: DEBUG oslo_concurrency.lockutils [None req-c6a373c3-100c-40e2-8daf-772490c64e4b tempest-CreateVolumesFromSnapshotTest-1225283416 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=84538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 19:07:42 devstack cinder-volume[84538]: DEBUG cinder.volume.drivers.quobyte [None req-c6a373c3-100c-40e2-8daf-772490c64e4b tempest-CreateVolumesFromSnapshotTest-1225283416 None] Selected osci02.corp.quobyte.com/cinder-vol-34312b00-dd6d-45bb-af98-75855cea8e48 as target Quobyte volume. {{(pid=84538) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 29 19:07:42 devstack cinder-volume[84538]: INFO cinder.volume.drivers.remotefs [None req-c6a373c3-100c-40e2-8daf-772490c64e4b tempest-CreateVolumesFromSnapshotTest-1225283416 None] casted to osci02.corp.quobyte.com/cinder-vol-34312b00-dd6d-45bb-af98-75855cea8e48 Apr 29 19:07:42 devstack cinder-volume[84538]: DEBUG oslo_concurrency.processutils [None req-c6a373c3-100c-40e2-8daf-772490c64e4b tempest-CreateVolumesFromSnapshotTest-1225283416 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-27cc19a5-9a9d-4846-9399-c3b5144863ba 1073741824 {{(pid=84538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 19:07:42 devstack cinder-volume[84538]: DEBUG cinder.volume.manager [None req-91178d19-dbd0-4943-bc31-89679f9754cd tempest-CreateVolumesFromSnapshotTest-1225283416 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9138093a-d9f5-4708-81d9-a82c4a4d6271) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-16789a85-97f2-44b6-849b-e6fb494cac24', 'volume_size': 1}' {{(pid=84538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 19:07:42 devstack sudo[93456]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-27cc19a5-9a9d-4846-9399-c3b5144863ba 1073741824 Apr 29 19:07:42 devstack sudo[93456]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 19:07:42 devstack cinder-volume[84538]: DEBUG cinder.volume.manager [None req-91178d19-dbd0-4943-bc31-89679f9754cd tempest-CreateVolumesFromSnapshotTest-1225283416 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0c7e892b-5ca6-40cf-806f-2f4caf1b62f6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 19:07:42 devstack cinder-volume[84538]: INFO cinder.volume.flows.manager.create_volume [None req-91178d19-dbd0-4943-bc31-89679f9754cd tempest-CreateVolumesFromSnapshotTest-1225283416 None] Volume volume-16789a85-97f2-44b6-849b-e6fb494cac24 (16789a85-97f2-44b6-849b-e6fb494cac24): created successfully Apr 29 19:07:42 devstack cinder-volume[84538]: DEBUG cinder.volume.manager [None req-91178d19-dbd0-4943-bc31-89679f9754cd tempest-CreateVolumesFromSnapshotTest-1225283416 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0c7e892b-5ca6-40cf-806f-2f4caf1b62f6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 19:07:42 devstack cinder-volume[84538]: DEBUG cinder.volume.manager [None req-91178d19-dbd0-4943-bc31-89679f9754cd tempest-CreateVolumesFromSnapshotTest-1225283416 None] Flow 'volume_create_manager' (7b0bff70-4089-40c5-baeb-9cc778299d21) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84538) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 19:07:42 devstack cinder-volume[84538]: INFO cinder.volume.manager [None req-91178d19-dbd0-4943-bc31-89679f9754cd tempest-CreateVolumesFromSnapshotTest-1225283416 None] Created volume successfully. Apr 29 19:07:43 devstack sudo[93456]: pam_unix(sudo:session): session closed for user root Apr 29 19:07:43 devstack cinder-volume[84538]: DEBUG oslo_concurrency.processutils [None req-c6a373c3-100c-40e2-8daf-772490c64e4b tempest-CreateVolumesFromSnapshotTest-1225283416 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-27cc19a5-9a9d-4846-9399-c3b5144863ba 1073741824" returned: 0 in 0.748s {{(pid=84538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 19:07:43 devstack cinder-volume[84538]: DEBUG oslo_concurrency.processutils [None req-c6a373c3-100c-40e2-8daf-772490c64e4b tempest-CreateVolumesFromSnapshotTest-1225283416 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-27cc19a5-9a9d-4846-9399-c3b5144863ba {{(pid=84538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 19:07:43 devstack sudo[93461]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-27cc19a5-9a9d-4846-9399-c3b5144863ba Apr 29 19:07:43 devstack sudo[93461]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 19:07:43 devstack sudo[93461]: pam_unix(sudo:session): session closed for user root Apr 29 19:07:43 devstack cinder-volume[84538]: DEBUG oslo_concurrency.processutils [None req-c6a373c3-100c-40e2-8daf-772490c64e4b tempest-CreateVolumesFromSnapshotTest-1225283416 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-27cc19a5-9a9d-4846-9399-c3b5144863ba" returned: 0 in 0.599s {{(pid=84538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 19:07:43 devstack cinder-volume[84538]: DEBUG cinder.volume.drivers.quobyte [None req-c6a373c3-100c-40e2-8daf-772490c64e4b tempest-CreateVolumesFromSnapshotTest-1225283416 None] <== create_volume: return (1383ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-34312b00-dd6d-45bb-af98-75855cea8e48'} {{(pid=84538) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 29 19:07:43 devstack cinder-volume[84538]: DEBUG oslo_concurrency.lockutils [None req-c6a373c3-100c-40e2-8daf-772490c64e4b tempest-CreateVolumesFromSnapshotTest-1225283416 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.386s {{(pid=84538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 19:07:43 devstack cinder-volume[84538]: DEBUG oslo_concurrency.lockutils [None req-b0daf435-c1e9-4fc6-bed9-8fbe6bc372ec tempest-CreateVolumesFromSnapshotTest-1225283416 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.277s {{(pid=84538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 19:07:43 devstack cinder-volume[84538]: DEBUG cinder.volume.drivers.quobyte [None req-b0daf435-c1e9-4fc6-bed9-8fbe6bc372ec tempest-CreateVolumesFromSnapshotTest-1225283416 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-29T17:07:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-447667768',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=be9cd419-0460-43cb-8077-0065c7dc7ef7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bd3faae15a554f6dae855a923e039db9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T17:07:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T17:07:40Z,use_quota=True,user_id='4548792545884e54ac5240e402b4cf15',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(62b05900-93e3-4190-a88f-1d87324303d1),volume_type_id=62b05900-93e3-4190-a88f-1d87324303d1)}" {{(pid=84538) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 29 19:07:43 devstack cinder-volume[84538]: DEBUG cinder.volume.drivers.remotefs [None req-b0daf435-c1e9-4fc6-bed9-8fbe6bc372ec tempest-CreateVolumesFromSnapshotTest-1225283416 None] Creating volume be9cd419-0460-43cb-8077-0065c7dc7ef7 {{(pid=84538) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 29 19:07:43 devstack cinder-volume[84538]: DEBUG oslo_concurrency.lockutils [None req-b0daf435-c1e9-4fc6-bed9-8fbe6bc372ec tempest-CreateVolumesFromSnapshotTest-1225283416 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 19:07:43 devstack cinder-volume[84538]: DEBUG oslo_concurrency.lockutils [None req-b0daf435-c1e9-4fc6-bed9-8fbe6bc372ec tempest-CreateVolumesFromSnapshotTest-1225283416 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=84538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 19:07:43 devstack cinder-volume[84538]: DEBUG cinder.volume.drivers.quobyte [None req-b0daf435-c1e9-4fc6-bed9-8fbe6bc372ec tempest-CreateVolumesFromSnapshotTest-1225283416 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-34312b00-dd6d-45bb-af98-75855cea8e48': None} {{(pid=84538) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 19:07:43 devstack cinder-volume[84538]: DEBUG cinder.volume.drivers.quobyte [None req-b0daf435-c1e9-4fc6-bed9-8fbe6bc372ec tempest-CreateVolumesFromSnapshotTest-1225283416 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-34312b00-dd6d-45bb-af98-75855cea8e48'] {{(pid=84538) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 19:07:43 devstack cinder-volume[84538]: DEBUG oslo_concurrency.lockutils [None req-b0daf435-c1e9-4fc6-bed9-8fbe6bc372ec tempest-CreateVolumesFromSnapshotTest-1225283416 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=84538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 19:07:43 devstack cinder-volume[84538]: DEBUG cinder.volume.drivers.quobyte [None req-b0daf435-c1e9-4fc6-bed9-8fbe6bc372ec tempest-CreateVolumesFromSnapshotTest-1225283416 None] Selected osci02.corp.quobyte.com/cinder-vol-34312b00-dd6d-45bb-af98-75855cea8e48 as target Quobyte volume. {{(pid=84538) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 29 19:07:43 devstack cinder-volume[84538]: INFO cinder.volume.drivers.remotefs [None req-b0daf435-c1e9-4fc6-bed9-8fbe6bc372ec tempest-CreateVolumesFromSnapshotTest-1225283416 None] casted to osci02.corp.quobyte.com/cinder-vol-34312b00-dd6d-45bb-af98-75855cea8e48 Apr 29 19:07:43 devstack cinder-volume[84538]: DEBUG oslo_concurrency.processutils [None req-b0daf435-c1e9-4fc6-bed9-8fbe6bc372ec tempest-CreateVolumesFromSnapshotTest-1225283416 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-be9cd419-0460-43cb-8077-0065c7dc7ef7 1073741824 {{(pid=84538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 19:07:43 devstack sudo[93464]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-be9cd419-0460-43cb-8077-0065c7dc7ef7 1073741824 Apr 29 19:07:43 devstack sudo[93464]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 19:07:43 devstack cinder-volume[84538]: DEBUG cinder.volume.manager [None req-c6a373c3-100c-40e2-8daf-772490c64e4b tempest-CreateVolumesFromSnapshotTest-1225283416 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c42314be-9dd2-4786-9c2f-12a6a7727b9b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-27cc19a5-9a9d-4846-9399-c3b5144863ba', 'volume_size': 1}' {{(pid=84538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 19:07:43 devstack cinder-volume[84538]: DEBUG cinder.volume.manager [None req-c6a373c3-100c-40e2-8daf-772490c64e4b tempest-CreateVolumesFromSnapshotTest-1225283416 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1c185e9f-cc21-4639-ab53-a7c5e6e6a0d0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 19:07:43 devstack cinder-volume[84538]: INFO cinder.volume.flows.manager.create_volume [None req-c6a373c3-100c-40e2-8daf-772490c64e4b tempest-CreateVolumesFromSnapshotTest-1225283416 None] Volume volume-27cc19a5-9a9d-4846-9399-c3b5144863ba (27cc19a5-9a9d-4846-9399-c3b5144863ba): created successfully Apr 29 19:07:43 devstack cinder-volume[84538]: DEBUG cinder.volume.manager [None req-c6a373c3-100c-40e2-8daf-772490c64e4b tempest-CreateVolumesFromSnapshotTest-1225283416 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1c185e9f-cc21-4639-ab53-a7c5e6e6a0d0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 19:07:43 devstack cinder-volume[84538]: DEBUG cinder.volume.manager [None req-c6a373c3-100c-40e2-8daf-772490c64e4b tempest-CreateVolumesFromSnapshotTest-1225283416 None] Flow 'volume_create_manager' (a258387d-d4bf-4b40-b582-54149f048cbb) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84538) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 19:07:43 devstack cinder-volume[84538]: INFO cinder.volume.manager [None req-c6a373c3-100c-40e2-8daf-772490c64e4b tempest-CreateVolumesFromSnapshotTest-1225283416 None] Created volume successfully. Apr 29 19:07:44 devstack sudo[93464]: pam_unix(sudo:session): session closed for user root Apr 29 19:07:44 devstack cinder-volume[84538]: DEBUG oslo_concurrency.processutils [None req-b0daf435-c1e9-4fc6-bed9-8fbe6bc372ec tempest-CreateVolumesFromSnapshotTest-1225283416 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-be9cd419-0460-43cb-8077-0065c7dc7ef7 1073741824" returned: 0 in 0.739s {{(pid=84538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 19:07:44 devstack cinder-volume[84538]: DEBUG oslo_concurrency.processutils [None req-b0daf435-c1e9-4fc6-bed9-8fbe6bc372ec tempest-CreateVolumesFromSnapshotTest-1225283416 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-be9cd419-0460-43cb-8077-0065c7dc7ef7 {{(pid=84538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 19:07:44 devstack sudo[93469]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-be9cd419-0460-43cb-8077-0065c7dc7ef7 Apr 29 19:07:44 devstack sudo[93469]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 19:07:45 devstack sudo[93469]: pam_unix(sudo:session): session closed for user root Apr 29 19:07:45 devstack cinder-volume[84538]: DEBUG oslo_concurrency.processutils [None req-b0daf435-c1e9-4fc6-bed9-8fbe6bc372ec tempest-CreateVolumesFromSnapshotTest-1225283416 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-be9cd419-0460-43cb-8077-0065c7dc7ef7" returned: 0 in 0.575s {{(pid=84538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 19:07:45 devstack cinder-volume[84538]: DEBUG cinder.volume.drivers.quobyte [None req-b0daf435-c1e9-4fc6-bed9-8fbe6bc372ec tempest-CreateVolumesFromSnapshotTest-1225283416 None] <== create_volume: return (1349ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-34312b00-dd6d-45bb-af98-75855cea8e48'} {{(pid=84538) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 29 19:07:45 devstack cinder-volume[84538]: DEBUG oslo_concurrency.lockutils [None req-b0daf435-c1e9-4fc6-bed9-8fbe6bc372ec tempest-CreateVolumesFromSnapshotTest-1225283416 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.352s {{(pid=84538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 19:07:45 devstack cinder-volume[84538]: DEBUG oslo_concurrency.lockutils [None req-283b1e64-bff2-4f4e-b22b-f41f79a419f7 tempest-CreateVolumesFromSnapshotTest-1225283416 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.333s {{(pid=84538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 19:07:45 devstack cinder-volume[84538]: DEBUG cinder.volume.drivers.quobyte [None req-283b1e64-bff2-4f4e-b22b-f41f79a419f7 tempest-CreateVolumesFromSnapshotTest-1225283416 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-29T17:07:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-201974948',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0fa37d77-e177-4e95-9b3e-44bc32d5fff9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bd3faae15a554f6dae855a923e039db9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T17:07:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T17:07:41Z,use_quota=True,user_id='4548792545884e54ac5240e402b4cf15',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(62b05900-93e3-4190-a88f-1d87324303d1),volume_type_id=62b05900-93e3-4190-a88f-1d87324303d1)}" {{(pid=84538) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 29 19:07:45 devstack cinder-volume[84538]: DEBUG cinder.volume.drivers.remotefs [None req-283b1e64-bff2-4f4e-b22b-f41f79a419f7 tempest-CreateVolumesFromSnapshotTest-1225283416 None] Creating volume 0fa37d77-e177-4e95-9b3e-44bc32d5fff9 {{(pid=84538) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 29 19:07:45 devstack cinder-volume[84538]: DEBUG oslo_concurrency.lockutils [None req-283b1e64-bff2-4f4e-b22b-f41f79a419f7 tempest-CreateVolumesFromSnapshotTest-1225283416 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 19:07:45 devstack cinder-volume[84538]: DEBUG oslo_concurrency.lockutils [None req-283b1e64-bff2-4f4e-b22b-f41f79a419f7 tempest-CreateVolumesFromSnapshotTest-1225283416 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=84538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 19:07:45 devstack cinder-volume[84538]: DEBUG cinder.volume.drivers.quobyte [None req-283b1e64-bff2-4f4e-b22b-f41f79a419f7 tempest-CreateVolumesFromSnapshotTest-1225283416 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-34312b00-dd6d-45bb-af98-75855cea8e48': None} {{(pid=84538) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 19:07:45 devstack cinder-volume[84538]: DEBUG cinder.volume.drivers.quobyte [None req-283b1e64-bff2-4f4e-b22b-f41f79a419f7 tempest-CreateVolumesFromSnapshotTest-1225283416 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-34312b00-dd6d-45bb-af98-75855cea8e48'] {{(pid=84538) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 19:07:45 devstack cinder-volume[84538]: DEBUG oslo_concurrency.lockutils [None req-283b1e64-bff2-4f4e-b22b-f41f79a419f7 tempest-CreateVolumesFromSnapshotTest-1225283416 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=84538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 19:07:45 devstack cinder-volume[84538]: DEBUG cinder.volume.drivers.quobyte [None req-283b1e64-bff2-4f4e-b22b-f41f79a419f7 tempest-CreateVolumesFromSnapshotTest-1225283416 None] Selected osci02.corp.quobyte.com/cinder-vol-34312b00-dd6d-45bb-af98-75855cea8e48 as target Quobyte volume. {{(pid=84538) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 29 19:07:45 devstack cinder-volume[84538]: INFO cinder.volume.drivers.remotefs [None req-283b1e64-bff2-4f4e-b22b-f41f79a419f7 tempest-CreateVolumesFromSnapshotTest-1225283416 None] casted to osci02.corp.quobyte.com/cinder-vol-34312b00-dd6d-45bb-af98-75855cea8e48 Apr 29 19:07:45 devstack cinder-volume[84538]: DEBUG oslo_concurrency.processutils [None req-283b1e64-bff2-4f4e-b22b-f41f79a419f7 tempest-CreateVolumesFromSnapshotTest-1225283416 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-0fa37d77-e177-4e95-9b3e-44bc32d5fff9 1073741824 {{(pid=84538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 19:07:45 devstack sudo[93472]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-0fa37d77-e177-4e95-9b3e-44bc32d5fff9 1073741824 Apr 29 19:07:45 devstack sudo[93472]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 19:07:45 devstack cinder-volume[84538]: DEBUG cinder.volume.manager [None req-b0daf435-c1e9-4fc6-bed9-8fbe6bc372ec tempest-CreateVolumesFromSnapshotTest-1225283416 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (19b25a4e-cd4a-4556-87ee-37fa29c067a2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-be9cd419-0460-43cb-8077-0065c7dc7ef7', 'volume_size': 1}' {{(pid=84538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 19:07:45 devstack cinder-volume[84538]: DEBUG cinder.volume.manager [None req-b0daf435-c1e9-4fc6-bed9-8fbe6bc372ec tempest-CreateVolumesFromSnapshotTest-1225283416 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fd8819a6-3c5b-429c-a086-46579182d018) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 19:07:45 devstack cinder-volume[84538]: INFO cinder.volume.flows.manager.create_volume [None req-b0daf435-c1e9-4fc6-bed9-8fbe6bc372ec tempest-CreateVolumesFromSnapshotTest-1225283416 None] Volume volume-be9cd419-0460-43cb-8077-0065c7dc7ef7 (be9cd419-0460-43cb-8077-0065c7dc7ef7): created successfully Apr 29 19:07:45 devstack cinder-volume[84538]: DEBUG cinder.volume.manager [None req-b0daf435-c1e9-4fc6-bed9-8fbe6bc372ec tempest-CreateVolumesFromSnapshotTest-1225283416 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fd8819a6-3c5b-429c-a086-46579182d018) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 19:07:45 devstack cinder-volume[84538]: DEBUG cinder.volume.manager [None req-b0daf435-c1e9-4fc6-bed9-8fbe6bc372ec tempest-CreateVolumesFromSnapshotTest-1225283416 None] Flow 'volume_create_manager' (03883f32-823a-4f92-a9cf-cd7d777d3c03) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84538) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 19:07:45 devstack cinder-volume[84538]: INFO cinder.volume.manager [None req-b0daf435-c1e9-4fc6-bed9-8fbe6bc372ec tempest-CreateVolumesFromSnapshotTest-1225283416 None] Created volume successfully. Apr 29 19:07:45 devstack sudo[93472]: pam_unix(sudo:session): session closed for user root Apr 29 19:07:45 devstack cinder-volume[84538]: DEBUG oslo_concurrency.processutils [None req-283b1e64-bff2-4f4e-b22b-f41f79a419f7 tempest-CreateVolumesFromSnapshotTest-1225283416 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-0fa37d77-e177-4e95-9b3e-44bc32d5fff9 1073741824" returned: 0 in 0.742s {{(pid=84538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 19:07:45 devstack cinder-volume[84538]: DEBUG oslo_concurrency.processutils [None req-283b1e64-bff2-4f4e-b22b-f41f79a419f7 tempest-CreateVolumesFromSnapshotTest-1225283416 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-0fa37d77-e177-4e95-9b3e-44bc32d5fff9 {{(pid=84538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 19:07:45 devstack sudo[93478]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-0fa37d77-e177-4e95-9b3e-44bc32d5fff9 Apr 29 19:07:45 devstack sudo[93478]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 19:07:46 devstack sudo[93478]: pam_unix(sudo:session): session closed for user root Apr 29 19:07:46 devstack cinder-volume[84538]: DEBUG oslo_concurrency.processutils [None req-283b1e64-bff2-4f4e-b22b-f41f79a419f7 tempest-CreateVolumesFromSnapshotTest-1225283416 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-0fa37d77-e177-4e95-9b3e-44bc32d5fff9" returned: 0 in 0.587s {{(pid=84538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 19:07:46 devstack cinder-volume[84538]: DEBUG cinder.volume.drivers.quobyte [None req-283b1e64-bff2-4f4e-b22b-f41f79a419f7 tempest-CreateVolumesFromSnapshotTest-1225283416 None] <== create_volume: return (1366ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-34312b00-dd6d-45bb-af98-75855cea8e48'} {{(pid=84538) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 29 19:07:46 devstack cinder-volume[84538]: DEBUG oslo_concurrency.lockutils [None req-283b1e64-bff2-4f4e-b22b-f41f79a419f7 tempest-CreateVolumesFromSnapshotTest-1225283416 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.369s {{(pid=84538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 19:07:46 devstack cinder-volume[84538]: DEBUG cinder.volume.manager [None req-283b1e64-bff2-4f4e-b22b-f41f79a419f7 tempest-CreateVolumesFromSnapshotTest-1225283416 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3022d371-57b4-4822-a7ef-c919ededa847) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0fa37d77-e177-4e95-9b3e-44bc32d5fff9', 'volume_size': 1}' {{(pid=84538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 19:07:46 devstack cinder-volume[84538]: DEBUG cinder.volume.manager [None req-283b1e64-bff2-4f4e-b22b-f41f79a419f7 tempest-CreateVolumesFromSnapshotTest-1225283416 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a5eaf878-f69c-4c2b-93c9-615074249cb3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 19:07:46 devstack cinder-volume[84538]: INFO cinder.volume.flows.manager.create_volume [None req-283b1e64-bff2-4f4e-b22b-f41f79a419f7 tempest-CreateVolumesFromSnapshotTest-1225283416 None] Volume volume-0fa37d77-e177-4e95-9b3e-44bc32d5fff9 (0fa37d77-e177-4e95-9b3e-44bc32d5fff9): created successfully Apr 29 19:07:46 devstack cinder-volume[84538]: DEBUG cinder.volume.manager [None req-283b1e64-bff2-4f4e-b22b-f41f79a419f7 tempest-CreateVolumesFromSnapshotTest-1225283416 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a5eaf878-f69c-4c2b-93c9-615074249cb3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 19:07:46 devstack cinder-volume[84538]: DEBUG cinder.volume.manager [None req-283b1e64-bff2-4f4e-b22b-f41f79a419f7 tempest-CreateVolumesFromSnapshotTest-1225283416 None] Flow 'volume_create_manager' (4046307e-daa1-4aae-ac24-54df9e43a8e6) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84538) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 19:07:46 devstack cinder-volume[84538]: INFO cinder.volume.manager [None req-283b1e64-bff2-4f4e-b22b-f41f79a419f7 tempest-CreateVolumesFromSnapshotTest-1225283416 None] Created volume successfully. Apr 29 19:07:47 devstack cinder-volume[84538]: DEBUG cinder.coordination [None req-e4fe7660-beb0-4f0c-8af4-01705bdb94e6 tempest-CreateVolumesFromSnapshotTest-1225283416 None] Acquiring lock "cinder-0fa37d77-e177-4e95-9b3e-44bc32d5fff9-delete_volume" by "delete_volume" {{(pid=84538) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 19:07:47 devstack cinder-volume[84538]: DEBUG cinder.coordination [None req-e4fe7660-beb0-4f0c-8af4-01705bdb94e6 tempest-CreateVolumesFromSnapshotTest-1225283416 None] Lock "cinder-0fa37d77-e177-4e95-9b3e-44bc32d5fff9-delete_volume" acquired by "delete_volume" :: waited 0.014s {{(pid=84538) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 19:07:47 devstack cinder-volume[84538]: DEBUG dbcounter [-] [84538] Writing DB stats cinder:SELECT=95,cinder:INSERT=32,cinder:UPDATE=114,cinder:DELETE=9 {{(pid=84538) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Apr 29 19:07:47 devstack cinder-volume[84538]: DEBUG dbcounter [-] [84538] Writing DB stats cinder:UPDATE=117,cinder:SELECT=82,cinder:INSERT=35,cinder:DELETE=13 {{(pid=84538) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Apr 29 19:07:47 devstack cinder-volume[84538]: DEBUG cinder.coordination [None req-e4fe7660-beb0-4f0c-8af4-01705bdb94e6 tempest-CreateVolumesFromSnapshotTest-1225283416 None] Acquiring lock "cinder-quobyte-0fa37d77-e177-4e95-9b3e-44bc32d5fff9" by "delete_volume" {{(pid=84538) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 19:07:47 devstack cinder-volume[84538]: DEBUG cinder.coordination [None req-e4fe7660-beb0-4f0c-8af4-01705bdb94e6 tempest-CreateVolumesFromSnapshotTest-1225283416 None] Lock "cinder-quobyte-0fa37d77-e177-4e95-9b3e-44bc32d5fff9" acquired by "delete_volume" :: waited 0.015s {{(pid=84538) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 19:07:47 devstack cinder-volume[84538]: DEBUG oslo.privsep.daemon [-] privsep: reply[419eb039-70c0-426f-8b3b-54776832bb10]: (4, 'qcow2') {{(pid=85803) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 19:07:47 devstack cinder-volume[84538]: DEBUG oslo_concurrency.processutils [None req-e4fe7660-beb0-4f0c-8af4-01705bdb94e6 tempest-CreateVolumesFromSnapshotTest-1225283416 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-0fa37d77-e177-4e95-9b3e-44bc32d5fff9 {{(pid=84538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 19:07:47 devstack sudo[93481]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-0fa37d77-e177-4e95-9b3e-44bc32d5fff9 Apr 29 19:07:47 devstack sudo[93481]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 19:07:47 devstack sudo[93481]: pam_unix(sudo:session): session closed for user root Apr 29 19:07:47 devstack cinder-volume[84538]: DEBUG oslo_concurrency.processutils [None req-e4fe7660-beb0-4f0c-8af4-01705bdb94e6 tempest-CreateVolumesFromSnapshotTest-1225283416 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-0fa37d77-e177-4e95-9b3e-44bc32d5fff9" returned: 0 in 0.695s {{(pid=84538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 19:07:47 devstack cinder-volume[84538]: DEBUG oslo_concurrency.processutils [None req-e4fe7660-beb0-4f0c-8af4-01705bdb94e6 tempest-CreateVolumesFromSnapshotTest-1225283416 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-0fa37d77-e177-4e95-9b3e-44bc32d5fff9 {{(pid=84538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 19:07:47 devstack sudo[93522]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-0fa37d77-e177-4e95-9b3e-44bc32d5fff9 Apr 29 19:07:48 devstack sudo[93522]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 19:07:48 devstack sudo[93522]: pam_unix(sudo:session): session closed for user root Apr 29 19:07:48 devstack cinder-volume[84538]: DEBUG oslo_concurrency.processutils [None req-e4fe7660-beb0-4f0c-8af4-01705bdb94e6 tempest-CreateVolumesFromSnapshotTest-1225283416 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-0fa37d77-e177-4e95-9b3e-44bc32d5fff9" returned: 0 in 0.594s {{(pid=84538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 19:07:48 devstack cinder-volume[84538]: DEBUG cinder.coordination [None req-e4fe7660-beb0-4f0c-8af4-01705bdb94e6 tempest-CreateVolumesFromSnapshotTest-1225283416 None] Lock "cinder-quobyte-0fa37d77-e177-4e95-9b3e-44bc32d5fff9" released by "delete_volume" :: held 1.324s {{(pid=84538) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 19:07:48 devstack cinder-volume[84538]: DEBUG cinder.quota [None req-e4fe7660-beb0-4f0c-8af4-01705bdb94e6 tempest-CreateVolumesFromSnapshotTest-1225283416 None] Created reservations ['3555b191-a735-454c-aaa3-d1e1e7268206', '7a97445b-737b-448d-82e0-bba627df125a', '0d3c6aeb-4346-4c53-95a4-3554acb80f3c', '24651e40-779d-4296-9646-4b1be9c96ade'] {{(pid=84538) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 29 19:07:48 devstack cinder-volume[84538]: DEBUG oslo_concurrency.lockutils [None req-e4fe7660-beb0-4f0c-8af4-01705bdb94e6 tempest-CreateVolumesFromSnapshotTest-1225283416 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 19:07:48 devstack cinder-volume[84538]: DEBUG oslo_concurrency.lockutils [None req-e4fe7660-beb0-4f0c-8af4-01705bdb94e6 tempest-CreateVolumesFromSnapshotTest-1225283416 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 19:07:48 devstack cinder-volume[84538]: DEBUG cinder.volume.drivers.quobyte [None req-e4fe7660-beb0-4f0c-8af4-01705bdb94e6 tempest-CreateVolumesFromSnapshotTest-1225283416 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-34312b00-dd6d-45bb-af98-75855cea8e48': None} {{(pid=84538) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 19:07:48 devstack cinder-volume[84538]: DEBUG cinder.volume.drivers.quobyte [None req-e4fe7660-beb0-4f0c-8af4-01705bdb94e6 tempest-CreateVolumesFromSnapshotTest-1225283416 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-34312b00-dd6d-45bb-af98-75855cea8e48'] {{(pid=84538) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 19:07:48 devstack cinder-volume[84538]: DEBUG oslo_concurrency.lockutils [None req-e4fe7660-beb0-4f0c-8af4-01705bdb94e6 tempest-CreateVolumesFromSnapshotTest-1225283416 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=84538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 19:07:48 devstack cinder-volume[84538]: DEBUG oslo_concurrency.processutils [None req-e4fe7660-beb0-4f0c-8af4-01705bdb94e6 tempest-CreateVolumesFromSnapshotTest-1225283416 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d {{(pid=84538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 19:07:48 devstack sudo[93526]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d Apr 29 19:07:48 devstack sudo[93526]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 19:07:49 devstack sudo[93526]: pam_unix(sudo:session): session closed for user root Apr 29 19:07:49 devstack cinder-volume[84538]: DEBUG oslo_concurrency.processutils [None req-e4fe7660-beb0-4f0c-8af4-01705bdb94e6 tempest-CreateVolumesFromSnapshotTest-1225283416 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d" returned: 0 in 0.576s {{(pid=84538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 19:07:49 devstack cinder-volume[84538]: DEBUG cinder.manager [None req-e4fe7660-beb0-4f0c-8af4-01705bdb94e6 tempest-CreateVolumesFromSnapshotTest-1225283416 None] Notifying Schedulers of capabilities ... {{(pid=84538) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 29 19:07:49 devstack cinder-volume[84538]: INFO cinder.volume.manager [None req-e4fe7660-beb0-4f0c-8af4-01705bdb94e6 tempest-CreateVolumesFromSnapshotTest-1225283416 None] Deleted volume successfully. Apr 29 19:07:49 devstack cinder-volume[84538]: DEBUG cinder.coordination [None req-e4fe7660-beb0-4f0c-8af4-01705bdb94e6 tempest-CreateVolumesFromSnapshotTest-1225283416 None] Lock "cinder-0fa37d77-e177-4e95-9b3e-44bc32d5fff9-delete_volume" released by "delete_volume" :: held 2.105s {{(pid=84538) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 19:07:49 devstack cinder-volume[84538]: DEBUG cinder.coordination [None req-58f68d78-6ffa-4a8d-a39b-00a5b71f8a15 tempest-CreateVolumesFromSnapshotTest-1225283416 None] Acquiring lock "cinder-be9cd419-0460-43cb-8077-0065c7dc7ef7-delete_volume" by "delete_volume" {{(pid=84538) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 19:07:49 devstack cinder-volume[84538]: DEBUG cinder.coordination [None req-58f68d78-6ffa-4a8d-a39b-00a5b71f8a15 tempest-CreateVolumesFromSnapshotTest-1225283416 None] Lock "cinder-be9cd419-0460-43cb-8077-0065c7dc7ef7-delete_volume" acquired by "delete_volume" :: waited 0.017s {{(pid=84538) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 19:07:49 devstack cinder-volume[84538]: DEBUG cinder.coordination [None req-58f68d78-6ffa-4a8d-a39b-00a5b71f8a15 tempest-CreateVolumesFromSnapshotTest-1225283416 None] Acquiring lock "cinder-quobyte-be9cd419-0460-43cb-8077-0065c7dc7ef7" by "delete_volume" {{(pid=84538) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 19:07:49 devstack cinder-volume[84538]: DEBUG cinder.coordination [None req-58f68d78-6ffa-4a8d-a39b-00a5b71f8a15 tempest-CreateVolumesFromSnapshotTest-1225283416 None] Lock "cinder-quobyte-be9cd419-0460-43cb-8077-0065c7dc7ef7" acquired by "delete_volume" :: waited 0.016s {{(pid=84538) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 19:07:49 devstack cinder-volume[84538]: DEBUG oslo.privsep.daemon [-] privsep: reply[4ffbfdb8-fb32-4d86-8cfa-ce10969dfab1]: (4, 'qcow2') {{(pid=85803) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 19:07:49 devstack cinder-volume[84538]: DEBUG oslo_concurrency.processutils [None req-58f68d78-6ffa-4a8d-a39b-00a5b71f8a15 tempest-CreateVolumesFromSnapshotTest-1225283416 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-be9cd419-0460-43cb-8077-0065c7dc7ef7 {{(pid=84538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 19:07:49 devstack sudo[93529]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-be9cd419-0460-43cb-8077-0065c7dc7ef7 Apr 29 19:07:49 devstack sudo[93529]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 19:07:50 devstack sudo[93529]: pam_unix(sudo:session): session closed for user root Apr 29 19:07:50 devstack cinder-volume[84538]: DEBUG oslo_concurrency.processutils [None req-58f68d78-6ffa-4a8d-a39b-00a5b71f8a15 tempest-CreateVolumesFromSnapshotTest-1225283416 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-be9cd419-0460-43cb-8077-0065c7dc7ef7" returned: 0 in 0.715s {{(pid=84538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 19:07:50 devstack cinder-volume[84538]: DEBUG oslo_concurrency.processutils [None req-58f68d78-6ffa-4a8d-a39b-00a5b71f8a15 tempest-CreateVolumesFromSnapshotTest-1225283416 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-be9cd419-0460-43cb-8077-0065c7dc7ef7 {{(pid=84538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 19:07:50 devstack sudo[93534]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-be9cd419-0460-43cb-8077-0065c7dc7ef7 Apr 29 19:07:50 devstack sudo[93534]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 19:07:50 devstack sudo[93534]: pam_unix(sudo:session): session closed for user root Apr 29 19:07:50 devstack cinder-volume[84538]: DEBUG oslo_concurrency.processutils [None req-58f68d78-6ffa-4a8d-a39b-00a5b71f8a15 tempest-CreateVolumesFromSnapshotTest-1225283416 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-be9cd419-0460-43cb-8077-0065c7dc7ef7" returned: 0 in 0.578s {{(pid=84538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 19:07:50 devstack cinder-volume[84538]: DEBUG cinder.coordination [None req-58f68d78-6ffa-4a8d-a39b-00a5b71f8a15 tempest-CreateVolumesFromSnapshotTest-1225283416 None] Lock "cinder-quobyte-be9cd419-0460-43cb-8077-0065c7dc7ef7" released by "delete_volume" :: held 1.330s {{(pid=84538) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 19:07:50 devstack cinder-volume[84538]: DEBUG cinder.quota [None req-58f68d78-6ffa-4a8d-a39b-00a5b71f8a15 tempest-CreateVolumesFromSnapshotTest-1225283416 None] Created reservations ['8224e403-036c-41fe-9ff7-1587a24000fb', '9dbc31b0-7c68-49e6-a51f-950c6ea17fb8', 'cb3e9663-f3c5-4fac-9f01-762b214bb110', '483fd1eb-dee5-4a66-83bf-3008f5c4eb3d'] {{(pid=84538) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 29 19:07:50 devstack cinder-volume[84538]: DEBUG oslo_concurrency.lockutils [None req-58f68d78-6ffa-4a8d-a39b-00a5b71f8a15 tempest-CreateVolumesFromSnapshotTest-1225283416 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 19:07:50 devstack cinder-volume[84538]: DEBUG oslo_concurrency.lockutils [None req-58f68d78-6ffa-4a8d-a39b-00a5b71f8a15 tempest-CreateVolumesFromSnapshotTest-1225283416 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 19:07:50 devstack cinder-volume[84538]: DEBUG cinder.volume.drivers.quobyte [None req-58f68d78-6ffa-4a8d-a39b-00a5b71f8a15 tempest-CreateVolumesFromSnapshotTest-1225283416 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-34312b00-dd6d-45bb-af98-75855cea8e48': None} {{(pid=84538) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 19:07:50 devstack cinder-volume[84538]: DEBUG cinder.volume.drivers.quobyte [None req-58f68d78-6ffa-4a8d-a39b-00a5b71f8a15 tempest-CreateVolumesFromSnapshotTest-1225283416 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-34312b00-dd6d-45bb-af98-75855cea8e48'] {{(pid=84538) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 19:07:50 devstack cinder-volume[84538]: DEBUG oslo_concurrency.lockutils [None req-58f68d78-6ffa-4a8d-a39b-00a5b71f8a15 tempest-CreateVolumesFromSnapshotTest-1225283416 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=84538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 19:07:50 devstack cinder-volume[84538]: DEBUG oslo_concurrency.processutils [None req-58f68d78-6ffa-4a8d-a39b-00a5b71f8a15 tempest-CreateVolumesFromSnapshotTest-1225283416 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d {{(pid=84538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 19:07:50 devstack sudo[93537]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d Apr 29 19:07:50 devstack sudo[93537]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 19:07:51 devstack sudo[93537]: pam_unix(sudo:session): session closed for user root Apr 29 19:07:51 devstack cinder-volume[84538]: DEBUG oslo_concurrency.processutils [None req-58f68d78-6ffa-4a8d-a39b-00a5b71f8a15 tempest-CreateVolumesFromSnapshotTest-1225283416 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d" returned: 0 in 0.584s {{(pid=84538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 19:07:51 devstack cinder-volume[84538]: DEBUG cinder.manager [None req-58f68d78-6ffa-4a8d-a39b-00a5b71f8a15 tempest-CreateVolumesFromSnapshotTest-1225283416 None] Notifying Schedulers of capabilities ... {{(pid=84538) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 29 19:07:51 devstack cinder-volume[84538]: INFO cinder.volume.manager [None req-58f68d78-6ffa-4a8d-a39b-00a5b71f8a15 tempest-CreateVolumesFromSnapshotTest-1225283416 None] Deleted volume successfully. Apr 29 19:07:51 devstack cinder-volume[84538]: DEBUG cinder.coordination [None req-58f68d78-6ffa-4a8d-a39b-00a5b71f8a15 tempest-CreateVolumesFromSnapshotTest-1225283416 None] Lock "cinder-be9cd419-0460-43cb-8077-0065c7dc7ef7-delete_volume" released by "delete_volume" :: held 2.100s {{(pid=84538) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 19:07:51 devstack cinder-volume[84538]: DEBUG cinder.coordination [None req-4e9ebdfd-e925-48f3-9e19-53146f3039d0 tempest-CreateVolumesFromSnapshotTest-1225283416 None] Acquiring lock "cinder-27cc19a5-9a9d-4846-9399-c3b5144863ba-delete_volume" by "delete_volume" {{(pid=84538) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 19:07:51 devstack cinder-volume[84538]: DEBUG cinder.coordination [None req-4e9ebdfd-e925-48f3-9e19-53146f3039d0 tempest-CreateVolumesFromSnapshotTest-1225283416 None] Lock "cinder-27cc19a5-9a9d-4846-9399-c3b5144863ba-delete_volume" acquired by "delete_volume" :: waited 0.017s {{(pid=84538) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 19:07:51 devstack cinder-volume[84538]: DEBUG cinder.coordination [None req-4e9ebdfd-e925-48f3-9e19-53146f3039d0 tempest-CreateVolumesFromSnapshotTest-1225283416 None] Acquiring lock "cinder-quobyte-27cc19a5-9a9d-4846-9399-c3b5144863ba" by "delete_volume" {{(pid=84538) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 19:07:51 devstack cinder-volume[84538]: DEBUG cinder.coordination [None req-4e9ebdfd-e925-48f3-9e19-53146f3039d0 tempest-CreateVolumesFromSnapshotTest-1225283416 None] Lock "cinder-quobyte-27cc19a5-9a9d-4846-9399-c3b5144863ba" acquired by "delete_volume" :: waited 0.016s {{(pid=84538) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 19:07:51 devstack cinder-volume[84538]: DEBUG oslo.privsep.daemon [-] privsep: reply[e0401222-0c1f-4987-a1df-23a8f8a56cd9]: (4, 'qcow2') {{(pid=85803) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 19:07:51 devstack cinder-volume[84538]: DEBUG oslo_concurrency.processutils [None req-4e9ebdfd-e925-48f3-9e19-53146f3039d0 tempest-CreateVolumesFromSnapshotTest-1225283416 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-27cc19a5-9a9d-4846-9399-c3b5144863ba {{(pid=84538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 19:07:51 devstack sudo[93540]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-27cc19a5-9a9d-4846-9399-c3b5144863ba Apr 29 19:07:51 devstack sudo[93540]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 19:07:52 devstack sudo[93540]: pam_unix(sudo:session): session closed for user root Apr 29 19:07:52 devstack cinder-volume[84538]: DEBUG oslo_concurrency.processutils [None req-4e9ebdfd-e925-48f3-9e19-53146f3039d0 tempest-CreateVolumesFromSnapshotTest-1225283416 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-27cc19a5-9a9d-4846-9399-c3b5144863ba" returned: 0 in 0.683s {{(pid=84538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 19:07:52 devstack cinder-volume[84538]: DEBUG oslo_concurrency.processutils [None req-4e9ebdfd-e925-48f3-9e19-53146f3039d0 tempest-CreateVolumesFromSnapshotTest-1225283416 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-27cc19a5-9a9d-4846-9399-c3b5144863ba {{(pid=84538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 19:07:52 devstack sudo[93545]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-27cc19a5-9a9d-4846-9399-c3b5144863ba Apr 29 19:07:52 devstack sudo[93545]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 19:07:52 devstack sudo[93545]: pam_unix(sudo:session): session closed for user root Apr 29 19:07:52 devstack cinder-volume[84538]: DEBUG oslo_concurrency.processutils [None req-4e9ebdfd-e925-48f3-9e19-53146f3039d0 tempest-CreateVolumesFromSnapshotTest-1225283416 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-27cc19a5-9a9d-4846-9399-c3b5144863ba" returned: 0 in 0.590s {{(pid=84538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 19:07:52 devstack cinder-volume[84538]: DEBUG cinder.coordination [None req-4e9ebdfd-e925-48f3-9e19-53146f3039d0 tempest-CreateVolumesFromSnapshotTest-1225283416 None] Lock "cinder-quobyte-27cc19a5-9a9d-4846-9399-c3b5144863ba" released by "delete_volume" :: held 1.315s {{(pid=84538) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 19:07:53 devstack cinder-volume[84538]: DEBUG cinder.quota [None req-4e9ebdfd-e925-48f3-9e19-53146f3039d0 tempest-CreateVolumesFromSnapshotTest-1225283416 None] Created reservations ['63cd7b82-7f90-4b3a-a8d5-e9ae3e45e29e', 'e146c60d-0f6c-479e-b394-60bf59a9d70f', '20c42a16-aa93-41bf-8456-3c1dd5044bc6', '290ce0c1-1257-4439-a516-64d455bceb02'] {{(pid=84538) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 29 19:07:53 devstack cinder-volume[84538]: DEBUG oslo_concurrency.lockutils [None req-4e9ebdfd-e925-48f3-9e19-53146f3039d0 tempest-CreateVolumesFromSnapshotTest-1225283416 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 19:07:53 devstack cinder-volume[84538]: DEBUG oslo_concurrency.lockutils [None req-4e9ebdfd-e925-48f3-9e19-53146f3039d0 tempest-CreateVolumesFromSnapshotTest-1225283416 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 19:07:53 devstack cinder-volume[84538]: DEBUG cinder.volume.drivers.quobyte [None req-4e9ebdfd-e925-48f3-9e19-53146f3039d0 tempest-CreateVolumesFromSnapshotTest-1225283416 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-34312b00-dd6d-45bb-af98-75855cea8e48': None} {{(pid=84538) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 19:07:53 devstack cinder-volume[84538]: DEBUG cinder.volume.drivers.quobyte [None req-4e9ebdfd-e925-48f3-9e19-53146f3039d0 tempest-CreateVolumesFromSnapshotTest-1225283416 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-34312b00-dd6d-45bb-af98-75855cea8e48'] {{(pid=84538) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 19:07:53 devstack cinder-volume[84538]: DEBUG oslo_concurrency.lockutils [None req-4e9ebdfd-e925-48f3-9e19-53146f3039d0 tempest-CreateVolumesFromSnapshotTest-1225283416 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=84538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 19:07:53 devstack cinder-volume[84538]: DEBUG oslo_concurrency.processutils [None req-4e9ebdfd-e925-48f3-9e19-53146f3039d0 tempest-CreateVolumesFromSnapshotTest-1225283416 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d {{(pid=84538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 19:07:53 devstack sudo[93548]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d Apr 29 19:07:53 devstack sudo[93548]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 19:07:53 devstack sudo[93548]: pam_unix(sudo:session): session closed for user root Apr 29 19:07:53 devstack cinder-volume[84538]: DEBUG oslo_concurrency.processutils [None req-4e9ebdfd-e925-48f3-9e19-53146f3039d0 tempest-CreateVolumesFromSnapshotTest-1225283416 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d" returned: 0 in 0.594s {{(pid=84538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 19:07:53 devstack cinder-volume[84538]: DEBUG cinder.manager [None req-4e9ebdfd-e925-48f3-9e19-53146f3039d0 tempest-CreateVolumesFromSnapshotTest-1225283416 None] Notifying Schedulers of capabilities ... {{(pid=84538) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 29 19:07:53 devstack cinder-volume[84538]: INFO cinder.volume.manager [None req-4e9ebdfd-e925-48f3-9e19-53146f3039d0 tempest-CreateVolumesFromSnapshotTest-1225283416 None] Deleted volume successfully. Apr 29 19:07:53 devstack cinder-volume[84538]: DEBUG cinder.coordination [None req-4e9ebdfd-e925-48f3-9e19-53146f3039d0 tempest-CreateVolumesFromSnapshotTest-1225283416 None] Lock "cinder-27cc19a5-9a9d-4846-9399-c3b5144863ba-delete_volume" released by "delete_volume" :: held 2.091s {{(pid=84538) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 19:07:53 devstack cinder-volume[84538]: DEBUG cinder.coordination [None req-e662b45e-7337-45f8-b884-46d06a914c15 tempest-CreateVolumesFromSnapshotTest-1225283416 None] Acquiring lock "cinder-16789a85-97f2-44b6-849b-e6fb494cac24-delete_volume" by "delete_volume" {{(pid=84538) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 19:07:53 devstack cinder-volume[84538]: DEBUG cinder.coordination [None req-e662b45e-7337-45f8-b884-46d06a914c15 tempest-CreateVolumesFromSnapshotTest-1225283416 None] Lock "cinder-16789a85-97f2-44b6-849b-e6fb494cac24-delete_volume" acquired by "delete_volume" :: waited 0.016s {{(pid=84538) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 19:07:53 devstack cinder-volume[84538]: DEBUG cinder.coordination [None req-e662b45e-7337-45f8-b884-46d06a914c15 tempest-CreateVolumesFromSnapshotTest-1225283416 None] Acquiring lock "cinder-quobyte-16789a85-97f2-44b6-849b-e6fb494cac24" by "delete_volume" {{(pid=84538) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 19:07:53 devstack cinder-volume[84538]: DEBUG cinder.coordination [None req-e662b45e-7337-45f8-b884-46d06a914c15 tempest-CreateVolumesFromSnapshotTest-1225283416 None] Lock "cinder-quobyte-16789a85-97f2-44b6-849b-e6fb494cac24" acquired by "delete_volume" :: waited 0.014s {{(pid=84538) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 19:07:53 devstack cinder-volume[84538]: DEBUG oslo.privsep.daemon [-] privsep: reply[32a58943-a413-4c53-8dfe-c0280463b5d4]: (4, 'qcow2') {{(pid=85803) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 19:07:53 devstack cinder-volume[84538]: DEBUG oslo_concurrency.processutils [None req-e662b45e-7337-45f8-b884-46d06a914c15 tempest-CreateVolumesFromSnapshotTest-1225283416 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-16789a85-97f2-44b6-849b-e6fb494cac24 {{(pid=84538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 19:07:53 devstack sudo[93551]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-16789a85-97f2-44b6-849b-e6fb494cac24 Apr 29 19:07:53 devstack sudo[93551]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 19:07:54 devstack sudo[93551]: pam_unix(sudo:session): session closed for user root Apr 29 19:07:54 devstack cinder-volume[84538]: DEBUG oslo_concurrency.processutils [None req-e662b45e-7337-45f8-b884-46d06a914c15 tempest-CreateVolumesFromSnapshotTest-1225283416 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-16789a85-97f2-44b6-849b-e6fb494cac24" returned: 0 in 0.700s {{(pid=84538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 19:07:54 devstack cinder-volume[84538]: DEBUG oslo_concurrency.processutils [None req-e662b45e-7337-45f8-b884-46d06a914c15 tempest-CreateVolumesFromSnapshotTest-1225283416 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-16789a85-97f2-44b6-849b-e6fb494cac24 {{(pid=84538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 19:07:54 devstack sudo[93556]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-16789a85-97f2-44b6-849b-e6fb494cac24 Apr 29 19:07:54 devstack sudo[93556]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 19:07:55 devstack sudo[93556]: pam_unix(sudo:session): session closed for user root Apr 29 19:07:55 devstack cinder-volume[84538]: DEBUG oslo_concurrency.processutils [None req-e662b45e-7337-45f8-b884-46d06a914c15 tempest-CreateVolumesFromSnapshotTest-1225283416 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-16789a85-97f2-44b6-849b-e6fb494cac24" returned: 0 in 0.581s {{(pid=84538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 19:07:55 devstack cinder-volume[84538]: DEBUG cinder.coordination [None req-e662b45e-7337-45f8-b884-46d06a914c15 tempest-CreateVolumesFromSnapshotTest-1225283416 None] Lock "cinder-quobyte-16789a85-97f2-44b6-849b-e6fb494cac24" released by "delete_volume" :: held 1.319s {{(pid=84538) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 19:07:55 devstack cinder-volume[84538]: DEBUG cinder.quota [None req-e662b45e-7337-45f8-b884-46d06a914c15 tempest-CreateVolumesFromSnapshotTest-1225283416 None] Created reservations ['adf2473f-7f30-4ac7-8e31-3e14266ab719', '3791e357-f25e-4648-9f72-2a3eefa2006b', '4b8aca9d-e0d7-4931-a95f-758fb324d515', '3ebcdc58-0be2-49cd-b87d-46a85b7a0500'] {{(pid=84538) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 29 19:07:55 devstack cinder-volume[84538]: DEBUG oslo_concurrency.lockutils [None req-e662b45e-7337-45f8-b884-46d06a914c15 tempest-CreateVolumesFromSnapshotTest-1225283416 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 19:07:55 devstack cinder-volume[84538]: DEBUG oslo_concurrency.lockutils [None req-e662b45e-7337-45f8-b884-46d06a914c15 tempest-CreateVolumesFromSnapshotTest-1225283416 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 19:07:55 devstack cinder-volume[84538]: DEBUG cinder.volume.drivers.quobyte [None req-e662b45e-7337-45f8-b884-46d06a914c15 tempest-CreateVolumesFromSnapshotTest-1225283416 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-34312b00-dd6d-45bb-af98-75855cea8e48': None} {{(pid=84538) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 19:07:55 devstack cinder-volume[84538]: DEBUG cinder.volume.drivers.quobyte [None req-e662b45e-7337-45f8-b884-46d06a914c15 tempest-CreateVolumesFromSnapshotTest-1225283416 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-34312b00-dd6d-45bb-af98-75855cea8e48'] {{(pid=84538) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 19:07:55 devstack cinder-volume[84538]: DEBUG oslo_concurrency.lockutils [None req-e662b45e-7337-45f8-b884-46d06a914c15 tempest-CreateVolumesFromSnapshotTest-1225283416 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=84538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 19:07:55 devstack cinder-volume[84538]: DEBUG oslo_concurrency.processutils [None req-e662b45e-7337-45f8-b884-46d06a914c15 tempest-CreateVolumesFromSnapshotTest-1225283416 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d {{(pid=84538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 19:07:55 devstack sudo[93565]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d Apr 29 19:07:55 devstack sudo[93565]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 19:07:55 devstack sudo[93565]: pam_unix(sudo:session): session closed for user root Apr 29 19:07:55 devstack cinder-volume[84538]: DEBUG oslo_concurrency.processutils [None req-e662b45e-7337-45f8-b884-46d06a914c15 tempest-CreateVolumesFromSnapshotTest-1225283416 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d" returned: 0 in 0.605s {{(pid=84538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 19:07:55 devstack cinder-volume[84538]: DEBUG cinder.manager [None req-e662b45e-7337-45f8-b884-46d06a914c15 tempest-CreateVolumesFromSnapshotTest-1225283416 None] Notifying Schedulers of capabilities ... {{(pid=84538) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 29 19:07:55 devstack cinder-volume[84538]: INFO cinder.volume.manager [None req-e662b45e-7337-45f8-b884-46d06a914c15 tempest-CreateVolumesFromSnapshotTest-1225283416 None] Deleted volume successfully. Apr 29 19:07:55 devstack cinder-volume[84538]: DEBUG cinder.coordination [None req-e662b45e-7337-45f8-b884-46d06a914c15 tempest-CreateVolumesFromSnapshotTest-1225283416 None] Lock "cinder-16789a85-97f2-44b6-849b-e6fb494cac24-delete_volume" released by "delete_volume" :: held 2.104s {{(pid=84538) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 19:07:55 devstack cinder-volume[84538]: DEBUG cinder.coordination [None req-7f60ca22-24d5-4fac-b536-7495e08ab2d0 tempest-CreateVolumesFromSnapshotTest-1225283416 None] Acquiring lock "cinder-c5ec4aa8-2064-4627-82d8-e65a47df0d4e-delete_volume" by "delete_volume" {{(pid=84538) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 19:07:56 devstack cinder-volume[84538]: DEBUG cinder.coordination [None req-7f60ca22-24d5-4fac-b536-7495e08ab2d0 tempest-CreateVolumesFromSnapshotTest-1225283416 None] Lock "cinder-c5ec4aa8-2064-4627-82d8-e65a47df0d4e-delete_volume" acquired by "delete_volume" :: waited 0.014s {{(pid=84538) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 19:07:56 devstack cinder-volume[84538]: DEBUG cinder.coordination [None req-7f60ca22-24d5-4fac-b536-7495e08ab2d0 tempest-CreateVolumesFromSnapshotTest-1225283416 None] Acquiring lock "cinder-quobyte-c5ec4aa8-2064-4627-82d8-e65a47df0d4e" by "delete_volume" {{(pid=84538) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 19:07:56 devstack cinder-volume[84538]: DEBUG cinder.coordination [None req-7f60ca22-24d5-4fac-b536-7495e08ab2d0 tempest-CreateVolumesFromSnapshotTest-1225283416 None] Lock "cinder-quobyte-c5ec4aa8-2064-4627-82d8-e65a47df0d4e" acquired by "delete_volume" :: waited 0.014s {{(pid=84538) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 19:07:56 devstack cinder-volume[84538]: DEBUG oslo.privsep.daemon [-] privsep: reply[8a9d9c04-bf4a-400a-9cb8-9a0845f4892b]: (4, 'qcow2') {{(pid=85803) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 19:07:56 devstack cinder-volume[84538]: DEBUG oslo_concurrency.processutils [None req-7f60ca22-24d5-4fac-b536-7495e08ab2d0 tempest-CreateVolumesFromSnapshotTest-1225283416 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-c5ec4aa8-2064-4627-82d8-e65a47df0d4e {{(pid=84538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 19:07:56 devstack sudo[93568]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-c5ec4aa8-2064-4627-82d8-e65a47df0d4e Apr 29 19:07:56 devstack sudo[93568]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 19:07:56 devstack sudo[93568]: pam_unix(sudo:session): session closed for user root Apr 29 19:07:56 devstack cinder-volume[84538]: DEBUG oslo_concurrency.processutils [None req-7f60ca22-24d5-4fac-b536-7495e08ab2d0 tempest-CreateVolumesFromSnapshotTest-1225283416 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-c5ec4aa8-2064-4627-82d8-e65a47df0d4e" returned: 0 in 0.690s {{(pid=84538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 19:07:56 devstack cinder-volume[84538]: DEBUG oslo_concurrency.processutils [None req-7f60ca22-24d5-4fac-b536-7495e08ab2d0 tempest-CreateVolumesFromSnapshotTest-1225283416 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-c5ec4aa8-2064-4627-82d8-e65a47df0d4e {{(pid=84538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 19:07:56 devstack sudo[93573]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-c5ec4aa8-2064-4627-82d8-e65a47df0d4e Apr 29 19:07:56 devstack sudo[93573]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 19:07:57 devstack sudo[93573]: pam_unix(sudo:session): session closed for user root Apr 29 19:07:57 devstack cinder-volume[84538]: DEBUG oslo_concurrency.processutils [None req-7f60ca22-24d5-4fac-b536-7495e08ab2d0 tempest-CreateVolumesFromSnapshotTest-1225283416 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-c5ec4aa8-2064-4627-82d8-e65a47df0d4e" returned: 0 in 0.597s {{(pid=84538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 19:07:57 devstack cinder-volume[84538]: DEBUG cinder.coordination [None req-7f60ca22-24d5-4fac-b536-7495e08ab2d0 tempest-CreateVolumesFromSnapshotTest-1225283416 None] Lock "cinder-quobyte-c5ec4aa8-2064-4627-82d8-e65a47df0d4e" released by "delete_volume" :: held 1.326s {{(pid=84538) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 19:07:57 devstack cinder-volume[84538]: DEBUG cinder.quota [None req-7f60ca22-24d5-4fac-b536-7495e08ab2d0 tempest-CreateVolumesFromSnapshotTest-1225283416 None] Created reservations ['26ab7950-8ac9-4c0a-9c98-8b85796bf257', '06e28b7d-3582-4e79-9407-072f35f5e708', '9ece7f6b-fb80-499a-ac94-a68ba2e54e1e', 'c4c405c6-5628-47e4-addf-37b75daa8abb'] {{(pid=84538) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 29 19:07:57 devstack cinder-volume[84538]: DEBUG oslo_concurrency.lockutils [None req-7f60ca22-24d5-4fac-b536-7495e08ab2d0 tempest-CreateVolumesFromSnapshotTest-1225283416 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 19:07:57 devstack cinder-volume[84538]: DEBUG oslo_concurrency.lockutils [None req-7f60ca22-24d5-4fac-b536-7495e08ab2d0 tempest-CreateVolumesFromSnapshotTest-1225283416 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 19:07:57 devstack cinder-volume[84538]: DEBUG cinder.volume.drivers.quobyte [None req-7f60ca22-24d5-4fac-b536-7495e08ab2d0 tempest-CreateVolumesFromSnapshotTest-1225283416 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-34312b00-dd6d-45bb-af98-75855cea8e48': None} {{(pid=84538) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 19:07:57 devstack cinder-volume[84538]: DEBUG cinder.volume.drivers.quobyte [None req-7f60ca22-24d5-4fac-b536-7495e08ab2d0 tempest-CreateVolumesFromSnapshotTest-1225283416 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-34312b00-dd6d-45bb-af98-75855cea8e48'] {{(pid=84538) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 19:07:57 devstack cinder-volume[84538]: DEBUG oslo_concurrency.lockutils [None req-7f60ca22-24d5-4fac-b536-7495e08ab2d0 tempest-CreateVolumesFromSnapshotTest-1225283416 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=84538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 19:07:57 devstack cinder-volume[84538]: DEBUG oslo_concurrency.processutils [None req-7f60ca22-24d5-4fac-b536-7495e08ab2d0 tempest-CreateVolumesFromSnapshotTest-1225283416 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d {{(pid=84538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 19:07:57 devstack sudo[93576]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d Apr 29 19:07:57 devstack sudo[93576]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 19:07:58 devstack sudo[93576]: pam_unix(sudo:session): session closed for user root Apr 29 19:07:58 devstack cinder-volume[84538]: DEBUG oslo_concurrency.processutils [None req-7f60ca22-24d5-4fac-b536-7495e08ab2d0 tempest-CreateVolumesFromSnapshotTest-1225283416 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d" returned: 0 in 0.588s {{(pid=84538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 19:07:58 devstack cinder-volume[84538]: DEBUG cinder.manager [None req-7f60ca22-24d5-4fac-b536-7495e08ab2d0 tempest-CreateVolumesFromSnapshotTest-1225283416 None] Notifying Schedulers of capabilities ... {{(pid=84538) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 29 19:07:58 devstack cinder-volume[84538]: INFO cinder.volume.manager [None req-7f60ca22-24d5-4fac-b536-7495e08ab2d0 tempest-CreateVolumesFromSnapshotTest-1225283416 None] Deleted volume successfully. Apr 29 19:07:58 devstack cinder-volume[84538]: DEBUG cinder.coordination [None req-7f60ca22-24d5-4fac-b536-7495e08ab2d0 tempest-CreateVolumesFromSnapshotTest-1225283416 None] Lock "cinder-c5ec4aa8-2064-4627-82d8-e65a47df0d4e-delete_volume" released by "delete_volume" :: held 2.144s {{(pid=84538) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 19:07:58 devstack cinder-volume[84538]: DEBUG cinder.coordination [None req-96c3fee7-4cc6-4d16-9b78-155883214a2e tempest-CreateVolumesFromSnapshotTest-1225283416 None] Acquiring lock "cinder-1a178f8d-a84e-45ca-b886-2e524ba74d85-delete_snapshot" by "delete_snapshot" {{(pid=84538) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 19:07:58 devstack cinder-volume[84538]: DEBUG cinder.coordination [None req-96c3fee7-4cc6-4d16-9b78-155883214a2e tempest-CreateVolumesFromSnapshotTest-1225283416 None] Lock "cinder-1a178f8d-a84e-45ca-b886-2e524ba74d85-delete_snapshot" acquired by "delete_snapshot" :: waited 0.016s {{(pid=84538) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 19:07:58 devstack cinder-volume[84538]: DEBUG cinder.coordination [None req-96c3fee7-4cc6-4d16-9b78-155883214a2e tempest-CreateVolumesFromSnapshotTest-1225283416 None] Acquiring lock "cinder-quobyte-0b41e26d-fb31-4b53-8974-4617d108edba" by "delete_snapshot" {{(pid=84538) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 19:07:58 devstack cinder-volume[84538]: DEBUG cinder.coordination [None req-96c3fee7-4cc6-4d16-9b78-155883214a2e tempest-CreateVolumesFromSnapshotTest-1225283416 None] Lock "cinder-quobyte-0b41e26d-fb31-4b53-8974-4617d108edba" acquired by "delete_snapshot" :: waited 0.015s {{(pid=84538) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 19:07:58 devstack cinder-volume[84538]: DEBUG cinder.coordination [None req-96c3fee7-4cc6-4d16-9b78-155883214a2e tempest-CreateVolumesFromSnapshotTest-1225283416 None] Acquiring lock "cinder-quobyte-1a178f8d-a84e-45ca-b886-2e524ba74d85" by "_delete_snapshot" {{(pid=84538) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 19:07:58 devstack cinder-volume[84538]: DEBUG cinder.coordination [None req-96c3fee7-4cc6-4d16-9b78-155883214a2e tempest-CreateVolumesFromSnapshotTest-1225283416 None] Lock "cinder-quobyte-1a178f8d-a84e-45ca-b886-2e524ba74d85" acquired by "_delete_snapshot" :: waited 0.014s {{(pid=84538) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 19:07:58 devstack cinder-volume[84538]: DEBUG cinder.volume.drivers.remotefs [None req-96c3fee7-4cc6-4d16-9b78-155883214a2e tempest-CreateVolumesFromSnapshotTest-1225283416 None] Deleting offline snapshot 1a178f8d-a84e-45ca-b886-2e524ba74d85 of volume 0b41e26d-fb31-4b53-8974-4617d108edba {{(pid=84538) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 29 19:07:58 devstack cinder-volume[84538]: DEBUG cinder.volume.drivers.remotefs [None req-96c3fee7-4cc6-4d16-9b78-155883214a2e tempest-CreateVolumesFromSnapshotTest-1225283416 None] snapshot_file for this snap is: volume-0b41e26d-fb31-4b53-8974-4617d108edba.1a178f8d-a84e-45ca-b886-2e524ba74d85 {{(pid=84538) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 29 19:07:58 devstack cinder-volume[84538]: DEBUG oslo.privsep.daemon [-] privsep: reply[ac09f0b6-06b8-413a-9712-46d61b6533cf]: (4, 'qcow2') {{(pid=85803) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 19:07:58 devstack cinder-volume[84538]: DEBUG oslo_concurrency.processutils [None req-96c3fee7-4cc6-4d16-9b78-155883214a2e tempest-CreateVolumesFromSnapshotTest-1225283416 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-0b41e26d-fb31-4b53-8974-4617d108edba.1a178f8d-a84e-45ca-b886-2e524ba74d85 {{(pid=84538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 19:07:58 devstack sudo[93579]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-0b41e26d-fb31-4b53-8974-4617d108edba.1a178f8d-a84e-45ca-b886-2e524ba74d85 Apr 29 19:07:58 devstack sudo[93579]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 19:07:58 devstack sudo[93579]: pam_unix(sudo:session): session closed for user root Apr 29 19:07:58 devstack cinder-volume[84538]: DEBUG oslo_concurrency.processutils [None req-96c3fee7-4cc6-4d16-9b78-155883214a2e tempest-CreateVolumesFromSnapshotTest-1225283416 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-0b41e26d-fb31-4b53-8974-4617d108edba.1a178f8d-a84e-45ca-b886-2e524ba74d85" returned: 0 in 0.691s {{(pid=84538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 19:07:58 devstack cinder-volume[84538]: DEBUG cinder.volume.drivers.remotefs [None req-96c3fee7-4cc6-4d16-9b78-155883214a2e tempest-CreateVolumesFromSnapshotTest-1225283416 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-0b41e26d-fb31-4b53-8974-4617d108edba(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=84538) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 29 19:07:59 devstack cinder-volume[84538]: DEBUG oslo.privsep.daemon [-] privsep: reply[30348da4-799b-483f-9aef-694d0eb3d204]: (4, 'qcow2') {{(pid=85803) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 19:07:59 devstack cinder-volume[84538]: DEBUG oslo_concurrency.processutils [None req-96c3fee7-4cc6-4d16-9b78-155883214a2e tempest-CreateVolumesFromSnapshotTest-1225283416 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-0b41e26d-fb31-4b53-8974-4617d108edba {{(pid=84538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 19:07:59 devstack sudo[93585]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-0b41e26d-fb31-4b53-8974-4617d108edba Apr 29 19:07:59 devstack sudo[93585]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 19:07:59 devstack sudo[93585]: pam_unix(sudo:session): session closed for user root Apr 29 19:07:59 devstack cinder-volume[84538]: DEBUG oslo_concurrency.processutils [None req-96c3fee7-4cc6-4d16-9b78-155883214a2e tempest-CreateVolumesFromSnapshotTest-1225283416 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-0b41e26d-fb31-4b53-8974-4617d108edba" returned: 0 in 0.691s {{(pid=84538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 19:07:59 devstack cinder-volume[84538]: DEBUG oslo_concurrency.processutils [None req-96c3fee7-4cc6-4d16-9b78-155883214a2e tempest-CreateVolumesFromSnapshotTest-1225283416 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-0b41e26d-fb31-4b53-8974-4617d108edba.1a178f8d-a84e-45ca-b886-2e524ba74d85 {{(pid=84538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 19:07:59 devstack sudo[93590]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-0b41e26d-fb31-4b53-8974-4617d108edba.1a178f8d-a84e-45ca-b886-2e524ba74d85 Apr 29 19:07:59 devstack sudo[93590]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 19:08:00 devstack sudo[93590]: pam_unix(sudo:session): session closed for user root Apr 29 19:08:00 devstack cinder-volume[84538]: DEBUG oslo_concurrency.processutils [None req-96c3fee7-4cc6-4d16-9b78-155883214a2e tempest-CreateVolumesFromSnapshotTest-1225283416 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-0b41e26d-fb31-4b53-8974-4617d108edba.1a178f8d-a84e-45ca-b886-2e524ba74d85" returned: 0 in 0.663s {{(pid=84538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 19:08:00 devstack cinder-volume[84538]: DEBUG oslo_concurrency.processutils [None req-96c3fee7-4cc6-4d16-9b78-155883214a2e tempest-CreateVolumesFromSnapshotTest-1225283416 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-0b41e26d-fb31-4b53-8974-4617d108edba.1a178f8d-a84e-45ca-b886-2e524ba74d85 {{(pid=84538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 19:08:00 devstack sudo[93596]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-0b41e26d-fb31-4b53-8974-4617d108edba.1a178f8d-a84e-45ca-b886-2e524ba74d85 Apr 29 19:08:00 devstack sudo[93596]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 19:08:00 devstack sudo[93596]: pam_unix(sudo:session): session closed for user root Apr 29 19:08:00 devstack cinder-volume[84538]: DEBUG oslo_concurrency.processutils [None req-96c3fee7-4cc6-4d16-9b78-155883214a2e tempest-CreateVolumesFromSnapshotTest-1225283416 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-0b41e26d-fb31-4b53-8974-4617d108edba.1a178f8d-a84e-45ca-b886-2e524ba74d85" returned: 0 in 0.581s {{(pid=84538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 19:08:00 devstack cinder-volume[84538]: DEBUG cinder.coordination [None req-96c3fee7-4cc6-4d16-9b78-155883214a2e tempest-CreateVolumesFromSnapshotTest-1225283416 None] Lock "cinder-quobyte-1a178f8d-a84e-45ca-b886-2e524ba74d85" released by "_delete_snapshot" :: held 2.725s {{(pid=84538) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 19:08:00 devstack cinder-volume[84538]: DEBUG cinder.coordination [None req-96c3fee7-4cc6-4d16-9b78-155883214a2e tempest-CreateVolumesFromSnapshotTest-1225283416 None] Lock "cinder-quobyte-0b41e26d-fb31-4b53-8974-4617d108edba" released by "delete_snapshot" :: held 2.746s {{(pid=84538) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 19:08:01 devstack cinder-volume[84538]: DEBUG cinder.quota [None req-96c3fee7-4cc6-4d16-9b78-155883214a2e tempest-CreateVolumesFromSnapshotTest-1225283416 None] Created reservations ['0a0c943e-fa37-437d-8825-87e2a2e0ee51', 'c4946abd-e7e3-4a8c-b4c1-a08511f800f9', '857f37ba-3ed8-4f6b-bda7-67fac7b249de', '0907ca2a-6054-4660-b87e-209c26c11b5f'] {{(pid=84538) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 29 19:08:01 devstack cinder-volume[84538]: INFO cinder.volume.manager [None req-96c3fee7-4cc6-4d16-9b78-155883214a2e tempest-CreateVolumesFromSnapshotTest-1225283416 None] Delete snapshot completed successfully. Apr 29 19:08:01 devstack cinder-volume[84538]: DEBUG cinder.coordination [None req-96c3fee7-4cc6-4d16-9b78-155883214a2e tempest-CreateVolumesFromSnapshotTest-1225283416 None] Lock "cinder-1a178f8d-a84e-45ca-b886-2e524ba74d85-delete_snapshot" released by "delete_snapshot" :: held 2.864s {{(pid=84538) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 19:08:01 devstack cinder-volume[84538]: DEBUG cinder.coordination [None req-a7870607-dfce-4c11-b538-2c1492b0af74 tempest-CreateVolumesFromSnapshotTest-1225283416 None] Acquiring lock "cinder-0b41e26d-fb31-4b53-8974-4617d108edba-delete_volume" by "delete_volume" {{(pid=84538) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 19:08:01 devstack cinder-volume[84538]: DEBUG cinder.coordination [None req-a7870607-dfce-4c11-b538-2c1492b0af74 tempest-CreateVolumesFromSnapshotTest-1225283416 None] Lock "cinder-0b41e26d-fb31-4b53-8974-4617d108edba-delete_volume" acquired by "delete_volume" :: waited 0.017s {{(pid=84538) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 19:08:01 devstack cinder-volume[84538]: DEBUG cinder.coordination [None req-a7870607-dfce-4c11-b538-2c1492b0af74 tempest-CreateVolumesFromSnapshotTest-1225283416 None] Acquiring lock "cinder-quobyte-0b41e26d-fb31-4b53-8974-4617d108edba" by "delete_volume" {{(pid=84538) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 19:08:01 devstack cinder-volume[84538]: DEBUG cinder.coordination [None req-a7870607-dfce-4c11-b538-2c1492b0af74 tempest-CreateVolumesFromSnapshotTest-1225283416 None] Lock "cinder-quobyte-0b41e26d-fb31-4b53-8974-4617d108edba" acquired by "delete_volume" :: waited 0.015s {{(pid=84538) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 19:08:01 devstack cinder-volume[84538]: DEBUG oslo.privsep.daemon [-] privsep: reply[ebccb558-208a-475d-a148-f51d14449805]: (4, 'qcow2') {{(pid=85803) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 19:08:01 devstack cinder-volume[84538]: DEBUG oslo_concurrency.processutils [None req-a7870607-dfce-4c11-b538-2c1492b0af74 tempest-CreateVolumesFromSnapshotTest-1225283416 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-0b41e26d-fb31-4b53-8974-4617d108edba {{(pid=84538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 19:08:01 devstack sudo[93599]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-0b41e26d-fb31-4b53-8974-4617d108edba Apr 29 19:08:01 devstack sudo[93599]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 19:08:02 devstack sudo[93599]: pam_unix(sudo:session): session closed for user root Apr 29 19:08:02 devstack cinder-volume[84538]: DEBUG oslo_concurrency.processutils [None req-a7870607-dfce-4c11-b538-2c1492b0af74 tempest-CreateVolumesFromSnapshotTest-1225283416 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-0b41e26d-fb31-4b53-8974-4617d108edba" returned: 0 in 0.694s {{(pid=84538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 19:08:02 devstack cinder-volume[84538]: DEBUG oslo_concurrency.processutils [None req-a7870607-dfce-4c11-b538-2c1492b0af74 tempest-CreateVolumesFromSnapshotTest-1225283416 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-0b41e26d-fb31-4b53-8974-4617d108edba {{(pid=84538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 19:08:02 devstack sudo[93604]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-0b41e26d-fb31-4b53-8974-4617d108edba Apr 29 19:08:02 devstack sudo[93604]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 19:08:02 devstack sudo[93604]: pam_unix(sudo:session): session closed for user root Apr 29 19:08:02 devstack cinder-volume[84538]: DEBUG oslo_concurrency.processutils [None req-a7870607-dfce-4c11-b538-2c1492b0af74 tempest-CreateVolumesFromSnapshotTest-1225283416 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-0b41e26d-fb31-4b53-8974-4617d108edba" returned: 0 in 0.589s {{(pid=84538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 19:08:02 devstack cinder-volume[84538]: DEBUG cinder.coordination [None req-a7870607-dfce-4c11-b538-2c1492b0af74 tempest-CreateVolumesFromSnapshotTest-1225283416 None] Lock "cinder-quobyte-0b41e26d-fb31-4b53-8974-4617d108edba" released by "delete_volume" :: held 1.338s {{(pid=84538) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 19:08:02 devstack cinder-volume[84538]: DEBUG cinder.quota [None req-a7870607-dfce-4c11-b538-2c1492b0af74 tempest-CreateVolumesFromSnapshotTest-1225283416 None] Created reservations ['d5b9c71f-d8d7-4553-abd3-66bc3d05a07a', '4b208f89-2238-4e5d-bee6-4116d23fe936', '6fb8396a-f7e0-45d4-806c-9ba626e673e1', 'ab53fc5e-ec15-435d-8608-110fc8da52d9'] {{(pid=84538) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 29 19:08:02 devstack cinder-volume[84538]: DEBUG oslo_concurrency.lockutils [None req-a7870607-dfce-4c11-b538-2c1492b0af74 tempest-CreateVolumesFromSnapshotTest-1225283416 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 19:08:02 devstack cinder-volume[84538]: DEBUG oslo_concurrency.lockutils [None req-a7870607-dfce-4c11-b538-2c1492b0af74 tempest-CreateVolumesFromSnapshotTest-1225283416 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 19:08:02 devstack cinder-volume[84538]: DEBUG cinder.volume.drivers.quobyte [None req-a7870607-dfce-4c11-b538-2c1492b0af74 tempest-CreateVolumesFromSnapshotTest-1225283416 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-34312b00-dd6d-45bb-af98-75855cea8e48': None} {{(pid=84538) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 19:08:02 devstack cinder-volume[84538]: DEBUG cinder.volume.drivers.quobyte [None req-a7870607-dfce-4c11-b538-2c1492b0af74 tempest-CreateVolumesFromSnapshotTest-1225283416 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-34312b00-dd6d-45bb-af98-75855cea8e48'] {{(pid=84538) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 19:08:02 devstack cinder-volume[84538]: DEBUG oslo_concurrency.lockutils [None req-a7870607-dfce-4c11-b538-2c1492b0af74 tempest-CreateVolumesFromSnapshotTest-1225283416 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=84538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 19:08:02 devstack cinder-volume[84538]: DEBUG oslo_concurrency.processutils [None req-a7870607-dfce-4c11-b538-2c1492b0af74 tempest-CreateVolumesFromSnapshotTest-1225283416 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d {{(pid=84538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 19:08:02 devstack sudo[93607]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d Apr 29 19:08:02 devstack sudo[93607]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 19:08:03 devstack sudo[93607]: pam_unix(sudo:session): session closed for user root Apr 29 19:08:03 devstack cinder-volume[84538]: DEBUG oslo_concurrency.processutils [None req-a7870607-dfce-4c11-b538-2c1492b0af74 tempest-CreateVolumesFromSnapshotTest-1225283416 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d" returned: 0 in 0.589s {{(pid=84538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 19:08:03 devstack cinder-volume[84538]: DEBUG cinder.manager [None req-a7870607-dfce-4c11-b538-2c1492b0af74 tempest-CreateVolumesFromSnapshotTest-1225283416 None] Notifying Schedulers of capabilities ... {{(pid=84538) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 29 19:08:03 devstack cinder-volume[84538]: INFO cinder.volume.manager [None req-a7870607-dfce-4c11-b538-2c1492b0af74 tempest-CreateVolumesFromSnapshotTest-1225283416 None] Deleted volume successfully. Apr 29 19:08:03 devstack cinder-volume[84538]: DEBUG cinder.coordination [None req-a7870607-dfce-4c11-b538-2c1492b0af74 tempest-CreateVolumesFromSnapshotTest-1225283416 None] Lock "cinder-0b41e26d-fb31-4b53-8974-4617d108edba-delete_volume" released by "delete_volume" :: held 2.104s {{(pid=84538) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 19:08:12 devstack cinder-volume[84538]: DEBUG dbcounter [-] [84538] Writing DB stats cinder:SELECT=34,cinder:INSERT=16,cinder:UPDATE=52,cinder:DELETE=3 {{(pid=84538) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Apr 29 19:08:13 devstack cinder-volume[84538]: DEBUG dbcounter [-] [84538] Writing DB stats cinder:SELECT=36,cinder:INSERT=12,cinder:UPDATE=54,cinder:DELETE=3 {{(pid=84538) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Apr 29 19:08:22 devstack cinder-volume[84538]: DEBUG cinder.volume.flows.manager.create_volume [None req-f84a1f61-aa5c-4107-8b9e-02be2aa67621 tempest-SnapshotDependencyTests-2096680585 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84538) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Apr 29 19:08:22 devstack cinder-volume[84538]: DEBUG cinder.volume.manager [None req-f84a1f61-aa5c-4107-8b9e-02be2aa67621 tempest-SnapshotDependencyTests-2096680585 None] Flow 'volume_create_manager' (ebaff2af-8d5c-48af-bd4d-2d054cb44253) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84538) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 19:08:22 devstack cinder-volume[84538]: DEBUG cinder.volume.manager [None req-f84a1f61-aa5c-4107-8b9e-02be2aa67621 tempest-SnapshotDependencyTests-2096680585 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ad7152d7-a508-4ecd-96e3-7e08521917b3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 19:08:22 devstack cinder-volume[84538]: DEBUG cinder.volume.manager [None req-f84a1f61-aa5c-4107-8b9e-02be2aa67621 tempest-SnapshotDependencyTests-2096680585 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ad7152d7-a508-4ecd-96e3-7e08521917b3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-29T17:08:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDependencyTests-volume-1414044529',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=388cd4a9-17a2-4a2b-ab26-839b5de52f2a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8964a1cd80b3400da29a094eebb77ecc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T17:08:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T17:08:22Z,use_quota=True,user_id='b13df1c65eaa462588ddc81351f2b65f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(62b05900-93e3-4190-a88f-1d87324303d1),volume_type_id=62b05900-93e3-4190-a88f-1d87324303d1)' {{(pid=84538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 19:08:22 devstack cinder-volume[84538]: DEBUG cinder.volume.manager [None req-f84a1f61-aa5c-4107-8b9e-02be2aa67621 tempest-SnapshotDependencyTests-2096680585 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (44b52ca4-12ed-4573-a34b-8ddc57db18de) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 19:08:22 devstack cinder-volume[84538]: DEBUG cinder.volume.manager [None req-f84a1f61-aa5c-4107-8b9e-02be2aa67621 tempest-SnapshotDependencyTests-2096680585 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (44b52ca4-12ed-4573-a34b-8ddc57db18de) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 19:08:22 devstack cinder-volume[84538]: DEBUG cinder.volume.manager [None req-f84a1f61-aa5c-4107-8b9e-02be2aa67621 tempest-SnapshotDependencyTests-2096680585 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ac30f880-0dc4-4647-b67f-d21fea1a53bb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 19:08:22 devstack cinder-volume[84538]: DEBUG cinder.volume.manager [None req-f84a1f61-aa5c-4107-8b9e-02be2aa67621 tempest-SnapshotDependencyTests-2096680585 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ac30f880-0dc4-4647-b67f-d21fea1a53bb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '388cd4a9-17a2-4a2b-ab26-839b5de52f2a', 'volume_name': 'volume-388cd4a9-17a2-4a2b-ab26-839b5de52f2a', 'volume_size': 1}' {{(pid=84538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 19:08:22 devstack cinder-volume[84538]: DEBUG cinder.volume.manager [None req-f84a1f61-aa5c-4107-8b9e-02be2aa67621 tempest-SnapshotDependencyTests-2096680585 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1d72e0a7-bc6a-44fb-938b-e422028bfe4b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 19:08:22 devstack cinder-volume[84538]: DEBUG cinder.volume.manager [None req-f84a1f61-aa5c-4107-8b9e-02be2aa67621 tempest-SnapshotDependencyTests-2096680585 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1d72e0a7-bc6a-44fb-938b-e422028bfe4b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 19:08:22 devstack cinder-volume[84538]: DEBUG cinder.volume.manager [None req-f84a1f61-aa5c-4107-8b9e-02be2aa67621 tempest-SnapshotDependencyTests-2096680585 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (663c57c9-6510-45f4-aab9-f9e18e5275cc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 19:08:22 devstack cinder-volume[84538]: INFO cinder.volume.flows.manager.create_volume [None req-f84a1f61-aa5c-4107-8b9e-02be2aa67621 tempest-SnapshotDependencyTests-2096680585 None] Volume 388cd4a9-17a2-4a2b-ab26-839b5de52f2a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-388cd4a9-17a2-4a2b-ab26-839b5de52f2a', 'volume_size': 1} Apr 29 19:08:22 devstack cinder-volume[84538]: DEBUG oslo_concurrency.lockutils [None req-f84a1f61-aa5c-4107-8b9e-02be2aa67621 tempest-SnapshotDependencyTests-2096680585 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 19:08:22 devstack cinder-volume[84538]: DEBUG oslo_concurrency.lockutils [None req-f84a1f61-aa5c-4107-8b9e-02be2aa67621 tempest-SnapshotDependencyTests-2096680585 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=84538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 19:08:22 devstack cinder-volume[84538]: DEBUG cinder.volume.drivers.quobyte [None req-f84a1f61-aa5c-4107-8b9e-02be2aa67621 tempest-SnapshotDependencyTests-2096680585 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-29T17:08:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDependencyTests-volume-1414044529',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=388cd4a9-17a2-4a2b-ab26-839b5de52f2a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8964a1cd80b3400da29a094eebb77ecc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T17:08:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T17:08:22Z,use_quota=True,user_id='b13df1c65eaa462588ddc81351f2b65f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(62b05900-93e3-4190-a88f-1d87324303d1),volume_type_id=62b05900-93e3-4190-a88f-1d87324303d1)}" {{(pid=84538) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 29 19:08:22 devstack cinder-volume[84538]: DEBUG cinder.volume.drivers.remotefs [None req-f84a1f61-aa5c-4107-8b9e-02be2aa67621 tempest-SnapshotDependencyTests-2096680585 None] Creating volume 388cd4a9-17a2-4a2b-ab26-839b5de52f2a {{(pid=84538) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 29 19:08:22 devstack cinder-volume[84538]: DEBUG oslo_concurrency.lockutils [None req-f84a1f61-aa5c-4107-8b9e-02be2aa67621 tempest-SnapshotDependencyTests-2096680585 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 19:08:22 devstack cinder-volume[84538]: DEBUG oslo_concurrency.lockutils [None req-f84a1f61-aa5c-4107-8b9e-02be2aa67621 tempest-SnapshotDependencyTests-2096680585 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=84538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 19:08:22 devstack cinder-volume[84538]: DEBUG cinder.volume.drivers.quobyte [None req-f84a1f61-aa5c-4107-8b9e-02be2aa67621 tempest-SnapshotDependencyTests-2096680585 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-34312b00-dd6d-45bb-af98-75855cea8e48': None} {{(pid=84538) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 19:08:22 devstack cinder-volume[84538]: DEBUG cinder.volume.drivers.quobyte [None req-f84a1f61-aa5c-4107-8b9e-02be2aa67621 tempest-SnapshotDependencyTests-2096680585 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-34312b00-dd6d-45bb-af98-75855cea8e48'] {{(pid=84538) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 19:08:22 devstack cinder-volume[84538]: DEBUG oslo_concurrency.lockutils [None req-f84a1f61-aa5c-4107-8b9e-02be2aa67621 tempest-SnapshotDependencyTests-2096680585 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=84538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 19:08:22 devstack cinder-volume[84538]: DEBUG cinder.volume.drivers.quobyte [None req-f84a1f61-aa5c-4107-8b9e-02be2aa67621 tempest-SnapshotDependencyTests-2096680585 None] Selected osci02.corp.quobyte.com/cinder-vol-34312b00-dd6d-45bb-af98-75855cea8e48 as target Quobyte volume. {{(pid=84538) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 29 19:08:22 devstack cinder-volume[84538]: INFO cinder.volume.drivers.remotefs [None req-f84a1f61-aa5c-4107-8b9e-02be2aa67621 tempest-SnapshotDependencyTests-2096680585 None] casted to osci02.corp.quobyte.com/cinder-vol-34312b00-dd6d-45bb-af98-75855cea8e48 Apr 29 19:08:22 devstack cinder-volume[84538]: DEBUG oslo_concurrency.processutils [None req-f84a1f61-aa5c-4107-8b9e-02be2aa67621 tempest-SnapshotDependencyTests-2096680585 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-388cd4a9-17a2-4a2b-ab26-839b5de52f2a 1073741824 {{(pid=84538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 19:08:22 devstack sudo[93613]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-388cd4a9-17a2-4a2b-ab26-839b5de52f2a 1073741824 Apr 29 19:08:22 devstack sudo[93613]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 19:08:22 devstack sudo[93613]: pam_unix(sudo:session): session closed for user root Apr 29 19:08:22 devstack cinder-volume[84538]: DEBUG oslo_concurrency.processutils [None req-f84a1f61-aa5c-4107-8b9e-02be2aa67621 tempest-SnapshotDependencyTests-2096680585 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-388cd4a9-17a2-4a2b-ab26-839b5de52f2a 1073741824" returned: 0 in 0.756s {{(pid=84538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 19:08:22 devstack cinder-volume[84538]: DEBUG oslo_concurrency.processutils [None req-f84a1f61-aa5c-4107-8b9e-02be2aa67621 tempest-SnapshotDependencyTests-2096680585 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-388cd4a9-17a2-4a2b-ab26-839b5de52f2a {{(pid=84538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 19:08:22 devstack sudo[93618]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-388cd4a9-17a2-4a2b-ab26-839b5de52f2a Apr 29 19:08:22 devstack sudo[93618]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 19:08:23 devstack sudo[93618]: pam_unix(sudo:session): session closed for user root Apr 29 19:08:23 devstack cinder-volume[84538]: DEBUG oslo_concurrency.processutils [None req-f84a1f61-aa5c-4107-8b9e-02be2aa67621 tempest-SnapshotDependencyTests-2096680585 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-388cd4a9-17a2-4a2b-ab26-839b5de52f2a" returned: 0 in 0.613s {{(pid=84538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 19:08:23 devstack cinder-volume[84538]: DEBUG cinder.volume.drivers.quobyte [None req-f84a1f61-aa5c-4107-8b9e-02be2aa67621 tempest-SnapshotDependencyTests-2096680585 None] <== create_volume: return (1407ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-34312b00-dd6d-45bb-af98-75855cea8e48'} {{(pid=84538) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 29 19:08:23 devstack cinder-volume[84538]: DEBUG oslo_concurrency.lockutils [None req-f84a1f61-aa5c-4107-8b9e-02be2aa67621 tempest-SnapshotDependencyTests-2096680585 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.409s {{(pid=84538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 19:08:23 devstack cinder-volume[84538]: DEBUG cinder.volume.manager [None req-f84a1f61-aa5c-4107-8b9e-02be2aa67621 tempest-SnapshotDependencyTests-2096680585 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (663c57c9-6510-45f4-aab9-f9e18e5275cc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-388cd4a9-17a2-4a2b-ab26-839b5de52f2a', 'volume_size': 1}' {{(pid=84538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 19:08:23 devstack cinder-volume[84538]: DEBUG cinder.volume.manager [None req-f84a1f61-aa5c-4107-8b9e-02be2aa67621 tempest-SnapshotDependencyTests-2096680585 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (45d86e3b-4b22-4a27-9bf4-d0bf6175fbce) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 19:08:23 devstack cinder-volume[84538]: INFO cinder.volume.flows.manager.create_volume [None req-f84a1f61-aa5c-4107-8b9e-02be2aa67621 tempest-SnapshotDependencyTests-2096680585 None] Volume volume-388cd4a9-17a2-4a2b-ab26-839b5de52f2a (388cd4a9-17a2-4a2b-ab26-839b5de52f2a): created successfully Apr 29 19:08:23 devstack cinder-volume[84538]: DEBUG cinder.volume.manager [None req-f84a1f61-aa5c-4107-8b9e-02be2aa67621 tempest-SnapshotDependencyTests-2096680585 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (45d86e3b-4b22-4a27-9bf4-d0bf6175fbce) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 19:08:23 devstack cinder-volume[84538]: DEBUG cinder.volume.manager [None req-f84a1f61-aa5c-4107-8b9e-02be2aa67621 tempest-SnapshotDependencyTests-2096680585 None] Flow 'volume_create_manager' (ebaff2af-8d5c-48af-bd4d-2d054cb44253) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84538) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 19:08:23 devstack cinder-volume[84538]: INFO cinder.volume.manager [None req-f84a1f61-aa5c-4107-8b9e-02be2aa67621 tempest-SnapshotDependencyTests-2096680585 None] Created volume successfully. Apr 29 19:08:24 devstack cinder-volume[84538]: DEBUG oslo_concurrency.lockutils [None req-9bfb7f3e-8423-4872-aa22-04868723206e tempest-SnapshotDependencyTests-2096680585 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=84538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 19:08:24 devstack cinder-volume[84538]: DEBUG oslo_concurrency.lockutils [None req-9bfb7f3e-8423-4872-aa22-04868723206e tempest-SnapshotDependencyTests-2096680585 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=84538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 19:08:24 devstack cinder-volume[84538]: DEBUG cinder.volume.drivers.remotefs [None req-9bfb7f3e-8423-4872-aa22-04868723206e tempest-SnapshotDependencyTests-2096680585 None] Creating offline snapshot 72dbc63b-1d13-4ff5-954a-9186ece1c4d9 of volume 388cd4a9-17a2-4a2b-ab26-839b5de52f2a {{(pid=84538) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}} Apr 29 19:08:24 devstack cinder-volume[84538]: DEBUG oslo.privsep.daemon [-] privsep: reply[8ce5420d-486f-4f7c-a0a0-e715cf46e1c9]: (4, 'qcow2') {{(pid=85803) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 19:08:24 devstack cinder-volume[84538]: DEBUG oslo_concurrency.processutils [None req-9bfb7f3e-8423-4872-aa22-04868723206e tempest-SnapshotDependencyTests-2096680585 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-388cd4a9-17a2-4a2b-ab26-839b5de52f2a {{(pid=84538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 19:08:24 devstack sudo[93621]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-388cd4a9-17a2-4a2b-ab26-839b5de52f2a Apr 29 19:08:24 devstack sudo[93621]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 19:08:25 devstack cinder-volume[84538]: DEBUG oslo_service.periodic_task [None req-a93183a6-1080-461c-84de-2fcb210d4f60 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=84538) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}} Apr 29 19:08:25 devstack cinder-volume[84538]: DEBUG oslo_concurrency.lockutils [None req-a93183a6-1080-461c-84de-2fcb210d4f60 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 19:08:25 devstack cinder-volume[84538]: DEBUG oslo_concurrency.lockutils [None req-a93183a6-1080-461c-84de-2fcb210d4f60 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 19:08:25 devstack cinder-volume[84538]: DEBUG cinder.volume.drivers.quobyte [None req-a93183a6-1080-461c-84de-2fcb210d4f60 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-34312b00-dd6d-45bb-af98-75855cea8e48': None} {{(pid=84538) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 19:08:25 devstack cinder-volume[84538]: DEBUG cinder.volume.drivers.quobyte [None req-a93183a6-1080-461c-84de-2fcb210d4f60 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-34312b00-dd6d-45bb-af98-75855cea8e48'] {{(pid=84538) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 19:08:25 devstack cinder-volume[84538]: DEBUG oslo_concurrency.lockutils [None req-a93183a6-1080-461c-84de-2fcb210d4f60 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=84538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 19:08:25 devstack cinder-volume[84538]: DEBUG oslo_concurrency.processutils [None req-a93183a6-1080-461c-84de-2fcb210d4f60 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d {{(pid=84538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 19:08:25 devstack sudo[93621]: pam_unix(sudo:session): session closed for user root Apr 29 19:08:25 devstack cinder-volume[84538]: DEBUG oslo_concurrency.processutils [None req-9bfb7f3e-8423-4872-aa22-04868723206e tempest-SnapshotDependencyTests-2096680585 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-388cd4a9-17a2-4a2b-ab26-839b5de52f2a" returned: 0 in 0.691s {{(pid=84538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 19:08:25 devstack cinder-volume[84538]: DEBUG oslo_concurrency.processutils [None req-9bfb7f3e-8423-4872-aa22-04868723206e tempest-SnapshotDependencyTests-2096680585 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-388cd4a9-17a2-4a2b-ab26-839b5de52f2a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-388cd4a9-17a2-4a2b-ab26-839b5de52f2a.72dbc63b-1d13-4ff5-954a-9186ece1c4d9 1G {{(pid=84538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 19:08:25 devstack sudo[93626]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d Apr 29 19:08:25 devstack sudo[93626]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 19:08:25 devstack sudo[93627]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-388cd4a9-17a2-4a2b-ab26-839b5de52f2a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-388cd4a9-17a2-4a2b-ab26-839b5de52f2a.72dbc63b-1d13-4ff5-954a-9186ece1c4d9 1G Apr 29 19:08:25 devstack sudo[93627]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 19:08:25 devstack sudo[93626]: pam_unix(sudo:session): session closed for user root Apr 29 19:08:25 devstack cinder-volume[84538]: DEBUG oslo_concurrency.processutils [None req-a93183a6-1080-461c-84de-2fcb210d4f60 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d" returned: 0 in 0.609s {{(pid=84538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 19:08:25 devstack cinder-volume[84538]: DEBUG cinder.manager [None req-a93183a6-1080-461c-84de-2fcb210d4f60 None None] Notifying Schedulers of capabilities ... {{(pid=84538) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 29 19:08:25 devstack sudo[93627]: pam_unix(sudo:session): session closed for user root Apr 29 19:08:25 devstack cinder-volume[84538]: DEBUG oslo_concurrency.processutils [None req-9bfb7f3e-8423-4872-aa22-04868723206e tempest-SnapshotDependencyTests-2096680585 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-388cd4a9-17a2-4a2b-ab26-839b5de52f2a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-388cd4a9-17a2-4a2b-ab26-839b5de52f2a.72dbc63b-1d13-4ff5-954a-9186ece1c4d9 1G" returned: 0 in 0.748s {{(pid=84538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 19:08:25 devstack cinder-volume[84538]: DEBUG oslo_concurrency.processutils [None req-9bfb7f3e-8423-4872-aa22-04868723206e tempest-SnapshotDependencyTests-2096680585 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-388cd4a9-17a2-4a2b-ab26-839b5de52f2a -F qcow2 /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-388cd4a9-17a2-4a2b-ab26-839b5de52f2a.72dbc63b-1d13-4ff5-954a-9186ece1c4d9 {{(pid=84538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 19:08:25 devstack sudo[93634]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-388cd4a9-17a2-4a2b-ab26-839b5de52f2a -F qcow2 /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-388cd4a9-17a2-4a2b-ab26-839b5de52f2a.72dbc63b-1d13-4ff5-954a-9186ece1c4d9 Apr 29 19:08:25 devstack sudo[93634]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 19:08:26 devstack sudo[93634]: pam_unix(sudo:session): session closed for user root Apr 29 19:08:26 devstack cinder-volume[84538]: DEBUG oslo_concurrency.processutils [None req-9bfb7f3e-8423-4872-aa22-04868723206e tempest-SnapshotDependencyTests-2096680585 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-388cd4a9-17a2-4a2b-ab26-839b5de52f2a -F qcow2 /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-388cd4a9-17a2-4a2b-ab26-839b5de52f2a.72dbc63b-1d13-4ff5-954a-9186ece1c4d9" returned: 0 in 0.623s {{(pid=84538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 19:08:26 devstack cinder-volume[84538]: WARNING cinder.volume.drivers.remotefs [None req-9bfb7f3e-8423-4872-aa22-04868723206e tempest-SnapshotDependencyTests-2096680585 None] /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-388cd4a9-17a2-4a2b-ab26-839b5de52f2a.72dbc63b-1d13-4ff5-954a-9186ece1c4d9 is being set with open permissions: ugo+rw Apr 29 19:08:26 devstack cinder-volume[84538]: DEBUG oslo_concurrency.processutils [None req-9bfb7f3e-8423-4872-aa22-04868723206e tempest-SnapshotDependencyTests-2096680585 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-388cd4a9-17a2-4a2b-ab26-839b5de52f2a.72dbc63b-1d13-4ff5-954a-9186ece1c4d9 {{(pid=84538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 19:08:26 devstack sudo[93639]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-388cd4a9-17a2-4a2b-ab26-839b5de52f2a.72dbc63b-1d13-4ff5-954a-9186ece1c4d9 Apr 29 19:08:26 devstack sudo[93639]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 19:08:27 devstack sudo[93639]: pam_unix(sudo:session): session closed for user root Apr 29 19:08:27 devstack cinder-volume[84538]: DEBUG oslo_concurrency.processutils [None req-9bfb7f3e-8423-4872-aa22-04868723206e tempest-SnapshotDependencyTests-2096680585 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-388cd4a9-17a2-4a2b-ab26-839b5de52f2a.72dbc63b-1d13-4ff5-954a-9186ece1c4d9" returned: 0 in 0.584s {{(pid=84538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 19:08:27 devstack cinder-volume[84538]: DEBUG oslo_concurrency.processutils [None req-9bfb7f3e-8423-4872-aa22-04868723206e tempest-SnapshotDependencyTests-2096680585 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-388cd4a9-17a2-4a2b-ab26-839b5de52f2a.info {{(pid=84538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 19:08:27 devstack sudo[93642]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-388cd4a9-17a2-4a2b-ab26-839b5de52f2a.info Apr 29 19:08:27 devstack sudo[93642]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 19:08:27 devstack sudo[93642]: pam_unix(sudo:session): session closed for user root Apr 29 19:08:27 devstack cinder-volume[84538]: DEBUG oslo_concurrency.processutils [None req-9bfb7f3e-8423-4872-aa22-04868723206e tempest-SnapshotDependencyTests-2096680585 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-388cd4a9-17a2-4a2b-ab26-839b5de52f2a.info" returned: 0 in 0.621s {{(pid=84538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 19:08:27 devstack cinder-volume[84538]: WARNING cinder.volume.drivers.remotefs [None req-9bfb7f3e-8423-4872-aa22-04868723206e tempest-SnapshotDependencyTests-2096680585 None] /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-388cd4a9-17a2-4a2b-ab26-839b5de52f2a.info is being set with open permissions: ugo+rw Apr 29 19:08:27 devstack cinder-volume[84538]: DEBUG oslo_concurrency.processutils [None req-9bfb7f3e-8423-4872-aa22-04868723206e tempest-SnapshotDependencyTests-2096680585 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-388cd4a9-17a2-4a2b-ab26-839b5de52f2a.info {{(pid=84538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 19:08:27 devstack sudo[93645]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-388cd4a9-17a2-4a2b-ab26-839b5de52f2a.info Apr 29 19:08:27 devstack sudo[93645]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 19:08:28 devstack sudo[93645]: pam_unix(sudo:session): session closed for user root Apr 29 19:08:28 devstack cinder-volume[84538]: DEBUG oslo_concurrency.processutils [None req-9bfb7f3e-8423-4872-aa22-04868723206e tempest-SnapshotDependencyTests-2096680585 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-388cd4a9-17a2-4a2b-ab26-839b5de52f2a.info" returned: 0 in 0.608s {{(pid=84538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 19:08:28 devstack cinder-volume[84538]: DEBUG oslo_concurrency.lockutils [None req-9bfb7f3e-8423-4872-aa22-04868723206e tempest-SnapshotDependencyTests-2096680585 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.958s {{(pid=84538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 19:08:28 devstack cinder-volume[84538]: INFO cinder.volume.manager [None req-9bfb7f3e-8423-4872-aa22-04868723206e tempest-SnapshotDependencyTests-2096680585 None] Create snapshot completed successfully Apr 29 19:08:29 devstack cinder-volume[84538]: DEBUG cinder.volume.flows.manager.create_volume [None req-68673020-499a-4820-9d3a-0a1fb8233cd7 tempest-SnapshotDependencyTests-2096680585 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84538) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Apr 29 19:08:29 devstack cinder-volume[84538]: DEBUG cinder.volume.manager [None req-68673020-499a-4820-9d3a-0a1fb8233cd7 tempest-SnapshotDependencyTests-2096680585 None] Flow 'volume_create_manager' (3c83366d-17d0-4aea-9f54-b8af36f5b632) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84538) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 19:08:29 devstack cinder-volume[84538]: DEBUG cinder.volume.manager [None req-68673020-499a-4820-9d3a-0a1fb8233cd7 tempest-SnapshotDependencyTests-2096680585 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1dc97aee-0c23-449d-a06f-5fabf94f8517) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 19:08:29 devstack cinder-volume[84538]: DEBUG cinder.volume.manager [None req-68673020-499a-4820-9d3a-0a1fb8233cd7 tempest-SnapshotDependencyTests-2096680585 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1dc97aee-0c23-449d-a06f-5fabf94f8517) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-29T17:08:29Z,deleted=False,deleted_at=None,display_description=None,display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=122936b3-a8e1-40c6-a1df-6b6990b73fa2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8964a1cd80b3400da29a094eebb77ecc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T17:08:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=72dbc63b-1d13-4ff5-954a-9186ece1c4d9,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T17:08:29Z,use_quota=True,user_id='b13df1c65eaa462588ddc81351f2b65f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(62b05900-93e3-4190-a88f-1d87324303d1),volume_type_id=62b05900-93e3-4190-a88f-1d87324303d1)' {{(pid=84538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 19:08:29 devstack cinder-volume[84538]: DEBUG cinder.volume.manager [None req-68673020-499a-4820-9d3a-0a1fb8233cd7 tempest-SnapshotDependencyTests-2096680585 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a8fe2be6-7418-497b-8459-b930f13870b7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 19:08:29 devstack cinder-volume[84538]: DEBUG cinder.volume.manager [None req-68673020-499a-4820-9d3a-0a1fb8233cd7 tempest-SnapshotDependencyTests-2096680585 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a8fe2be6-7418-497b-8459-b930f13870b7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 19:08:29 devstack cinder-volume[84538]: DEBUG cinder.volume.manager [None req-68673020-499a-4820-9d3a-0a1fb8233cd7 tempest-SnapshotDependencyTests-2096680585 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (81d5acae-ddcc-474a-b549-df32e42eacaf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 19:08:29 devstack cinder-volume[84538]: DEBUG cinder.volume.manager [None req-68673020-499a-4820-9d3a-0a1fb8233cd7 tempest-SnapshotDependencyTests-2096680585 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (81d5acae-ddcc-474a-b549-df32e42eacaf) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '122936b3-a8e1-40c6-a1df-6b6990b73fa2', 'volume_name': 'volume-122936b3-a8e1-40c6-a1df-6b6990b73fa2', 'volume_size': 1, 'snapshot_id': '72dbc63b-1d13-4ff5-954a-9186ece1c4d9'}' {{(pid=84538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 19:08:29 devstack cinder-volume[84538]: DEBUG cinder.volume.manager [None req-68673020-499a-4820-9d3a-0a1fb8233cd7 tempest-SnapshotDependencyTests-2096680585 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6d7b62f6-9fe5-4ffb-97c7-def679e2b0b1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 19:08:29 devstack cinder-volume[84538]: DEBUG cinder.volume.manager [None req-68673020-499a-4820-9d3a-0a1fb8233cd7 tempest-SnapshotDependencyTests-2096680585 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6d7b62f6-9fe5-4ffb-97c7-def679e2b0b1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 19:08:29 devstack cinder-volume[84538]: DEBUG cinder.volume.manager [None req-68673020-499a-4820-9d3a-0a1fb8233cd7 tempest-SnapshotDependencyTests-2096680585 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (72d7e171-bd24-4f56-b242-6f8cefb555b7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 19:08:29 devstack cinder-volume[84538]: INFO cinder.volume.flows.manager.create_volume [None req-68673020-499a-4820-9d3a-0a1fb8233cd7 tempest-SnapshotDependencyTests-2096680585 None] Volume 122936b3-a8e1-40c6-a1df-6b6990b73fa2: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-122936b3-a8e1-40c6-a1df-6b6990b73fa2', 'volume_size': 1, 'snapshot_id': '72dbc63b-1d13-4ff5-954a-9186ece1c4d9'} Apr 29 19:08:29 devstack cinder-volume[84538]: DEBUG oslo_concurrency.lockutils [None req-68673020-499a-4820-9d3a-0a1fb8233cd7 tempest-SnapshotDependencyTests-2096680585 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=84538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 19:08:29 devstack cinder-volume[84538]: DEBUG oslo_concurrency.lockutils [None req-68673020-499a-4820-9d3a-0a1fb8233cd7 tempest-SnapshotDependencyTests-2096680585 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=84538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 19:08:29 devstack cinder-volume[84538]: DEBUG cinder.coordination [None req-68673020-499a-4820-9d3a-0a1fb8233cd7 tempest-SnapshotDependencyTests-2096680585 None] Acquiring lock "cinder-quobyte-72dbc63b-1d13-4ff5-954a-9186ece1c4d9-122936b3-a8e1-40c6-a1df-6b6990b73fa2" by "_create_volume_from_snapshot" {{(pid=84538) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 19:08:29 devstack cinder-volume[84538]: DEBUG cinder.coordination [None req-68673020-499a-4820-9d3a-0a1fb8233cd7 tempest-SnapshotDependencyTests-2096680585 None] Lock "cinder-quobyte-72dbc63b-1d13-4ff5-954a-9186ece1c4d9-122936b3-a8e1-40c6-a1df-6b6990b73fa2" acquired by "_create_volume_from_snapshot" :: waited 0.013s {{(pid=84538) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 19:08:29 devstack cinder-volume[84538]: DEBUG cinder.volume.drivers.quobyte [None req-68673020-499a-4820-9d3a-0a1fb8233cd7 tempest-SnapshotDependencyTests-2096680585 None] Creating volume 122936b3-a8e1-40c6-a1df-6b6990b73fa2 from snapshot 72dbc63b-1d13-4ff5-954a-9186ece1c4d9 {{(pid=84538) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:356}} Apr 29 19:08:29 devstack cinder-volume[84538]: DEBUG oslo_concurrency.lockutils [None req-68673020-499a-4820-9d3a-0a1fb8233cd7 tempest-SnapshotDependencyTests-2096680585 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 19:08:29 devstack cinder-volume[84538]: DEBUG oslo_concurrency.lockutils [None req-68673020-499a-4820-9d3a-0a1fb8233cd7 tempest-SnapshotDependencyTests-2096680585 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=84538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 19:08:29 devstack cinder-volume[84538]: DEBUG cinder.volume.drivers.quobyte [None req-68673020-499a-4820-9d3a-0a1fb8233cd7 tempest-SnapshotDependencyTests-2096680585 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-34312b00-dd6d-45bb-af98-75855cea8e48': None} {{(pid=84538) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 19:08:29 devstack cinder-volume[84538]: DEBUG cinder.volume.drivers.quobyte [None req-68673020-499a-4820-9d3a-0a1fb8233cd7 tempest-SnapshotDependencyTests-2096680585 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-34312b00-dd6d-45bb-af98-75855cea8e48'] {{(pid=84538) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 19:08:29 devstack cinder-volume[84538]: DEBUG oslo_concurrency.lockutils [None req-68673020-499a-4820-9d3a-0a1fb8233cd7 tempest-SnapshotDependencyTests-2096680585 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=84538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 19:08:29 devstack cinder-volume[84538]: DEBUG cinder.volume.drivers.quobyte [None req-68673020-499a-4820-9d3a-0a1fb8233cd7 tempest-SnapshotDependencyTests-2096680585 None] Selected osci02.corp.quobyte.com/cinder-vol-34312b00-dd6d-45bb-af98-75855cea8e48 as target Quobyte volume. {{(pid=84538) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 29 19:08:29 devstack cinder-volume[84538]: DEBUG cinder.coordination [None req-68673020-499a-4820-9d3a-0a1fb8233cd7 tempest-SnapshotDependencyTests-2096680585 None] Acquiring lock "cinder-quobyte-122936b3-a8e1-40c6-a1df-6b6990b73fa2" by "_copy_volume_from_snapshot" {{(pid=84538) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 19:08:29 devstack cinder-volume[84538]: DEBUG cinder.coordination [None req-68673020-499a-4820-9d3a-0a1fb8233cd7 tempest-SnapshotDependencyTests-2096680585 None] Lock "cinder-quobyte-122936b3-a8e1-40c6-a1df-6b6990b73fa2" acquired by "_copy_volume_from_snapshot" :: waited 0.013s {{(pid=84538) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 19:08:29 devstack cinder-volume[84538]: DEBUG cinder.volume.drivers.quobyte [None req-68673020-499a-4820-9d3a-0a1fb8233cd7 tempest-SnapshotDependencyTests-2096680585 None] snapshot: 72dbc63b-1d13-4ff5-954a-9186ece1c4d9, volume: 122936b3-a8e1-40c6-a1df-6b6990b73fa2, {{(pid=84538) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Apr 29 19:08:29 devstack cinder-volume[84538]: DEBUG oslo_concurrency.lockutils [None req-68673020-499a-4820-9d3a-0a1fb8233cd7 tempest-SnapshotDependencyTests-2096680585 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 19:08:29 devstack cinder-volume[84538]: DEBUG oslo_concurrency.lockutils [None req-68673020-499a-4820-9d3a-0a1fb8233cd7 tempest-SnapshotDependencyTests-2096680585 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 19:08:29 devstack cinder-volume[84538]: DEBUG cinder.volume.drivers.quobyte [None req-68673020-499a-4820-9d3a-0a1fb8233cd7 tempest-SnapshotDependencyTests-2096680585 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-34312b00-dd6d-45bb-af98-75855cea8e48': None} {{(pid=84538) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 19:08:29 devstack cinder-volume[84538]: DEBUG cinder.volume.drivers.quobyte [None req-68673020-499a-4820-9d3a-0a1fb8233cd7 tempest-SnapshotDependencyTests-2096680585 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-34312b00-dd6d-45bb-af98-75855cea8e48'] {{(pid=84538) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 19:08:29 devstack cinder-volume[84538]: DEBUG oslo_concurrency.lockutils [None req-68673020-499a-4820-9d3a-0a1fb8233cd7 tempest-SnapshotDependencyTests-2096680585 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=84538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 19:08:29 devstack cinder-volume[84538]: DEBUG oslo.privsep.daemon [-] privsep: reply[e26832e4-d63b-49ac-b2bb-08841a0ded65]: (4, 'qcow2') {{(pid=85803) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 19:08:29 devstack cinder-volume[84538]: DEBUG oslo_concurrency.processutils [None req-68673020-499a-4820-9d3a-0a1fb8233cd7 tempest-SnapshotDependencyTests-2096680585 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-388cd4a9-17a2-4a2b-ab26-839b5de52f2a.72dbc63b-1d13-4ff5-954a-9186ece1c4d9 {{(pid=84538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 19:08:29 devstack sudo[93650]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-388cd4a9-17a2-4a2b-ab26-839b5de52f2a.72dbc63b-1d13-4ff5-954a-9186ece1c4d9 Apr 29 19:08:29 devstack sudo[93650]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 19:08:29 devstack sudo[93650]: pam_unix(sudo:session): session closed for user root Apr 29 19:08:29 devstack cinder-volume[84538]: DEBUG oslo_concurrency.processutils [None req-68673020-499a-4820-9d3a-0a1fb8233cd7 tempest-SnapshotDependencyTests-2096680585 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-388cd4a9-17a2-4a2b-ab26-839b5de52f2a.72dbc63b-1d13-4ff5-954a-9186ece1c4d9" returned: 0 in 0.734s {{(pid=84538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 19:08:29 devstack cinder-volume[84538]: DEBUG cinder.volume.drivers.remotefs [None req-68673020-499a-4820-9d3a-0a1fb8233cd7 tempest-SnapshotDependencyTests-2096680585 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-388cd4a9-17a2-4a2b-ab26-839b5de52f2a(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=84538) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 29 19:08:29 devstack cinder-volume[84538]: DEBUG cinder.volume.drivers.quobyte [None req-68673020-499a-4820-9d3a-0a1fb8233cd7 tempest-SnapshotDependencyTests-2096680585 None] will copy from snapshot at /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-388cd4a9-17a2-4a2b-ab26-839b5de52f2a {{(pid=84538) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Apr 29 19:08:29 devstack cinder-volume[84538]: DEBUG cinder.volume.drivers.quobyte [None req-68673020-499a-4820-9d3a-0a1fb8233cd7 tempest-SnapshotDependencyTests-2096680585 None] Creating direct copy from snapshot {{(pid=84538) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Apr 29 19:08:29 devstack cinder-volume[84538]: DEBUG oslo.privsep.daemon [-] privsep: reply[633719e5-0e69-4c2d-8469-8a49939c5b4d]: (4, 'qcow2') {{(pid=85803) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 19:08:29 devstack cinder-volume[84538]: DEBUG oslo_concurrency.processutils [None req-68673020-499a-4820-9d3a-0a1fb8233cd7 tempest-SnapshotDependencyTests-2096680585 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-388cd4a9-17a2-4a2b-ab26-839b5de52f2a {{(pid=84538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 19:08:30 devstack sudo[93655]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-388cd4a9-17a2-4a2b-ab26-839b5de52f2a Apr 29 19:08:30 devstack sudo[93655]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 19:08:30 devstack sudo[93655]: pam_unix(sudo:session): session closed for user root Apr 29 19:08:30 devstack cinder-volume[84538]: DEBUG oslo_concurrency.processutils [None req-68673020-499a-4820-9d3a-0a1fb8233cd7 tempest-SnapshotDependencyTests-2096680585 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-388cd4a9-17a2-4a2b-ab26-839b5de52f2a" returned: 0 in 0.744s {{(pid=84538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 19:08:30 devstack cinder-volume[84538]: DEBUG cinder.utils [None req-68673020-499a-4820-9d3a-0a1fb8233cd7 tempest-SnapshotDependencyTests-2096680585 None] Path /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-122936b3-a8e1-40c6-a1df-6b6990b73fa2 not found in is_blk_device check {{(pid=84538) is_blk_device /opt/stack/cinder/cinder/utils.py:602}} Apr 29 19:08:30 devstack cinder-volume[84538]: DEBUG oslo_concurrency.processutils [None req-68673020-499a-4820-9d3a-0a1fb8233cd7 tempest-SnapshotDependencyTests-2096680585 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-388cd4a9-17a2-4a2b-ab26-839b5de52f2a /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-122936b3-a8e1-40c6-a1df-6b6990b73fa2 {{(pid=84538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 19:08:30 devstack sudo[93660]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-388cd4a9-17a2-4a2b-ab26-839b5de52f2a /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-122936b3-a8e1-40c6-a1df-6b6990b73fa2 Apr 29 19:08:30 devstack sudo[93660]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 19:08:35 devstack sudo[93660]: pam_unix(sudo:session): session closed for user root Apr 29 19:08:35 devstack cinder-volume[84538]: DEBUG oslo_concurrency.processutils [None req-68673020-499a-4820-9d3a-0a1fb8233cd7 tempest-SnapshotDependencyTests-2096680585 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-388cd4a9-17a2-4a2b-ab26-839b5de52f2a /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-122936b3-a8e1-40c6-a1df-6b6990b73fa2" returned: 0 in 4.363s {{(pid=84538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 19:08:35 devstack cinder-volume[84538]: DEBUG oslo.privsep.daemon [-] privsep: reply[d011cd21-6171-4066-a216-d54b7ddf2a71]: (4, 'qcow2') {{(pid=85803) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 19:08:35 devstack cinder-volume[84538]: DEBUG oslo_concurrency.processutils [None req-68673020-499a-4820-9d3a-0a1fb8233cd7 tempest-SnapshotDependencyTests-2096680585 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-388cd4a9-17a2-4a2b-ab26-839b5de52f2a {{(pid=84538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 19:08:35 devstack sudo[93673]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-388cd4a9-17a2-4a2b-ab26-839b5de52f2a Apr 29 19:08:35 devstack sudo[93673]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 19:08:35 devstack sudo[93673]: pam_unix(sudo:session): session closed for user root Apr 29 19:08:35 devstack cinder-volume[84538]: DEBUG oslo_concurrency.processutils [None req-68673020-499a-4820-9d3a-0a1fb8233cd7 tempest-SnapshotDependencyTests-2096680585 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-388cd4a9-17a2-4a2b-ab26-839b5de52f2a" returned: 0 in 0.855s {{(pid=84538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 19:08:35 devstack cinder-volume[84538]: DEBUG cinder.image.image_utils [None req-68673020-499a-4820-9d3a-0a1fb8233cd7 tempest-SnapshotDependencyTests-2096680585 None] Image conversion details: src /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-388cd4a9-17a2-4a2b-ab26-839b5de52f2a, size 1024.00 MB, duration 4.36 sec, destination /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-122936b3-a8e1-40c6-a1df-6b6990b73fa2 {{(pid=84538) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}} Apr 29 19:08:35 devstack cinder-volume[84538]: INFO cinder.image.image_utils [None req-68673020-499a-4820-9d3a-0a1fb8233cd7 tempest-SnapshotDependencyTests-2096680585 None] Converted 1024.00 MB image at 234.63 MB/s Apr 29 19:08:35 devstack cinder-volume[84538]: WARNING cinder.volume.drivers.remotefs [None req-68673020-499a-4820-9d3a-0a1fb8233cd7 tempest-SnapshotDependencyTests-2096680585 None] /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-122936b3-a8e1-40c6-a1df-6b6990b73fa2 is being set with open permissions: ugo+rw Apr 29 19:08:35 devstack cinder-volume[84538]: DEBUG oslo_concurrency.processutils [None req-68673020-499a-4820-9d3a-0a1fb8233cd7 tempest-SnapshotDependencyTests-2096680585 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-122936b3-a8e1-40c6-a1df-6b6990b73fa2 {{(pid=84538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 19:08:35 devstack sudo[93678]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-122936b3-a8e1-40c6-a1df-6b6990b73fa2 Apr 29 19:08:35 devstack sudo[93678]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 19:08:36 devstack sudo[93678]: pam_unix(sudo:session): session closed for user root Apr 29 19:08:36 devstack cinder-volume[84538]: DEBUG oslo_concurrency.processutils [None req-68673020-499a-4820-9d3a-0a1fb8233cd7 tempest-SnapshotDependencyTests-2096680585 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-122936b3-a8e1-40c6-a1df-6b6990b73fa2" returned: 0 in 0.576s {{(pid=84538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 19:08:36 devstack cinder-volume[84538]: DEBUG cinder.coordination [None req-68673020-499a-4820-9d3a-0a1fb8233cd7 tempest-SnapshotDependencyTests-2096680585 None] Lock "cinder-quobyte-122936b3-a8e1-40c6-a1df-6b6990b73fa2" released by "_copy_volume_from_snapshot" :: held 7.359s {{(pid=84538) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 19:08:36 devstack cinder-volume[84538]: DEBUG cinder.coordination [None req-68673020-499a-4820-9d3a-0a1fb8233cd7 tempest-SnapshotDependencyTests-2096680585 None] Lock "cinder-quobyte-72dbc63b-1d13-4ff5-954a-9186ece1c4d9-122936b3-a8e1-40c6-a1df-6b6990b73fa2" released by "_create_volume_from_snapshot" :: held 7.387s {{(pid=84538) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 19:08:36 devstack cinder-volume[84538]: DEBUG oslo_concurrency.lockutils [None req-68673020-499a-4820-9d3a-0a1fb8233cd7 tempest-SnapshotDependencyTests-2096680585 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 7.401s {{(pid=84538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 19:08:36 devstack cinder-volume[84538]: DEBUG cinder.volume.manager [None req-68673020-499a-4820-9d3a-0a1fb8233cd7 tempest-SnapshotDependencyTests-2096680585 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (72d7e171-bd24-4f56-b242-6f8cefb555b7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-122936b3-a8e1-40c6-a1df-6b6990b73fa2', 'volume_size': 1, 'snapshot_id': '72dbc63b-1d13-4ff5-954a-9186ece1c4d9'}' {{(pid=84538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 19:08:36 devstack cinder-volume[84538]: DEBUG cinder.volume.manager [None req-68673020-499a-4820-9d3a-0a1fb8233cd7 tempest-SnapshotDependencyTests-2096680585 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (eb8a06f9-5e44-4772-a907-0911248280ba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 19:08:36 devstack cinder-volume[84538]: INFO cinder.volume.flows.manager.create_volume [None req-68673020-499a-4820-9d3a-0a1fb8233cd7 tempest-SnapshotDependencyTests-2096680585 None] Volume volume-122936b3-a8e1-40c6-a1df-6b6990b73fa2 (122936b3-a8e1-40c6-a1df-6b6990b73fa2): created successfully Apr 29 19:08:36 devstack cinder-volume[84538]: DEBUG cinder.volume.manager [None req-68673020-499a-4820-9d3a-0a1fb8233cd7 tempest-SnapshotDependencyTests-2096680585 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (eb8a06f9-5e44-4772-a907-0911248280ba) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 19:08:36 devstack cinder-volume[84538]: DEBUG cinder.volume.manager [None req-68673020-499a-4820-9d3a-0a1fb8233cd7 tempest-SnapshotDependencyTests-2096680585 None] Flow 'volume_create_manager' (3c83366d-17d0-4aea-9f54-b8af36f5b632) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84538) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 19:08:36 devstack cinder-volume[84538]: INFO cinder.volume.manager [None req-68673020-499a-4820-9d3a-0a1fb8233cd7 tempest-SnapshotDependencyTests-2096680585 None] Created volume successfully. Apr 29 19:08:37 devstack cinder-volume[84538]: DEBUG cinder.coordination [None req-e344bf91-30fe-4764-be41-223956c18a48 tempest-SnapshotDependencyTests-2096680585 None] Acquiring lock "cinder-72dbc63b-1d13-4ff5-954a-9186ece1c4d9-delete_snapshot" by "delete_snapshot" {{(pid=84538) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 19:08:37 devstack cinder-volume[84538]: DEBUG cinder.coordination [None req-e344bf91-30fe-4764-be41-223956c18a48 tempest-SnapshotDependencyTests-2096680585 None] Lock "cinder-72dbc63b-1d13-4ff5-954a-9186ece1c4d9-delete_snapshot" acquired by "delete_snapshot" :: waited 0.017s {{(pid=84538) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 19:08:37 devstack cinder-volume[84538]: DEBUG cinder.coordination [None req-e344bf91-30fe-4764-be41-223956c18a48 tempest-SnapshotDependencyTests-2096680585 None] Acquiring lock "cinder-quobyte-388cd4a9-17a2-4a2b-ab26-839b5de52f2a" by "delete_snapshot" {{(pid=84538) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 19:08:37 devstack cinder-volume[84538]: DEBUG cinder.coordination [None req-e344bf91-30fe-4764-be41-223956c18a48 tempest-SnapshotDependencyTests-2096680585 None] Lock "cinder-quobyte-388cd4a9-17a2-4a2b-ab26-839b5de52f2a" acquired by "delete_snapshot" :: waited 0.015s {{(pid=84538) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 19:08:37 devstack cinder-volume[84538]: DEBUG cinder.coordination [None req-e344bf91-30fe-4764-be41-223956c18a48 tempest-SnapshotDependencyTests-2096680585 None] Acquiring lock "cinder-quobyte-72dbc63b-1d13-4ff5-954a-9186ece1c4d9" by "_delete_snapshot" {{(pid=84538) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 19:08:37 devstack cinder-volume[84538]: DEBUG cinder.coordination [None req-e344bf91-30fe-4764-be41-223956c18a48 tempest-SnapshotDependencyTests-2096680585 None] Lock "cinder-quobyte-72dbc63b-1d13-4ff5-954a-9186ece1c4d9" acquired by "_delete_snapshot" :: waited 0.015s {{(pid=84538) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 19:08:37 devstack cinder-volume[84538]: DEBUG cinder.volume.drivers.remotefs [None req-e344bf91-30fe-4764-be41-223956c18a48 tempest-SnapshotDependencyTests-2096680585 None] Deleting offline snapshot 72dbc63b-1d13-4ff5-954a-9186ece1c4d9 of volume 388cd4a9-17a2-4a2b-ab26-839b5de52f2a {{(pid=84538) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 29 19:08:37 devstack cinder-volume[84538]: DEBUG cinder.volume.drivers.remotefs [None req-e344bf91-30fe-4764-be41-223956c18a48 tempest-SnapshotDependencyTests-2096680585 None] snapshot_file for this snap is: volume-388cd4a9-17a2-4a2b-ab26-839b5de52f2a.72dbc63b-1d13-4ff5-954a-9186ece1c4d9 {{(pid=84538) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 29 19:08:37 devstack cinder-volume[84538]: DEBUG oslo.privsep.daemon [-] privsep: reply[73842841-dc30-41b5-a61e-c3ed77e10eaf]: (4, 'qcow2') {{(pid=85803) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 19:08:37 devstack cinder-volume[84538]: DEBUG oslo_concurrency.processutils [None req-e344bf91-30fe-4764-be41-223956c18a48 tempest-SnapshotDependencyTests-2096680585 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-388cd4a9-17a2-4a2b-ab26-839b5de52f2a.72dbc63b-1d13-4ff5-954a-9186ece1c4d9 {{(pid=84538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 19:08:37 devstack sudo[93681]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-388cd4a9-17a2-4a2b-ab26-839b5de52f2a.72dbc63b-1d13-4ff5-954a-9186ece1c4d9 Apr 29 19:08:37 devstack sudo[93681]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 19:08:38 devstack sudo[93681]: pam_unix(sudo:session): session closed for user root Apr 29 19:08:38 devstack cinder-volume[84538]: DEBUG oslo_concurrency.processutils [None req-e344bf91-30fe-4764-be41-223956c18a48 tempest-SnapshotDependencyTests-2096680585 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-388cd4a9-17a2-4a2b-ab26-839b5de52f2a.72dbc63b-1d13-4ff5-954a-9186ece1c4d9" returned: 0 in 0.690s {{(pid=84538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 19:08:38 devstack cinder-volume[84538]: DEBUG cinder.volume.drivers.remotefs [None req-e344bf91-30fe-4764-be41-223956c18a48 tempest-SnapshotDependencyTests-2096680585 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-388cd4a9-17a2-4a2b-ab26-839b5de52f2a(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=84538) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 29 19:08:38 devstack cinder-volume[84538]: DEBUG oslo.privsep.daemon [-] privsep: reply[3c1a565a-4b6e-49d2-aafc-f359c048c666]: (4, 'qcow2') {{(pid=85803) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 19:08:38 devstack cinder-volume[84538]: DEBUG oslo_concurrency.processutils [None req-e344bf91-30fe-4764-be41-223956c18a48 tempest-SnapshotDependencyTests-2096680585 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-388cd4a9-17a2-4a2b-ab26-839b5de52f2a {{(pid=84538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 19:08:38 devstack sudo[93688]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-388cd4a9-17a2-4a2b-ab26-839b5de52f2a Apr 29 19:08:38 devstack sudo[93688]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 19:08:39 devstack sudo[93688]: pam_unix(sudo:session): session closed for user root Apr 29 19:08:39 devstack cinder-volume[84538]: DEBUG oslo_concurrency.processutils [None req-e344bf91-30fe-4764-be41-223956c18a48 tempest-SnapshotDependencyTests-2096680585 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-388cd4a9-17a2-4a2b-ab26-839b5de52f2a" returned: 0 in 0.699s {{(pid=84538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 19:08:39 devstack cinder-volume[84538]: DEBUG oslo_concurrency.processutils [None req-e344bf91-30fe-4764-be41-223956c18a48 tempest-SnapshotDependencyTests-2096680585 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-388cd4a9-17a2-4a2b-ab26-839b5de52f2a.72dbc63b-1d13-4ff5-954a-9186ece1c4d9 {{(pid=84538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 19:08:39 devstack sudo[93693]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-388cd4a9-17a2-4a2b-ab26-839b5de52f2a.72dbc63b-1d13-4ff5-954a-9186ece1c4d9 Apr 29 19:08:39 devstack sudo[93693]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 19:08:39 devstack sudo[93693]: pam_unix(sudo:session): session closed for user root Apr 29 19:08:39 devstack cinder-volume[84538]: DEBUG oslo_concurrency.processutils [None req-e344bf91-30fe-4764-be41-223956c18a48 tempest-SnapshotDependencyTests-2096680585 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-388cd4a9-17a2-4a2b-ab26-839b5de52f2a.72dbc63b-1d13-4ff5-954a-9186ece1c4d9" returned: 0 in 0.675s {{(pid=84538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 19:08:39 devstack cinder-volume[84538]: DEBUG oslo_concurrency.processutils [None req-e344bf91-30fe-4764-be41-223956c18a48 tempest-SnapshotDependencyTests-2096680585 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-388cd4a9-17a2-4a2b-ab26-839b5de52f2a.72dbc63b-1d13-4ff5-954a-9186ece1c4d9 {{(pid=84538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 19:08:39 devstack sudo[93698]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-388cd4a9-17a2-4a2b-ab26-839b5de52f2a.72dbc63b-1d13-4ff5-954a-9186ece1c4d9 Apr 29 19:08:39 devstack sudo[93698]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 19:08:40 devstack sudo[93698]: pam_unix(sudo:session): session closed for user root Apr 29 19:08:40 devstack cinder-volume[84538]: DEBUG oslo_concurrency.processutils [None req-e344bf91-30fe-4764-be41-223956c18a48 tempest-SnapshotDependencyTests-2096680585 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-388cd4a9-17a2-4a2b-ab26-839b5de52f2a.72dbc63b-1d13-4ff5-954a-9186ece1c4d9" returned: 0 in 0.573s {{(pid=84538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 19:08:40 devstack cinder-volume[84538]: DEBUG cinder.coordination [None req-e344bf91-30fe-4764-be41-223956c18a48 tempest-SnapshotDependencyTests-2096680585 None] Lock "cinder-quobyte-72dbc63b-1d13-4ff5-954a-9186ece1c4d9" released by "_delete_snapshot" :: held 2.726s {{(pid=84538) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 19:08:40 devstack cinder-volume[84538]: DEBUG cinder.coordination [None req-e344bf91-30fe-4764-be41-223956c18a48 tempest-SnapshotDependencyTests-2096680585 None] Lock "cinder-quobyte-388cd4a9-17a2-4a2b-ab26-839b5de52f2a" released by "delete_snapshot" :: held 2.748s {{(pid=84538) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 19:08:40 devstack cinder-volume[84538]: DEBUG cinder.quota [None req-e344bf91-30fe-4764-be41-223956c18a48 tempest-SnapshotDependencyTests-2096680585 None] Created reservations ['b4a883c1-44b7-4db4-a080-60d01d1d8dc2', '0b773359-ef82-4117-809f-dd6c1c29f340', 'c105e9b4-2c1e-4567-851f-a525f85ff409', '170ef27d-4761-4aa9-8669-8ce5b6f7556c'] {{(pid=84538) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 29 19:08:40 devstack cinder-volume[84538]: INFO cinder.volume.manager [None req-e344bf91-30fe-4764-be41-223956c18a48 tempest-SnapshotDependencyTests-2096680585 None] Delete snapshot completed successfully. Apr 29 19:08:40 devstack cinder-volume[84538]: DEBUG cinder.coordination [None req-e344bf91-30fe-4764-be41-223956c18a48 tempest-SnapshotDependencyTests-2096680585 None] Lock "cinder-72dbc63b-1d13-4ff5-954a-9186ece1c4d9-delete_snapshot" released by "delete_snapshot" :: held 2.866s {{(pid=84538) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 19:08:40 devstack cinder-volume[84538]: DEBUG cinder.coordination [None req-e714dffa-cd97-4a4e-ba41-b8a291eabb0f tempest-SnapshotDependencyTests-2096680585 None] Acquiring lock "cinder-388cd4a9-17a2-4a2b-ab26-839b5de52f2a-delete_volume" by "delete_volume" {{(pid=84538) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 19:08:40 devstack cinder-volume[84538]: DEBUG cinder.coordination [None req-e714dffa-cd97-4a4e-ba41-b8a291eabb0f tempest-SnapshotDependencyTests-2096680585 None] Lock "cinder-388cd4a9-17a2-4a2b-ab26-839b5de52f2a-delete_volume" acquired by "delete_volume" :: waited 0.017s {{(pid=84538) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 19:08:40 devstack cinder-volume[84538]: DEBUG cinder.coordination [None req-e714dffa-cd97-4a4e-ba41-b8a291eabb0f tempest-SnapshotDependencyTests-2096680585 None] Acquiring lock "cinder-quobyte-388cd4a9-17a2-4a2b-ab26-839b5de52f2a" by "delete_volume" {{(pid=84538) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 19:08:40 devstack cinder-volume[84538]: DEBUG cinder.coordination [None req-e714dffa-cd97-4a4e-ba41-b8a291eabb0f tempest-SnapshotDependencyTests-2096680585 None] Lock "cinder-quobyte-388cd4a9-17a2-4a2b-ab26-839b5de52f2a" acquired by "delete_volume" :: waited 0.014s {{(pid=84538) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 19:08:40 devstack cinder-volume[84538]: DEBUG oslo.privsep.daemon [-] privsep: reply[8e012f18-03c8-4b5a-b3bb-75bcda2f54b9]: (4, 'qcow2') {{(pid=85803) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 19:08:40 devstack cinder-volume[84538]: DEBUG oslo_concurrency.processutils [None req-e714dffa-cd97-4a4e-ba41-b8a291eabb0f tempest-SnapshotDependencyTests-2096680585 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-388cd4a9-17a2-4a2b-ab26-839b5de52f2a {{(pid=84538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 19:08:41 devstack sudo[93703]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-388cd4a9-17a2-4a2b-ab26-839b5de52f2a Apr 29 19:08:41 devstack sudo[93703]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 19:08:41 devstack sudo[93703]: pam_unix(sudo:session): session closed for user root Apr 29 19:08:41 devstack cinder-volume[84538]: DEBUG oslo_concurrency.processutils [None req-e714dffa-cd97-4a4e-ba41-b8a291eabb0f tempest-SnapshotDependencyTests-2096680585 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-388cd4a9-17a2-4a2b-ab26-839b5de52f2a" returned: 0 in 0.696s {{(pid=84538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 19:08:41 devstack cinder-volume[84538]: DEBUG oslo_concurrency.processutils [None req-e714dffa-cd97-4a4e-ba41-b8a291eabb0f tempest-SnapshotDependencyTests-2096680585 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-388cd4a9-17a2-4a2b-ab26-839b5de52f2a {{(pid=84538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 19:08:41 devstack sudo[93708]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-388cd4a9-17a2-4a2b-ab26-839b5de52f2a Apr 29 19:08:41 devstack sudo[93708]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 19:08:42 devstack sudo[93708]: pam_unix(sudo:session): session closed for user root Apr 29 19:08:42 devstack cinder-volume[84538]: DEBUG oslo_concurrency.processutils [None req-e714dffa-cd97-4a4e-ba41-b8a291eabb0f tempest-SnapshotDependencyTests-2096680585 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-388cd4a9-17a2-4a2b-ab26-839b5de52f2a" returned: 0 in 0.572s {{(pid=84538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 19:08:42 devstack cinder-volume[84538]: DEBUG cinder.coordination [None req-e714dffa-cd97-4a4e-ba41-b8a291eabb0f tempest-SnapshotDependencyTests-2096680585 None] Lock "cinder-quobyte-388cd4a9-17a2-4a2b-ab26-839b5de52f2a" released by "delete_volume" :: held 1.322s {{(pid=84538) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 19:08:42 devstack cinder-volume[84538]: DEBUG cinder.quota [None req-e714dffa-cd97-4a4e-ba41-b8a291eabb0f tempest-SnapshotDependencyTests-2096680585 None] Created reservations ['a5f206cb-54af-494c-b196-8514a90af2e9', '490a2169-9f42-431c-9641-fbf6e3838a44', 'd4ce9032-860b-488f-bd02-3c306c390d19', '8c6976e5-66ab-4a44-9a31-d6eba19f3acb'] {{(pid=84538) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 29 19:08:42 devstack cinder-volume[84538]: DEBUG oslo_concurrency.lockutils [None req-e714dffa-cd97-4a4e-ba41-b8a291eabb0f tempest-SnapshotDependencyTests-2096680585 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 19:08:42 devstack cinder-volume[84538]: DEBUG oslo_concurrency.lockutils [None req-e714dffa-cd97-4a4e-ba41-b8a291eabb0f tempest-SnapshotDependencyTests-2096680585 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 19:08:42 devstack cinder-volume[84538]: DEBUG cinder.volume.drivers.quobyte [None req-e714dffa-cd97-4a4e-ba41-b8a291eabb0f tempest-SnapshotDependencyTests-2096680585 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-34312b00-dd6d-45bb-af98-75855cea8e48': None} {{(pid=84538) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 19:08:42 devstack cinder-volume[84538]: DEBUG cinder.volume.drivers.quobyte [None req-e714dffa-cd97-4a4e-ba41-b8a291eabb0f tempest-SnapshotDependencyTests-2096680585 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-34312b00-dd6d-45bb-af98-75855cea8e48'] {{(pid=84538) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 19:08:42 devstack cinder-volume[84538]: DEBUG oslo_concurrency.lockutils [None req-e714dffa-cd97-4a4e-ba41-b8a291eabb0f tempest-SnapshotDependencyTests-2096680585 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=84538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 19:08:42 devstack cinder-volume[84538]: DEBUG oslo_concurrency.processutils [None req-e714dffa-cd97-4a4e-ba41-b8a291eabb0f tempest-SnapshotDependencyTests-2096680585 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d {{(pid=84538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 19:08:42 devstack sudo[93711]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d Apr 29 19:08:42 devstack sudo[93711]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 19:08:42 devstack sudo[93711]: pam_unix(sudo:session): session closed for user root Apr 29 19:08:42 devstack cinder-volume[84538]: DEBUG oslo_concurrency.processutils [None req-e714dffa-cd97-4a4e-ba41-b8a291eabb0f tempest-SnapshotDependencyTests-2096680585 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d" returned: 0 in 0.584s {{(pid=84538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 19:08:42 devstack cinder-volume[84538]: DEBUG cinder.manager [None req-e714dffa-cd97-4a4e-ba41-b8a291eabb0f tempest-SnapshotDependencyTests-2096680585 None] Notifying Schedulers of capabilities ... {{(pid=84538) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 29 19:08:42 devstack cinder-volume[84538]: INFO cinder.volume.manager [None req-e714dffa-cd97-4a4e-ba41-b8a291eabb0f tempest-SnapshotDependencyTests-2096680585 None] Deleted volume successfully. Apr 29 19:08:42 devstack cinder-volume[84538]: DEBUG cinder.coordination [None req-e714dffa-cd97-4a4e-ba41-b8a291eabb0f tempest-SnapshotDependencyTests-2096680585 None] Lock "cinder-388cd4a9-17a2-4a2b-ab26-839b5de52f2a-delete_volume" released by "delete_volume" :: held 2.083s {{(pid=84538) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 19:08:43 devstack cinder-volume[84538]: DEBUG cinder.coordination [None req-5e23a43a-3dcd-4246-83a9-749a88f7f3a6 tempest-SnapshotDependencyTests-2096680585 None] Acquiring lock "cinder-122936b3-a8e1-40c6-a1df-6b6990b73fa2-delete_volume" by "delete_volume" {{(pid=84538) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 19:08:43 devstack cinder-volume[84538]: DEBUG cinder.coordination [None req-5e23a43a-3dcd-4246-83a9-749a88f7f3a6 tempest-SnapshotDependencyTests-2096680585 None] Lock "cinder-122936b3-a8e1-40c6-a1df-6b6990b73fa2-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=84538) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 19:08:43 devstack cinder-volume[84538]: DEBUG cinder.coordination [None req-5e23a43a-3dcd-4246-83a9-749a88f7f3a6 tempest-SnapshotDependencyTests-2096680585 None] Acquiring lock "cinder-quobyte-122936b3-a8e1-40c6-a1df-6b6990b73fa2" by "delete_volume" {{(pid=84538) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 19:08:43 devstack cinder-volume[84538]: DEBUG cinder.coordination [None req-5e23a43a-3dcd-4246-83a9-749a88f7f3a6 tempest-SnapshotDependencyTests-2096680585 None] Lock "cinder-quobyte-122936b3-a8e1-40c6-a1df-6b6990b73fa2" acquired by "delete_volume" :: waited 0.015s {{(pid=84538) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 19:08:43 devstack cinder-volume[84538]: DEBUG oslo.privsep.daemon [-] privsep: reply[37b2cc22-abfd-4a7a-b47e-4ce8e3a89d56]: (4, 'qcow2') {{(pid=85803) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 19:08:43 devstack cinder-volume[84538]: DEBUG oslo_concurrency.processutils [None req-5e23a43a-3dcd-4246-83a9-749a88f7f3a6 tempest-SnapshotDependencyTests-2096680585 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-122936b3-a8e1-40c6-a1df-6b6990b73fa2 {{(pid=84538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 19:08:43 devstack sudo[93714]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-122936b3-a8e1-40c6-a1df-6b6990b73fa2 Apr 29 19:08:43 devstack sudo[93714]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 19:08:43 devstack sudo[93714]: pam_unix(sudo:session): session closed for user root Apr 29 19:08:43 devstack cinder-volume[84538]: DEBUG oslo_concurrency.processutils [None req-5e23a43a-3dcd-4246-83a9-749a88f7f3a6 tempest-SnapshotDependencyTests-2096680585 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-122936b3-a8e1-40c6-a1df-6b6990b73fa2" returned: 0 in 0.691s {{(pid=84538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 19:08:43 devstack cinder-volume[84538]: DEBUG oslo_concurrency.processutils [None req-5e23a43a-3dcd-4246-83a9-749a88f7f3a6 tempest-SnapshotDependencyTests-2096680585 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-122936b3-a8e1-40c6-a1df-6b6990b73fa2 {{(pid=84538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 19:08:43 devstack sudo[93719]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-122936b3-a8e1-40c6-a1df-6b6990b73fa2 Apr 29 19:08:43 devstack sudo[93719]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 19:08:44 devstack sudo[93719]: pam_unix(sudo:session): session closed for user root Apr 29 19:08:44 devstack cinder-volume[84538]: DEBUG oslo_concurrency.processutils [None req-5e23a43a-3dcd-4246-83a9-749a88f7f3a6 tempest-SnapshotDependencyTests-2096680585 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-122936b3-a8e1-40c6-a1df-6b6990b73fa2" returned: 0 in 0.589s {{(pid=84538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 19:08:44 devstack cinder-volume[84538]: DEBUG cinder.coordination [None req-5e23a43a-3dcd-4246-83a9-749a88f7f3a6 tempest-SnapshotDependencyTests-2096680585 None] Lock "cinder-quobyte-122936b3-a8e1-40c6-a1df-6b6990b73fa2" released by "delete_volume" :: held 1.322s {{(pid=84538) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 19:08:44 devstack cinder-volume[84538]: DEBUG cinder.quota [None req-5e23a43a-3dcd-4246-83a9-749a88f7f3a6 tempest-SnapshotDependencyTests-2096680585 None] Created reservations ['5234fe99-2997-4112-b907-1f0f76bb853c', '9e5311d7-57cf-41c8-be21-a309c5a5c13a', '66c0ef5a-3e9b-48cb-8864-4f1bd9279cd3', 'ca8c7bec-51b0-4f41-9c57-7cda7404f9aa'] {{(pid=84538) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 29 19:08:44 devstack cinder-volume[84538]: DEBUG oslo_concurrency.lockutils [None req-5e23a43a-3dcd-4246-83a9-749a88f7f3a6 tempest-SnapshotDependencyTests-2096680585 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 19:08:44 devstack cinder-volume[84538]: DEBUG oslo_concurrency.lockutils [None req-5e23a43a-3dcd-4246-83a9-749a88f7f3a6 tempest-SnapshotDependencyTests-2096680585 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 19:08:44 devstack cinder-volume[84538]: DEBUG cinder.volume.drivers.quobyte [None req-5e23a43a-3dcd-4246-83a9-749a88f7f3a6 tempest-SnapshotDependencyTests-2096680585 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-34312b00-dd6d-45bb-af98-75855cea8e48': None} {{(pid=84538) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 19:08:44 devstack cinder-volume[84538]: DEBUG cinder.volume.drivers.quobyte [None req-5e23a43a-3dcd-4246-83a9-749a88f7f3a6 tempest-SnapshotDependencyTests-2096680585 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-34312b00-dd6d-45bb-af98-75855cea8e48'] {{(pid=84538) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 19:08:44 devstack cinder-volume[84538]: DEBUG oslo_concurrency.lockutils [None req-5e23a43a-3dcd-4246-83a9-749a88f7f3a6 tempest-SnapshotDependencyTests-2096680585 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=84538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 19:08:44 devstack cinder-volume[84538]: DEBUG oslo_concurrency.processutils [None req-5e23a43a-3dcd-4246-83a9-749a88f7f3a6 tempest-SnapshotDependencyTests-2096680585 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d {{(pid=84538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 19:08:44 devstack sudo[93722]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d Apr 29 19:08:44 devstack sudo[93722]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 19:08:45 devstack sudo[93722]: pam_unix(sudo:session): session closed for user root Apr 29 19:08:45 devstack cinder-volume[84538]: DEBUG oslo_concurrency.processutils [None req-5e23a43a-3dcd-4246-83a9-749a88f7f3a6 tempest-SnapshotDependencyTests-2096680585 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d" returned: 0 in 0.595s {{(pid=84538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 19:08:45 devstack cinder-volume[84538]: DEBUG cinder.manager [None req-5e23a43a-3dcd-4246-83a9-749a88f7f3a6 tempest-SnapshotDependencyTests-2096680585 None] Notifying Schedulers of capabilities ... {{(pid=84538) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 29 19:08:45 devstack cinder-volume[84538]: INFO cinder.volume.manager [None req-5e23a43a-3dcd-4246-83a9-749a88f7f3a6 tempest-SnapshotDependencyTests-2096680585 None] Deleted volume successfully. Apr 29 19:08:45 devstack cinder-volume[84538]: DEBUG cinder.coordination [None req-5e23a43a-3dcd-4246-83a9-749a88f7f3a6 tempest-SnapshotDependencyTests-2096680585 None] Lock "cinder-122936b3-a8e1-40c6-a1df-6b6990b73fa2-delete_volume" released by "delete_volume" :: held 2.100s {{(pid=84538) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 19:08:54 devstack cinder-volume[84538]: DEBUG dbcounter [-] [84538] Writing DB stats cinder:UPDATE=25,cinder:SELECT=26,cinder:INSERT=7,cinder:DELETE=2 {{(pid=84538) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Apr 29 19:08:55 devstack cinder-volume[84538]: DEBUG dbcounter [-] [84538] Writing DB stats cinder:SELECT=21,cinder:UPDATE=31,cinder:DELETE=3,cinder:INSERT=7 {{(pid=84538) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Apr 29 19:09:02 devstack cinder-volume[84538]: DEBUG cinder.volume.flows.manager.create_volume [None req-01898046-19eb-4bf4-ac92-3a155a360157 tempest-CinderUnicodeTest-2074336556 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84538) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Apr 29 19:09:02 devstack cinder-volume[84538]: DEBUG cinder.volume.manager [None req-01898046-19eb-4bf4-ac92-3a155a360157 tempest-CinderUnicodeTest-2074336556 None] Flow 'volume_create_manager' (d969017f-415e-4302-84bb-be01d4e1554c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84538) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 19:09:02 devstack cinder-volume[84538]: DEBUG cinder.volume.manager [None req-01898046-19eb-4bf4-ac92-3a155a360157 tempest-CinderUnicodeTest-2074336556 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ad7dff2c-2384-44ff-95e4-54b0a9372df3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 19:09:02 devstack cinder-volume[84538]: DEBUG cinder.volume.manager [None req-01898046-19eb-4bf4-ac92-3a155a360157 tempest-CinderUnicodeTest-2074336556 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ad7dff2c-2384-44ff-95e4-54b0a9372df3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-29T17:09:02Z,deleted=False,deleted_at=None,display_description=None,display_name='CinderUnicodeTest塵㼗‽',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8d006829-6569-42c5-9f2c-536782b876a7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0112255e70ee40f5aef023c026ac05f7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T17:09:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T17:09:02Z,use_quota=True,user_id='30fc12f62ad84d6fa0d9545602738c6f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(62b05900-93e3-4190-a88f-1d87324303d1),volume_type_id=62b05900-93e3-4190-a88f-1d87324303d1)' {{(pid=84538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 19:09:02 devstack cinder-volume[84538]: DEBUG cinder.volume.manager [None req-01898046-19eb-4bf4-ac92-3a155a360157 tempest-CinderUnicodeTest-2074336556 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7cc235ea-0545-40ee-8baa-3023553e8ca6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 19:09:02 devstack cinder-volume[84538]: DEBUG cinder.volume.manager [None req-01898046-19eb-4bf4-ac92-3a155a360157 tempest-CinderUnicodeTest-2074336556 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7cc235ea-0545-40ee-8baa-3023553e8ca6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 19:09:02 devstack cinder-volume[84538]: DEBUG cinder.volume.manager [None req-01898046-19eb-4bf4-ac92-3a155a360157 tempest-CinderUnicodeTest-2074336556 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8a3a3323-0b37-4024-b7c2-74f5d7d7f6bd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 19:09:02 devstack cinder-volume[84538]: DEBUG cinder.volume.manager [None req-01898046-19eb-4bf4-ac92-3a155a360157 tempest-CinderUnicodeTest-2074336556 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8a3a3323-0b37-4024-b7c2-74f5d7d7f6bd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8d006829-6569-42c5-9f2c-536782b876a7', 'volume_name': 'volume-8d006829-6569-42c5-9f2c-536782b876a7', 'volume_size': 1}' {{(pid=84538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 19:09:02 devstack cinder-volume[84538]: DEBUG cinder.volume.manager [None req-01898046-19eb-4bf4-ac92-3a155a360157 tempest-CinderUnicodeTest-2074336556 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e79e7ad6-e58d-4ce8-8b6a-183e6784746d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 19:09:02 devstack cinder-volume[84538]: DEBUG cinder.volume.manager [None req-01898046-19eb-4bf4-ac92-3a155a360157 tempest-CinderUnicodeTest-2074336556 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e79e7ad6-e58d-4ce8-8b6a-183e6784746d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 19:09:02 devstack cinder-volume[84538]: DEBUG cinder.volume.manager [None req-01898046-19eb-4bf4-ac92-3a155a360157 tempest-CinderUnicodeTest-2074336556 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e70d1287-3e29-4236-bed8-f6cccee136a3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 19:09:02 devstack cinder-volume[84538]: INFO cinder.volume.flows.manager.create_volume [None req-01898046-19eb-4bf4-ac92-3a155a360157 tempest-CinderUnicodeTest-2074336556 None] Volume 8d006829-6569-42c5-9f2c-536782b876a7: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8d006829-6569-42c5-9f2c-536782b876a7', 'volume_size': 1} Apr 29 19:09:02 devstack cinder-volume[84538]: DEBUG oslo_concurrency.lockutils [None req-01898046-19eb-4bf4-ac92-3a155a360157 tempest-CinderUnicodeTest-2074336556 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 19:09:02 devstack cinder-volume[84538]: DEBUG oslo_concurrency.lockutils [None req-01898046-19eb-4bf4-ac92-3a155a360157 tempest-CinderUnicodeTest-2074336556 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=84538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 19:09:02 devstack cinder-volume[84538]: DEBUG cinder.volume.drivers.quobyte [None req-01898046-19eb-4bf4-ac92-3a155a360157 tempest-CinderUnicodeTest-2074336556 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-29T17:09:02Z,deleted=False,deleted_at=None,display_description=None,display_name='CinderUnicodeTest塵㼗‽',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8d006829-6569-42c5-9f2c-536782b876a7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0112255e70ee40f5aef023c026ac05f7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T17:09:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T17:09:02Z,use_quota=True,user_id='30fc12f62ad84d6fa0d9545602738c6f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(62b05900-93e3-4190-a88f-1d87324303d1),volume_type_id=62b05900-93e3-4190-a88f-1d87324303d1)}" {{(pid=84538) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 29 19:09:02 devstack cinder-volume[84538]: DEBUG cinder.volume.drivers.remotefs [None req-01898046-19eb-4bf4-ac92-3a155a360157 tempest-CinderUnicodeTest-2074336556 None] Creating volume 8d006829-6569-42c5-9f2c-536782b876a7 {{(pid=84538) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 29 19:09:02 devstack cinder-volume[84538]: DEBUG oslo_concurrency.lockutils [None req-01898046-19eb-4bf4-ac92-3a155a360157 tempest-CinderUnicodeTest-2074336556 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 19:09:02 devstack cinder-volume[84538]: DEBUG oslo_concurrency.lockutils [None req-01898046-19eb-4bf4-ac92-3a155a360157 tempest-CinderUnicodeTest-2074336556 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=84538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 19:09:02 devstack cinder-volume[84538]: DEBUG cinder.volume.drivers.quobyte [None req-01898046-19eb-4bf4-ac92-3a155a360157 tempest-CinderUnicodeTest-2074336556 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-34312b00-dd6d-45bb-af98-75855cea8e48': None} {{(pid=84538) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 19:09:02 devstack cinder-volume[84538]: DEBUG cinder.volume.drivers.quobyte [None req-01898046-19eb-4bf4-ac92-3a155a360157 tempest-CinderUnicodeTest-2074336556 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-34312b00-dd6d-45bb-af98-75855cea8e48'] {{(pid=84538) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 19:09:02 devstack cinder-volume[84538]: DEBUG oslo_concurrency.lockutils [None req-01898046-19eb-4bf4-ac92-3a155a360157 tempest-CinderUnicodeTest-2074336556 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=84538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 19:09:02 devstack cinder-volume[84538]: DEBUG cinder.volume.drivers.quobyte [None req-01898046-19eb-4bf4-ac92-3a155a360157 tempest-CinderUnicodeTest-2074336556 None] Selected osci02.corp.quobyte.com/cinder-vol-34312b00-dd6d-45bb-af98-75855cea8e48 as target Quobyte volume. {{(pid=84538) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 29 19:09:02 devstack cinder-volume[84538]: INFO cinder.volume.drivers.remotefs [None req-01898046-19eb-4bf4-ac92-3a155a360157 tempest-CinderUnicodeTest-2074336556 None] casted to osci02.corp.quobyte.com/cinder-vol-34312b00-dd6d-45bb-af98-75855cea8e48 Apr 29 19:09:02 devstack cinder-volume[84538]: DEBUG oslo_concurrency.processutils [None req-01898046-19eb-4bf4-ac92-3a155a360157 tempest-CinderUnicodeTest-2074336556 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-8d006829-6569-42c5-9f2c-536782b876a7 1073741824 {{(pid=84538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 19:09:02 devstack sudo[93812]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-8d006829-6569-42c5-9f2c-536782b876a7 1073741824 Apr 29 19:09:02 devstack sudo[93812]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 19:09:02 devstack cinder-volume[84538]: DEBUG cinder.volume.flows.manager.create_volume [None req-30df80ef-1951-4ff2-8404-334ce6277014 tempest-CreateVolumesFromImageTest-147990199 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84538) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Apr 29 19:09:02 devstack cinder-volume[84538]: DEBUG cinder.volume.manager [None req-30df80ef-1951-4ff2-8404-334ce6277014 tempest-CreateVolumesFromImageTest-147990199 None] Flow 'volume_create_manager' (538dc40c-b1ef-473c-9e2a-a45daf7c7fc9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84538) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 19:09:02 devstack cinder-volume[84538]: DEBUG cinder.volume.manager [None req-30df80ef-1951-4ff2-8404-334ce6277014 tempest-CreateVolumesFromImageTest-147990199 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (16bd8cdc-75e5-4843-b15e-cfbd4e74ab29) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 19:09:02 devstack cinder-volume[84538]: DEBUG cinder.volume.manager [None req-30df80ef-1951-4ff2-8404-334ce6277014 tempest-CreateVolumesFromImageTest-147990199 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (16bd8cdc-75e5-4843-b15e-cfbd4e74ab29) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-29T17:09:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1372711853',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=680a4262-5ad6-4765-b175-84c3356ee07d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='617a571331744ff28987b9c318d185ff',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T17:09:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T17:09:03Z,use_quota=True,user_id='39beec79f42b4cd4a647630326703bef',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(62b05900-93e3-4190-a88f-1d87324303d1),volume_type_id=62b05900-93e3-4190-a88f-1d87324303d1)' {{(pid=84538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 19:09:02 devstack cinder-volume[84538]: DEBUG cinder.volume.manager [None req-30df80ef-1951-4ff2-8404-334ce6277014 tempest-CreateVolumesFromImageTest-147990199 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (176ed746-1146-4d0f-8a12-89492abbb556) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 19:09:02 devstack cinder-volume[84538]: DEBUG cinder.volume.manager [None req-30df80ef-1951-4ff2-8404-334ce6277014 tempest-CreateVolumesFromImageTest-147990199 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (176ed746-1146-4d0f-8a12-89492abbb556) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 19:09:02 devstack cinder-volume[84538]: DEBUG cinder.volume.manager [None req-30df80ef-1951-4ff2-8404-334ce6277014 tempest-CreateVolumesFromImageTest-147990199 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (38f890b0-e3bc-4529-9686-53b28bc426ec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 19:09:02 devstack cinder-volume[84538]: DEBUG cinder.volume.manager [None req-30df80ef-1951-4ff2-8404-334ce6277014 tempest-CreateVolumesFromImageTest-147990199 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (38f890b0-e3bc-4529-9686-53b28bc426ec) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '680a4262-5ad6-4765-b175-84c3356ee07d', 'volume_name': 'volume-680a4262-5ad6-4765-b175-84c3356ee07d', 'volume_size': 1}' {{(pid=84538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 19:09:02 devstack cinder-volume[84538]: DEBUG cinder.volume.manager [None req-30df80ef-1951-4ff2-8404-334ce6277014 tempest-CreateVolumesFromImageTest-147990199 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cf171c89-5e51-44ed-978e-156e134094ac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 19:09:02 devstack cinder-volume[84538]: DEBUG cinder.volume.manager [None req-30df80ef-1951-4ff2-8404-334ce6277014 tempest-CreateVolumesFromImageTest-147990199 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cf171c89-5e51-44ed-978e-156e134094ac) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 19:09:02 devstack cinder-volume[84538]: DEBUG cinder.volume.manager [None req-30df80ef-1951-4ff2-8404-334ce6277014 tempest-CreateVolumesFromImageTest-147990199 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4aac83d7-5886-4a76-b804-3a569f9b1815) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 19:09:02 devstack cinder-volume[84538]: INFO cinder.volume.flows.manager.create_volume [None req-30df80ef-1951-4ff2-8404-334ce6277014 tempest-CreateVolumesFromImageTest-147990199 None] Volume 680a4262-5ad6-4765-b175-84c3356ee07d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-680a4262-5ad6-4765-b175-84c3356ee07d', 'volume_size': 1} Apr 29 19:09:02 devstack cinder-volume[84538]: DEBUG oslo_concurrency.lockutils [None req-30df80ef-1951-4ff2-8404-334ce6277014 tempest-CreateVolumesFromImageTest-147990199 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 19:09:03 devstack cinder-volume[84538]: DEBUG cinder.volume.flows.manager.create_volume [None req-b8bcece0-d6d7-4f8e-99a6-d9aa6a177c25 tempest-VolumeDependencyTests-868648422 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84538) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Apr 29 19:09:03 devstack cinder-volume[84538]: DEBUG cinder.volume.manager [None req-b8bcece0-d6d7-4f8e-99a6-d9aa6a177c25 tempest-VolumeDependencyTests-868648422 None] Flow 'volume_create_manager' (fc78de28-28df-4bc8-8d65-bed3c179ea8b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84538) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 19:09:03 devstack cinder-volume[84538]: DEBUG cinder.volume.manager [None req-b8bcece0-d6d7-4f8e-99a6-d9aa6a177c25 tempest-VolumeDependencyTests-868648422 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e778b111-0cbe-432a-aa97-59053db6d575) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 19:09:03 devstack cinder-volume[84538]: DEBUG cinder.volume.manager [None req-b8bcece0-d6d7-4f8e-99a6-d9aa6a177c25 tempest-VolumeDependencyTests-868648422 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e778b111-0cbe-432a-aa97-59053db6d575) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-29T17:09:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-347254035',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a86ac317-c9ef-4185-8a8c-2cb05a50fdf9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5af39d55694c40d7b5395e79cb6623fa',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T17:09:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T17:09:03Z,use_quota=True,user_id='d13112c160bd44458a48dc463fb78a07',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(62b05900-93e3-4190-a88f-1d87324303d1),volume_type_id=62b05900-93e3-4190-a88f-1d87324303d1)' {{(pid=84538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 19:09:03 devstack cinder-volume[84538]: DEBUG cinder.volume.manager [None req-b8bcece0-d6d7-4f8e-99a6-d9aa6a177c25 tempest-VolumeDependencyTests-868648422 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ac096222-9be9-4903-89de-004e5c84e38f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 19:09:03 devstack cinder-volume[84538]: DEBUG cinder.volume.manager [None req-b8bcece0-d6d7-4f8e-99a6-d9aa6a177c25 tempest-VolumeDependencyTests-868648422 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ac096222-9be9-4903-89de-004e5c84e38f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 19:09:03 devstack cinder-volume[84538]: DEBUG cinder.volume.manager [None req-b8bcece0-d6d7-4f8e-99a6-d9aa6a177c25 tempest-VolumeDependencyTests-868648422 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5cce4a0d-411e-44ab-ac79-cb932fe4db0c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 19:09:03 devstack cinder-volume[84538]: DEBUG cinder.volume.manager [None req-b8bcece0-d6d7-4f8e-99a6-d9aa6a177c25 tempest-VolumeDependencyTests-868648422 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5cce4a0d-411e-44ab-ac79-cb932fe4db0c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a86ac317-c9ef-4185-8a8c-2cb05a50fdf9', 'volume_name': 'volume-a86ac317-c9ef-4185-8a8c-2cb05a50fdf9', 'volume_size': 1}' {{(pid=84538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 19:09:03 devstack cinder-volume[84538]: DEBUG cinder.volume.manager [None req-b8bcece0-d6d7-4f8e-99a6-d9aa6a177c25 tempest-VolumeDependencyTests-868648422 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (77255b98-13a1-470c-ad7b-c7d1c2b6bc9e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 19:09:03 devstack cinder-volume[84538]: DEBUG cinder.volume.manager [None req-b8bcece0-d6d7-4f8e-99a6-d9aa6a177c25 tempest-VolumeDependencyTests-868648422 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (77255b98-13a1-470c-ad7b-c7d1c2b6bc9e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 19:09:03 devstack cinder-volume[84538]: DEBUG cinder.volume.manager [None req-b8bcece0-d6d7-4f8e-99a6-d9aa6a177c25 tempest-VolumeDependencyTests-868648422 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d3cd5003-d37d-4d75-8f8f-c7240bc65f65) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 19:09:03 devstack cinder-volume[84538]: INFO cinder.volume.flows.manager.create_volume [None req-b8bcece0-d6d7-4f8e-99a6-d9aa6a177c25 tempest-VolumeDependencyTests-868648422 None] Volume a86ac317-c9ef-4185-8a8c-2cb05a50fdf9: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a86ac317-c9ef-4185-8a8c-2cb05a50fdf9', 'volume_size': 1} Apr 29 19:09:03 devstack cinder-volume[84538]: DEBUG oslo_concurrency.lockutils [None req-b8bcece0-d6d7-4f8e-99a6-d9aa6a177c25 tempest-VolumeDependencyTests-868648422 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 19:09:03 devstack cinder-volume[84538]: DEBUG cinder.volume.flows.manager.create_volume [None req-aade417b-1466-4c68-8266-4eaeeeba71f0 tempest-CreateVolumesFromSnapshotTest-1938046858 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84538) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Apr 29 19:09:03 devstack cinder-volume[84538]: DEBUG cinder.volume.manager [None req-aade417b-1466-4c68-8266-4eaeeeba71f0 tempest-CreateVolumesFromSnapshotTest-1938046858 None] Flow 'volume_create_manager' (07bfdfa3-00c0-4a8a-847c-61325d82d3c8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84538) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 19:09:03 devstack cinder-volume[84538]: DEBUG cinder.volume.manager [None req-aade417b-1466-4c68-8266-4eaeeeba71f0 tempest-CreateVolumesFromSnapshotTest-1938046858 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2e69e20f-caa3-4d0b-8279-b7930b11de77) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 19:09:03 devstack cinder-volume[84538]: DEBUG cinder.volume.manager [None req-aade417b-1466-4c68-8266-4eaeeeba71f0 tempest-CreateVolumesFromSnapshotTest-1938046858 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2e69e20f-caa3-4d0b-8279-b7930b11de77) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-29T17:09:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1043265194',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2d2109ce-37b6-478b-bb3f-990749f03fc6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='43976132c7c54fdaa06722c210f732f0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T17:09:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T17:09:03Z,use_quota=True,user_id='6ffeea78e69b4e0d8fe06ce426cac057',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(62b05900-93e3-4190-a88f-1d87324303d1),volume_type_id=62b05900-93e3-4190-a88f-1d87324303d1)' {{(pid=84538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 19:09:03 devstack cinder-volume[84538]: DEBUG cinder.volume.manager [None req-aade417b-1466-4c68-8266-4eaeeeba71f0 tempest-CreateVolumesFromSnapshotTest-1938046858 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (63c763cc-b318-4332-878c-6d3ae52cad0f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 19:09:03 devstack cinder-volume[84538]: DEBUG cinder.volume.manager [None req-aade417b-1466-4c68-8266-4eaeeeba71f0 tempest-CreateVolumesFromSnapshotTest-1938046858 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (63c763cc-b318-4332-878c-6d3ae52cad0f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 19:09:03 devstack cinder-volume[84538]: DEBUG cinder.volume.manager [None req-aade417b-1466-4c68-8266-4eaeeeba71f0 tempest-CreateVolumesFromSnapshotTest-1938046858 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2db9af5a-c551-44d7-8230-126891df77ab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 19:09:03 devstack cinder-volume[84538]: DEBUG cinder.volume.manager [None req-aade417b-1466-4c68-8266-4eaeeeba71f0 tempest-CreateVolumesFromSnapshotTest-1938046858 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2db9af5a-c551-44d7-8230-126891df77ab) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2d2109ce-37b6-478b-bb3f-990749f03fc6', 'volume_name': 'volume-2d2109ce-37b6-478b-bb3f-990749f03fc6', 'volume_size': 1}' {{(pid=84538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 19:09:03 devstack cinder-volume[84538]: DEBUG cinder.volume.manager [None req-aade417b-1466-4c68-8266-4eaeeeba71f0 tempest-CreateVolumesFromSnapshotTest-1938046858 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (25c7f33c-c1ac-4065-96a5-4b1dd85053f6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 19:09:03 devstack cinder-volume[84538]: DEBUG cinder.volume.manager [None req-aade417b-1466-4c68-8266-4eaeeeba71f0 tempest-CreateVolumesFromSnapshotTest-1938046858 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (25c7f33c-c1ac-4065-96a5-4b1dd85053f6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 19:09:03 devstack cinder-volume[84538]: DEBUG cinder.volume.manager [None req-aade417b-1466-4c68-8266-4eaeeeba71f0 tempest-CreateVolumesFromSnapshotTest-1938046858 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b4e89037-7adc-45da-8045-c63c1e74fdf1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 19:09:03 devstack cinder-volume[84538]: INFO cinder.volume.flows.manager.create_volume [None req-aade417b-1466-4c68-8266-4eaeeeba71f0 tempest-CreateVolumesFromSnapshotTest-1938046858 None] Volume 2d2109ce-37b6-478b-bb3f-990749f03fc6: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2d2109ce-37b6-478b-bb3f-990749f03fc6', 'volume_size': 1} Apr 29 19:09:03 devstack cinder-volume[84538]: DEBUG oslo_concurrency.lockutils [None req-aade417b-1466-4c68-8266-4eaeeeba71f0 tempest-CreateVolumesFromSnapshotTest-1938046858 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 19:09:03 devstack cinder-volume[84538]: DEBUG cinder.volume.flows.manager.create_volume [None req-22a304f1-c6f9-4fc3-9d5c-b4e6320923a5 tempest-CreateVolumesFromImageTest-147990199 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84538) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Apr 29 19:09:03 devstack cinder-volume[84538]: DEBUG cinder.volume.manager [None req-22a304f1-c6f9-4fc3-9d5c-b4e6320923a5 tempest-CreateVolumesFromImageTest-147990199 None] Flow 'volume_create_manager' (18c89d81-c14f-4d42-aaf4-0cec0f9aea8a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84538) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 19:09:03 devstack cinder-volume[84538]: DEBUG cinder.volume.manager [None req-22a304f1-c6f9-4fc3-9d5c-b4e6320923a5 tempest-CreateVolumesFromImageTest-147990199 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f1e923db-8747-457d-be82-eb0b2137e86b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 19:09:03 devstack cinder-volume[84538]: DEBUG cinder.volume.manager [None req-22a304f1-c6f9-4fc3-9d5c-b4e6320923a5 tempest-CreateVolumesFromImageTest-147990199 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f1e923db-8747-457d-be82-eb0b2137e86b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-29T17:09:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1157047808',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c19cf185-e537-4815-9d41-e08128d05c40,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='617a571331744ff28987b9c318d185ff',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T17:09:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T17:09:03Z,use_quota=True,user_id='39beec79f42b4cd4a647630326703bef',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(62b05900-93e3-4190-a88f-1d87324303d1),volume_type_id=62b05900-93e3-4190-a88f-1d87324303d1)' {{(pid=84538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 19:09:03 devstack cinder-volume[84538]: DEBUG cinder.volume.manager [None req-22a304f1-c6f9-4fc3-9d5c-b4e6320923a5 tempest-CreateVolumesFromImageTest-147990199 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b31f97e0-0363-4f9e-9d25-ad356011a091) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 19:09:03 devstack cinder-volume[84538]: DEBUG cinder.volume.manager [None req-22a304f1-c6f9-4fc3-9d5c-b4e6320923a5 tempest-CreateVolumesFromImageTest-147990199 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b31f97e0-0363-4f9e-9d25-ad356011a091) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 19:09:03 devstack cinder-volume[84538]: DEBUG cinder.volume.manager [None req-22a304f1-c6f9-4fc3-9d5c-b4e6320923a5 tempest-CreateVolumesFromImageTest-147990199 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (15953c49-588c-4faf-971c-210c2fdaaa68) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 19:09:03 devstack cinder-volume[84538]: DEBUG cinder.volume.manager [None req-22a304f1-c6f9-4fc3-9d5c-b4e6320923a5 tempest-CreateVolumesFromImageTest-147990199 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (15953c49-588c-4faf-971c-210c2fdaaa68) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c19cf185-e537-4815-9d41-e08128d05c40', 'volume_name': 'volume-c19cf185-e537-4815-9d41-e08128d05c40', 'volume_size': 1}' {{(pid=84538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 19:09:03 devstack cinder-volume[84538]: DEBUG cinder.volume.manager [None req-22a304f1-c6f9-4fc3-9d5c-b4e6320923a5 tempest-CreateVolumesFromImageTest-147990199 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bad4d1a1-e3cb-40c5-87fd-27a196907daf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 19:09:03 devstack cinder-volume[84538]: DEBUG cinder.volume.manager [None req-22a304f1-c6f9-4fc3-9d5c-b4e6320923a5 tempest-CreateVolumesFromImageTest-147990199 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bad4d1a1-e3cb-40c5-87fd-27a196907daf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 19:09:03 devstack cinder-volume[84538]: DEBUG cinder.volume.manager [None req-22a304f1-c6f9-4fc3-9d5c-b4e6320923a5 tempest-CreateVolumesFromImageTest-147990199 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0d9277bf-e986-422b-b367-fb8d65b27b74) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 19:09:03 devstack cinder-volume[84538]: INFO cinder.volume.flows.manager.create_volume [None req-22a304f1-c6f9-4fc3-9d5c-b4e6320923a5 tempest-CreateVolumesFromImageTest-147990199 None] Volume c19cf185-e537-4815-9d41-e08128d05c40: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c19cf185-e537-4815-9d41-e08128d05c40', 'volume_size': 1} Apr 29 19:09:03 devstack cinder-volume[84538]: DEBUG oslo_concurrency.lockutils [None req-22a304f1-c6f9-4fc3-9d5c-b4e6320923a5 tempest-CreateVolumesFromImageTest-147990199 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 19:09:03 devstack sudo[93812]: pam_unix(sudo:session): session closed for user root Apr 29 19:09:03 devstack cinder-volume[84538]: DEBUG oslo_concurrency.processutils [None req-01898046-19eb-4bf4-ac92-3a155a360157 tempest-CinderUnicodeTest-2074336556 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-8d006829-6569-42c5-9f2c-536782b876a7 1073741824" returned: 0 in 0.991s {{(pid=84538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 19:09:03 devstack cinder-volume[84538]: DEBUG oslo_concurrency.processutils [None req-01898046-19eb-4bf4-ac92-3a155a360157 tempest-CinderUnicodeTest-2074336556 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-8d006829-6569-42c5-9f2c-536782b876a7 {{(pid=84538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 19:09:03 devstack sudo[93818]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-8d006829-6569-42c5-9f2c-536782b876a7 Apr 29 19:09:03 devstack sudo[93818]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 19:09:03 devstack cinder-volume[84538]: DEBUG cinder.volume.flows.manager.create_volume [None req-c467ce28-759b-4883-a2db-18cf7e07e850 tempest-CreateVolumesFromImageTest-147990199 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84538) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Apr 29 19:09:03 devstack cinder-volume[84538]: DEBUG cinder.volume.manager [None req-c467ce28-759b-4883-a2db-18cf7e07e850 tempest-CreateVolumesFromImageTest-147990199 None] Flow 'volume_create_manager' (00b3a4c2-3069-4a71-a20b-21ebed528405) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84538) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 19:09:03 devstack cinder-volume[84538]: DEBUG cinder.volume.manager [None req-c467ce28-759b-4883-a2db-18cf7e07e850 tempest-CreateVolumesFromImageTest-147990199 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (53f1f5df-a59e-4828-9f0e-71ca32a697e5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 19:09:03 devstack cinder-volume[84538]: DEBUG cinder.volume.manager [None req-c467ce28-759b-4883-a2db-18cf7e07e850 tempest-CreateVolumesFromImageTest-147990199 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (53f1f5df-a59e-4828-9f0e-71ca32a697e5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-29T17:09:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1843425052',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b9da96b0-3fc4-4a15-bc91-859ba280cdd5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='617a571331744ff28987b9c318d185ff',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T17:09:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T17:09:04Z,use_quota=True,user_id='39beec79f42b4cd4a647630326703bef',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(62b05900-93e3-4190-a88f-1d87324303d1),volume_type_id=62b05900-93e3-4190-a88f-1d87324303d1)' {{(pid=84538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 19:09:03 devstack cinder-volume[84538]: DEBUG cinder.volume.manager [None req-c467ce28-759b-4883-a2db-18cf7e07e850 tempest-CreateVolumesFromImageTest-147990199 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5ab7319e-1f74-4a7b-a9dd-41886be0457d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 19:09:03 devstack cinder-volume[84538]: DEBUG cinder.volume.manager [None req-c467ce28-759b-4883-a2db-18cf7e07e850 tempest-CreateVolumesFromImageTest-147990199 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5ab7319e-1f74-4a7b-a9dd-41886be0457d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 19:09:03 devstack cinder-volume[84538]: DEBUG cinder.volume.manager [None req-c467ce28-759b-4883-a2db-18cf7e07e850 tempest-CreateVolumesFromImageTest-147990199 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b1eeb783-f98d-45f3-9209-e444472cc15f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 19:09:03 devstack cinder-volume[84538]: DEBUG cinder.volume.manager [None req-c467ce28-759b-4883-a2db-18cf7e07e850 tempest-CreateVolumesFromImageTest-147990199 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b1eeb783-f98d-45f3-9209-e444472cc15f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b9da96b0-3fc4-4a15-bc91-859ba280cdd5', 'volume_name': 'volume-b9da96b0-3fc4-4a15-bc91-859ba280cdd5', 'volume_size': 1}' {{(pid=84538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 19:09:03 devstack cinder-volume[84538]: DEBUG cinder.volume.manager [None req-c467ce28-759b-4883-a2db-18cf7e07e850 tempest-CreateVolumesFromImageTest-147990199 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (31584613-7763-48c3-8f08-6032aa414410) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 19:09:03 devstack cinder-volume[84538]: DEBUG cinder.volume.manager [None req-c467ce28-759b-4883-a2db-18cf7e07e850 tempest-CreateVolumesFromImageTest-147990199 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (31584613-7763-48c3-8f08-6032aa414410) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 19:09:03 devstack cinder-volume[84538]: DEBUG cinder.volume.manager [None req-c467ce28-759b-4883-a2db-18cf7e07e850 tempest-CreateVolumesFromImageTest-147990199 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d32284e3-61c7-42f2-a52d-54d24d88ea5f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 19:09:03 devstack cinder-volume[84538]: INFO cinder.volume.flows.manager.create_volume [None req-c467ce28-759b-4883-a2db-18cf7e07e850 tempest-CreateVolumesFromImageTest-147990199 None] Volume b9da96b0-3fc4-4a15-bc91-859ba280cdd5: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b9da96b0-3fc4-4a15-bc91-859ba280cdd5', 'volume_size': 1} Apr 29 19:09:03 devstack cinder-volume[84538]: DEBUG oslo_concurrency.lockutils [None req-c467ce28-759b-4883-a2db-18cf7e07e850 tempest-CreateVolumesFromImageTest-147990199 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 19:09:04 devstack cinder-volume[84538]: DEBUG cinder.volume.flows.manager.create_volume [None req-9a28839b-144e-4d0b-9849-013c340c66be tempest-CreateVolumesFromImageTest-147990199 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84538) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Apr 29 19:09:04 devstack cinder-volume[84538]: DEBUG cinder.volume.manager [None req-9a28839b-144e-4d0b-9849-013c340c66be tempest-CreateVolumesFromImageTest-147990199 None] Flow 'volume_create_manager' (db3289db-e6d4-4bd3-ac2c-ad8d3bf78863) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84538) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 19:09:04 devstack cinder-volume[84538]: DEBUG cinder.volume.manager [None req-9a28839b-144e-4d0b-9849-013c340c66be tempest-CreateVolumesFromImageTest-147990199 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (062bac51-e124-4edb-9cf0-22a4ac8aed45) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 19:09:04 devstack cinder-volume[84538]: DEBUG cinder.volume.manager [None req-9a28839b-144e-4d0b-9849-013c340c66be tempest-CreateVolumesFromImageTest-147990199 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (062bac51-e124-4edb-9cf0-22a4ac8aed45) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-29T17:09:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-834397394',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c61d2277-9a07-44b4-b6bd-cb4bd478c2d2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='617a571331744ff28987b9c318d185ff',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T17:09:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T17:09:04Z,use_quota=True,user_id='39beec79f42b4cd4a647630326703bef',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(62b05900-93e3-4190-a88f-1d87324303d1),volume_type_id=62b05900-93e3-4190-a88f-1d87324303d1)' {{(pid=84538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 19:09:04 devstack sudo[93818]: pam_unix(sudo:session): session closed for user root Apr 29 19:09:04 devstack cinder-volume[84538]: DEBUG cinder.volume.manager [None req-9a28839b-144e-4d0b-9849-013c340c66be tempest-CreateVolumesFromImageTest-147990199 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c7bda179-2904-4bc7-9698-72af8f7ede4e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 19:09:04 devstack cinder-volume[84538]: DEBUG cinder.volume.manager [None req-9a28839b-144e-4d0b-9849-013c340c66be tempest-CreateVolumesFromImageTest-147990199 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c7bda179-2904-4bc7-9698-72af8f7ede4e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 19:09:04 devstack cinder-volume[84538]: DEBUG cinder.volume.manager [None req-9a28839b-144e-4d0b-9849-013c340c66be tempest-CreateVolumesFromImageTest-147990199 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8fc15272-ebcd-4f34-8972-053b885d185a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 19:09:04 devstack cinder-volume[84538]: DEBUG cinder.volume.manager [None req-9a28839b-144e-4d0b-9849-013c340c66be tempest-CreateVolumesFromImageTest-147990199 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8fc15272-ebcd-4f34-8972-053b885d185a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c61d2277-9a07-44b4-b6bd-cb4bd478c2d2', 'volume_name': 'volume-c61d2277-9a07-44b4-b6bd-cb4bd478c2d2', 'volume_size': 1}' {{(pid=84538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 19:09:04 devstack cinder-volume[84538]: DEBUG cinder.volume.manager [None req-9a28839b-144e-4d0b-9849-013c340c66be tempest-CreateVolumesFromImageTest-147990199 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4ee5ba67-5703-4140-b6e7-9377d01f1927) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 19:09:04 devstack cinder-volume[84538]: DEBUG cinder.volume.manager [None req-9a28839b-144e-4d0b-9849-013c340c66be tempest-CreateVolumesFromImageTest-147990199 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4ee5ba67-5703-4140-b6e7-9377d01f1927) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 19:09:04 devstack cinder-volume[84538]: DEBUG cinder.volume.manager [None req-9a28839b-144e-4d0b-9849-013c340c66be tempest-CreateVolumesFromImageTest-147990199 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f4f9d092-b590-470f-ae42-c0b7109328ea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 19:09:04 devstack cinder-volume[84538]: INFO cinder.volume.flows.manager.create_volume [None req-9a28839b-144e-4d0b-9849-013c340c66be tempest-CreateVolumesFromImageTest-147990199 None] Volume c61d2277-9a07-44b4-b6bd-cb4bd478c2d2: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c61d2277-9a07-44b4-b6bd-cb4bd478c2d2', 'volume_size': 1} Apr 29 19:09:04 devstack cinder-volume[84538]: DEBUG oslo_concurrency.lockutils [None req-9a28839b-144e-4d0b-9849-013c340c66be tempest-CreateVolumesFromImageTest-147990199 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 19:09:04 devstack cinder-volume[84538]: DEBUG oslo_concurrency.processutils [None req-01898046-19eb-4bf4-ac92-3a155a360157 tempest-CinderUnicodeTest-2074336556 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-8d006829-6569-42c5-9f2c-536782b876a7" returned: 0 in 0.727s {{(pid=84538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 19:09:04 devstack cinder-volume[84538]: DEBUG cinder.volume.drivers.quobyte [None req-01898046-19eb-4bf4-ac92-3a155a360157 tempest-CinderUnicodeTest-2074336556 None] <== create_volume: return (1763ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-34312b00-dd6d-45bb-af98-75855cea8e48'} {{(pid=84538) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 29 19:09:04 devstack cinder-volume[84538]: DEBUG oslo_concurrency.lockutils [None req-01898046-19eb-4bf4-ac92-3a155a360157 tempest-CinderUnicodeTest-2074336556 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.767s {{(pid=84538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 19:09:04 devstack cinder-volume[84538]: DEBUG oslo_concurrency.lockutils [None req-30df80ef-1951-4ff2-8404-334ce6277014 tempest-CreateVolumesFromImageTest-147990199 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.590s {{(pid=84538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 19:09:04 devstack cinder-volume[84538]: DEBUG cinder.volume.drivers.quobyte [None req-30df80ef-1951-4ff2-8404-334ce6277014 tempest-CreateVolumesFromImageTest-147990199 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-29T17:09:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1372711853',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=680a4262-5ad6-4765-b175-84c3356ee07d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='617a571331744ff28987b9c318d185ff',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T17:09:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T17:09:03Z,use_quota=True,user_id='39beec79f42b4cd4a647630326703bef',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(62b05900-93e3-4190-a88f-1d87324303d1),volume_type_id=62b05900-93e3-4190-a88f-1d87324303d1)}" {{(pid=84538) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 29 19:09:04 devstack cinder-volume[84538]: DEBUG cinder.volume.drivers.remotefs [None req-30df80ef-1951-4ff2-8404-334ce6277014 tempest-CreateVolumesFromImageTest-147990199 None] Creating volume 680a4262-5ad6-4765-b175-84c3356ee07d {{(pid=84538) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 29 19:09:04 devstack cinder-volume[84538]: DEBUG oslo_concurrency.lockutils [None req-30df80ef-1951-4ff2-8404-334ce6277014 tempest-CreateVolumesFromImageTest-147990199 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 19:09:04 devstack cinder-volume[84538]: DEBUG oslo_concurrency.lockutils [None req-30df80ef-1951-4ff2-8404-334ce6277014 tempest-CreateVolumesFromImageTest-147990199 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=84538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 19:09:04 devstack cinder-volume[84538]: DEBUG cinder.volume.drivers.quobyte [None req-30df80ef-1951-4ff2-8404-334ce6277014 tempest-CreateVolumesFromImageTest-147990199 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-34312b00-dd6d-45bb-af98-75855cea8e48': None} {{(pid=84538) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 19:09:04 devstack cinder-volume[84538]: DEBUG cinder.volume.drivers.quobyte [None req-30df80ef-1951-4ff2-8404-334ce6277014 tempest-CreateVolumesFromImageTest-147990199 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-34312b00-dd6d-45bb-af98-75855cea8e48'] {{(pid=84538) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 19:09:04 devstack cinder-volume[84538]: DEBUG oslo_concurrency.lockutils [None req-30df80ef-1951-4ff2-8404-334ce6277014 tempest-CreateVolumesFromImageTest-147990199 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=84538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 19:09:04 devstack cinder-volume[84538]: DEBUG cinder.volume.drivers.quobyte [None req-30df80ef-1951-4ff2-8404-334ce6277014 tempest-CreateVolumesFromImageTest-147990199 None] Selected osci02.corp.quobyte.com/cinder-vol-34312b00-dd6d-45bb-af98-75855cea8e48 as target Quobyte volume. {{(pid=84538) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 29 19:09:04 devstack cinder-volume[84538]: INFO cinder.volume.drivers.remotefs [None req-30df80ef-1951-4ff2-8404-334ce6277014 tempest-CreateVolumesFromImageTest-147990199 None] casted to osci02.corp.quobyte.com/cinder-vol-34312b00-dd6d-45bb-af98-75855cea8e48 Apr 29 19:09:04 devstack cinder-volume[84538]: DEBUG oslo_concurrency.processutils [None req-30df80ef-1951-4ff2-8404-334ce6277014 tempest-CreateVolumesFromImageTest-147990199 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-680a4262-5ad6-4765-b175-84c3356ee07d 1073741824 {{(pid=84538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 19:09:04 devstack cinder-volume[84538]: DEBUG cinder.volume.manager [None req-01898046-19eb-4bf4-ac92-3a155a360157 tempest-CinderUnicodeTest-2074336556 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e70d1287-3e29-4236-bed8-f6cccee136a3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8d006829-6569-42c5-9f2c-536782b876a7', 'volume_size': 1}' {{(pid=84538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 19:09:04 devstack sudo[93821]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-680a4262-5ad6-4765-b175-84c3356ee07d 1073741824 Apr 29 19:09:04 devstack sudo[93821]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 19:09:04 devstack cinder-volume[84538]: DEBUG cinder.volume.manager [None req-01898046-19eb-4bf4-ac92-3a155a360157 tempest-CinderUnicodeTest-2074336556 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (47cd5e28-02c9-43ee-bb6e-dcd20ccd7f44) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 19:09:04 devstack cinder-volume[84538]: INFO cinder.volume.flows.manager.create_volume [None req-01898046-19eb-4bf4-ac92-3a155a360157 tempest-CinderUnicodeTest-2074336556 None] Volume volume-8d006829-6569-42c5-9f2c-536782b876a7 (8d006829-6569-42c5-9f2c-536782b876a7): created successfully Apr 29 19:09:04 devstack cinder-volume[84538]: DEBUG cinder.volume.manager [None req-01898046-19eb-4bf4-ac92-3a155a360157 tempest-CinderUnicodeTest-2074336556 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (47cd5e28-02c9-43ee-bb6e-dcd20ccd7f44) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 19:09:04 devstack cinder-volume[84538]: DEBUG cinder.volume.manager [None req-01898046-19eb-4bf4-ac92-3a155a360157 tempest-CinderUnicodeTest-2074336556 None] Flow 'volume_create_manager' (d969017f-415e-4302-84bb-be01d4e1554c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84538) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 19:09:04 devstack cinder-volume[84538]: INFO cinder.volume.manager [None req-01898046-19eb-4bf4-ac92-3a155a360157 tempest-CinderUnicodeTest-2074336556 None] Created volume successfully. Apr 29 19:09:04 devstack cinder-volume[84538]: DEBUG cinder.volume.flows.manager.create_volume [None req-87cf167c-3963-44af-bf10-fa200530baa3 tempest-CreateVolumesFromImageTest-147990199 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84538) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Apr 29 19:09:04 devstack cinder-volume[84538]: DEBUG cinder.volume.manager [None req-87cf167c-3963-44af-bf10-fa200530baa3 tempest-CreateVolumesFromImageTest-147990199 None] Flow 'volume_create_manager' (59492a5e-8d66-4005-b506-8552c9886d7a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84538) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 19:09:04 devstack cinder-volume[84538]: DEBUG cinder.volume.manager [None req-87cf167c-3963-44af-bf10-fa200530baa3 tempest-CreateVolumesFromImageTest-147990199 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d741f011-9656-4956-8fb9-f69a95b2a167) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 19:09:04 devstack cinder-volume[84538]: DEBUG cinder.volume.manager [None req-87cf167c-3963-44af-bf10-fa200530baa3 tempest-CreateVolumesFromImageTest-147990199 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d741f011-9656-4956-8fb9-f69a95b2a167) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-29T17:09:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-605038978',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=07c46871-22bc-45a0-92d9-be41530b11cd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='617a571331744ff28987b9c318d185ff',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T17:09:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T17:09:05Z,use_quota=True,user_id='39beec79f42b4cd4a647630326703bef',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(62b05900-93e3-4190-a88f-1d87324303d1),volume_type_id=62b05900-93e3-4190-a88f-1d87324303d1)' {{(pid=84538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 19:09:04 devstack cinder-volume[84538]: DEBUG cinder.volume.manager [None req-87cf167c-3963-44af-bf10-fa200530baa3 tempest-CreateVolumesFromImageTest-147990199 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (592d7772-d0d7-4cdd-89cd-27837cb5ca96) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 19:09:04 devstack cinder-volume[84538]: DEBUG cinder.volume.manager [None req-87cf167c-3963-44af-bf10-fa200530baa3 tempest-CreateVolumesFromImageTest-147990199 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (592d7772-d0d7-4cdd-89cd-27837cb5ca96) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 19:09:04 devstack cinder-volume[84538]: DEBUG cinder.volume.manager [None req-87cf167c-3963-44af-bf10-fa200530baa3 tempest-CreateVolumesFromImageTest-147990199 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (35d3d4de-a968-4111-a68e-7d98dd07ab75) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 19:09:04 devstack cinder-volume[84538]: DEBUG cinder.volume.manager [None req-87cf167c-3963-44af-bf10-fa200530baa3 tempest-CreateVolumesFromImageTest-147990199 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (35d3d4de-a968-4111-a68e-7d98dd07ab75) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '07c46871-22bc-45a0-92d9-be41530b11cd', 'volume_name': 'volume-07c46871-22bc-45a0-92d9-be41530b11cd', 'volume_size': 1}' {{(pid=84538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 19:09:04 devstack cinder-volume[84538]: DEBUG cinder.volume.manager [None req-87cf167c-3963-44af-bf10-fa200530baa3 tempest-CreateVolumesFromImageTest-147990199 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0790a0ae-92f3-4924-bdf8-df2f2112d0be) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 19:09:04 devstack cinder-volume[84538]: DEBUG cinder.volume.manager [None req-87cf167c-3963-44af-bf10-fa200530baa3 tempest-CreateVolumesFromImageTest-147990199 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0790a0ae-92f3-4924-bdf8-df2f2112d0be) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 19:09:04 devstack cinder-volume[84538]: DEBUG cinder.volume.manager [None req-87cf167c-3963-44af-bf10-fa200530baa3 tempest-CreateVolumesFromImageTest-147990199 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f23aa9d0-9d00-4277-879b-c59a18c227a9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 19:09:04 devstack cinder-volume[84538]: INFO cinder.volume.flows.manager.create_volume [None req-87cf167c-3963-44af-bf10-fa200530baa3 tempest-CreateVolumesFromImageTest-147990199 None] Volume 07c46871-22bc-45a0-92d9-be41530b11cd: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-07c46871-22bc-45a0-92d9-be41530b11cd', 'volume_size': 1} Apr 29 19:09:04 devstack cinder-volume[84538]: DEBUG oslo_concurrency.lockutils [None req-87cf167c-3963-44af-bf10-fa200530baa3 tempest-CreateVolumesFromImageTest-147990199 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 19:09:05 devstack sudo[93821]: pam_unix(sudo:session): session closed for user root Apr 29 19:09:05 devstack cinder-volume[84538]: DEBUG oslo_concurrency.processutils [None req-30df80ef-1951-4ff2-8404-334ce6277014 tempest-CreateVolumesFromImageTest-147990199 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-680a4262-5ad6-4765-b175-84c3356ee07d 1073741824" returned: 0 in 0.874s {{(pid=84538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 19:09:05 devstack cinder-volume[84538]: DEBUG oslo_concurrency.processutils [None req-30df80ef-1951-4ff2-8404-334ce6277014 tempest-CreateVolumesFromImageTest-147990199 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-680a4262-5ad6-4765-b175-84c3356ee07d {{(pid=84538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 19:09:05 devstack sudo[93827]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-680a4262-5ad6-4765-b175-84c3356ee07d Apr 29 19:09:05 devstack sudo[93827]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 19:09:05 devstack cinder-volume[84538]: DEBUG cinder.volume.flows.manager.create_volume [None req-b86f188c-cb5a-4341-a688-b9c9f8eef927 tempest-CinderUnicodeTest-2074336556 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84538) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Apr 29 19:09:05 devstack cinder-volume[84538]: DEBUG cinder.volume.manager [None req-b86f188c-cb5a-4341-a688-b9c9f8eef927 tempest-CinderUnicodeTest-2074336556 None] Flow 'volume_create_manager' (8d58a0d8-3180-45dc-9f67-40ab97c0b879) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84538) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 19:09:05 devstack cinder-volume[84538]: DEBUG cinder.volume.manager [None req-b86f188c-cb5a-4341-a688-b9c9f8eef927 tempest-CinderUnicodeTest-2074336556 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a73767cf-f9de-4551-8e3b-7b661366ffb3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 19:09:05 devstack cinder-volume[84538]: DEBUG cinder.volume.manager [None req-b86f188c-cb5a-4341-a688-b9c9f8eef927 tempest-CinderUnicodeTest-2074336556 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a73767cf-f9de-4551-8e3b-7b661366ffb3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-29T17:09:05Z,deleted=False,deleted_at=None,display_description='קייפש',display_name='tempest-CinderUnicodeTest-Volume-901073397',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0d42a7b3-e110-4ac2-a938-632eda1c3957,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0112255e70ee40f5aef023c026ac05f7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T17:09:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T17:09:06Z,use_quota=True,user_id='30fc12f62ad84d6fa0d9545602738c6f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(62b05900-93e3-4190-a88f-1d87324303d1),volume_type_id=62b05900-93e3-4190-a88f-1d87324303d1)' {{(pid=84538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 19:09:05 devstack cinder-volume[84538]: DEBUG cinder.volume.manager [None req-b86f188c-cb5a-4341-a688-b9c9f8eef927 tempest-CinderUnicodeTest-2074336556 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f838c79b-55c9-4241-bc9e-25db1c7d21b4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 19:09:05 devstack cinder-volume[84538]: DEBUG cinder.volume.manager [None req-b86f188c-cb5a-4341-a688-b9c9f8eef927 tempest-CinderUnicodeTest-2074336556 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f838c79b-55c9-4241-bc9e-25db1c7d21b4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 19:09:05 devstack cinder-volume[84538]: DEBUG cinder.volume.manager [None req-b86f188c-cb5a-4341-a688-b9c9f8eef927 tempest-CinderUnicodeTest-2074336556 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ace6408b-0aa8-4db2-8c9c-c0c8960c7900) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 19:09:05 devstack cinder-volume[84538]: DEBUG cinder.volume.manager [None req-b86f188c-cb5a-4341-a688-b9c9f8eef927 tempest-CinderUnicodeTest-2074336556 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ace6408b-0aa8-4db2-8c9c-c0c8960c7900) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0d42a7b3-e110-4ac2-a938-632eda1c3957', 'volume_name': 'volume-0d42a7b3-e110-4ac2-a938-632eda1c3957', 'volume_size': 1}' {{(pid=84538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 19:09:05 devstack cinder-volume[84538]: DEBUG cinder.volume.manager [None req-b86f188c-cb5a-4341-a688-b9c9f8eef927 tempest-CinderUnicodeTest-2074336556 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (43c92ad5-1930-47b6-964b-f5632d62b435) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 19:09:05 devstack cinder-volume[84538]: DEBUG cinder.volume.manager [None req-b86f188c-cb5a-4341-a688-b9c9f8eef927 tempest-CinderUnicodeTest-2074336556 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (43c92ad5-1930-47b6-964b-f5632d62b435) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 19:09:05 devstack cinder-volume[84538]: DEBUG cinder.volume.manager [None req-b86f188c-cb5a-4341-a688-b9c9f8eef927 tempest-CinderUnicodeTest-2074336556 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (87eec92f-08bd-4af8-86ca-f57aed5349b7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 19:09:05 devstack cinder-volume[84538]: INFO cinder.volume.flows.manager.create_volume [None req-b86f188c-cb5a-4341-a688-b9c9f8eef927 tempest-CinderUnicodeTest-2074336556 None] Volume 0d42a7b3-e110-4ac2-a938-632eda1c3957: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0d42a7b3-e110-4ac2-a938-632eda1c3957', 'volume_size': 1} Apr 29 19:09:05 devstack cinder-volume[84538]: DEBUG oslo_concurrency.lockutils [None req-b86f188c-cb5a-4341-a688-b9c9f8eef927 tempest-CinderUnicodeTest-2074336556 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 19:09:05 devstack sudo[93827]: pam_unix(sudo:session): session closed for user root Apr 29 19:09:05 devstack cinder-volume[84538]: DEBUG oslo_concurrency.processutils [None req-30df80ef-1951-4ff2-8404-334ce6277014 tempest-CreateVolumesFromImageTest-147990199 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-680a4262-5ad6-4765-b175-84c3356ee07d" returned: 0 in 0.637s {{(pid=84538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 19:09:05 devstack cinder-volume[84538]: DEBUG cinder.volume.drivers.quobyte [None req-30df80ef-1951-4ff2-8404-334ce6277014 tempest-CreateVolumesFromImageTest-147990199 None] <== create_volume: return (1572ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-34312b00-dd6d-45bb-af98-75855cea8e48'} {{(pid=84538) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 29 19:09:05 devstack cinder-volume[84538]: DEBUG oslo_concurrency.lockutils [None req-30df80ef-1951-4ff2-8404-334ce6277014 tempest-CreateVolumesFromImageTest-147990199 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.575s {{(pid=84538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 19:09:05 devstack cinder-volume[84538]: DEBUG oslo_concurrency.lockutils [None req-b8bcece0-d6d7-4f8e-99a6-d9aa6a177c25 tempest-VolumeDependencyTests-868648422 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.850s {{(pid=84538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 19:09:05 devstack cinder-volume[84538]: DEBUG cinder.volume.drivers.quobyte [None req-b8bcece0-d6d7-4f8e-99a6-d9aa6a177c25 tempest-VolumeDependencyTests-868648422 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-29T17:09:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-347254035',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a86ac317-c9ef-4185-8a8c-2cb05a50fdf9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5af39d55694c40d7b5395e79cb6623fa',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T17:09:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T17:09:03Z,use_quota=True,user_id='d13112c160bd44458a48dc463fb78a07',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(62b05900-93e3-4190-a88f-1d87324303d1),volume_type_id=62b05900-93e3-4190-a88f-1d87324303d1)}" {{(pid=84538) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 29 19:09:05 devstack cinder-volume[84538]: DEBUG cinder.volume.drivers.remotefs [None req-b8bcece0-d6d7-4f8e-99a6-d9aa6a177c25 tempest-VolumeDependencyTests-868648422 None] Creating volume a86ac317-c9ef-4185-8a8c-2cb05a50fdf9 {{(pid=84538) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 29 19:09:05 devstack cinder-volume[84538]: DEBUG oslo_concurrency.lockutils [None req-b8bcece0-d6d7-4f8e-99a6-d9aa6a177c25 tempest-VolumeDependencyTests-868648422 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 19:09:05 devstack cinder-volume[84538]: DEBUG oslo_concurrency.lockutils [None req-b8bcece0-d6d7-4f8e-99a6-d9aa6a177c25 tempest-VolumeDependencyTests-868648422 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=84538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 19:09:05 devstack cinder-volume[84538]: DEBUG cinder.volume.drivers.quobyte [None req-b8bcece0-d6d7-4f8e-99a6-d9aa6a177c25 tempest-VolumeDependencyTests-868648422 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-34312b00-dd6d-45bb-af98-75855cea8e48': None} {{(pid=84538) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 19:09:05 devstack cinder-volume[84538]: DEBUG cinder.volume.drivers.quobyte [None req-b8bcece0-d6d7-4f8e-99a6-d9aa6a177c25 tempest-VolumeDependencyTests-868648422 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-34312b00-dd6d-45bb-af98-75855cea8e48'] {{(pid=84538) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 19:09:05 devstack cinder-volume[84538]: DEBUG oslo_concurrency.lockutils [None req-b8bcece0-d6d7-4f8e-99a6-d9aa6a177c25 tempest-VolumeDependencyTests-868648422 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=84538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 19:09:05 devstack cinder-volume[84538]: DEBUG cinder.volume.drivers.quobyte [None req-b8bcece0-d6d7-4f8e-99a6-d9aa6a177c25 tempest-VolumeDependencyTests-868648422 None] Selected osci02.corp.quobyte.com/cinder-vol-34312b00-dd6d-45bb-af98-75855cea8e48 as target Quobyte volume. {{(pid=84538) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 29 19:09:05 devstack cinder-volume[84538]: INFO cinder.volume.drivers.remotefs [None req-b8bcece0-d6d7-4f8e-99a6-d9aa6a177c25 tempest-VolumeDependencyTests-868648422 None] casted to osci02.corp.quobyte.com/cinder-vol-34312b00-dd6d-45bb-af98-75855cea8e48 Apr 29 19:09:05 devstack cinder-volume[84538]: DEBUG oslo_concurrency.processutils [None req-b8bcece0-d6d7-4f8e-99a6-d9aa6a177c25 tempest-VolumeDependencyTests-868648422 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-a86ac317-c9ef-4185-8a8c-2cb05a50fdf9 1073741824 {{(pid=84538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 19:09:06 devstack sudo[93830]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-a86ac317-c9ef-4185-8a8c-2cb05a50fdf9 1073741824 Apr 29 19:09:06 devstack sudo[93830]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 19:09:06 devstack cinder-volume[84538]: DEBUG cinder.volume.manager [None req-30df80ef-1951-4ff2-8404-334ce6277014 tempest-CreateVolumesFromImageTest-147990199 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4aac83d7-5886-4a76-b804-3a569f9b1815) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-680a4262-5ad6-4765-b175-84c3356ee07d', 'volume_size': 1}' {{(pid=84538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 19:09:06 devstack cinder-volume[84538]: DEBUG cinder.volume.manager [None req-30df80ef-1951-4ff2-8404-334ce6277014 tempest-CreateVolumesFromImageTest-147990199 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3f77c145-74ec-4888-91a5-b0a0a7b3648f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 19:09:06 devstack cinder-volume[84538]: INFO cinder.volume.flows.manager.create_volume [None req-30df80ef-1951-4ff2-8404-334ce6277014 tempest-CreateVolumesFromImageTest-147990199 None] Volume volume-680a4262-5ad6-4765-b175-84c3356ee07d (680a4262-5ad6-4765-b175-84c3356ee07d): created successfully Apr 29 19:09:06 devstack cinder-volume[84538]: DEBUG cinder.volume.manager [None req-30df80ef-1951-4ff2-8404-334ce6277014 tempest-CreateVolumesFromImageTest-147990199 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3f77c145-74ec-4888-91a5-b0a0a7b3648f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 19:09:06 devstack cinder-volume[84538]: DEBUG cinder.volume.manager [None req-30df80ef-1951-4ff2-8404-334ce6277014 tempest-CreateVolumesFromImageTest-147990199 None] Flow 'volume_create_manager' (538dc40c-b1ef-473c-9e2a-a45daf7c7fc9) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84538) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 19:09:06 devstack cinder-volume[84538]: INFO cinder.volume.manager [None req-30df80ef-1951-4ff2-8404-334ce6277014 tempest-CreateVolumesFromImageTest-147990199 None] Created volume successfully. Apr 29 19:09:06 devstack sudo[93830]: pam_unix(sudo:session): session closed for user root Apr 29 19:09:06 devstack cinder-volume[84538]: DEBUG oslo_concurrency.processutils [None req-b8bcece0-d6d7-4f8e-99a6-d9aa6a177c25 tempest-VolumeDependencyTests-868648422 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-a86ac317-c9ef-4185-8a8c-2cb05a50fdf9 1073741824" returned: 0 in 0.834s {{(pid=84538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 19:09:06 devstack cinder-volume[84538]: DEBUG oslo_concurrency.processutils [None req-b8bcece0-d6d7-4f8e-99a6-d9aa6a177c25 tempest-VolumeDependencyTests-868648422 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-a86ac317-c9ef-4185-8a8c-2cb05a50fdf9 {{(pid=84538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 19:09:06 devstack sudo[93835]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-a86ac317-c9ef-4185-8a8c-2cb05a50fdf9 Apr 29 19:09:06 devstack sudo[93835]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 19:09:07 devstack sudo[93835]: pam_unix(sudo:session): session closed for user root Apr 29 19:09:07 devstack cinder-volume[84538]: DEBUG oslo_concurrency.processutils [None req-b8bcece0-d6d7-4f8e-99a6-d9aa6a177c25 tempest-VolumeDependencyTests-868648422 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-a86ac317-c9ef-4185-8a8c-2cb05a50fdf9" returned: 0 in 0.587s {{(pid=84538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 19:09:07 devstack cinder-volume[84538]: DEBUG cinder.volume.drivers.quobyte [None req-b8bcece0-d6d7-4f8e-99a6-d9aa6a177c25 tempest-VolumeDependencyTests-868648422 None] <== create_volume: return (1460ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-34312b00-dd6d-45bb-af98-75855cea8e48'} {{(pid=84538) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 29 19:09:07 devstack cinder-volume[84538]: DEBUG oslo_concurrency.lockutils [None req-b8bcece0-d6d7-4f8e-99a6-d9aa6a177c25 tempest-VolumeDependencyTests-868648422 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.462s {{(pid=84538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 19:09:07 devstack cinder-volume[84538]: DEBUG oslo_concurrency.lockutils [None req-aade417b-1466-4c68-8266-4eaeeeba71f0 tempest-CreateVolumesFromSnapshotTest-1938046858 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.060s {{(pid=84538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 19:09:07 devstack cinder-volume[84538]: DEBUG cinder.volume.drivers.quobyte [None req-aade417b-1466-4c68-8266-4eaeeeba71f0 tempest-CreateVolumesFromSnapshotTest-1938046858 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-29T17:09:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1043265194',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2d2109ce-37b6-478b-bb3f-990749f03fc6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='43976132c7c54fdaa06722c210f732f0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T17:09:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T17:09:03Z,use_quota=True,user_id='6ffeea78e69b4e0d8fe06ce426cac057',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(62b05900-93e3-4190-a88f-1d87324303d1),volume_type_id=62b05900-93e3-4190-a88f-1d87324303d1)}" {{(pid=84538) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 29 19:09:07 devstack cinder-volume[84538]: DEBUG cinder.volume.drivers.remotefs [None req-aade417b-1466-4c68-8266-4eaeeeba71f0 tempest-CreateVolumesFromSnapshotTest-1938046858 None] Creating volume 2d2109ce-37b6-478b-bb3f-990749f03fc6 {{(pid=84538) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 29 19:09:07 devstack cinder-volume[84538]: DEBUG oslo_concurrency.lockutils [None req-aade417b-1466-4c68-8266-4eaeeeba71f0 tempest-CreateVolumesFromSnapshotTest-1938046858 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 19:09:07 devstack cinder-volume[84538]: DEBUG oslo_concurrency.lockutils [None req-aade417b-1466-4c68-8266-4eaeeeba71f0 tempest-CreateVolumesFromSnapshotTest-1938046858 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=84538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 19:09:07 devstack cinder-volume[84538]: DEBUG cinder.volume.drivers.quobyte [None req-aade417b-1466-4c68-8266-4eaeeeba71f0 tempest-CreateVolumesFromSnapshotTest-1938046858 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-34312b00-dd6d-45bb-af98-75855cea8e48': None} {{(pid=84538) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 19:09:07 devstack cinder-volume[84538]: DEBUG cinder.volume.drivers.quobyte [None req-aade417b-1466-4c68-8266-4eaeeeba71f0 tempest-CreateVolumesFromSnapshotTest-1938046858 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-34312b00-dd6d-45bb-af98-75855cea8e48'] {{(pid=84538) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 19:09:07 devstack cinder-volume[84538]: DEBUG oslo_concurrency.lockutils [None req-aade417b-1466-4c68-8266-4eaeeeba71f0 tempest-CreateVolumesFromSnapshotTest-1938046858 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=84538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 19:09:07 devstack cinder-volume[84538]: DEBUG cinder.volume.drivers.quobyte [None req-aade417b-1466-4c68-8266-4eaeeeba71f0 tempest-CreateVolumesFromSnapshotTest-1938046858 None] Selected osci02.corp.quobyte.com/cinder-vol-34312b00-dd6d-45bb-af98-75855cea8e48 as target Quobyte volume. {{(pid=84538) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 29 19:09:07 devstack cinder-volume[84538]: INFO cinder.volume.drivers.remotefs [None req-aade417b-1466-4c68-8266-4eaeeeba71f0 tempest-CreateVolumesFromSnapshotTest-1938046858 None] casted to osci02.corp.quobyte.com/cinder-vol-34312b00-dd6d-45bb-af98-75855cea8e48 Apr 29 19:09:07 devstack cinder-volume[84538]: DEBUG oslo_concurrency.processutils [None req-aade417b-1466-4c68-8266-4eaeeeba71f0 tempest-CreateVolumesFromSnapshotTest-1938046858 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-2d2109ce-37b6-478b-bb3f-990749f03fc6 1073741824 {{(pid=84538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 19:09:07 devstack cinder-volume[84538]: DEBUG cinder.volume.manager [None req-b8bcece0-d6d7-4f8e-99a6-d9aa6a177c25 tempest-VolumeDependencyTests-868648422 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d3cd5003-d37d-4d75-8f8f-c7240bc65f65) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a86ac317-c9ef-4185-8a8c-2cb05a50fdf9', 'volume_size': 1}' {{(pid=84538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 19:09:07 devstack cinder-volume[84538]: DEBUG cinder.volume.manager [None req-b8bcece0-d6d7-4f8e-99a6-d9aa6a177c25 tempest-VolumeDependencyTests-868648422 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b1809375-b286-4670-a922-47d1de87c07b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 19:09:07 devstack sudo[93838]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-2d2109ce-37b6-478b-bb3f-990749f03fc6 1073741824 Apr 29 19:09:07 devstack sudo[93838]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 19:09:07 devstack cinder-volume[84538]: INFO cinder.volume.flows.manager.create_volume [None req-b8bcece0-d6d7-4f8e-99a6-d9aa6a177c25 tempest-VolumeDependencyTests-868648422 None] Volume volume-a86ac317-c9ef-4185-8a8c-2cb05a50fdf9 (a86ac317-c9ef-4185-8a8c-2cb05a50fdf9): created successfully Apr 29 19:09:07 devstack cinder-volume[84538]: DEBUG cinder.volume.manager [None req-b8bcece0-d6d7-4f8e-99a6-d9aa6a177c25 tempest-VolumeDependencyTests-868648422 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b1809375-b286-4670-a922-47d1de87c07b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 19:09:07 devstack cinder-volume[84538]: DEBUG cinder.volume.manager [None req-b8bcece0-d6d7-4f8e-99a6-d9aa6a177c25 tempest-VolumeDependencyTests-868648422 None] Flow 'volume_create_manager' (fc78de28-28df-4bc8-8d65-bed3c179ea8b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84538) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 19:09:07 devstack cinder-volume[84538]: INFO cinder.volume.manager [None req-b8bcece0-d6d7-4f8e-99a6-d9aa6a177c25 tempest-VolumeDependencyTests-868648422 None] Created volume successfully. Apr 29 19:09:08 devstack sudo[93838]: pam_unix(sudo:session): session closed for user root Apr 29 19:09:08 devstack cinder-volume[84538]: DEBUG oslo_concurrency.processutils [None req-aade417b-1466-4c68-8266-4eaeeeba71f0 tempest-CreateVolumesFromSnapshotTest-1938046858 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-2d2109ce-37b6-478b-bb3f-990749f03fc6 1073741824" returned: 0 in 0.811s {{(pid=84538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 19:09:08 devstack cinder-volume[84538]: DEBUG oslo_concurrency.processutils [None req-aade417b-1466-4c68-8266-4eaeeeba71f0 tempest-CreateVolumesFromSnapshotTest-1938046858 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-2d2109ce-37b6-478b-bb3f-990749f03fc6 {{(pid=84538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 19:09:08 devstack sudo[93843]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-2d2109ce-37b6-478b-bb3f-990749f03fc6 Apr 29 19:09:08 devstack sudo[93843]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 19:09:08 devstack cinder-volume[84538]: DEBUG oslo_concurrency.lockutils [None req-9c3e12b4-5707-4c13-b3d2-f3f774b7ae4e tempest-VolumeDependencyTests-868648422 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=84538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 19:09:08 devstack sudo[93843]: pam_unix(sudo:session): session closed for user root Apr 29 19:09:08 devstack cinder-volume[84538]: DEBUG oslo_concurrency.processutils [None req-aade417b-1466-4c68-8266-4eaeeeba71f0 tempest-CreateVolumesFromSnapshotTest-1938046858 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-2d2109ce-37b6-478b-bb3f-990749f03fc6" returned: 0 in 0.627s {{(pid=84538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 19:09:08 devstack cinder-volume[84538]: DEBUG cinder.volume.drivers.quobyte [None req-aade417b-1466-4c68-8266-4eaeeeba71f0 tempest-CreateVolumesFromSnapshotTest-1938046858 None] <== create_volume: return (1474ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-34312b00-dd6d-45bb-af98-75855cea8e48'} {{(pid=84538) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 29 19:09:08 devstack cinder-volume[84538]: DEBUG oslo_concurrency.lockutils [None req-aade417b-1466-4c68-8266-4eaeeeba71f0 tempest-CreateVolumesFromSnapshotTest-1938046858 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.477s {{(pid=84538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 19:09:08 devstack cinder-volume[84538]: DEBUG oslo_concurrency.lockutils [None req-22a304f1-c6f9-4fc3-9d5c-b4e6320923a5 tempest-CreateVolumesFromImageTest-147990199 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 5.323s {{(pid=84538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 19:09:08 devstack cinder-volume[84538]: DEBUG cinder.volume.drivers.quobyte [None req-22a304f1-c6f9-4fc3-9d5c-b4e6320923a5 tempest-CreateVolumesFromImageTest-147990199 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-29T17:09:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1157047808',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c19cf185-e537-4815-9d41-e08128d05c40,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='617a571331744ff28987b9c318d185ff',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T17:09:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T17:09:03Z,use_quota=True,user_id='39beec79f42b4cd4a647630326703bef',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(62b05900-93e3-4190-a88f-1d87324303d1),volume_type_id=62b05900-93e3-4190-a88f-1d87324303d1)}" {{(pid=84538) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 29 19:09:08 devstack cinder-volume[84538]: DEBUG cinder.volume.drivers.remotefs [None req-22a304f1-c6f9-4fc3-9d5c-b4e6320923a5 tempest-CreateVolumesFromImageTest-147990199 None] Creating volume c19cf185-e537-4815-9d41-e08128d05c40 {{(pid=84538) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 29 19:09:08 devstack cinder-volume[84538]: DEBUG oslo_concurrency.lockutils [None req-22a304f1-c6f9-4fc3-9d5c-b4e6320923a5 tempest-CreateVolumesFromImageTest-147990199 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 19:09:08 devstack cinder-volume[84538]: DEBUG oslo_concurrency.lockutils [None req-22a304f1-c6f9-4fc3-9d5c-b4e6320923a5 tempest-CreateVolumesFromImageTest-147990199 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=84538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 19:09:08 devstack cinder-volume[84538]: DEBUG cinder.volume.drivers.quobyte [None req-22a304f1-c6f9-4fc3-9d5c-b4e6320923a5 tempest-CreateVolumesFromImageTest-147990199 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-34312b00-dd6d-45bb-af98-75855cea8e48': None} {{(pid=84538) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 19:09:08 devstack cinder-volume[84538]: DEBUG cinder.volume.drivers.quobyte [None req-22a304f1-c6f9-4fc3-9d5c-b4e6320923a5 tempest-CreateVolumesFromImageTest-147990199 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-34312b00-dd6d-45bb-af98-75855cea8e48'] {{(pid=84538) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 19:09:08 devstack cinder-volume[84538]: DEBUG oslo_concurrency.lockutils [None req-22a304f1-c6f9-4fc3-9d5c-b4e6320923a5 tempest-CreateVolumesFromImageTest-147990199 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=84538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 19:09:08 devstack cinder-volume[84538]: DEBUG cinder.volume.drivers.quobyte [None req-22a304f1-c6f9-4fc3-9d5c-b4e6320923a5 tempest-CreateVolumesFromImageTest-147990199 None] Selected osci02.corp.quobyte.com/cinder-vol-34312b00-dd6d-45bb-af98-75855cea8e48 as target Quobyte volume. {{(pid=84538) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 29 19:09:08 devstack cinder-volume[84538]: INFO cinder.volume.drivers.remotefs [None req-22a304f1-c6f9-4fc3-9d5c-b4e6320923a5 tempest-CreateVolumesFromImageTest-147990199 None] casted to osci02.corp.quobyte.com/cinder-vol-34312b00-dd6d-45bb-af98-75855cea8e48 Apr 29 19:09:08 devstack cinder-volume[84538]: DEBUG oslo_concurrency.processutils [None req-22a304f1-c6f9-4fc3-9d5c-b4e6320923a5 tempest-CreateVolumesFromImageTest-147990199 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-c19cf185-e537-4815-9d41-e08128d05c40 1073741824 {{(pid=84538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 19:09:08 devstack cinder-volume[84538]: DEBUG cinder.volume.manager [None req-aade417b-1466-4c68-8266-4eaeeeba71f0 tempest-CreateVolumesFromSnapshotTest-1938046858 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b4e89037-7adc-45da-8045-c63c1e74fdf1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2d2109ce-37b6-478b-bb3f-990749f03fc6', 'volume_size': 1}' {{(pid=84538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 19:09:08 devstack sudo[93847]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-c19cf185-e537-4815-9d41-e08128d05c40 1073741824 Apr 29 19:09:08 devstack sudo[93847]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 19:09:08 devstack cinder-volume[84538]: DEBUG cinder.volume.manager [None req-aade417b-1466-4c68-8266-4eaeeeba71f0 tempest-CreateVolumesFromSnapshotTest-1938046858 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2406a5a2-53ec-4add-946f-8b5651cb4fa8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 19:09:08 devstack cinder-volume[84538]: INFO cinder.volume.flows.manager.create_volume [None req-aade417b-1466-4c68-8266-4eaeeeba71f0 tempest-CreateVolumesFromSnapshotTest-1938046858 None] Volume volume-2d2109ce-37b6-478b-bb3f-990749f03fc6 (2d2109ce-37b6-478b-bb3f-990749f03fc6): created successfully Apr 29 19:09:08 devstack cinder-volume[84538]: DEBUG cinder.volume.manager [None req-aade417b-1466-4c68-8266-4eaeeeba71f0 tempest-CreateVolumesFromSnapshotTest-1938046858 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2406a5a2-53ec-4add-946f-8b5651cb4fa8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 19:09:08 devstack cinder-volume[84538]: DEBUG cinder.volume.manager [None req-aade417b-1466-4c68-8266-4eaeeeba71f0 tempest-CreateVolumesFromSnapshotTest-1938046858 None] Flow 'volume_create_manager' (07bfdfa3-00c0-4a8a-847c-61325d82d3c8) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84538) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 19:09:08 devstack cinder-volume[84538]: INFO cinder.volume.manager [None req-aade417b-1466-4c68-8266-4eaeeeba71f0 tempest-CreateVolumesFromSnapshotTest-1938046858 None] Created volume successfully. Apr 29 19:09:09 devstack sudo[93847]: pam_unix(sudo:session): session closed for user root Apr 29 19:09:09 devstack cinder-volume[84538]: DEBUG oslo_concurrency.processutils [None req-22a304f1-c6f9-4fc3-9d5c-b4e6320923a5 tempest-CreateVolumesFromImageTest-147990199 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-c19cf185-e537-4815-9d41-e08128d05c40 1073741824" returned: 0 in 0.788s {{(pid=84538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 19:09:09 devstack cinder-volume[84538]: DEBUG oslo_concurrency.processutils [None req-22a304f1-c6f9-4fc3-9d5c-b4e6320923a5 tempest-CreateVolumesFromImageTest-147990199 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-c19cf185-e537-4815-9d41-e08128d05c40 {{(pid=84538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 19:09:09 devstack sudo[93852]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-c19cf185-e537-4815-9d41-e08128d05c40 Apr 29 19:09:09 devstack sudo[93852]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 19:09:09 devstack cinder-volume[84538]: DEBUG oslo_concurrency.lockutils [None req-27647daf-1e02-4cd0-9595-d7ca305721d2 tempest-CreateVolumesFromSnapshotTest-1938046858 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=84538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 19:09:10 devstack sudo[93852]: pam_unix(sudo:session): session closed for user root Apr 29 19:09:10 devstack cinder-volume[84538]: DEBUG oslo_concurrency.processutils [None req-22a304f1-c6f9-4fc3-9d5c-b4e6320923a5 tempest-CreateVolumesFromImageTest-147990199 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-c19cf185-e537-4815-9d41-e08128d05c40" returned: 0 in 0.633s {{(pid=84538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 19:09:10 devstack cinder-volume[84538]: DEBUG cinder.volume.drivers.quobyte [None req-22a304f1-c6f9-4fc3-9d5c-b4e6320923a5 tempest-CreateVolumesFromImageTest-147990199 None] <== create_volume: return (1483ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-34312b00-dd6d-45bb-af98-75855cea8e48'} {{(pid=84538) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 29 19:09:10 devstack cinder-volume[84538]: DEBUG oslo_concurrency.lockutils [None req-22a304f1-c6f9-4fc3-9d5c-b4e6320923a5 tempest-CreateVolumesFromImageTest-147990199 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.486s {{(pid=84538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 19:09:10 devstack cinder-volume[84538]: DEBUG oslo_concurrency.lockutils [None req-c467ce28-759b-4883-a2db-18cf7e07e850 tempest-CreateVolumesFromImageTest-147990199 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 6.457s {{(pid=84538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 19:09:10 devstack cinder-volume[84538]: DEBUG cinder.volume.drivers.quobyte [None req-c467ce28-759b-4883-a2db-18cf7e07e850 tempest-CreateVolumesFromImageTest-147990199 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-29T17:09:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1843425052',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b9da96b0-3fc4-4a15-bc91-859ba280cdd5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='617a571331744ff28987b9c318d185ff',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T17:09:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T17:09:04Z,use_quota=True,user_id='39beec79f42b4cd4a647630326703bef',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(62b05900-93e3-4190-a88f-1d87324303d1),volume_type_id=62b05900-93e3-4190-a88f-1d87324303d1)}" {{(pid=84538) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 29 19:09:10 devstack cinder-volume[84538]: DEBUG cinder.volume.drivers.remotefs [None req-c467ce28-759b-4883-a2db-18cf7e07e850 tempest-CreateVolumesFromImageTest-147990199 None] Creating volume b9da96b0-3fc4-4a15-bc91-859ba280cdd5 {{(pid=84538) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 29 19:09:10 devstack cinder-volume[84538]: DEBUG oslo_concurrency.lockutils [None req-c467ce28-759b-4883-a2db-18cf7e07e850 tempest-CreateVolumesFromImageTest-147990199 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 19:09:10 devstack cinder-volume[84538]: DEBUG oslo_concurrency.lockutils [None req-c467ce28-759b-4883-a2db-18cf7e07e850 tempest-CreateVolumesFromImageTest-147990199 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=84538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 19:09:10 devstack cinder-volume[84538]: DEBUG cinder.volume.drivers.quobyte [None req-c467ce28-759b-4883-a2db-18cf7e07e850 tempest-CreateVolumesFromImageTest-147990199 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-34312b00-dd6d-45bb-af98-75855cea8e48': None} {{(pid=84538) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 19:09:10 devstack cinder-volume[84538]: DEBUG cinder.volume.drivers.quobyte [None req-c467ce28-759b-4883-a2db-18cf7e07e850 tempest-CreateVolumesFromImageTest-147990199 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-34312b00-dd6d-45bb-af98-75855cea8e48'] {{(pid=84538) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 19:09:10 devstack cinder-volume[84538]: DEBUG oslo_concurrency.lockutils [None req-c467ce28-759b-4883-a2db-18cf7e07e850 tempest-CreateVolumesFromImageTest-147990199 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=84538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 19:09:10 devstack cinder-volume[84538]: DEBUG cinder.volume.drivers.quobyte [None req-c467ce28-759b-4883-a2db-18cf7e07e850 tempest-CreateVolumesFromImageTest-147990199 None] Selected osci02.corp.quobyte.com/cinder-vol-34312b00-dd6d-45bb-af98-75855cea8e48 as target Quobyte volume. {{(pid=84538) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 29 19:09:10 devstack cinder-volume[84538]: INFO cinder.volume.drivers.remotefs [None req-c467ce28-759b-4883-a2db-18cf7e07e850 tempest-CreateVolumesFromImageTest-147990199 None] casted to osci02.corp.quobyte.com/cinder-vol-34312b00-dd6d-45bb-af98-75855cea8e48 Apr 29 19:09:10 devstack cinder-volume[84538]: DEBUG oslo_concurrency.processutils [None req-c467ce28-759b-4883-a2db-18cf7e07e850 tempest-CreateVolumesFromImageTest-147990199 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-b9da96b0-3fc4-4a15-bc91-859ba280cdd5 1073741824 {{(pid=84538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 19:09:10 devstack cinder-volume[84538]: DEBUG cinder.volume.manager [None req-22a304f1-c6f9-4fc3-9d5c-b4e6320923a5 tempest-CreateVolumesFromImageTest-147990199 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0d9277bf-e986-422b-b367-fb8d65b27b74) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c19cf185-e537-4815-9d41-e08128d05c40', 'volume_size': 1}' {{(pid=84538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 19:09:10 devstack sudo[93855]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-b9da96b0-3fc4-4a15-bc91-859ba280cdd5 1073741824 Apr 29 19:09:10 devstack cinder-volume[84538]: DEBUG cinder.volume.manager [None req-22a304f1-c6f9-4fc3-9d5c-b4e6320923a5 tempest-CreateVolumesFromImageTest-147990199 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fd2620d8-a3cb-407b-a38c-25bbfacc4a6e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 19:09:10 devstack sudo[93855]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 19:09:10 devstack cinder-volume[84538]: INFO cinder.volume.flows.manager.create_volume [None req-22a304f1-c6f9-4fc3-9d5c-b4e6320923a5 tempest-CreateVolumesFromImageTest-147990199 None] Volume volume-c19cf185-e537-4815-9d41-e08128d05c40 (c19cf185-e537-4815-9d41-e08128d05c40): created successfully Apr 29 19:09:10 devstack cinder-volume[84538]: DEBUG cinder.volume.manager [None req-22a304f1-c6f9-4fc3-9d5c-b4e6320923a5 tempest-CreateVolumesFromImageTest-147990199 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fd2620d8-a3cb-407b-a38c-25bbfacc4a6e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 19:09:10 devstack cinder-volume[84538]: DEBUG cinder.volume.manager [None req-22a304f1-c6f9-4fc3-9d5c-b4e6320923a5 tempest-CreateVolumesFromImageTest-147990199 None] Flow 'volume_create_manager' (18c89d81-c14f-4d42-aaf4-0cec0f9aea8a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84538) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 19:09:10 devstack cinder-volume[84538]: INFO cinder.volume.manager [None req-22a304f1-c6f9-4fc3-9d5c-b4e6320923a5 tempest-CreateVolumesFromImageTest-147990199 None] Created volume successfully. Apr 29 19:09:11 devstack sudo[93855]: pam_unix(sudo:session): session closed for user root Apr 29 19:09:11 devstack cinder-volume[84538]: DEBUG oslo_concurrency.processutils [None req-c467ce28-759b-4883-a2db-18cf7e07e850 tempest-CreateVolumesFromImageTest-147990199 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-b9da96b0-3fc4-4a15-bc91-859ba280cdd5 1073741824" returned: 0 in 0.791s {{(pid=84538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 19:09:11 devstack cinder-volume[84538]: DEBUG oslo_concurrency.processutils [None req-c467ce28-759b-4883-a2db-18cf7e07e850 tempest-CreateVolumesFromImageTest-147990199 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-b9da96b0-3fc4-4a15-bc91-859ba280cdd5 {{(pid=84538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 19:09:11 devstack sudo[93860]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-b9da96b0-3fc4-4a15-bc91-859ba280cdd5 Apr 29 19:09:11 devstack sudo[93860]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 19:09:11 devstack sudo[93860]: pam_unix(sudo:session): session closed for user root Apr 29 19:09:11 devstack cinder-volume[84538]: DEBUG oslo_concurrency.processutils [None req-c467ce28-759b-4883-a2db-18cf7e07e850 tempest-CreateVolumesFromImageTest-147990199 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-b9da96b0-3fc4-4a15-bc91-859ba280cdd5" returned: 0 in 0.580s {{(pid=84538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 19:09:11 devstack cinder-volume[84538]: DEBUG cinder.volume.drivers.quobyte [None req-c467ce28-759b-4883-a2db-18cf7e07e850 tempest-CreateVolumesFromImageTest-147990199 None] <== create_volume: return (1407ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-34312b00-dd6d-45bb-af98-75855cea8e48'} {{(pid=84538) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 29 19:09:11 devstack cinder-volume[84538]: DEBUG oslo_concurrency.lockutils [None req-c467ce28-759b-4883-a2db-18cf7e07e850 tempest-CreateVolumesFromImageTest-147990199 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.410s {{(pid=84538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 19:09:11 devstack cinder-volume[84538]: DEBUG oslo_concurrency.lockutils [None req-9a28839b-144e-4d0b-9849-013c340c66be tempest-CreateVolumesFromImageTest-147990199 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 7.438s {{(pid=84538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 19:09:11 devstack cinder-volume[84538]: DEBUG cinder.volume.drivers.quobyte [None req-9a28839b-144e-4d0b-9849-013c340c66be tempest-CreateVolumesFromImageTest-147990199 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-29T17:09:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-834397394',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c61d2277-9a07-44b4-b6bd-cb4bd478c2d2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='617a571331744ff28987b9c318d185ff',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T17:09:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T17:09:04Z,use_quota=True,user_id='39beec79f42b4cd4a647630326703bef',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(62b05900-93e3-4190-a88f-1d87324303d1),volume_type_id=62b05900-93e3-4190-a88f-1d87324303d1)}" {{(pid=84538) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 29 19:09:11 devstack cinder-volume[84538]: DEBUG cinder.volume.drivers.remotefs [None req-9a28839b-144e-4d0b-9849-013c340c66be tempest-CreateVolumesFromImageTest-147990199 None] Creating volume c61d2277-9a07-44b4-b6bd-cb4bd478c2d2 {{(pid=84538) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 29 19:09:11 devstack cinder-volume[84538]: DEBUG oslo_concurrency.lockutils [None req-9a28839b-144e-4d0b-9849-013c340c66be tempest-CreateVolumesFromImageTest-147990199 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 19:09:11 devstack cinder-volume[84538]: DEBUG oslo_concurrency.lockutils [None req-9a28839b-144e-4d0b-9849-013c340c66be tempest-CreateVolumesFromImageTest-147990199 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=84538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 19:09:11 devstack cinder-volume[84538]: DEBUG cinder.volume.drivers.quobyte [None req-9a28839b-144e-4d0b-9849-013c340c66be tempest-CreateVolumesFromImageTest-147990199 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-34312b00-dd6d-45bb-af98-75855cea8e48': None} {{(pid=84538) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 19:09:11 devstack cinder-volume[84538]: DEBUG cinder.volume.drivers.quobyte [None req-9a28839b-144e-4d0b-9849-013c340c66be tempest-CreateVolumesFromImageTest-147990199 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-34312b00-dd6d-45bb-af98-75855cea8e48'] {{(pid=84538) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 19:09:11 devstack cinder-volume[84538]: DEBUG oslo_concurrency.lockutils [None req-9a28839b-144e-4d0b-9849-013c340c66be tempest-CreateVolumesFromImageTest-147990199 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=84538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 19:09:11 devstack cinder-volume[84538]: DEBUG cinder.volume.drivers.quobyte [None req-9a28839b-144e-4d0b-9849-013c340c66be tempest-CreateVolumesFromImageTest-147990199 None] Selected osci02.corp.quobyte.com/cinder-vol-34312b00-dd6d-45bb-af98-75855cea8e48 as target Quobyte volume. {{(pid=84538) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 29 19:09:11 devstack cinder-volume[84538]: INFO cinder.volume.drivers.remotefs [None req-9a28839b-144e-4d0b-9849-013c340c66be tempest-CreateVolumesFromImageTest-147990199 None] casted to osci02.corp.quobyte.com/cinder-vol-34312b00-dd6d-45bb-af98-75855cea8e48 Apr 29 19:09:11 devstack cinder-volume[84538]: DEBUG oslo_concurrency.processutils [None req-9a28839b-144e-4d0b-9849-013c340c66be tempest-CreateVolumesFromImageTest-147990199 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-c61d2277-9a07-44b4-b6bd-cb4bd478c2d2 1073741824 {{(pid=84538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 19:09:11 devstack cinder-volume[84538]: DEBUG cinder.volume.manager [None req-c467ce28-759b-4883-a2db-18cf7e07e850 tempest-CreateVolumesFromImageTest-147990199 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d32284e3-61c7-42f2-a52d-54d24d88ea5f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b9da96b0-3fc4-4a15-bc91-859ba280cdd5', 'volume_size': 1}' {{(pid=84538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 19:09:11 devstack sudo[93863]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-c61d2277-9a07-44b4-b6bd-cb4bd478c2d2 1073741824 Apr 29 19:09:11 devstack sudo[93863]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 19:09:11 devstack cinder-volume[84538]: DEBUG cinder.volume.manager [None req-c467ce28-759b-4883-a2db-18cf7e07e850 tempest-CreateVolumesFromImageTest-147990199 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0cb006c2-8421-4593-a5f8-c4646e37ab9a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 19:09:11 devstack cinder-volume[84538]: INFO cinder.volume.flows.manager.create_volume [None req-c467ce28-759b-4883-a2db-18cf7e07e850 tempest-CreateVolumesFromImageTest-147990199 None] Volume volume-b9da96b0-3fc4-4a15-bc91-859ba280cdd5 (b9da96b0-3fc4-4a15-bc91-859ba280cdd5): created successfully Apr 29 19:09:11 devstack cinder-volume[84538]: DEBUG cinder.volume.manager [None req-c467ce28-759b-4883-a2db-18cf7e07e850 tempest-CreateVolumesFromImageTest-147990199 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0cb006c2-8421-4593-a5f8-c4646e37ab9a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 19:09:11 devstack cinder-volume[84538]: DEBUG cinder.volume.manager [None req-c467ce28-759b-4883-a2db-18cf7e07e850 tempest-CreateVolumesFromImageTest-147990199 None] Flow 'volume_create_manager' (00b3a4c2-3069-4a71-a20b-21ebed528405) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84538) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 19:09:11 devstack cinder-volume[84538]: INFO cinder.volume.manager [None req-c467ce28-759b-4883-a2db-18cf7e07e850 tempest-CreateVolumesFromImageTest-147990199 None] Created volume successfully. Apr 29 19:09:12 devstack sudo[93863]: pam_unix(sudo:session): session closed for user root Apr 29 19:09:12 devstack cinder-volume[84538]: DEBUG oslo_concurrency.processutils [None req-9a28839b-144e-4d0b-9849-013c340c66be tempest-CreateVolumesFromImageTest-147990199 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-c61d2277-9a07-44b4-b6bd-cb4bd478c2d2 1073741824" returned: 0 in 0.796s {{(pid=84538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 19:09:12 devstack cinder-volume[84538]: DEBUG oslo_concurrency.processutils [None req-9a28839b-144e-4d0b-9849-013c340c66be tempest-CreateVolumesFromImageTest-147990199 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-c61d2277-9a07-44b4-b6bd-cb4bd478c2d2 {{(pid=84538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 19:09:12 devstack sudo[93868]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-c61d2277-9a07-44b4-b6bd-cb4bd478c2d2 Apr 29 19:09:12 devstack sudo[93868]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 19:09:13 devstack sudo[93868]: pam_unix(sudo:session): session closed for user root Apr 29 19:09:13 devstack cinder-volume[84538]: DEBUG oslo_concurrency.processutils [None req-9a28839b-144e-4d0b-9849-013c340c66be tempest-CreateVolumesFromImageTest-147990199 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-c61d2277-9a07-44b4-b6bd-cb4bd478c2d2" returned: 0 in 0.613s {{(pid=84538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 19:09:13 devstack cinder-volume[84538]: DEBUG cinder.volume.drivers.quobyte [None req-9a28839b-144e-4d0b-9849-013c340c66be tempest-CreateVolumesFromImageTest-147990199 None] <== create_volume: return (1447ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-34312b00-dd6d-45bb-af98-75855cea8e48'} {{(pid=84538) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 29 19:09:13 devstack cinder-volume[84538]: DEBUG oslo_concurrency.lockutils [None req-9a28839b-144e-4d0b-9849-013c340c66be tempest-CreateVolumesFromImageTest-147990199 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.452s {{(pid=84538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 19:09:13 devstack cinder-volume[84538]: DEBUG oslo_concurrency.lockutils [None req-87cf167c-3963-44af-bf10-fa200530baa3 tempest-CreateVolumesFromImageTest-147990199 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 8.546s {{(pid=84538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 19:09:13 devstack cinder-volume[84538]: DEBUG cinder.volume.drivers.quobyte [None req-87cf167c-3963-44af-bf10-fa200530baa3 tempest-CreateVolumesFromImageTest-147990199 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-29T17:09:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-605038978',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=07c46871-22bc-45a0-92d9-be41530b11cd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='617a571331744ff28987b9c318d185ff',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T17:09:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T17:09:05Z,use_quota=True,user_id='39beec79f42b4cd4a647630326703bef',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(62b05900-93e3-4190-a88f-1d87324303d1),volume_type_id=62b05900-93e3-4190-a88f-1d87324303d1)}" {{(pid=84538) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 29 19:09:13 devstack cinder-volume[84538]: DEBUG cinder.volume.drivers.remotefs [None req-87cf167c-3963-44af-bf10-fa200530baa3 tempest-CreateVolumesFromImageTest-147990199 None] Creating volume 07c46871-22bc-45a0-92d9-be41530b11cd {{(pid=84538) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 29 19:09:13 devstack cinder-volume[84538]: DEBUG oslo_concurrency.lockutils [None req-87cf167c-3963-44af-bf10-fa200530baa3 tempest-CreateVolumesFromImageTest-147990199 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 19:09:13 devstack cinder-volume[84538]: DEBUG oslo_concurrency.lockutils [None req-87cf167c-3963-44af-bf10-fa200530baa3 tempest-CreateVolumesFromImageTest-147990199 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 19:09:13 devstack cinder-volume[84538]: DEBUG cinder.volume.drivers.quobyte [None req-87cf167c-3963-44af-bf10-fa200530baa3 tempest-CreateVolumesFromImageTest-147990199 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-34312b00-dd6d-45bb-af98-75855cea8e48': None} {{(pid=84538) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 19:09:13 devstack cinder-volume[84538]: DEBUG cinder.volume.drivers.quobyte [None req-87cf167c-3963-44af-bf10-fa200530baa3 tempest-CreateVolumesFromImageTest-147990199 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-34312b00-dd6d-45bb-af98-75855cea8e48'] {{(pid=84538) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 19:09:13 devstack cinder-volume[84538]: DEBUG oslo_concurrency.lockutils [None req-87cf167c-3963-44af-bf10-fa200530baa3 tempest-CreateVolumesFromImageTest-147990199 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=84538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 19:09:13 devstack cinder-volume[84538]: DEBUG cinder.volume.drivers.quobyte [None req-87cf167c-3963-44af-bf10-fa200530baa3 tempest-CreateVolumesFromImageTest-147990199 None] Selected osci02.corp.quobyte.com/cinder-vol-34312b00-dd6d-45bb-af98-75855cea8e48 as target Quobyte volume. {{(pid=84538) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 29 19:09:13 devstack cinder-volume[84538]: INFO cinder.volume.drivers.remotefs [None req-87cf167c-3963-44af-bf10-fa200530baa3 tempest-CreateVolumesFromImageTest-147990199 None] casted to osci02.corp.quobyte.com/cinder-vol-34312b00-dd6d-45bb-af98-75855cea8e48 Apr 29 19:09:13 devstack cinder-volume[84538]: DEBUG oslo_concurrency.processutils [None req-87cf167c-3963-44af-bf10-fa200530baa3 tempest-CreateVolumesFromImageTest-147990199 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-07c46871-22bc-45a0-92d9-be41530b11cd 1073741824 {{(pid=84538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 19:09:13 devstack cinder-volume[84538]: DEBUG cinder.volume.manager [None req-9a28839b-144e-4d0b-9849-013c340c66be tempest-CreateVolumesFromImageTest-147990199 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f4f9d092-b590-470f-ae42-c0b7109328ea) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c61d2277-9a07-44b4-b6bd-cb4bd478c2d2', 'volume_size': 1}' {{(pid=84538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 19:09:13 devstack sudo[93871]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-07c46871-22bc-45a0-92d9-be41530b11cd 1073741824 Apr 29 19:09:13 devstack sudo[93871]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 19:09:13 devstack cinder-volume[84538]: DEBUG cinder.volume.manager [None req-9a28839b-144e-4d0b-9849-013c340c66be tempest-CreateVolumesFromImageTest-147990199 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4afc6b4b-cf1b-4273-80b4-4db98a4b1937) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 19:09:13 devstack cinder-volume[84538]: INFO cinder.volume.flows.manager.create_volume [None req-9a28839b-144e-4d0b-9849-013c340c66be tempest-CreateVolumesFromImageTest-147990199 None] Volume volume-c61d2277-9a07-44b4-b6bd-cb4bd478c2d2 (c61d2277-9a07-44b4-b6bd-cb4bd478c2d2): created successfully Apr 29 19:09:13 devstack cinder-volume[84538]: DEBUG cinder.volume.manager [None req-9a28839b-144e-4d0b-9849-013c340c66be tempest-CreateVolumesFromImageTest-147990199 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4afc6b4b-cf1b-4273-80b4-4db98a4b1937) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 19:09:13 devstack cinder-volume[84538]: DEBUG cinder.volume.manager [None req-9a28839b-144e-4d0b-9849-013c340c66be tempest-CreateVolumesFromImageTest-147990199 None] Flow 'volume_create_manager' (db3289db-e6d4-4bd3-ac2c-ad8d3bf78863) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84538) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 19:09:13 devstack cinder-volume[84538]: INFO cinder.volume.manager [None req-9a28839b-144e-4d0b-9849-013c340c66be tempest-CreateVolumesFromImageTest-147990199 None] Created volume successfully. Apr 29 19:09:14 devstack sudo[93871]: pam_unix(sudo:session): session closed for user root Apr 29 19:09:14 devstack cinder-volume[84538]: DEBUG oslo_concurrency.processutils [None req-87cf167c-3963-44af-bf10-fa200530baa3 tempest-CreateVolumesFromImageTest-147990199 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-07c46871-22bc-45a0-92d9-be41530b11cd 1073741824" returned: 0 in 0.761s {{(pid=84538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 19:09:14 devstack cinder-volume[84538]: DEBUG oslo_concurrency.processutils [None req-87cf167c-3963-44af-bf10-fa200530baa3 tempest-CreateVolumesFromImageTest-147990199 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-07c46871-22bc-45a0-92d9-be41530b11cd {{(pid=84538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 19:09:14 devstack sudo[93877]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-07c46871-22bc-45a0-92d9-be41530b11cd Apr 29 19:09:14 devstack sudo[93877]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 19:09:14 devstack sudo[93877]: pam_unix(sudo:session): session closed for user root Apr 29 19:09:14 devstack cinder-volume[84538]: DEBUG oslo_concurrency.processutils [None req-87cf167c-3963-44af-bf10-fa200530baa3 tempest-CreateVolumesFromImageTest-147990199 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-07c46871-22bc-45a0-92d9-be41530b11cd" returned: 0 in 0.579s {{(pid=84538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 19:09:14 devstack cinder-volume[84538]: DEBUG cinder.volume.drivers.quobyte [None req-87cf167c-3963-44af-bf10-fa200530baa3 tempest-CreateVolumesFromImageTest-147990199 None] <== create_volume: return (1383ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-34312b00-dd6d-45bb-af98-75855cea8e48'} {{(pid=84538) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 29 19:09:14 devstack cinder-volume[84538]: DEBUG oslo_concurrency.lockutils [None req-87cf167c-3963-44af-bf10-fa200530baa3 tempest-CreateVolumesFromImageTest-147990199 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.387s {{(pid=84538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 19:09:14 devstack cinder-volume[84538]: DEBUG oslo_concurrency.lockutils [None req-b86f188c-cb5a-4341-a688-b9c9f8eef927 tempest-CinderUnicodeTest-2074336556 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 8.991s {{(pid=84538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 19:09:14 devstack cinder-volume[84538]: DEBUG cinder.volume.drivers.quobyte [None req-b86f188c-cb5a-4341-a688-b9c9f8eef927 tempest-CinderUnicodeTest-2074336556 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-29T17:09:05Z,deleted=False,deleted_at=None,display_description='קייפש',display_name='tempest-CinderUnicodeTest-Volume-901073397',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0d42a7b3-e110-4ac2-a938-632eda1c3957,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0112255e70ee40f5aef023c026ac05f7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T17:09:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T17:09:06Z,use_quota=True,user_id='30fc12f62ad84d6fa0d9545602738c6f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(62b05900-93e3-4190-a88f-1d87324303d1),volume_type_id=62b05900-93e3-4190-a88f-1d87324303d1)}" {{(pid=84538) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 29 19:09:14 devstack cinder-volume[84538]: DEBUG cinder.volume.drivers.remotefs [None req-b86f188c-cb5a-4341-a688-b9c9f8eef927 tempest-CinderUnicodeTest-2074336556 None] Creating volume 0d42a7b3-e110-4ac2-a938-632eda1c3957 {{(pid=84538) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 29 19:09:14 devstack cinder-volume[84538]: DEBUG oslo_concurrency.lockutils [None req-b86f188c-cb5a-4341-a688-b9c9f8eef927 tempest-CinderUnicodeTest-2074336556 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 19:09:14 devstack cinder-volume[84538]: DEBUG oslo_concurrency.lockutils [None req-b86f188c-cb5a-4341-a688-b9c9f8eef927 tempest-CinderUnicodeTest-2074336556 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=84538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 19:09:14 devstack cinder-volume[84538]: DEBUG cinder.volume.drivers.quobyte [None req-b86f188c-cb5a-4341-a688-b9c9f8eef927 tempest-CinderUnicodeTest-2074336556 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-34312b00-dd6d-45bb-af98-75855cea8e48': None} {{(pid=84538) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 19:09:14 devstack cinder-volume[84538]: DEBUG cinder.volume.drivers.quobyte [None req-b86f188c-cb5a-4341-a688-b9c9f8eef927 tempest-CinderUnicodeTest-2074336556 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-34312b00-dd6d-45bb-af98-75855cea8e48'] {{(pid=84538) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 19:09:14 devstack cinder-volume[84538]: DEBUG oslo_concurrency.lockutils [None req-b86f188c-cb5a-4341-a688-b9c9f8eef927 tempest-CinderUnicodeTest-2074336556 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=84538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 19:09:14 devstack cinder-volume[84538]: DEBUG cinder.volume.drivers.quobyte [None req-b86f188c-cb5a-4341-a688-b9c9f8eef927 tempest-CinderUnicodeTest-2074336556 None] Selected osci02.corp.quobyte.com/cinder-vol-34312b00-dd6d-45bb-af98-75855cea8e48 as target Quobyte volume. {{(pid=84538) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 29 19:09:14 devstack cinder-volume[84538]: INFO cinder.volume.drivers.remotefs [None req-b86f188c-cb5a-4341-a688-b9c9f8eef927 tempest-CinderUnicodeTest-2074336556 None] casted to osci02.corp.quobyte.com/cinder-vol-34312b00-dd6d-45bb-af98-75855cea8e48 Apr 29 19:09:14 devstack cinder-volume[84538]: DEBUG oslo_concurrency.processutils [None req-b86f188c-cb5a-4341-a688-b9c9f8eef927 tempest-CinderUnicodeTest-2074336556 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-0d42a7b3-e110-4ac2-a938-632eda1c3957 1073741824 {{(pid=84538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 19:09:14 devstack sudo[93880]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-0d42a7b3-e110-4ac2-a938-632eda1c3957 1073741824 Apr 29 19:09:14 devstack sudo[93880]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 19:09:14 devstack cinder-volume[84538]: DEBUG cinder.volume.manager [None req-87cf167c-3963-44af-bf10-fa200530baa3 tempest-CreateVolumesFromImageTest-147990199 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f23aa9d0-9d00-4277-879b-c59a18c227a9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-07c46871-22bc-45a0-92d9-be41530b11cd', 'volume_size': 1}' {{(pid=84538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 19:09:14 devstack cinder-volume[84538]: DEBUG cinder.volume.manager [None req-87cf167c-3963-44af-bf10-fa200530baa3 tempest-CreateVolumesFromImageTest-147990199 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (db5ad09e-63bf-46a9-8547-d746428d387e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 19:09:14 devstack cinder-volume[84538]: INFO cinder.volume.flows.manager.create_volume [None req-87cf167c-3963-44af-bf10-fa200530baa3 tempest-CreateVolumesFromImageTest-147990199 None] Volume volume-07c46871-22bc-45a0-92d9-be41530b11cd (07c46871-22bc-45a0-92d9-be41530b11cd): created successfully Apr 29 19:09:14 devstack cinder-volume[84538]: DEBUG cinder.volume.manager [None req-87cf167c-3963-44af-bf10-fa200530baa3 tempest-CreateVolumesFromImageTest-147990199 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (db5ad09e-63bf-46a9-8547-d746428d387e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 19:09:14 devstack cinder-volume[84538]: DEBUG cinder.volume.manager [None req-87cf167c-3963-44af-bf10-fa200530baa3 tempest-CreateVolumesFromImageTest-147990199 None] Flow 'volume_create_manager' (59492a5e-8d66-4005-b506-8552c9886d7a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84538) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 19:09:14 devstack cinder-volume[84538]: INFO cinder.volume.manager [None req-87cf167c-3963-44af-bf10-fa200530baa3 tempest-CreateVolumesFromImageTest-147990199 None] Created volume successfully. Apr 29 19:09:15 devstack sudo[93880]: pam_unix(sudo:session): session closed for user root Apr 29 19:09:15 devstack cinder-volume[84538]: DEBUG oslo_concurrency.processutils [None req-b86f188c-cb5a-4341-a688-b9c9f8eef927 tempest-CinderUnicodeTest-2074336556 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-0d42a7b3-e110-4ac2-a938-632eda1c3957 1073741824" returned: 0 in 0.809s {{(pid=84538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 19:09:15 devstack cinder-volume[84538]: DEBUG cinder.coordination [None req-7f9fddff-b9bf-4520-9ff1-c94f9a042976 tempest-CreateVolumesFromImageTest-147990199 None] Acquiring lock "cinder-07c46871-22bc-45a0-92d9-be41530b11cd-delete_volume" by "delete_volume" {{(pid=84538) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 19:09:15 devstack cinder-volume[84538]: DEBUG cinder.coordination [None req-7f9fddff-b9bf-4520-9ff1-c94f9a042976 tempest-CreateVolumesFromImageTest-147990199 None] Lock "cinder-07c46871-22bc-45a0-92d9-be41530b11cd-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=84538) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 19:09:15 devstack cinder-volume[84538]: DEBUG oslo_concurrency.processutils [None req-b86f188c-cb5a-4341-a688-b9c9f8eef927 tempest-CinderUnicodeTest-2074336556 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-0d42a7b3-e110-4ac2-a938-632eda1c3957 {{(pid=84538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 19:09:15 devstack sudo[93886]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-0d42a7b3-e110-4ac2-a938-632eda1c3957 Apr 29 19:09:15 devstack sudo[93886]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 19:09:15 devstack cinder-volume[84538]: DEBUG cinder.coordination [None req-7f9fddff-b9bf-4520-9ff1-c94f9a042976 tempest-CreateVolumesFromImageTest-147990199 None] Acquiring lock "cinder-quobyte-07c46871-22bc-45a0-92d9-be41530b11cd" by "delete_volume" {{(pid=84538) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 19:09:15 devstack cinder-volume[84538]: DEBUG cinder.coordination [None req-7f9fddff-b9bf-4520-9ff1-c94f9a042976 tempest-CreateVolumesFromImageTest-147990199 None] Lock "cinder-quobyte-07c46871-22bc-45a0-92d9-be41530b11cd" acquired by "delete_volume" :: waited 0.015s {{(pid=84538) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 19:09:15 devstack cinder-volume[84538]: DEBUG oslo.privsep.daemon [-] privsep: reply[89c27a7b-135f-468e-b33a-74c5916c1496]: (4, 'qcow2') {{(pid=85803) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 19:09:15 devstack cinder-volume[84538]: DEBUG oslo_concurrency.processutils [None req-7f9fddff-b9bf-4520-9ff1-c94f9a042976 tempest-CreateVolumesFromImageTest-147990199 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-07c46871-22bc-45a0-92d9-be41530b11cd {{(pid=84538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 19:09:15 devstack sudo[93888]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-07c46871-22bc-45a0-92d9-be41530b11cd Apr 29 19:09:15 devstack sudo[93888]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 19:09:16 devstack sudo[93886]: pam_unix(sudo:session): session closed for user root Apr 29 19:09:16 devstack cinder-volume[84538]: DEBUG oslo_concurrency.processutils [None req-b86f188c-cb5a-4341-a688-b9c9f8eef927 tempest-CinderUnicodeTest-2074336556 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-0d42a7b3-e110-4ac2-a938-632eda1c3957" returned: 0 in 0.620s {{(pid=84538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 19:09:16 devstack cinder-volume[84538]: DEBUG cinder.volume.drivers.quobyte [None req-b86f188c-cb5a-4341-a688-b9c9f8eef927 tempest-CinderUnicodeTest-2074336556 None] <== create_volume: return (1488ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-34312b00-dd6d-45bb-af98-75855cea8e48'} {{(pid=84538) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 29 19:09:16 devstack cinder-volume[84538]: DEBUG oslo_concurrency.lockutils [None req-b86f188c-cb5a-4341-a688-b9c9f8eef927 tempest-CinderUnicodeTest-2074336556 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.492s {{(pid=84538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 19:09:16 devstack cinder-volume[84538]: DEBUG oslo_concurrency.lockutils [None req-9c3e12b4-5707-4c13-b3d2-f3f774b7ae4e tempest-VolumeDependencyTests-868648422 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 7.387s {{(pid=84538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 19:09:16 devstack cinder-volume[84538]: DEBUG cinder.volume.manager [None req-b86f188c-cb5a-4341-a688-b9c9f8eef927 tempest-CinderUnicodeTest-2074336556 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (87eec92f-08bd-4af8-86ca-f57aed5349b7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0d42a7b3-e110-4ac2-a938-632eda1c3957', 'volume_size': 1}' {{(pid=84538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 19:09:16 devstack cinder-volume[84538]: DEBUG cinder.volume.manager [None req-b86f188c-cb5a-4341-a688-b9c9f8eef927 tempest-CinderUnicodeTest-2074336556 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (44c8fffb-0fef-4ac4-9d5e-eadf5045f0d9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 19:09:16 devstack cinder-volume[84538]: DEBUG cinder.volume.drivers.remotefs [None req-9c3e12b4-5707-4c13-b3d2-f3f774b7ae4e tempest-VolumeDependencyTests-868648422 None] Creating offline snapshot 198e6df2-3e81-4d9e-ac11-ea6277a3032d of volume a86ac317-c9ef-4185-8a8c-2cb05a50fdf9 {{(pid=84538) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}} Apr 29 19:09:16 devstack cinder-volume[84538]: INFO cinder.volume.flows.manager.create_volume [None req-b86f188c-cb5a-4341-a688-b9c9f8eef927 tempest-CinderUnicodeTest-2074336556 None] Volume volume-0d42a7b3-e110-4ac2-a938-632eda1c3957 (0d42a7b3-e110-4ac2-a938-632eda1c3957): created successfully Apr 29 19:09:16 devstack cinder-volume[84538]: DEBUG cinder.volume.manager [None req-b86f188c-cb5a-4341-a688-b9c9f8eef927 tempest-CinderUnicodeTest-2074336556 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (44c8fffb-0fef-4ac4-9d5e-eadf5045f0d9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 19:09:16 devstack cinder-volume[84538]: DEBUG cinder.volume.manager [None req-b86f188c-cb5a-4341-a688-b9c9f8eef927 tempest-CinderUnicodeTest-2074336556 None] Flow 'volume_create_manager' (8d58a0d8-3180-45dc-9f67-40ab97c0b879) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84538) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 19:09:16 devstack cinder-volume[84538]: DEBUG oslo.privsep.daemon [-] privsep: reply[a9598b0c-b8ec-4000-8a9a-553db3e743d4]: (4, 'qcow2') {{(pid=85803) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 19:09:16 devstack cinder-volume[84538]: DEBUG oslo_concurrency.processutils [None req-9c3e12b4-5707-4c13-b3d2-f3f774b7ae4e tempest-VolumeDependencyTests-868648422 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-a86ac317-c9ef-4185-8a8c-2cb05a50fdf9 {{(pid=84538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 19:09:16 devstack cinder-volume[84538]: INFO cinder.volume.manager [None req-b86f188c-cb5a-4341-a688-b9c9f8eef927 tempest-CinderUnicodeTest-2074336556 None] Created volume successfully. Apr 29 19:09:16 devstack sudo[93894]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-a86ac317-c9ef-4185-8a8c-2cb05a50fdf9 Apr 29 19:09:16 devstack sudo[93894]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 19:09:16 devstack sudo[93888]: pam_unix(sudo:session): session closed for user root Apr 29 19:09:16 devstack cinder-volume[84538]: DEBUG oslo_concurrency.processutils [None req-7f9fddff-b9bf-4520-9ff1-c94f9a042976 tempest-CreateVolumesFromImageTest-147990199 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-07c46871-22bc-45a0-92d9-be41530b11cd" returned: 0 in 0.750s {{(pid=84538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 19:09:16 devstack cinder-volume[84538]: DEBUG oslo_concurrency.processutils [None req-7f9fddff-b9bf-4520-9ff1-c94f9a042976 tempest-CreateVolumesFromImageTest-147990199 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-07c46871-22bc-45a0-92d9-be41530b11cd {{(pid=84538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 19:09:16 devstack sudo[93896]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-07c46871-22bc-45a0-92d9-be41530b11cd Apr 29 19:09:16 devstack sudo[93896]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 19:09:16 devstack sudo[93896]: pam_unix(sudo:session): session closed for user root Apr 29 19:09:16 devstack cinder-volume[84538]: DEBUG oslo_concurrency.processutils [None req-7f9fddff-b9bf-4520-9ff1-c94f9a042976 tempest-CreateVolumesFromImageTest-147990199 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-07c46871-22bc-45a0-92d9-be41530b11cd" returned: 0 in 0.602s {{(pid=84538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 19:09:16 devstack sudo[93894]: pam_unix(sudo:session): session closed for user root Apr 29 19:09:17 devstack cinder-volume[84538]: DEBUG oslo_concurrency.processutils [None req-9c3e12b4-5707-4c13-b3d2-f3f774b7ae4e tempest-VolumeDependencyTests-868648422 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-a86ac317-c9ef-4185-8a8c-2cb05a50fdf9" returned: 0 in 0.750s {{(pid=84538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 19:09:17 devstack cinder-volume[84538]: DEBUG oslo_concurrency.processutils [None req-9c3e12b4-5707-4c13-b3d2-f3f774b7ae4e tempest-VolumeDependencyTests-868648422 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-a86ac317-c9ef-4185-8a8c-2cb05a50fdf9,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-a86ac317-c9ef-4185-8a8c-2cb05a50fdf9.198e6df2-3e81-4d9e-ac11-ea6277a3032d 1G {{(pid=84538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 19:09:17 devstack cinder-volume[84538]: DEBUG cinder.coordination [None req-7f9fddff-b9bf-4520-9ff1-c94f9a042976 tempest-CreateVolumesFromImageTest-147990199 None] Lock "cinder-quobyte-07c46871-22bc-45a0-92d9-be41530b11cd" released by "delete_volume" :: held 1.416s {{(pid=84538) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 19:09:17 devstack sudo[93903]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-a86ac317-c9ef-4185-8a8c-2cb05a50fdf9,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-a86ac317-c9ef-4185-8a8c-2cb05a50fdf9.198e6df2-3e81-4d9e-ac11-ea6277a3032d 1G Apr 29 19:09:17 devstack sudo[93903]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 19:09:17 devstack cinder-volume[84538]: DEBUG cinder.quota [None req-7f9fddff-b9bf-4520-9ff1-c94f9a042976 tempest-CreateVolumesFromImageTest-147990199 None] Created reservations ['b5bbe9d8-db86-4750-a10d-cd457f13cbb6', '01799d76-7400-408a-bb84-3fe7fdba0d5f', '6f51f2f6-acc9-4717-8562-f36e823e632e', 'd6af77a2-aaaa-4183-89dc-cc35b51565d0'] {{(pid=84538) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 29 19:09:17 devstack cinder-volume[84538]: DEBUG oslo_concurrency.lockutils [None req-7f9fddff-b9bf-4520-9ff1-c94f9a042976 tempest-CreateVolumesFromImageTest-147990199 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 19:09:17 devstack cinder-volume[84538]: DEBUG oslo_concurrency.lockutils [None req-7f9fddff-b9bf-4520-9ff1-c94f9a042976 tempest-CreateVolumesFromImageTest-147990199 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 19:09:17 devstack cinder-volume[84538]: DEBUG cinder.volume.drivers.quobyte [None req-7f9fddff-b9bf-4520-9ff1-c94f9a042976 tempest-CreateVolumesFromImageTest-147990199 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-34312b00-dd6d-45bb-af98-75855cea8e48': None} {{(pid=84538) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 19:09:17 devstack cinder-volume[84538]: DEBUG cinder.volume.drivers.quobyte [None req-7f9fddff-b9bf-4520-9ff1-c94f9a042976 tempest-CreateVolumesFromImageTest-147990199 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-34312b00-dd6d-45bb-af98-75855cea8e48'] {{(pid=84538) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 19:09:17 devstack cinder-volume[84538]: DEBUG oslo_concurrency.lockutils [None req-7f9fddff-b9bf-4520-9ff1-c94f9a042976 tempest-CreateVolumesFromImageTest-147990199 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=84538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 19:09:17 devstack cinder-volume[84538]: DEBUG oslo_concurrency.processutils [None req-7f9fddff-b9bf-4520-9ff1-c94f9a042976 tempest-CreateVolumesFromImageTest-147990199 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d {{(pid=84538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 19:09:17 devstack sudo[93905]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d Apr 29 19:09:17 devstack sudo[93905]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 19:09:17 devstack cinder-volume[84538]: DEBUG oslo_concurrency.lockutils [None req-ec94e830-e93b-4984-b611-08ee9b4495a1 tempest-CinderUnicodeTest-2074336556 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=84538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 19:09:17 devstack cinder-volume[84538]: DEBUG cinder.coordination [None req-406a8e44-c393-4e01-94ee-b59ea7a45630 tempest-CreateVolumesFromImageTest-147990199 None] Acquiring lock "cinder-c61d2277-9a07-44b4-b6bd-cb4bd478c2d2-delete_volume" by "delete_volume" {{(pid=84538) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 19:09:17 devstack cinder-volume[84538]: DEBUG cinder.coordination [None req-406a8e44-c393-4e01-94ee-b59ea7a45630 tempest-CreateVolumesFromImageTest-147990199 None] Lock "cinder-c61d2277-9a07-44b4-b6bd-cb4bd478c2d2-delete_volume" acquired by "delete_volume" :: waited 0.031s {{(pid=84538) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 19:09:17 devstack sudo[93905]: pam_unix(sudo:session): session closed for user root Apr 29 19:09:17 devstack cinder-volume[84538]: DEBUG cinder.coordination [None req-406a8e44-c393-4e01-94ee-b59ea7a45630 tempest-CreateVolumesFromImageTest-147990199 None] Acquiring lock "cinder-quobyte-c61d2277-9a07-44b4-b6bd-cb4bd478c2d2" by "delete_volume" {{(pid=84538) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 19:09:17 devstack cinder-volume[84538]: DEBUG oslo_concurrency.processutils [None req-7f9fddff-b9bf-4520-9ff1-c94f9a042976 tempest-CreateVolumesFromImageTest-147990199 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d" returned: 0 in 0.696s {{(pid=84538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 19:09:17 devstack cinder-volume[84538]: DEBUG cinder.manager [None req-7f9fddff-b9bf-4520-9ff1-c94f9a042976 tempest-CreateVolumesFromImageTest-147990199 None] Notifying Schedulers of capabilities ... {{(pid=84538) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 29 19:09:17 devstack cinder-volume[84538]: INFO cinder.volume.manager [None req-7f9fddff-b9bf-4520-9ff1-c94f9a042976 tempest-CreateVolumesFromImageTest-147990199 None] Deleted volume successfully. Apr 29 19:09:17 devstack cinder-volume[84538]: DEBUG cinder.coordination [None req-406a8e44-c393-4e01-94ee-b59ea7a45630 tempest-CreateVolumesFromImageTest-147990199 None] Lock "cinder-quobyte-c61d2277-9a07-44b4-b6bd-cb4bd478c2d2" acquired by "delete_volume" :: waited 0.027s {{(pid=84538) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 19:09:17 devstack sudo[93903]: pam_unix(sudo:session): session closed for user root Apr 29 19:09:17 devstack cinder-volume[84538]: DEBUG oslo_concurrency.processutils [None req-9c3e12b4-5707-4c13-b3d2-f3f774b7ae4e tempest-VolumeDependencyTests-868648422 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-a86ac317-c9ef-4185-8a8c-2cb05a50fdf9,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-a86ac317-c9ef-4185-8a8c-2cb05a50fdf9.198e6df2-3e81-4d9e-ac11-ea6277a3032d 1G" returned: 0 in 0.865s {{(pid=84538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 19:09:17 devstack cinder-volume[84538]: DEBUG oslo_concurrency.processutils [None req-9c3e12b4-5707-4c13-b3d2-f3f774b7ae4e tempest-VolumeDependencyTests-868648422 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a86ac317-c9ef-4185-8a8c-2cb05a50fdf9 -F qcow2 /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-a86ac317-c9ef-4185-8a8c-2cb05a50fdf9.198e6df2-3e81-4d9e-ac11-ea6277a3032d {{(pid=84538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 19:09:17 devstack cinder-volume[84538]: DEBUG oslo.privsep.daemon [-] privsep: reply[82731c24-e4b7-49d0-b7ff-3335f94dddc1]: (4, 'qcow2') {{(pid=85803) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 19:09:17 devstack cinder-volume[84538]: DEBUG oslo_concurrency.processutils [None req-406a8e44-c393-4e01-94ee-b59ea7a45630 tempest-CreateVolumesFromImageTest-147990199 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-c61d2277-9a07-44b4-b6bd-cb4bd478c2d2 {{(pid=84538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 19:09:17 devstack sudo[93912]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a86ac317-c9ef-4185-8a8c-2cb05a50fdf9 -F qcow2 /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-a86ac317-c9ef-4185-8a8c-2cb05a50fdf9.198e6df2-3e81-4d9e-ac11-ea6277a3032d Apr 29 19:09:17 devstack sudo[93912]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 19:09:17 devstack cinder-volume[84538]: DEBUG cinder.coordination [None req-7f9fddff-b9bf-4520-9ff1-c94f9a042976 tempest-CreateVolumesFromImageTest-147990199 None] Lock "cinder-07c46871-22bc-45a0-92d9-be41530b11cd-delete_volume" released by "delete_volume" :: held 2.383s {{(pid=84538) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 19:09:17 devstack sudo[93913]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-c61d2277-9a07-44b4-b6bd-cb4bd478c2d2 Apr 29 19:09:18 devstack sudo[93913]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 19:09:18 devstack sudo[93912]: pam_unix(sudo:session): session closed for user root Apr 29 19:09:18 devstack cinder-volume[84538]: DEBUG oslo_concurrency.processutils [None req-9c3e12b4-5707-4c13-b3d2-f3f774b7ae4e tempest-VolumeDependencyTests-868648422 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a86ac317-c9ef-4185-8a8c-2cb05a50fdf9 -F qcow2 /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-a86ac317-c9ef-4185-8a8c-2cb05a50fdf9.198e6df2-3e81-4d9e-ac11-ea6277a3032d" returned: 0 in 0.676s {{(pid=84538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 19:09:18 devstack cinder-volume[84538]: WARNING cinder.volume.drivers.remotefs [None req-9c3e12b4-5707-4c13-b3d2-f3f774b7ae4e tempest-VolumeDependencyTests-868648422 None] /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-a86ac317-c9ef-4185-8a8c-2cb05a50fdf9.198e6df2-3e81-4d9e-ac11-ea6277a3032d is being set with open permissions: ugo+rw Apr 29 19:09:18 devstack cinder-volume[84538]: DEBUG oslo_concurrency.processutils [None req-9c3e12b4-5707-4c13-b3d2-f3f774b7ae4e tempest-VolumeDependencyTests-868648422 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-a86ac317-c9ef-4185-8a8c-2cb05a50fdf9.198e6df2-3e81-4d9e-ac11-ea6277a3032d {{(pid=84538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 19:09:18 devstack sudo[93924]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-a86ac317-c9ef-4185-8a8c-2cb05a50fdf9.198e6df2-3e81-4d9e-ac11-ea6277a3032d Apr 29 19:09:18 devstack sudo[93924]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 19:09:18 devstack sudo[93913]: pam_unix(sudo:session): session closed for user root Apr 29 19:09:18 devstack cinder-volume[84538]: DEBUG oslo_concurrency.processutils [None req-406a8e44-c393-4e01-94ee-b59ea7a45630 tempest-CreateVolumesFromImageTest-147990199 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-c61d2277-9a07-44b4-b6bd-cb4bd478c2d2" returned: 0 in 0.718s {{(pid=84538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 19:09:18 devstack cinder-volume[84538]: DEBUG oslo_concurrency.processutils [None req-406a8e44-c393-4e01-94ee-b59ea7a45630 tempest-CreateVolumesFromImageTest-147990199 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-c61d2277-9a07-44b4-b6bd-cb4bd478c2d2 {{(pid=84538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 19:09:18 devstack sudo[93926]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-c61d2277-9a07-44b4-b6bd-cb4bd478c2d2 Apr 29 19:09:18 devstack sudo[93926]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 19:09:19 devstack sudo[93924]: pam_unix(sudo:session): session closed for user root Apr 29 19:09:19 devstack cinder-volume[84538]: DEBUG oslo_concurrency.processutils [None req-9c3e12b4-5707-4c13-b3d2-f3f774b7ae4e tempest-VolumeDependencyTests-868648422 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-a86ac317-c9ef-4185-8a8c-2cb05a50fdf9.198e6df2-3e81-4d9e-ac11-ea6277a3032d" returned: 0 in 0.617s {{(pid=84538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 19:09:19 devstack cinder-volume[84538]: DEBUG oslo_concurrency.processutils [None req-9c3e12b4-5707-4c13-b3d2-f3f774b7ae4e tempest-VolumeDependencyTests-868648422 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-a86ac317-c9ef-4185-8a8c-2cb05a50fdf9.info {{(pid=84538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 19:09:19 devstack sudo[93926]: pam_unix(sudo:session): session closed for user root Apr 29 19:09:19 devstack cinder-volume[84538]: DEBUG oslo_concurrency.processutils [None req-406a8e44-c393-4e01-94ee-b59ea7a45630 tempest-CreateVolumesFromImageTest-147990199 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-c61d2277-9a07-44b4-b6bd-cb4bd478c2d2" returned: 0 in 0.626s {{(pid=84538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 19:09:19 devstack sudo[93930]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-a86ac317-c9ef-4185-8a8c-2cb05a50fdf9.info Apr 29 19:09:19 devstack sudo[93930]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 19:09:19 devstack cinder-volume[84538]: DEBUG cinder.coordination [None req-406a8e44-c393-4e01-94ee-b59ea7a45630 tempest-CreateVolumesFromImageTest-147990199 None] Lock "cinder-quobyte-c61d2277-9a07-44b4-b6bd-cb4bd478c2d2" released by "delete_volume" :: held 1.395s {{(pid=84538) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 19:09:19 devstack cinder-volume[84538]: DEBUG cinder.quota [None req-406a8e44-c393-4e01-94ee-b59ea7a45630 tempest-CreateVolumesFromImageTest-147990199 None] Created reservations ['39226c4a-6f1c-448a-a45a-3c54bfb9860a', '5f13bbee-2cbe-4c7f-a7e4-a15d34a02af9', '801489b2-d7c6-410f-8205-e2b8f8f71d24', '07e9f8b5-d4cb-491e-a11d-39225a2a7ff4'] {{(pid=84538) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 29 19:09:19 devstack cinder-volume[84538]: DEBUG oslo_concurrency.lockutils [None req-406a8e44-c393-4e01-94ee-b59ea7a45630 tempest-CreateVolumesFromImageTest-147990199 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 19:09:19 devstack cinder-volume[84538]: DEBUG oslo_concurrency.lockutils [None req-406a8e44-c393-4e01-94ee-b59ea7a45630 tempest-CreateVolumesFromImageTest-147990199 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 19:09:19 devstack cinder-volume[84538]: DEBUG cinder.volume.drivers.quobyte [None req-406a8e44-c393-4e01-94ee-b59ea7a45630 tempest-CreateVolumesFromImageTest-147990199 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-34312b00-dd6d-45bb-af98-75855cea8e48': None} {{(pid=84538) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 19:09:19 devstack cinder-volume[84538]: DEBUG cinder.volume.drivers.quobyte [None req-406a8e44-c393-4e01-94ee-b59ea7a45630 tempest-CreateVolumesFromImageTest-147990199 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-34312b00-dd6d-45bb-af98-75855cea8e48'] {{(pid=84538) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 19:09:19 devstack cinder-volume[84538]: DEBUG oslo_concurrency.lockutils [None req-406a8e44-c393-4e01-94ee-b59ea7a45630 tempest-CreateVolumesFromImageTest-147990199 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=84538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 19:09:19 devstack cinder-volume[84538]: DEBUG oslo_concurrency.processutils [None req-406a8e44-c393-4e01-94ee-b59ea7a45630 tempest-CreateVolumesFromImageTest-147990199 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d {{(pid=84538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 19:09:19 devstack sudo[93932]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d Apr 29 19:09:19 devstack sudo[93932]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 19:09:19 devstack sudo[93930]: pam_unix(sudo:session): session closed for user root Apr 29 19:09:19 devstack cinder-volume[84538]: DEBUG oslo_concurrency.processutils [None req-9c3e12b4-5707-4c13-b3d2-f3f774b7ae4e tempest-VolumeDependencyTests-868648422 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-a86ac317-c9ef-4185-8a8c-2cb05a50fdf9.info" returned: 0 in 0.627s {{(pid=84538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 19:09:19 devstack cinder-volume[84538]: WARNING cinder.volume.drivers.remotefs [None req-9c3e12b4-5707-4c13-b3d2-f3f774b7ae4e tempest-VolumeDependencyTests-868648422 None] /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-a86ac317-c9ef-4185-8a8c-2cb05a50fdf9.info is being set with open permissions: ugo+rw Apr 29 19:09:19 devstack cinder-volume[84538]: DEBUG oslo_concurrency.processutils [None req-9c3e12b4-5707-4c13-b3d2-f3f774b7ae4e tempest-VolumeDependencyTests-868648422 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-a86ac317-c9ef-4185-8a8c-2cb05a50fdf9.info {{(pid=84538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 19:09:19 devstack sudo[93935]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-a86ac317-c9ef-4185-8a8c-2cb05a50fdf9.info Apr 29 19:09:19 devstack sudo[93935]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 19:09:19 devstack cinder-volume[84538]: DEBUG cinder.coordination [None req-3c62d331-a90b-43a6-9ed2-6b3b74a79e08 tempest-CreateVolumesFromImageTest-147990199 None] Acquiring lock "cinder-b9da96b0-3fc4-4a15-bc91-859ba280cdd5-delete_volume" by "delete_volume" {{(pid=84538) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 19:09:19 devstack sudo[93932]: pam_unix(sudo:session): session closed for user root Apr 29 19:09:19 devstack cinder-volume[84538]: DEBUG oslo_concurrency.processutils [None req-406a8e44-c393-4e01-94ee-b59ea7a45630 tempest-CreateVolumesFromImageTest-147990199 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d" returned: 0 in 0.627s {{(pid=84538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 19:09:19 devstack cinder-volume[84538]: DEBUG cinder.manager [None req-406a8e44-c393-4e01-94ee-b59ea7a45630 tempest-CreateVolumesFromImageTest-147990199 None] Notifying Schedulers of capabilities ... {{(pid=84538) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 29 19:09:19 devstack cinder-volume[84538]: INFO cinder.volume.manager [None req-406a8e44-c393-4e01-94ee-b59ea7a45630 tempest-CreateVolumesFromImageTest-147990199 None] Deleted volume successfully. Apr 29 19:09:20 devstack cinder-volume[84538]: DEBUG cinder.coordination [None req-3c62d331-a90b-43a6-9ed2-6b3b74a79e08 tempest-CreateVolumesFromImageTest-147990199 None] Lock "cinder-b9da96b0-3fc4-4a15-bc91-859ba280cdd5-delete_volume" acquired by "delete_volume" :: waited 0.033s {{(pid=84538) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 19:09:20 devstack cinder-volume[84538]: DEBUG cinder.coordination [None req-406a8e44-c393-4e01-94ee-b59ea7a45630 tempest-CreateVolumesFromImageTest-147990199 None] Lock "cinder-c61d2277-9a07-44b4-b6bd-cb4bd478c2d2-delete_volume" released by "delete_volume" :: held 2.262s {{(pid=84538) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 19:09:20 devstack cinder-volume[84538]: DEBUG cinder.coordination [None req-3c62d331-a90b-43a6-9ed2-6b3b74a79e08 tempest-CreateVolumesFromImageTest-147990199 None] Acquiring lock "cinder-quobyte-b9da96b0-3fc4-4a15-bc91-859ba280cdd5" by "delete_volume" {{(pid=84538) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 19:09:20 devstack cinder-volume[84538]: DEBUG cinder.coordination [None req-3c62d331-a90b-43a6-9ed2-6b3b74a79e08 tempest-CreateVolumesFromImageTest-147990199 None] Lock "cinder-quobyte-b9da96b0-3fc4-4a15-bc91-859ba280cdd5" acquired by "delete_volume" :: waited 0.014s {{(pid=84538) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 19:09:20 devstack cinder-volume[84538]: DEBUG oslo.privsep.daemon [-] privsep: reply[cbe451f4-37eb-4741-9f50-136e03298a6e]: (4, 'qcow2') {{(pid=85803) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 19:09:20 devstack cinder-volume[84538]: DEBUG oslo_concurrency.processutils [None req-3c62d331-a90b-43a6-9ed2-6b3b74a79e08 tempest-CreateVolumesFromImageTest-147990199 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-b9da96b0-3fc4-4a15-bc91-859ba280cdd5 {{(pid=84538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 19:09:20 devstack sudo[93938]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-b9da96b0-3fc4-4a15-bc91-859ba280cdd5 Apr 29 19:09:20 devstack sudo[93938]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 19:09:20 devstack sudo[93935]: pam_unix(sudo:session): session closed for user root Apr 29 19:09:20 devstack cinder-volume[84538]: DEBUG oslo_concurrency.processutils [None req-9c3e12b4-5707-4c13-b3d2-f3f774b7ae4e tempest-VolumeDependencyTests-868648422 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-a86ac317-c9ef-4185-8a8c-2cb05a50fdf9.info" returned: 0 in 0.676s {{(pid=84538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 19:09:20 devstack cinder-volume[84538]: DEBUG oslo_concurrency.lockutils [None req-9c3e12b4-5707-4c13-b3d2-f3f774b7ae4e tempest-VolumeDependencyTests-868648422 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.356s {{(pid=84538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 19:09:20 devstack cinder-volume[84538]: DEBUG oslo_concurrency.lockutils [None req-27647daf-1e02-4cd0-9595-d7ca305721d2 tempest-CreateVolumesFromSnapshotTest-1938046858 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 10.617s {{(pid=84538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 19:09:20 devstack cinder-volume[84538]: DEBUG cinder.volume.drivers.remotefs [None req-27647daf-1e02-4cd0-9595-d7ca305721d2 tempest-CreateVolumesFromSnapshotTest-1938046858 None] Creating offline snapshot 89bfd338-4f29-4224-b722-56ca888584d3 of volume 2d2109ce-37b6-478b-bb3f-990749f03fc6 {{(pid=84538) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}} Apr 29 19:09:20 devstack cinder-volume[84538]: INFO cinder.volume.manager [None req-9c3e12b4-5707-4c13-b3d2-f3f774b7ae4e tempest-VolumeDependencyTests-868648422 None] Create snapshot completed successfully Apr 29 19:09:20 devstack cinder-volume[84538]: DEBUG oslo.privsep.daemon [-] privsep: reply[b24a8924-24fe-49cd-b410-557ada1d45b1]: (4, 'qcow2') {{(pid=85803) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 19:09:20 devstack cinder-volume[84538]: DEBUG oslo_concurrency.processutils [None req-27647daf-1e02-4cd0-9595-d7ca305721d2 tempest-CreateVolumesFromSnapshotTest-1938046858 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-2d2109ce-37b6-478b-bb3f-990749f03fc6 {{(pid=84538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 19:09:20 devstack sudo[93941]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-2d2109ce-37b6-478b-bb3f-990749f03fc6 Apr 29 19:09:20 devstack sudo[93941]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 19:09:20 devstack sudo[93938]: pam_unix(sudo:session): session closed for user root Apr 29 19:09:20 devstack cinder-volume[84538]: DEBUG oslo_concurrency.processutils [None req-3c62d331-a90b-43a6-9ed2-6b3b74a79e08 tempest-CreateVolumesFromImageTest-147990199 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-b9da96b0-3fc4-4a15-bc91-859ba280cdd5" returned: 0 in 0.733s {{(pid=84538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 19:09:20 devstack cinder-volume[84538]: DEBUG oslo_concurrency.processutils [None req-3c62d331-a90b-43a6-9ed2-6b3b74a79e08 tempest-CreateVolumesFromImageTest-147990199 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-b9da96b0-3fc4-4a15-bc91-859ba280cdd5 {{(pid=84538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 19:09:20 devstack sudo[93946]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-b9da96b0-3fc4-4a15-bc91-859ba280cdd5 Apr 29 19:09:20 devstack sudo[93946]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 19:09:21 devstack sudo[93941]: pam_unix(sudo:session): session closed for user root Apr 29 19:09:21 devstack cinder-volume[84538]: DEBUG oslo_concurrency.processutils [None req-27647daf-1e02-4cd0-9595-d7ca305721d2 tempest-CreateVolumesFromSnapshotTest-1938046858 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-2d2109ce-37b6-478b-bb3f-990749f03fc6" returned: 0 in 0.755s {{(pid=84538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 19:09:21 devstack cinder-volume[84538]: DEBUG oslo_concurrency.processutils [None req-27647daf-1e02-4cd0-9595-d7ca305721d2 tempest-CreateVolumesFromSnapshotTest-1938046858 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-2d2109ce-37b6-478b-bb3f-990749f03fc6,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-2d2109ce-37b6-478b-bb3f-990749f03fc6.89bfd338-4f29-4224-b722-56ca888584d3 1G {{(pid=84538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 19:09:21 devstack sudo[93951]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-2d2109ce-37b6-478b-bb3f-990749f03fc6,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-2d2109ce-37b6-478b-bb3f-990749f03fc6.89bfd338-4f29-4224-b722-56ca888584d3 1G Apr 29 19:09:21 devstack sudo[93951]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 19:09:21 devstack sudo[93946]: pam_unix(sudo:session): session closed for user root Apr 29 19:09:21 devstack cinder-volume[84538]: DEBUG oslo_concurrency.processutils [None req-3c62d331-a90b-43a6-9ed2-6b3b74a79e08 tempest-CreateVolumesFromImageTest-147990199 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-b9da96b0-3fc4-4a15-bc91-859ba280cdd5" returned: 0 in 0.635s {{(pid=84538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 19:09:21 devstack cinder-volume[84538]: DEBUG cinder.coordination [None req-3c62d331-a90b-43a6-9ed2-6b3b74a79e08 tempest-CreateVolumesFromImageTest-147990199 None] Lock "cinder-quobyte-b9da96b0-3fc4-4a15-bc91-859ba280cdd5" released by "delete_volume" :: held 1.416s {{(pid=84538) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 19:09:21 devstack cinder-volume[84538]: DEBUG cinder.quota [None req-3c62d331-a90b-43a6-9ed2-6b3b74a79e08 tempest-CreateVolumesFromImageTest-147990199 None] Created reservations ['0642dac0-2f58-4dbd-ae09-8a8b76e44da6', '89cead12-68a3-48c0-8e59-8d634116b49d', 'c623c967-0a31-461c-929c-876255ca17dd', 'ab5d6c97-5fd3-4f7c-ad23-b95ebfa0b80d'] {{(pid=84538) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 29 19:09:21 devstack cinder-volume[84538]: DEBUG oslo_concurrency.lockutils [None req-3c62d331-a90b-43a6-9ed2-6b3b74a79e08 tempest-CreateVolumesFromImageTest-147990199 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 19:09:21 devstack cinder-volume[84538]: DEBUG oslo_concurrency.lockutils [None req-3c62d331-a90b-43a6-9ed2-6b3b74a79e08 tempest-CreateVolumesFromImageTest-147990199 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 19:09:21 devstack cinder-volume[84538]: DEBUG cinder.volume.drivers.quobyte [None req-3c62d331-a90b-43a6-9ed2-6b3b74a79e08 tempest-CreateVolumesFromImageTest-147990199 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-34312b00-dd6d-45bb-af98-75855cea8e48': None} {{(pid=84538) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 19:09:21 devstack cinder-volume[84538]: DEBUG cinder.volume.drivers.quobyte [None req-3c62d331-a90b-43a6-9ed2-6b3b74a79e08 tempest-CreateVolumesFromImageTest-147990199 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-34312b00-dd6d-45bb-af98-75855cea8e48'] {{(pid=84538) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 19:09:21 devstack cinder-volume[84538]: DEBUG oslo_concurrency.lockutils [None req-3c62d331-a90b-43a6-9ed2-6b3b74a79e08 tempest-CreateVolumesFromImageTest-147990199 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=84538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 19:09:21 devstack cinder-volume[84538]: DEBUG oslo_concurrency.processutils [None req-3c62d331-a90b-43a6-9ed2-6b3b74a79e08 tempest-CreateVolumesFromImageTest-147990199 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d {{(pid=84538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 19:09:21 devstack sudo[93954]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d Apr 29 19:09:21 devstack sudo[93954]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 19:09:21 devstack cinder-volume[84538]: DEBUG cinder.volume.flows.manager.create_volume [None req-0a9a7be7-cad7-40a2-aaaf-c4914eba2feb tempest-VolumeDependencyTests-868648422 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84538) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Apr 29 19:09:21 devstack cinder-volume[84538]: DEBUG cinder.volume.manager [None req-0a9a7be7-cad7-40a2-aaaf-c4914eba2feb tempest-VolumeDependencyTests-868648422 None] Flow 'volume_create_manager' (7d6725b5-c4ca-4f9e-8945-b649e1610282) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84538) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 19:09:21 devstack cinder-volume[84538]: DEBUG cinder.volume.manager [None req-0a9a7be7-cad7-40a2-aaaf-c4914eba2feb tempest-VolumeDependencyTests-868648422 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e329b601-4d85-4901-8445-42fb2feb2999) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 19:09:21 devstack cinder-volume[84538]: DEBUG cinder.volume.manager [None req-0a9a7be7-cad7-40a2-aaaf-c4914eba2feb tempest-VolumeDependencyTests-868648422 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e329b601-4d85-4901-8445-42fb2feb2999) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-29T17:09:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-600223081',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=90a642e5-d251-44d5-aa73-d01b4f57c2b2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5af39d55694c40d7b5395e79cb6623fa',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T17:09:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=198e6df2-3e81-4d9e-ac11-ea6277a3032d,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T17:09:22Z,use_quota=True,user_id='d13112c160bd44458a48dc463fb78a07',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(62b05900-93e3-4190-a88f-1d87324303d1),volume_type_id=62b05900-93e3-4190-a88f-1d87324303d1)' {{(pid=84538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 19:09:21 devstack cinder-volume[84538]: DEBUG cinder.volume.manager [None req-0a9a7be7-cad7-40a2-aaaf-c4914eba2feb tempest-VolumeDependencyTests-868648422 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (16bf8584-1ecc-4c86-b266-bd47c43a1640) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 19:09:21 devstack cinder-volume[84538]: DEBUG cinder.volume.manager [None req-0a9a7be7-cad7-40a2-aaaf-c4914eba2feb tempest-VolumeDependencyTests-868648422 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (16bf8584-1ecc-4c86-b266-bd47c43a1640) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 19:09:21 devstack cinder-volume[84538]: DEBUG cinder.volume.manager [None req-0a9a7be7-cad7-40a2-aaaf-c4914eba2feb tempest-VolumeDependencyTests-868648422 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (29d317da-7722-47bf-ab48-1e4057fabfa7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 19:09:21 devstack cinder-volume[84538]: DEBUG cinder.volume.manager [None req-0a9a7be7-cad7-40a2-aaaf-c4914eba2feb tempest-VolumeDependencyTests-868648422 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (29d317da-7722-47bf-ab48-1e4057fabfa7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '90a642e5-d251-44d5-aa73-d01b4f57c2b2', 'volume_name': 'volume-90a642e5-d251-44d5-aa73-d01b4f57c2b2', 'volume_size': 1, 'snapshot_id': '198e6df2-3e81-4d9e-ac11-ea6277a3032d'}' {{(pid=84538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 19:09:21 devstack cinder-volume[84538]: DEBUG cinder.volume.manager [None req-0a9a7be7-cad7-40a2-aaaf-c4914eba2feb tempest-VolumeDependencyTests-868648422 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (23b43cc3-3252-48da-ab87-561c83070790) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 19:09:21 devstack cinder-volume[84538]: DEBUG cinder.volume.manager [None req-0a9a7be7-cad7-40a2-aaaf-c4914eba2feb tempest-VolumeDependencyTests-868648422 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (23b43cc3-3252-48da-ab87-561c83070790) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 19:09:21 devstack cinder-volume[84538]: DEBUG cinder.volume.manager [None req-0a9a7be7-cad7-40a2-aaaf-c4914eba2feb tempest-VolumeDependencyTests-868648422 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (784f0ff3-d984-4696-86a0-8ddfa50eed72) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 19:09:21 devstack cinder-volume[84538]: INFO cinder.volume.flows.manager.create_volume [None req-0a9a7be7-cad7-40a2-aaaf-c4914eba2feb tempest-VolumeDependencyTests-868648422 None] Volume 90a642e5-d251-44d5-aa73-d01b4f57c2b2: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-90a642e5-d251-44d5-aa73-d01b4f57c2b2', 'volume_size': 1, 'snapshot_id': '198e6df2-3e81-4d9e-ac11-ea6277a3032d'} Apr 29 19:09:21 devstack cinder-volume[84538]: DEBUG oslo_concurrency.lockutils [None req-0a9a7be7-cad7-40a2-aaaf-c4914eba2feb tempest-VolumeDependencyTests-868648422 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=84538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 19:09:22 devstack sudo[93951]: pam_unix(sudo:session): session closed for user root Apr 29 19:09:22 devstack cinder-volume[84538]: DEBUG oslo_concurrency.processutils [None req-27647daf-1e02-4cd0-9595-d7ca305721d2 tempest-CreateVolumesFromSnapshotTest-1938046858 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-2d2109ce-37b6-478b-bb3f-990749f03fc6,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-2d2109ce-37b6-478b-bb3f-990749f03fc6.89bfd338-4f29-4224-b722-56ca888584d3 1G" returned: 0 in 0.852s {{(pid=84538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 19:09:22 devstack cinder-volume[84538]: DEBUG oslo_concurrency.processutils [None req-27647daf-1e02-4cd0-9595-d7ca305721d2 tempest-CreateVolumesFromSnapshotTest-1938046858 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-2d2109ce-37b6-478b-bb3f-990749f03fc6 -F qcow2 /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-2d2109ce-37b6-478b-bb3f-990749f03fc6.89bfd338-4f29-4224-b722-56ca888584d3 {{(pid=84538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 19:09:22 devstack sudo[93960]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-2d2109ce-37b6-478b-bb3f-990749f03fc6 -F qcow2 /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-2d2109ce-37b6-478b-bb3f-990749f03fc6.89bfd338-4f29-4224-b722-56ca888584d3 Apr 29 19:09:22 devstack sudo[93960]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 19:09:22 devstack cinder-volume[84538]: DEBUG cinder.coordination [None req-b1c3540b-c828-457e-8535-fecc6b922ca8 tempest-CreateVolumesFromImageTest-147990199 None] Acquiring lock "cinder-c19cf185-e537-4815-9d41-e08128d05c40-delete_volume" by "delete_volume" {{(pid=84538) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 19:09:22 devstack cinder-volume[84538]: DEBUG cinder.coordination [None req-b1c3540b-c828-457e-8535-fecc6b922ca8 tempest-CreateVolumesFromImageTest-147990199 None] Lock "cinder-c19cf185-e537-4815-9d41-e08128d05c40-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=84538) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 19:09:22 devstack cinder-volume[84538]: DEBUG cinder.coordination [None req-b1c3540b-c828-457e-8535-fecc6b922ca8 tempest-CreateVolumesFromImageTest-147990199 None] Acquiring lock "cinder-quobyte-c19cf185-e537-4815-9d41-e08128d05c40" by "delete_volume" {{(pid=84538) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 19:09:22 devstack cinder-volume[84538]: DEBUG cinder.coordination [None req-b1c3540b-c828-457e-8535-fecc6b922ca8 tempest-CreateVolumesFromImageTest-147990199 None] Lock "cinder-quobyte-c19cf185-e537-4815-9d41-e08128d05c40" acquired by "delete_volume" :: waited 0.017s {{(pid=84538) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 19:09:22 devstack cinder-volume[84538]: DEBUG oslo.privsep.daemon [-] privsep: reply[5b0910b8-3f2a-4b70-a381-bf99cebb5a00]: (4, 'qcow2') {{(pid=85803) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 19:09:22 devstack cinder-volume[84538]: DEBUG oslo_concurrency.processutils [None req-b1c3540b-c828-457e-8535-fecc6b922ca8 tempest-CreateVolumesFromImageTest-147990199 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-c19cf185-e537-4815-9d41-e08128d05c40 {{(pid=84538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 19:09:22 devstack sudo[93954]: pam_unix(sudo:session): session closed for user root Apr 29 19:09:22 devstack cinder-volume[84538]: DEBUG oslo_concurrency.processutils [None req-3c62d331-a90b-43a6-9ed2-6b3b74a79e08 tempest-CreateVolumesFromImageTest-147990199 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d" returned: 0 in 0.724s {{(pid=84538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 19:09:22 devstack cinder-volume[84538]: DEBUG cinder.manager [None req-3c62d331-a90b-43a6-9ed2-6b3b74a79e08 tempest-CreateVolumesFromImageTest-147990199 None] Notifying Schedulers of capabilities ... {{(pid=84538) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 29 19:09:22 devstack cinder-volume[84538]: INFO cinder.volume.manager [None req-3c62d331-a90b-43a6-9ed2-6b3b74a79e08 tempest-CreateVolumesFromImageTest-147990199 None] Deleted volume successfully. Apr 29 19:09:22 devstack cinder-volume[84538]: DEBUG cinder.coordination [None req-3c62d331-a90b-43a6-9ed2-6b3b74a79e08 tempest-CreateVolumesFromImageTest-147990199 None] Lock "cinder-b9da96b0-3fc4-4a15-bc91-859ba280cdd5-delete_volume" released by "delete_volume" :: held 2.399s {{(pid=84538) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 19:09:22 devstack sudo[93963]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-c19cf185-e537-4815-9d41-e08128d05c40 Apr 29 19:09:22 devstack sudo[93963]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 19:09:22 devstack sudo[93960]: pam_unix(sudo:session): session closed for user root Apr 29 19:09:22 devstack cinder-volume[84538]: DEBUG oslo_concurrency.processutils [None req-27647daf-1e02-4cd0-9595-d7ca305721d2 tempest-CreateVolumesFromSnapshotTest-1938046858 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-2d2109ce-37b6-478b-bb3f-990749f03fc6 -F qcow2 /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-2d2109ce-37b6-478b-bb3f-990749f03fc6.89bfd338-4f29-4224-b722-56ca888584d3" returned: 0 in 0.705s {{(pid=84538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 19:09:22 devstack cinder-volume[84538]: WARNING cinder.volume.drivers.remotefs [None req-27647daf-1e02-4cd0-9595-d7ca305721d2 tempest-CreateVolumesFromSnapshotTest-1938046858 None] /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-2d2109ce-37b6-478b-bb3f-990749f03fc6.89bfd338-4f29-4224-b722-56ca888584d3 is being set with open permissions: ugo+rw Apr 29 19:09:22 devstack cinder-volume[84538]: DEBUG oslo_concurrency.processutils [None req-27647daf-1e02-4cd0-9595-d7ca305721d2 tempest-CreateVolumesFromSnapshotTest-1938046858 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-2d2109ce-37b6-478b-bb3f-990749f03fc6.89bfd338-4f29-4224-b722-56ca888584d3 {{(pid=84538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 19:09:22 devstack sudo[93968]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-2d2109ce-37b6-478b-bb3f-990749f03fc6.89bfd338-4f29-4224-b722-56ca888584d3 Apr 29 19:09:22 devstack sudo[93968]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 19:09:23 devstack sudo[93963]: pam_unix(sudo:session): session closed for user root Apr 29 19:09:23 devstack cinder-volume[84538]: DEBUG oslo_concurrency.processutils [None req-b1c3540b-c828-457e-8535-fecc6b922ca8 tempest-CreateVolumesFromImageTest-147990199 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-c19cf185-e537-4815-9d41-e08128d05c40" returned: 0 in 0.790s {{(pid=84538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 19:09:23 devstack cinder-volume[84538]: DEBUG oslo_concurrency.processutils [None req-b1c3540b-c828-457e-8535-fecc6b922ca8 tempest-CreateVolumesFromImageTest-147990199 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-c19cf185-e537-4815-9d41-e08128d05c40 {{(pid=84538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 19:09:23 devstack sudo[93973]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-c19cf185-e537-4815-9d41-e08128d05c40 Apr 29 19:09:23 devstack sudo[93973]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 19:09:23 devstack sudo[93968]: pam_unix(sudo:session): session closed for user root Apr 29 19:09:23 devstack cinder-volume[84538]: DEBUG oslo_concurrency.processutils [None req-27647daf-1e02-4cd0-9595-d7ca305721d2 tempest-CreateVolumesFromSnapshotTest-1938046858 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-2d2109ce-37b6-478b-bb3f-990749f03fc6.89bfd338-4f29-4224-b722-56ca888584d3" returned: 0 in 0.668s {{(pid=84538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 19:09:23 devstack cinder-volume[84538]: DEBUG oslo_concurrency.processutils [None req-27647daf-1e02-4cd0-9595-d7ca305721d2 tempest-CreateVolumesFromSnapshotTest-1938046858 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-2d2109ce-37b6-478b-bb3f-990749f03fc6.info {{(pid=84538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 19:09:23 devstack sudo[93976]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-2d2109ce-37b6-478b-bb3f-990749f03fc6.info Apr 29 19:09:23 devstack sudo[93976]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 19:09:23 devstack sudo[93973]: pam_unix(sudo:session): session closed for user root Apr 29 19:09:23 devstack cinder-volume[84538]: DEBUG oslo_concurrency.processutils [None req-b1c3540b-c828-457e-8535-fecc6b922ca8 tempest-CreateVolumesFromImageTest-147990199 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-c19cf185-e537-4815-9d41-e08128d05c40" returned: 0 in 0.604s {{(pid=84538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 19:09:23 devstack cinder-volume[84538]: DEBUG cinder.coordination [None req-b1c3540b-c828-457e-8535-fecc6b922ca8 tempest-CreateVolumesFromImageTest-147990199 None] Lock "cinder-quobyte-c19cf185-e537-4815-9d41-e08128d05c40" released by "delete_volume" :: held 1.454s {{(pid=84538) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 19:09:23 devstack cinder-volume[84538]: DEBUG cinder.quota [None req-b1c3540b-c828-457e-8535-fecc6b922ca8 tempest-CreateVolumesFromImageTest-147990199 None] Created reservations ['69a8b211-1fec-4300-b5a7-8eb7813a7cb0', 'a64697fa-41e2-4414-bebd-65844c8afdef', '46cbfcd6-1c20-4dd6-a558-b0e4d03ab161', '937baf09-a377-4bdd-9f04-8c66e3afbaad'] {{(pid=84538) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 29 19:09:23 devstack cinder-volume[84538]: DEBUG oslo_concurrency.lockutils [None req-b1c3540b-c828-457e-8535-fecc6b922ca8 tempest-CreateVolumesFromImageTest-147990199 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 19:09:23 devstack cinder-volume[84538]: DEBUG oslo_concurrency.lockutils [None req-b1c3540b-c828-457e-8535-fecc6b922ca8 tempest-CreateVolumesFromImageTest-147990199 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 19:09:23 devstack cinder-volume[84538]: DEBUG cinder.volume.drivers.quobyte [None req-b1c3540b-c828-457e-8535-fecc6b922ca8 tempest-CreateVolumesFromImageTest-147990199 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-34312b00-dd6d-45bb-af98-75855cea8e48': None} {{(pid=84538) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 19:09:23 devstack cinder-volume[84538]: DEBUG cinder.volume.drivers.quobyte [None req-b1c3540b-c828-457e-8535-fecc6b922ca8 tempest-CreateVolumesFromImageTest-147990199 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-34312b00-dd6d-45bb-af98-75855cea8e48'] {{(pid=84538) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 19:09:23 devstack cinder-volume[84538]: DEBUG oslo_concurrency.lockutils [None req-b1c3540b-c828-457e-8535-fecc6b922ca8 tempest-CreateVolumesFromImageTest-147990199 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=84538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 19:09:23 devstack cinder-volume[84538]: DEBUG oslo_concurrency.processutils [None req-b1c3540b-c828-457e-8535-fecc6b922ca8 tempest-CreateVolumesFromImageTest-147990199 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d {{(pid=84538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 19:09:23 devstack sudo[93979]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d Apr 29 19:09:23 devstack sudo[93979]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 19:09:24 devstack sudo[93976]: pam_unix(sudo:session): session closed for user root Apr 29 19:09:24 devstack cinder-volume[84538]: DEBUG oslo_concurrency.processutils [None req-27647daf-1e02-4cd0-9595-d7ca305721d2 tempest-CreateVolumesFromSnapshotTest-1938046858 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-2d2109ce-37b6-478b-bb3f-990749f03fc6.info" returned: 0 in 0.648s {{(pid=84538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 19:09:24 devstack cinder-volume[84538]: WARNING cinder.volume.drivers.remotefs [None req-27647daf-1e02-4cd0-9595-d7ca305721d2 tempest-CreateVolumesFromSnapshotTest-1938046858 None] /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-2d2109ce-37b6-478b-bb3f-990749f03fc6.info is being set with open permissions: ugo+rw Apr 29 19:09:24 devstack cinder-volume[84538]: DEBUG oslo_concurrency.processutils [None req-27647daf-1e02-4cd0-9595-d7ca305721d2 tempest-CreateVolumesFromSnapshotTest-1938046858 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-2d2109ce-37b6-478b-bb3f-990749f03fc6.info {{(pid=84538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 19:09:24 devstack sudo[93982]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-2d2109ce-37b6-478b-bb3f-990749f03fc6.info Apr 29 19:09:24 devstack sudo[93982]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 19:09:24 devstack cinder-volume[84538]: DEBUG cinder.coordination [None req-9657011d-d4a6-44e4-8bad-ba2692dbd099 tempest-CreateVolumesFromImageTest-147990199 None] Acquiring lock "cinder-680a4262-5ad6-4765-b175-84c3356ee07d-delete_volume" by "delete_volume" {{(pid=84538) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 19:09:24 devstack cinder-volume[84538]: DEBUG cinder.coordination [None req-9657011d-d4a6-44e4-8bad-ba2692dbd099 tempest-CreateVolumesFromImageTest-147990199 None] Lock "cinder-680a4262-5ad6-4765-b175-84c3356ee07d-delete_volume" acquired by "delete_volume" :: waited 0.035s {{(pid=84538) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 19:09:24 devstack cinder-volume[84538]: DEBUG cinder.coordination [None req-9657011d-d4a6-44e4-8bad-ba2692dbd099 tempest-CreateVolumesFromImageTest-147990199 None] Acquiring lock "cinder-quobyte-680a4262-5ad6-4765-b175-84c3356ee07d" by "delete_volume" {{(pid=84538) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 19:09:24 devstack sudo[93979]: pam_unix(sudo:session): session closed for user root Apr 29 19:09:24 devstack cinder-volume[84538]: DEBUG oslo_concurrency.processutils [None req-b1c3540b-c828-457e-8535-fecc6b922ca8 tempest-CreateVolumesFromImageTest-147990199 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d" returned: 0 in 0.674s {{(pid=84538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 19:09:24 devstack cinder-volume[84538]: DEBUG cinder.manager [None req-b1c3540b-c828-457e-8535-fecc6b922ca8 tempest-CreateVolumesFromImageTest-147990199 None] Notifying Schedulers of capabilities ... {{(pid=84538) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 29 19:09:24 devstack cinder-volume[84538]: DEBUG cinder.coordination [None req-9657011d-d4a6-44e4-8bad-ba2692dbd099 tempest-CreateVolumesFromImageTest-147990199 None] Lock "cinder-quobyte-680a4262-5ad6-4765-b175-84c3356ee07d" acquired by "delete_volume" :: waited 0.020s {{(pid=84538) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 19:09:24 devstack cinder-volume[84538]: INFO cinder.volume.manager [None req-b1c3540b-c828-457e-8535-fecc6b922ca8 tempest-CreateVolumesFromImageTest-147990199 None] Deleted volume successfully. Apr 29 19:09:24 devstack cinder-volume[84538]: DEBUG oslo.privsep.daemon [-] privsep: reply[32c00c58-d66d-40f4-8597-b47aea2b713d]: (4, 'qcow2') {{(pid=85803) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 19:09:24 devstack cinder-volume[84538]: DEBUG oslo_concurrency.processutils [None req-9657011d-d4a6-44e4-8bad-ba2692dbd099 tempest-CreateVolumesFromImageTest-147990199 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-680a4262-5ad6-4765-b175-84c3356ee07d {{(pid=84538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 19:09:24 devstack cinder-volume[84538]: DEBUG cinder.coordination [None req-b1c3540b-c828-457e-8535-fecc6b922ca8 tempest-CreateVolumesFromImageTest-147990199 None] Lock "cinder-c19cf185-e537-4815-9d41-e08128d05c40-delete_volume" released by "delete_volume" :: held 2.400s {{(pid=84538) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 19:09:24 devstack sudo[93985]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-680a4262-5ad6-4765-b175-84c3356ee07d Apr 29 19:09:24 devstack sudo[93985]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 19:09:24 devstack sudo[93982]: pam_unix(sudo:session): session closed for user root Apr 29 19:09:24 devstack cinder-volume[84538]: DEBUG oslo_concurrency.processutils [None req-27647daf-1e02-4cd0-9595-d7ca305721d2 tempest-CreateVolumesFromSnapshotTest-1938046858 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-2d2109ce-37b6-478b-bb3f-990749f03fc6.info" returned: 0 in 0.671s {{(pid=84538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 19:09:24 devstack cinder-volume[84538]: DEBUG oslo_concurrency.lockutils [None req-27647daf-1e02-4cd0-9595-d7ca305721d2 tempest-CreateVolumesFromSnapshotTest-1938046858 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.395s {{(pid=84538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 19:09:24 devstack cinder-volume[84538]: DEBUG oslo_concurrency.lockutils [None req-ec94e830-e93b-4984-b611-08ee9b4495a1 tempest-CinderUnicodeTest-2074336556 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 7.328s {{(pid=84538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 19:09:24 devstack cinder-volume[84538]: DEBUG cinder.volume.drivers.remotefs [None req-ec94e830-e93b-4984-b611-08ee9b4495a1 tempest-CinderUnicodeTest-2074336556 None] Creating offline snapshot a13ff939-9b3b-45cd-9727-d0afcdbd4350 of volume 0d42a7b3-e110-4ac2-a938-632eda1c3957 {{(pid=84538) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}} Apr 29 19:09:24 devstack cinder-volume[84538]: INFO cinder.volume.manager [None req-27647daf-1e02-4cd0-9595-d7ca305721d2 tempest-CreateVolumesFromSnapshotTest-1938046858 None] Create snapshot completed successfully Apr 29 19:09:24 devstack cinder-volume[84538]: DEBUG oslo.privsep.daemon [-] privsep: reply[1357d205-5b60-4d36-bf65-7ba0b0d10bcf]: (4, 'qcow2') {{(pid=85803) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 19:09:24 devstack cinder-volume[84538]: DEBUG oslo_concurrency.processutils [None req-ec94e830-e93b-4984-b611-08ee9b4495a1 tempest-CinderUnicodeTest-2074336556 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-0d42a7b3-e110-4ac2-a938-632eda1c3957 {{(pid=84538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 19:09:25 devstack sudo[93988]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-0d42a7b3-e110-4ac2-a938-632eda1c3957 Apr 29 19:09:25 devstack sudo[93988]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 19:09:25 devstack cinder-volume[84538]: DEBUG oslo_service.periodic_task [None req-a93183a6-1080-461c-84de-2fcb210d4f60 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=84538) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}} Apr 29 19:09:25 devstack cinder-volume[84538]: DEBUG oslo_concurrency.lockutils [None req-a93183a6-1080-461c-84de-2fcb210d4f60 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 19:09:25 devstack cinder-volume[84538]: DEBUG oslo_concurrency.lockutils [None req-a93183a6-1080-461c-84de-2fcb210d4f60 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=84538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 19:09:25 devstack cinder-volume[84538]: DEBUG cinder.volume.drivers.quobyte [None req-a93183a6-1080-461c-84de-2fcb210d4f60 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-34312b00-dd6d-45bb-af98-75855cea8e48': None} {{(pid=84538) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 19:09:25 devstack cinder-volume[84538]: DEBUG cinder.volume.drivers.quobyte [None req-a93183a6-1080-461c-84de-2fcb210d4f60 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-34312b00-dd6d-45bb-af98-75855cea8e48'] {{(pid=84538) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 19:09:25 devstack cinder-volume[84538]: DEBUG oslo_concurrency.lockutils [None req-a93183a6-1080-461c-84de-2fcb210d4f60 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=84538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 19:09:25 devstack cinder-volume[84538]: DEBUG oslo_concurrency.processutils [None req-a93183a6-1080-461c-84de-2fcb210d4f60 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d {{(pid=84538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 19:09:25 devstack sudo[93990]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d Apr 29 19:09:25 devstack sudo[93990]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 19:09:25 devstack sudo[93985]: pam_unix(sudo:session): session closed for user root Apr 29 19:09:25 devstack cinder-volume[84538]: DEBUG oslo_concurrency.processutils [None req-9657011d-d4a6-44e4-8bad-ba2692dbd099 tempest-CreateVolumesFromImageTest-147990199 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-680a4262-5ad6-4765-b175-84c3356ee07d" returned: 0 in 0.778s {{(pid=84538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 19:09:25 devstack cinder-volume[84538]: DEBUG oslo_concurrency.processutils [None req-9657011d-d4a6-44e4-8bad-ba2692dbd099 tempest-CreateVolumesFromImageTest-147990199 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-680a4262-5ad6-4765-b175-84c3356ee07d {{(pid=84538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 19:09:25 devstack sudo[93995]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-680a4262-5ad6-4765-b175-84c3356ee07d Apr 29 19:09:25 devstack sudo[93995]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 19:09:25 devstack sudo[93988]: pam_unix(sudo:session): session closed for user root Apr 29 19:09:25 devstack cinder-volume[84538]: DEBUG oslo_concurrency.processutils [None req-ec94e830-e93b-4984-b611-08ee9b4495a1 tempest-CinderUnicodeTest-2074336556 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-0d42a7b3-e110-4ac2-a938-632eda1c3957" returned: 0 in 0.808s {{(pid=84538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 19:09:25 devstack cinder-volume[84538]: DEBUG oslo_concurrency.processutils [None req-ec94e830-e93b-4984-b611-08ee9b4495a1 tempest-CinderUnicodeTest-2074336556 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-0d42a7b3-e110-4ac2-a938-632eda1c3957,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-0d42a7b3-e110-4ac2-a938-632eda1c3957.a13ff939-9b3b-45cd-9727-d0afcdbd4350 1G {{(pid=84538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 19:09:25 devstack sudo[93990]: pam_unix(sudo:session): session closed for user root Apr 29 19:09:25 devstack cinder-volume[84538]: DEBUG oslo_concurrency.processutils [None req-a93183a6-1080-461c-84de-2fcb210d4f60 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d" returned: 0 in 0.693s {{(pid=84538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 19:09:25 devstack cinder-volume[84538]: DEBUG cinder.manager [None req-a93183a6-1080-461c-84de-2fcb210d4f60 None None] Notifying Schedulers of capabilities ... {{(pid=84538) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 29 19:09:25 devstack sudo[94001]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-0d42a7b3-e110-4ac2-a938-632eda1c3957,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-0d42a7b3-e110-4ac2-a938-632eda1c3957.a13ff939-9b3b-45cd-9727-d0afcdbd4350 1G Apr 29 19:09:25 devstack sudo[94001]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 19:09:26 devstack cinder-volume[84538]: DEBUG cinder.volume.flows.manager.create_volume [None req-ebb9d5fb-54f2-4816-ac1d-2e4965a19259 tempest-CreateVolumesFromSnapshotTest-1938046858 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84538) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Apr 29 19:09:26 devstack cinder-volume[84538]: DEBUG cinder.volume.manager [None req-ebb9d5fb-54f2-4816-ac1d-2e4965a19259 tempest-CreateVolumesFromSnapshotTest-1938046858 None] Flow 'volume_create_manager' (cff1844d-5d22-4beb-9e9f-dafcd140b588) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84538) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 19:09:26 devstack cinder-volume[84538]: DEBUG cinder.volume.manager [None req-ebb9d5fb-54f2-4816-ac1d-2e4965a19259 tempest-CreateVolumesFromSnapshotTest-1938046858 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (06411c78-cc97-467c-b01a-98ebefaccb6e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 19:09:26 devstack cinder-volume[84538]: DEBUG cinder.volume.manager [None req-ebb9d5fb-54f2-4816-ac1d-2e4965a19259 tempest-CreateVolumesFromSnapshotTest-1938046858 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (06411c78-cc97-467c-b01a-98ebefaccb6e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-29T17:09:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1390241809',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=22adfb3f-e963-4c06-9e74-8cd5868c13b3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='43976132c7c54fdaa06722c210f732f0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T17:09:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T17:09:26Z,use_quota=True,user_id='6ffeea78e69b4e0d8fe06ce426cac057',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(62b05900-93e3-4190-a88f-1d87324303d1),volume_type_id=62b05900-93e3-4190-a88f-1d87324303d1)' {{(pid=84538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 19:09:26 devstack cinder-volume[84538]: DEBUG cinder.volume.manager [None req-ebb9d5fb-54f2-4816-ac1d-2e4965a19259 tempest-CreateVolumesFromSnapshotTest-1938046858 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6ea1b94d-e5fb-46de-b083-dda8cb6e721b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 19:09:26 devstack cinder-volume[84538]: DEBUG cinder.volume.manager [None req-ebb9d5fb-54f2-4816-ac1d-2e4965a19259 tempest-CreateVolumesFromSnapshotTest-1938046858 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6ea1b94d-e5fb-46de-b083-dda8cb6e721b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 19:09:26 devstack cinder-volume[84538]: DEBUG cinder.volume.manager [None req-ebb9d5fb-54f2-4816-ac1d-2e4965a19259 tempest-CreateVolumesFromSnapshotTest-1938046858 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bb3e296a-999f-43f2-9364-59117ff1c453) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 19:09:26 devstack cinder-volume[84538]: DEBUG cinder.volume.manager [None req-ebb9d5fb-54f2-4816-ac1d-2e4965a19259 tempest-CreateVolumesFromSnapshotTest-1938046858 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bb3e296a-999f-43f2-9364-59117ff1c453) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '22adfb3f-e963-4c06-9e74-8cd5868c13b3', 'volume_name': 'volume-22adfb3f-e963-4c06-9e74-8cd5868c13b3', 'volume_size': 1}' {{(pid=84538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 19:09:26 devstack sudo[93995]: pam_unix(sudo:session): session closed for user root Apr 29 19:09:26 devstack cinder-volume[84538]: DEBUG cinder.volume.manager [None req-ebb9d5fb-54f2-4816-ac1d-2e4965a19259 tempest-CreateVolumesFromSnapshotTest-1938046858 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b0663eb8-7306-475d-b5dc-25ce28196685) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 19:09:26 devstack cinder-volume[84538]: DEBUG cinder.volume.manager [None req-ebb9d5fb-54f2-4816-ac1d-2e4965a19259 tempest-CreateVolumesFromSnapshotTest-1938046858 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b0663eb8-7306-475d-b5dc-25ce28196685) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 19:09:26 devstack cinder-volume[84538]: DEBUG cinder.volume.manager [None req-ebb9d5fb-54f2-4816-ac1d-2e4965a19259 tempest-CreateVolumesFromSnapshotTest-1938046858 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6ebcf03f-b638-4fea-8947-a50bc27ccb8a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 19:09:26 devstack cinder-volume[84538]: INFO cinder.volume.flows.manager.create_volume [None req-ebb9d5fb-54f2-4816-ac1d-2e4965a19259 tempest-CreateVolumesFromSnapshotTest-1938046858 None] Volume 22adfb3f-e963-4c06-9e74-8cd5868c13b3: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-22adfb3f-e963-4c06-9e74-8cd5868c13b3', 'volume_size': 1} Apr 29 19:09:26 devstack cinder-volume[84538]: DEBUG oslo_concurrency.lockutils [None req-ebb9d5fb-54f2-4816-ac1d-2e4965a19259 tempest-CreateVolumesFromSnapshotTest-1938046858 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 19:09:26 devstack cinder-volume[84538]: DEBUG oslo_concurrency.processutils [None req-9657011d-d4a6-44e4-8bad-ba2692dbd099 tempest-CreateVolumesFromImageTest-147990199 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-680a4262-5ad6-4765-b175-84c3356ee07d" returned: 0 in 0.703s {{(pid=84538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 19:09:26 devstack cinder-volume[84538]: DEBUG cinder.coordination [None req-9657011d-d4a6-44e4-8bad-ba2692dbd099 tempest-CreateVolumesFromImageTest-147990199 None] Lock "cinder-quobyte-680a4262-5ad6-4765-b175-84c3356ee07d" released by "delete_volume" :: held 1.537s {{(pid=84538) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 19:09:26 devstack cinder-volume[84538]: DEBUG cinder.quota [None req-9657011d-d4a6-44e4-8bad-ba2692dbd099 tempest-CreateVolumesFromImageTest-147990199 None] Created reservations ['842502ca-8049-45f1-aab0-30382d3a4d22', 'cf3a9df2-1843-45e7-ae5c-1639641b7170', 'b1bc82ff-fe47-4d8a-84d5-7f27b11e345a', 'd146b306-ae34-4224-bf9a-69ce8f531da3'] {{(pid=84538) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 29 19:09:26 devstack cinder-volume[84538]: DEBUG oslo_concurrency.lockutils [None req-9657011d-d4a6-44e4-8bad-ba2692dbd099 tempest-CreateVolumesFromImageTest-147990199 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 19:09:26 devstack cinder-volume[84538]: DEBUG oslo_concurrency.lockutils [None req-9657011d-d4a6-44e4-8bad-ba2692dbd099 tempest-CreateVolumesFromImageTest-147990199 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 19:09:26 devstack cinder-volume[84538]: DEBUG cinder.volume.drivers.quobyte [None req-9657011d-d4a6-44e4-8bad-ba2692dbd099 tempest-CreateVolumesFromImageTest-147990199 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-34312b00-dd6d-45bb-af98-75855cea8e48': None} {{(pid=84538) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 19:09:26 devstack cinder-volume[84538]: DEBUG cinder.volume.drivers.quobyte [None req-9657011d-d4a6-44e4-8bad-ba2692dbd099 tempest-CreateVolumesFromImageTest-147990199 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-34312b00-dd6d-45bb-af98-75855cea8e48'] {{(pid=84538) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 19:09:26 devstack cinder-volume[84538]: DEBUG oslo_concurrency.lockutils [None req-9657011d-d4a6-44e4-8bad-ba2692dbd099 tempest-CreateVolumesFromImageTest-147990199 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=84538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 19:09:26 devstack cinder-volume[84538]: DEBUG oslo_concurrency.processutils [None req-9657011d-d4a6-44e4-8bad-ba2692dbd099 tempest-CreateVolumesFromImageTest-147990199 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d {{(pid=84538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 19:09:26 devstack sudo[94004]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d Apr 29 19:09:26 devstack sudo[94004]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 19:09:26 devstack cinder-volume[84538]: DEBUG cinder.volume.flows.manager.create_volume [None req-ee354d37-2ea3-454b-be13-69075c29022a tempest-CreateVolumesFromSnapshotTest-1938046858 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84538) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Apr 29 19:09:26 devstack cinder-volume[84538]: DEBUG cinder.volume.manager [None req-ee354d37-2ea3-454b-be13-69075c29022a tempest-CreateVolumesFromSnapshotTest-1938046858 None] Flow 'volume_create_manager' (4270e196-88be-4c61-9f62-008c1969cae3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84538) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 19:09:26 devstack cinder-volume[84538]: DEBUG cinder.volume.manager [None req-ee354d37-2ea3-454b-be13-69075c29022a tempest-CreateVolumesFromSnapshotTest-1938046858 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (161b9324-3fb4-4684-90ae-29747ba8a505) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 19:09:26 devstack cinder-volume[84538]: DEBUG cinder.volume.manager [None req-ee354d37-2ea3-454b-be13-69075c29022a tempest-CreateVolumesFromSnapshotTest-1938046858 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (161b9324-3fb4-4684-90ae-29747ba8a505) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-29T17:09:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1802905063',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4474a441-c5bf-4439-86a5-e8e00aef1394,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='43976132c7c54fdaa06722c210f732f0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T17:09:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T17:09:26Z,use_quota=True,user_id='6ffeea78e69b4e0d8fe06ce426cac057',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(62b05900-93e3-4190-a88f-1d87324303d1),volume_type_id=62b05900-93e3-4190-a88f-1d87324303d1)' {{(pid=84538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 19:09:26 devstack cinder-volume[84538]: DEBUG cinder.volume.manager [None req-ee354d37-2ea3-454b-be13-69075c29022a tempest-CreateVolumesFromSnapshotTest-1938046858 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (91a911c1-e84c-47a6-8d18-a24c70ce6a4b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 19:09:26 devstack cinder-volume[84538]: DEBUG cinder.volume.manager [None req-ee354d37-2ea3-454b-be13-69075c29022a tempest-CreateVolumesFromSnapshotTest-1938046858 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (91a911c1-e84c-47a6-8d18-a24c70ce6a4b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 19:09:26 devstack cinder-volume[84538]: DEBUG cinder.volume.manager [None req-ee354d37-2ea3-454b-be13-69075c29022a tempest-CreateVolumesFromSnapshotTest-1938046858 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (639ae869-c4cb-46db-9fe1-6f115c4e09c3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 19:09:26 devstack cinder-volume[84538]: DEBUG cinder.volume.manager [None req-ee354d37-2ea3-454b-be13-69075c29022a tempest-CreateVolumesFromSnapshotTest-1938046858 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (639ae869-c4cb-46db-9fe1-6f115c4e09c3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4474a441-c5bf-4439-86a5-e8e00aef1394', 'volume_name': 'volume-4474a441-c5bf-4439-86a5-e8e00aef1394', 'volume_size': 1}' {{(pid=84538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 19:09:26 devstack cinder-volume[84538]: DEBUG cinder.volume.manager [None req-ee354d37-2ea3-454b-be13-69075c29022a tempest-CreateVolumesFromSnapshotTest-1938046858 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3b2af2b7-0059-40f2-9570-38c14fbc36ef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 19:09:26 devstack cinder-volume[84538]: DEBUG cinder.volume.manager [None req-ee354d37-2ea3-454b-be13-69075c29022a tempest-CreateVolumesFromSnapshotTest-1938046858 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3b2af2b7-0059-40f2-9570-38c14fbc36ef) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 19:09:26 devstack cinder-volume[84538]: DEBUG cinder.volume.manager [None req-ee354d37-2ea3-454b-be13-69075c29022a tempest-CreateVolumesFromSnapshotTest-1938046858 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (05477688-2160-42e5-8bba-3f089439bb13) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 19:09:26 devstack cinder-volume[84538]: INFO cinder.volume.flows.manager.create_volume [None req-ee354d37-2ea3-454b-be13-69075c29022a tempest-CreateVolumesFromSnapshotTest-1938046858 None] Volume 4474a441-c5bf-4439-86a5-e8e00aef1394: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4474a441-c5bf-4439-86a5-e8e00aef1394', 'volume_size': 1} Apr 29 19:09:26 devstack cinder-volume[84538]: DEBUG oslo_concurrency.lockutils [None req-ee354d37-2ea3-454b-be13-69075c29022a tempest-CreateVolumesFromSnapshotTest-1938046858 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 19:09:26 devstack sudo[94001]: pam_unix(sudo:session): session closed for user root Apr 29 19:09:26 devstack cinder-volume[84538]: DEBUG oslo_concurrency.processutils [None req-ec94e830-e93b-4984-b611-08ee9b4495a1 tempest-CinderUnicodeTest-2074336556 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-0d42a7b3-e110-4ac2-a938-632eda1c3957,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-0d42a7b3-e110-4ac2-a938-632eda1c3957.a13ff939-9b3b-45cd-9727-d0afcdbd4350 1G" returned: 0 in 0.951s {{(pid=84538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 19:09:26 devstack cinder-volume[84538]: DEBUG oslo_concurrency.processutils [None req-ec94e830-e93b-4984-b611-08ee9b4495a1 tempest-CinderUnicodeTest-2074336556 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-0d42a7b3-e110-4ac2-a938-632eda1c3957 -F qcow2 /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-0d42a7b3-e110-4ac2-a938-632eda1c3957.a13ff939-9b3b-45cd-9727-d0afcdbd4350 {{(pid=84538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 19:09:26 devstack sudo[94010]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-0d42a7b3-e110-4ac2-a938-632eda1c3957 -F qcow2 /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-0d42a7b3-e110-4ac2-a938-632eda1c3957.a13ff939-9b3b-45cd-9727-d0afcdbd4350 Apr 29 19:09:26 devstack sudo[94010]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 19:09:26 devstack cinder-volume[84538]: DEBUG cinder.volume.flows.manager.create_volume [None req-20f128b0-cbc8-441b-a075-c7a197e90479 tempest-CreateVolumesFromSnapshotTest-1938046858 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84538) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Apr 29 19:09:26 devstack cinder-volume[84538]: DEBUG cinder.volume.manager [None req-20f128b0-cbc8-441b-a075-c7a197e90479 tempest-CreateVolumesFromSnapshotTest-1938046858 None] Flow 'volume_create_manager' (8012b9f5-7564-44dc-84dc-688a8a7a404d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84538) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 19:09:26 devstack cinder-volume[84538]: DEBUG cinder.volume.manager [None req-20f128b0-cbc8-441b-a075-c7a197e90479 tempest-CreateVolumesFromSnapshotTest-1938046858 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (daff6d33-6caa-41cc-b051-325418f2f4f2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 19:09:26 devstack cinder-volume[84538]: DEBUG cinder.volume.manager [None req-20f128b0-cbc8-441b-a075-c7a197e90479 tempest-CreateVolumesFromSnapshotTest-1938046858 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (daff6d33-6caa-41cc-b051-325418f2f4f2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-29T17:09:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1937614316',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5e3d9ffe-6145-432b-889f-53ac70d96f1e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='43976132c7c54fdaa06722c210f732f0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T17:09:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T17:09:27Z,use_quota=True,user_id='6ffeea78e69b4e0d8fe06ce426cac057',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(62b05900-93e3-4190-a88f-1d87324303d1),volume_type_id=62b05900-93e3-4190-a88f-1d87324303d1)' {{(pid=84538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 19:09:26 devstack cinder-volume[84538]: DEBUG cinder.volume.manager [None req-20f128b0-cbc8-441b-a075-c7a197e90479 tempest-CreateVolumesFromSnapshotTest-1938046858 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (74b17a3f-1517-460a-a86c-c1721fd8ce1e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 19:09:27 devstack cinder-volume[84538]: DEBUG cinder.volume.manager [None req-20f128b0-cbc8-441b-a075-c7a197e90479 tempest-CreateVolumesFromSnapshotTest-1938046858 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (74b17a3f-1517-460a-a86c-c1721fd8ce1e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 19:09:27 devstack cinder-volume[84538]: DEBUG cinder.volume.manager [None req-20f128b0-cbc8-441b-a075-c7a197e90479 tempest-CreateVolumesFromSnapshotTest-1938046858 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5b66c279-e20f-4553-bb80-c4215907cf9d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 19:09:27 devstack cinder-volume[84538]: DEBUG cinder.volume.manager [None req-20f128b0-cbc8-441b-a075-c7a197e90479 tempest-CreateVolumesFromSnapshotTest-1938046858 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5b66c279-e20f-4553-bb80-c4215907cf9d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5e3d9ffe-6145-432b-889f-53ac70d96f1e', 'volume_name': 'volume-5e3d9ffe-6145-432b-889f-53ac70d96f1e', 'volume_size': 1}' {{(pid=84538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 19:09:27 devstack cinder-volume[84538]: DEBUG cinder.volume.manager [None req-20f128b0-cbc8-441b-a075-c7a197e90479 tempest-CreateVolumesFromSnapshotTest-1938046858 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (316a35a3-c6dc-4629-bc69-e3dd170bc71b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 19:09:27 devstack cinder-volume[84538]: DEBUG cinder.volume.manager [None req-20f128b0-cbc8-441b-a075-c7a197e90479 tempest-CreateVolumesFromSnapshotTest-1938046858 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (316a35a3-c6dc-4629-bc69-e3dd170bc71b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 19:09:27 devstack cinder-volume[84538]: DEBUG cinder.volume.manager [None req-20f128b0-cbc8-441b-a075-c7a197e90479 tempest-CreateVolumesFromSnapshotTest-1938046858 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (97de6274-09be-474f-baf1-83c69b42d887) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 19:09:27 devstack cinder-volume[84538]: INFO cinder.volume.flows.manager.create_volume [None req-20f128b0-cbc8-441b-a075-c7a197e90479 tempest-CreateVolumesFromSnapshotTest-1938046858 None] Volume 5e3d9ffe-6145-432b-889f-53ac70d96f1e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5e3d9ffe-6145-432b-889f-53ac70d96f1e', 'volume_size': 1} Apr 29 19:09:27 devstack cinder-volume[84538]: DEBUG oslo_concurrency.lockutils [None req-20f128b0-cbc8-441b-a075-c7a197e90479 tempest-CreateVolumesFromSnapshotTest-1938046858 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 19:09:27 devstack sudo[94004]: pam_unix(sudo:session): session closed for user root Apr 29 19:09:27 devstack cinder-volume[84538]: DEBUG oslo_concurrency.processutils [None req-9657011d-d4a6-44e4-8bad-ba2692dbd099 tempest-CreateVolumesFromImageTest-147990199 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d" returned: 0 in 0.782s {{(pid=84538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 19:09:27 devstack cinder-volume[84538]: DEBUG cinder.manager [None req-9657011d-d4a6-44e4-8bad-ba2692dbd099 tempest-CreateVolumesFromImageTest-147990199 None] Notifying Schedulers of capabilities ... {{(pid=84538) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 29 19:09:27 devstack cinder-volume[84538]: INFO cinder.volume.manager [None req-9657011d-d4a6-44e4-8bad-ba2692dbd099 tempest-CreateVolumesFromImageTest-147990199 None] Deleted volume successfully. Apr 29 19:09:27 devstack cinder-volume[84538]: DEBUG cinder.coordination [None req-9657011d-d4a6-44e4-8bad-ba2692dbd099 tempest-CreateVolumesFromImageTest-147990199 None] Lock "cinder-680a4262-5ad6-4765-b175-84c3356ee07d-delete_volume" released by "delete_volume" :: held 2.601s {{(pid=84538) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 19:09:27 devstack cinder-volume[84538]: DEBUG cinder.volume.flows.manager.create_volume [None req-083c5a03-40ba-48b2-aff9-82b04c009eb9 tempest-CreateVolumesFromSnapshotTest-1938046858 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84538) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Apr 29 19:09:27 devstack cinder-volume[84538]: DEBUG cinder.volume.manager [None req-083c5a03-40ba-48b2-aff9-82b04c009eb9 tempest-CreateVolumesFromSnapshotTest-1938046858 None] Flow 'volume_create_manager' (bdabba57-e7db-4585-94a0-336bdb7d9718) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84538) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 19:09:27 devstack cinder-volume[84538]: DEBUG cinder.volume.manager [None req-083c5a03-40ba-48b2-aff9-82b04c009eb9 tempest-CreateVolumesFromSnapshotTest-1938046858 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b74b2d0e-30fd-464b-965c-675b29890b8e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 19:09:27 devstack cinder-volume[84538]: DEBUG cinder.volume.manager [None req-083c5a03-40ba-48b2-aff9-82b04c009eb9 tempest-CreateVolumesFromSnapshotTest-1938046858 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b74b2d0e-30fd-464b-965c-675b29890b8e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-29T17:09:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1703762989',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1940ddaf-9cec-4a2b-809e-d58e15e38dac,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='43976132c7c54fdaa06722c210f732f0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T17:09:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T17:09:27Z,use_quota=True,user_id='6ffeea78e69b4e0d8fe06ce426cac057',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(62b05900-93e3-4190-a88f-1d87324303d1),volume_type_id=62b05900-93e3-4190-a88f-1d87324303d1)' {{(pid=84538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 19:09:27 devstack cinder-volume[84538]: DEBUG cinder.volume.manager [None req-083c5a03-40ba-48b2-aff9-82b04c009eb9 tempest-CreateVolumesFromSnapshotTest-1938046858 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b6d59255-d728-4e67-bead-aafdef476de5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 19:09:27 devstack cinder-volume[84538]: DEBUG cinder.volume.manager [None req-083c5a03-40ba-48b2-aff9-82b04c009eb9 tempest-CreateVolumesFromSnapshotTest-1938046858 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b6d59255-d728-4e67-bead-aafdef476de5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 19:09:27 devstack cinder-volume[84538]: DEBUG cinder.volume.manager [None req-083c5a03-40ba-48b2-aff9-82b04c009eb9 tempest-CreateVolumesFromSnapshotTest-1938046858 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9be39d58-b5a9-4e04-ab0c-01008bf44b8d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 19:09:27 devstack cinder-volume[84538]: DEBUG cinder.volume.manager [None req-083c5a03-40ba-48b2-aff9-82b04c009eb9 tempest-CreateVolumesFromSnapshotTest-1938046858 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9be39d58-b5a9-4e04-ab0c-01008bf44b8d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1940ddaf-9cec-4a2b-809e-d58e15e38dac', 'volume_name': 'volume-1940ddaf-9cec-4a2b-809e-d58e15e38dac', 'volume_size': 1}' {{(pid=84538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 19:09:27 devstack cinder-volume[84538]: DEBUG cinder.volume.manager [None req-083c5a03-40ba-48b2-aff9-82b04c009eb9 tempest-CreateVolumesFromSnapshotTest-1938046858 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7291fd3f-002a-48dc-9916-c2821ffb7f72) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 19:09:27 devstack cinder-volume[84538]: DEBUG cinder.volume.manager [None req-083c5a03-40ba-48b2-aff9-82b04c009eb9 tempest-CreateVolumesFromSnapshotTest-1938046858 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7291fd3f-002a-48dc-9916-c2821ffb7f72) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 19:09:27 devstack cinder-volume[84538]: DEBUG cinder.volume.manager [None req-083c5a03-40ba-48b2-aff9-82b04c009eb9 tempest-CreateVolumesFromSnapshotTest-1938046858 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5b5415f6-ccc4-45d0-9875-ae074fca43fc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 19:09:27 devstack cinder-volume[84538]: INFO cinder.volume.flows.manager.create_volume [None req-083c5a03-40ba-48b2-aff9-82b04c009eb9 tempest-CreateVolumesFromSnapshotTest-1938046858 None] Volume 1940ddaf-9cec-4a2b-809e-d58e15e38dac: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1940ddaf-9cec-4a2b-809e-d58e15e38dac', 'volume_size': 1} Apr 29 19:09:27 devstack cinder-volume[84538]: DEBUG oslo_concurrency.lockutils [None req-083c5a03-40ba-48b2-aff9-82b04c009eb9 tempest-CreateVolumesFromSnapshotTest-1938046858 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 19:09:27 devstack sudo[94010]: pam_unix(sudo:session): session closed for user root Apr 29 19:09:27 devstack cinder-volume[84538]: DEBUG oslo_concurrency.processutils [None req-ec94e830-e93b-4984-b611-08ee9b4495a1 tempest-CinderUnicodeTest-2074336556 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-0d42a7b3-e110-4ac2-a938-632eda1c3957 -F qcow2 /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-0d42a7b3-e110-4ac2-a938-632eda1c3957.a13ff939-9b3b-45cd-9727-d0afcdbd4350" returned: 0 in 0.915s {{(pid=84538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 19:09:27 devstack cinder-volume[84538]: WARNING cinder.volume.drivers.remotefs [None req-ec94e830-e93b-4984-b611-08ee9b4495a1 tempest-CinderUnicodeTest-2074336556 None] /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-0d42a7b3-e110-4ac2-a938-632eda1c3957.a13ff939-9b3b-45cd-9727-d0afcdbd4350 is being set with open permissions: ugo+rw Apr 29 19:09:27 devstack cinder-volume[84538]: DEBUG oslo_concurrency.processutils [None req-ec94e830-e93b-4984-b611-08ee9b4495a1 tempest-CinderUnicodeTest-2074336556 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-0d42a7b3-e110-4ac2-a938-632eda1c3957.a13ff939-9b3b-45cd-9727-d0afcdbd4350 {{(pid=84538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 19:09:27 devstack sudo[94017]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-0d42a7b3-e110-4ac2-a938-632eda1c3957.a13ff939-9b3b-45cd-9727-d0afcdbd4350 Apr 29 19:09:27 devstack sudo[94017]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 19:09:27 devstack cinder-volume[84538]: DEBUG cinder.volume.flows.manager.create_volume [None req-9c219846-3043-4c73-b7bc-9ea33c0894d6 tempest-CreateVolumesFromSnapshotTest-1938046858 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84538) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Apr 29 19:09:27 devstack cinder-volume[84538]: DEBUG cinder.volume.manager [None req-9c219846-3043-4c73-b7bc-9ea33c0894d6 tempest-CreateVolumesFromSnapshotTest-1938046858 None] Flow 'volume_create_manager' (ac5765e1-d3a8-4a61-85de-b343739847f5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84538) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 19:09:27 devstack cinder-volume[84538]: DEBUG cinder.volume.manager [None req-9c219846-3043-4c73-b7bc-9ea33c0894d6 tempest-CreateVolumesFromSnapshotTest-1938046858 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ff52e7b5-d1fe-4642-8d52-4bfdb31587a7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 19:09:27 devstack cinder-volume[84538]: DEBUG cinder.volume.manager [None req-9c219846-3043-4c73-b7bc-9ea33c0894d6 tempest-CreateVolumesFromSnapshotTest-1938046858 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ff52e7b5-d1fe-4642-8d52-4bfdb31587a7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-29T17:09:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1699117096',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e9b9e08b-e0a6-4853-99a3-377c499d6950,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='43976132c7c54fdaa06722c210f732f0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T17:09:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T17:09:28Z,use_quota=True,user_id='6ffeea78e69b4e0d8fe06ce426cac057',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(62b05900-93e3-4190-a88f-1d87324303d1),volume_type_id=62b05900-93e3-4190-a88f-1d87324303d1)' {{(pid=84538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 19:09:27 devstack cinder-volume[84538]: DEBUG cinder.volume.manager [None req-9c219846-3043-4c73-b7bc-9ea33c0894d6 tempest-CreateVolumesFromSnapshotTest-1938046858 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (84bfb361-d89b-44e9-b428-192f61100a02) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 19:09:27 devstack cinder-volume[84538]: DEBUG cinder.volume.manager [None req-9c219846-3043-4c73-b7bc-9ea33c0894d6 tempest-CreateVolumesFromSnapshotTest-1938046858 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (84bfb361-d89b-44e9-b428-192f61100a02) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 19:09:27 devstack cinder-volume[84538]: DEBUG cinder.volume.manager [None req-9c219846-3043-4c73-b7bc-9ea33c0894d6 tempest-CreateVolumesFromSnapshotTest-1938046858 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (639d6789-e800-4a55-ae14-38c6137b8507) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 19:09:27 devstack cinder-volume[84538]: DEBUG cinder.volume.manager [None req-9c219846-3043-4c73-b7bc-9ea33c0894d6 tempest-CreateVolumesFromSnapshotTest-1938046858 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (639d6789-e800-4a55-ae14-38c6137b8507) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e9b9e08b-e0a6-4853-99a3-377c499d6950', 'volume_name': 'volume-e9b9e08b-e0a6-4853-99a3-377c499d6950', 'volume_size': 1}' {{(pid=84538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 19:09:27 devstack cinder-volume[84538]: DEBUG cinder.volume.manager [None req-9c219846-3043-4c73-b7bc-9ea33c0894d6 tempest-CreateVolumesFromSnapshotTest-1938046858 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5fbb59bf-e292-43e8-b8e6-ccde58cf780c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 19:09:27 devstack cinder-volume[84538]: DEBUG cinder.volume.manager [None req-9c219846-3043-4c73-b7bc-9ea33c0894d6 tempest-CreateVolumesFromSnapshotTest-1938046858 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5fbb59bf-e292-43e8-b8e6-ccde58cf780c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 19:09:27 devstack cinder-volume[84538]: DEBUG cinder.volume.manager [None req-9c219846-3043-4c73-b7bc-9ea33c0894d6 tempest-CreateVolumesFromSnapshotTest-1938046858 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c58d3f8f-488d-430e-8e8c-2a7eaf8a9d90) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 19:09:27 devstack cinder-volume[84538]: INFO cinder.volume.flows.manager.create_volume [None req-9c219846-3043-4c73-b7bc-9ea33c0894d6 tempest-CreateVolumesFromSnapshotTest-1938046858 None] Volume e9b9e08b-e0a6-4853-99a3-377c499d6950: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e9b9e08b-e0a6-4853-99a3-377c499d6950', 'volume_size': 1} Apr 29 19:09:27 devstack cinder-volume[84538]: DEBUG oslo_concurrency.lockutils [None req-9c219846-3043-4c73-b7bc-9ea33c0894d6 tempest-CreateVolumesFromSnapshotTest-1938046858 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 19:09:28 devstack sudo[94017]: pam_unix(sudo:session): session closed for user root Apr 29 19:09:28 devstack cinder-volume[84538]: DEBUG oslo_concurrency.processutils [None req-ec94e830-e93b-4984-b611-08ee9b4495a1 tempest-CinderUnicodeTest-2074336556 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-0d42a7b3-e110-4ac2-a938-632eda1c3957.a13ff939-9b3b-45cd-9727-d0afcdbd4350" returned: 0 in 0.744s {{(pid=84538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 19:09:28 devstack cinder-volume[84538]: DEBUG oslo_concurrency.processutils [None req-ec94e830-e93b-4984-b611-08ee9b4495a1 tempest-CinderUnicodeTest-2074336556 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-0d42a7b3-e110-4ac2-a938-632eda1c3957.info {{(pid=84538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 19:09:28 devstack sudo[94020]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-0d42a7b3-e110-4ac2-a938-632eda1c3957.info Apr 29 19:09:28 devstack sudo[94020]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 19:09:29 devstack sudo[94020]: pam_unix(sudo:session): session closed for user root Apr 29 19:09:29 devstack cinder-volume[84538]: DEBUG oslo_concurrency.processutils [None req-ec94e830-e93b-4984-b611-08ee9b4495a1 tempest-CinderUnicodeTest-2074336556 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-0d42a7b3-e110-4ac2-a938-632eda1c3957.info" returned: 0 in 0.649s {{(pid=84538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 19:09:29 devstack cinder-volume[84538]: WARNING cinder.volume.drivers.remotefs [None req-ec94e830-e93b-4984-b611-08ee9b4495a1 tempest-CinderUnicodeTest-2074336556 None] /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-0d42a7b3-e110-4ac2-a938-632eda1c3957.info is being set with open permissions: ugo+rw Apr 29 19:09:29 devstack cinder-volume[84538]: DEBUG oslo_concurrency.processutils [None req-ec94e830-e93b-4984-b611-08ee9b4495a1 tempest-CinderUnicodeTest-2074336556 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-0d42a7b3-e110-4ac2-a938-632eda1c3957.info {{(pid=84538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 19:09:29 devstack sudo[94025]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-0d42a7b3-e110-4ac2-a938-632eda1c3957.info Apr 29 19:09:29 devstack sudo[94025]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 19:09:29 devstack sudo[94025]: pam_unix(sudo:session): session closed for user root Apr 29 19:09:29 devstack cinder-volume[84538]: DEBUG oslo_concurrency.processutils [None req-ec94e830-e93b-4984-b611-08ee9b4495a1 tempest-CinderUnicodeTest-2074336556 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-0d42a7b3-e110-4ac2-a938-632eda1c3957.info" returned: 0 in 0.643s {{(pid=84538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 19:09:29 devstack cinder-volume[84538]: DEBUG oslo_concurrency.lockutils [None req-ec94e830-e93b-4984-b611-08ee9b4495a1 tempest-CinderUnicodeTest-2074336556 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.810s {{(pid=84538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 19:09:29 devstack cinder-volume[84538]: DEBUG oslo_concurrency.lockutils [None req-0a9a7be7-cad7-40a2-aaaf-c4914eba2feb tempest-VolumeDependencyTests-868648422 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 7.893s {{(pid=84538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 19:09:29 devstack cinder-volume[84538]: DEBUG cinder.coordination [None req-0a9a7be7-cad7-40a2-aaaf-c4914eba2feb tempest-VolumeDependencyTests-868648422 None] Acquiring lock "cinder-quobyte-198e6df2-3e81-4d9e-ac11-ea6277a3032d-90a642e5-d251-44d5-aa73-d01b4f57c2b2" by "_create_volume_from_snapshot" {{(pid=84538) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 19:09:29 devstack cinder-volume[84538]: DEBUG cinder.coordination [None req-0a9a7be7-cad7-40a2-aaaf-c4914eba2feb tempest-VolumeDependencyTests-868648422 None] Lock "cinder-quobyte-198e6df2-3e81-4d9e-ac11-ea6277a3032d-90a642e5-d251-44d5-aa73-d01b4f57c2b2" acquired by "_create_volume_from_snapshot" :: waited 0.022s {{(pid=84538) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 19:09:29 devstack cinder-volume[84538]: DEBUG cinder.volume.drivers.quobyte [None req-0a9a7be7-cad7-40a2-aaaf-c4914eba2feb tempest-VolumeDependencyTests-868648422 None] Creating volume 90a642e5-d251-44d5-aa73-d01b4f57c2b2 from snapshot 198e6df2-3e81-4d9e-ac11-ea6277a3032d {{(pid=84538) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:356}} Apr 29 19:09:29 devstack cinder-volume[84538]: DEBUG oslo_concurrency.lockutils [None req-0a9a7be7-cad7-40a2-aaaf-c4914eba2feb tempest-VolumeDependencyTests-868648422 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 19:09:29 devstack cinder-volume[84538]: DEBUG oslo_concurrency.lockutils [None req-0a9a7be7-cad7-40a2-aaaf-c4914eba2feb tempest-VolumeDependencyTests-868648422 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 19:09:29 devstack cinder-volume[84538]: DEBUG cinder.volume.drivers.quobyte [None req-0a9a7be7-cad7-40a2-aaaf-c4914eba2feb tempest-VolumeDependencyTests-868648422 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-34312b00-dd6d-45bb-af98-75855cea8e48': None} {{(pid=84538) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 19:09:29 devstack cinder-volume[84538]: DEBUG cinder.volume.drivers.quobyte [None req-0a9a7be7-cad7-40a2-aaaf-c4914eba2feb tempest-VolumeDependencyTests-868648422 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-34312b00-dd6d-45bb-af98-75855cea8e48'] {{(pid=84538) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 19:09:29 devstack cinder-volume[84538]: DEBUG oslo_concurrency.lockutils [None req-0a9a7be7-cad7-40a2-aaaf-c4914eba2feb tempest-VolumeDependencyTests-868648422 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=84538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 19:09:29 devstack cinder-volume[84538]: DEBUG cinder.volume.drivers.quobyte [None req-0a9a7be7-cad7-40a2-aaaf-c4914eba2feb tempest-VolumeDependencyTests-868648422 None] Selected osci02.corp.quobyte.com/cinder-vol-34312b00-dd6d-45bb-af98-75855cea8e48 as target Quobyte volume. {{(pid=84538) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 29 19:09:29 devstack cinder-volume[84538]: DEBUG cinder.coordination [None req-0a9a7be7-cad7-40a2-aaaf-c4914eba2feb tempest-VolumeDependencyTests-868648422 None] Acquiring lock "cinder-quobyte-90a642e5-d251-44d5-aa73-d01b4f57c2b2" by "_copy_volume_from_snapshot" {{(pid=84538) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 19:09:29 devstack cinder-volume[84538]: INFO cinder.volume.manager [None req-ec94e830-e93b-4984-b611-08ee9b4495a1 tempest-CinderUnicodeTest-2074336556 None] Create snapshot completed successfully Apr 29 19:09:29 devstack cinder-volume[84538]: DEBUG cinder.coordination [None req-0a9a7be7-cad7-40a2-aaaf-c4914eba2feb tempest-VolumeDependencyTests-868648422 None] Lock "cinder-quobyte-90a642e5-d251-44d5-aa73-d01b4f57c2b2" acquired by "_copy_volume_from_snapshot" :: waited 0.019s {{(pid=84538) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 19:09:29 devstack cinder-volume[84538]: DEBUG cinder.volume.drivers.quobyte [None req-0a9a7be7-cad7-40a2-aaaf-c4914eba2feb tempest-VolumeDependencyTests-868648422 None] snapshot: 198e6df2-3e81-4d9e-ac11-ea6277a3032d, volume: 90a642e5-d251-44d5-aa73-d01b4f57c2b2, {{(pid=84538) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Apr 29 19:09:29 devstack cinder-volume[84538]: DEBUG oslo_concurrency.lockutils [None req-0a9a7be7-cad7-40a2-aaaf-c4914eba2feb tempest-VolumeDependencyTests-868648422 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 19:09:29 devstack cinder-volume[84538]: DEBUG oslo_concurrency.lockutils [None req-0a9a7be7-cad7-40a2-aaaf-c4914eba2feb tempest-VolumeDependencyTests-868648422 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 19:09:29 devstack cinder-volume[84538]: DEBUG cinder.volume.drivers.quobyte [None req-0a9a7be7-cad7-40a2-aaaf-c4914eba2feb tempest-VolumeDependencyTests-868648422 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-34312b00-dd6d-45bb-af98-75855cea8e48': None} {{(pid=84538) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 19:09:29 devstack cinder-volume[84538]: DEBUG cinder.volume.drivers.quobyte [None req-0a9a7be7-cad7-40a2-aaaf-c4914eba2feb tempest-VolumeDependencyTests-868648422 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-34312b00-dd6d-45bb-af98-75855cea8e48'] {{(pid=84538) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 19:09:29 devstack cinder-volume[84538]: DEBUG oslo_concurrency.lockutils [None req-0a9a7be7-cad7-40a2-aaaf-c4914eba2feb tempest-VolumeDependencyTests-868648422 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=84538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 19:09:29 devstack cinder-volume[84538]: DEBUG oslo.privsep.daemon [-] privsep: reply[dae71d33-9559-4398-ae10-8c00b01b9ec6]: (4, 'qcow2') {{(pid=85803) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 19:09:29 devstack cinder-volume[84538]: DEBUG oslo_concurrency.processutils [None req-0a9a7be7-cad7-40a2-aaaf-c4914eba2feb tempest-VolumeDependencyTests-868648422 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-a86ac317-c9ef-4185-8a8c-2cb05a50fdf9.198e6df2-3e81-4d9e-ac11-ea6277a3032d {{(pid=84538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 19:09:29 devstack sudo[94028]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-a86ac317-c9ef-4185-8a8c-2cb05a50fdf9.198e6df2-3e81-4d9e-ac11-ea6277a3032d Apr 29 19:09:29 devstack sudo[94028]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 19:09:30 devstack cinder-volume[84538]: DEBUG cinder.coordination [None req-62e65733-961f-497e-a03e-86013976f056 tempest-CinderUnicodeTest-2074336556 None] Acquiring lock "cinder-a13ff939-9b3b-45cd-9727-d0afcdbd4350-delete_snapshot" by "delete_snapshot" {{(pid=84538) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 19:09:30 devstack cinder-volume[84538]: DEBUG cinder.coordination [None req-62e65733-961f-497e-a03e-86013976f056 tempest-CinderUnicodeTest-2074336556 None] Lock "cinder-a13ff939-9b3b-45cd-9727-d0afcdbd4350-delete_snapshot" acquired by "delete_snapshot" :: waited 0.029s {{(pid=84538) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 19:09:30 devstack cinder-volume[84538]: DEBUG cinder.coordination [None req-62e65733-961f-497e-a03e-86013976f056 tempest-CinderUnicodeTest-2074336556 None] Acquiring lock "cinder-quobyte-0d42a7b3-e110-4ac2-a938-632eda1c3957" by "delete_snapshot" {{(pid=84538) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 19:09:30 devstack cinder-volume[84538]: DEBUG cinder.coordination [None req-62e65733-961f-497e-a03e-86013976f056 tempest-CinderUnicodeTest-2074336556 None] Lock "cinder-quobyte-0d42a7b3-e110-4ac2-a938-632eda1c3957" acquired by "delete_snapshot" :: waited 0.039s {{(pid=84538) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 19:09:30 devstack cinder-volume[84538]: DEBUG cinder.coordination [None req-62e65733-961f-497e-a03e-86013976f056 tempest-CinderUnicodeTest-2074336556 None] Acquiring lock "cinder-quobyte-a13ff939-9b3b-45cd-9727-d0afcdbd4350" by "_delete_snapshot" {{(pid=84538) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 19:09:30 devstack cinder-volume[84538]: DEBUG cinder.coordination [None req-62e65733-961f-497e-a03e-86013976f056 tempest-CinderUnicodeTest-2074336556 None] Lock "cinder-quobyte-a13ff939-9b3b-45cd-9727-d0afcdbd4350" acquired by "_delete_snapshot" :: waited 0.024s {{(pid=84538) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 19:09:30 devstack cinder-volume[84538]: DEBUG cinder.volume.drivers.remotefs [None req-62e65733-961f-497e-a03e-86013976f056 tempest-CinderUnicodeTest-2074336556 None] Deleting offline snapshot a13ff939-9b3b-45cd-9727-d0afcdbd4350 of volume 0d42a7b3-e110-4ac2-a938-632eda1c3957 {{(pid=84538) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 29 19:09:30 devstack cinder-volume[84538]: DEBUG cinder.volume.drivers.remotefs [None req-62e65733-961f-497e-a03e-86013976f056 tempest-CinderUnicodeTest-2074336556 None] snapshot_file for this snap is: volume-0d42a7b3-e110-4ac2-a938-632eda1c3957.a13ff939-9b3b-45cd-9727-d0afcdbd4350 {{(pid=84538) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 29 19:09:30 devstack cinder-volume[84538]: DEBUG oslo.privsep.daemon [-] privsep: reply[f7df6544-82d1-4652-b462-fe266241f49c]: (4, 'qcow2') {{(pid=85803) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 19:09:30 devstack cinder-volume[84538]: DEBUG oslo_concurrency.processutils [None req-62e65733-961f-497e-a03e-86013976f056 tempest-CinderUnicodeTest-2074336556 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-0d42a7b3-e110-4ac2-a938-632eda1c3957.a13ff939-9b3b-45cd-9727-d0afcdbd4350 {{(pid=84538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 19:09:30 devstack sudo[94030]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-0d42a7b3-e110-4ac2-a938-632eda1c3957.a13ff939-9b3b-45cd-9727-d0afcdbd4350 Apr 29 19:09:30 devstack sudo[94030]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 19:09:30 devstack sudo[94028]: pam_unix(sudo:session): session closed for user root Apr 29 19:09:30 devstack cinder-volume[84538]: DEBUG oslo_concurrency.processutils [None req-0a9a7be7-cad7-40a2-aaaf-c4914eba2feb tempest-VolumeDependencyTests-868648422 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-a86ac317-c9ef-4185-8a8c-2cb05a50fdf9.198e6df2-3e81-4d9e-ac11-ea6277a3032d" returned: 0 in 0.836s {{(pid=84538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 19:09:30 devstack cinder-volume[84538]: DEBUG cinder.volume.drivers.remotefs [None req-0a9a7be7-cad7-40a2-aaaf-c4914eba2feb tempest-VolumeDependencyTests-868648422 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-a86ac317-c9ef-4185-8a8c-2cb05a50fdf9(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=84538) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 29 19:09:30 devstack cinder-volume[84538]: DEBUG cinder.volume.drivers.quobyte [None req-0a9a7be7-cad7-40a2-aaaf-c4914eba2feb tempest-VolumeDependencyTests-868648422 None] will copy from snapshot at /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-a86ac317-c9ef-4185-8a8c-2cb05a50fdf9 {{(pid=84538) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Apr 29 19:09:30 devstack cinder-volume[84538]: DEBUG cinder.volume.drivers.quobyte [None req-0a9a7be7-cad7-40a2-aaaf-c4914eba2feb tempest-VolumeDependencyTests-868648422 None] Creating direct copy from snapshot {{(pid=84538) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Apr 29 19:09:30 devstack cinder-volume[84538]: DEBUG oslo.privsep.daemon [-] privsep: reply[9ec16086-fa77-44ce-8b28-39363a47f161]: (4, 'qcow2') {{(pid=85803) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 19:09:30 devstack cinder-volume[84538]: DEBUG oslo_concurrency.processutils [None req-0a9a7be7-cad7-40a2-aaaf-c4914eba2feb tempest-VolumeDependencyTests-868648422 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-a86ac317-c9ef-4185-8a8c-2cb05a50fdf9 {{(pid=84538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 19:09:30 devstack sudo[94036]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-a86ac317-c9ef-4185-8a8c-2cb05a50fdf9 Apr 29 19:09:30 devstack sudo[94036]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 19:09:31 devstack sudo[94030]: pam_unix(sudo:session): session closed for user root Apr 29 19:09:31 devstack cinder-volume[84538]: DEBUG oslo_concurrency.processutils [None req-62e65733-961f-497e-a03e-86013976f056 tempest-CinderUnicodeTest-2074336556 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-0d42a7b3-e110-4ac2-a938-632eda1c3957.a13ff939-9b3b-45cd-9727-d0afcdbd4350" returned: 0 in 0.874s {{(pid=84538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 19:09:31 devstack cinder-volume[84538]: DEBUG cinder.volume.drivers.remotefs [None req-62e65733-961f-497e-a03e-86013976f056 tempest-CinderUnicodeTest-2074336556 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-0d42a7b3-e110-4ac2-a938-632eda1c3957(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=84538) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 29 19:09:31 devstack cinder-volume[84538]: DEBUG oslo.privsep.daemon [-] privsep: reply[807a8163-8721-4eff-95e5-8b3991311b16]: (4, 'qcow2') {{(pid=85803) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 19:09:31 devstack cinder-volume[84538]: DEBUG oslo_concurrency.processutils [None req-62e65733-961f-497e-a03e-86013976f056 tempest-CinderUnicodeTest-2074336556 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-0d42a7b3-e110-4ac2-a938-632eda1c3957 {{(pid=84538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 19:09:31 devstack sudo[94041]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-0d42a7b3-e110-4ac2-a938-632eda1c3957 Apr 29 19:09:31 devstack sudo[94041]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 19:09:31 devstack sudo[94036]: pam_unix(sudo:session): session closed for user root Apr 29 19:09:31 devstack cinder-volume[84538]: DEBUG oslo_concurrency.processutils [None req-0a9a7be7-cad7-40a2-aaaf-c4914eba2feb tempest-VolumeDependencyTests-868648422 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-a86ac317-c9ef-4185-8a8c-2cb05a50fdf9" returned: 0 in 0.827s {{(pid=84538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 19:09:31 devstack cinder-volume[84538]: DEBUG cinder.utils [None req-0a9a7be7-cad7-40a2-aaaf-c4914eba2feb tempest-VolumeDependencyTests-868648422 None] Path /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-90a642e5-d251-44d5-aa73-d01b4f57c2b2 not found in is_blk_device check {{(pid=84538) is_blk_device /opt/stack/cinder/cinder/utils.py:602}} Apr 29 19:09:31 devstack cinder-volume[84538]: DEBUG oslo_concurrency.processutils [None req-0a9a7be7-cad7-40a2-aaaf-c4914eba2feb tempest-VolumeDependencyTests-868648422 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-a86ac317-c9ef-4185-8a8c-2cb05a50fdf9 /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-90a642e5-d251-44d5-aa73-d01b4f57c2b2 {{(pid=84538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 19:09:31 devstack sudo[94046]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-a86ac317-c9ef-4185-8a8c-2cb05a50fdf9 /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-90a642e5-d251-44d5-aa73-d01b4f57c2b2 Apr 29 19:09:31 devstack sudo[94046]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 19:09:32 devstack sudo[94041]: pam_unix(sudo:session): session closed for user root Apr 29 19:09:32 devstack cinder-volume[84538]: DEBUG oslo_concurrency.processutils [None req-62e65733-961f-497e-a03e-86013976f056 tempest-CinderUnicodeTest-2074336556 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-0d42a7b3-e110-4ac2-a938-632eda1c3957" returned: 0 in 0.787s {{(pid=84538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 19:09:32 devstack cinder-volume[84538]: DEBUG oslo_concurrency.processutils [None req-62e65733-961f-497e-a03e-86013976f056 tempest-CinderUnicodeTest-2074336556 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-0d42a7b3-e110-4ac2-a938-632eda1c3957.a13ff939-9b3b-45cd-9727-d0afcdbd4350 {{(pid=84538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 19:09:32 devstack sudo[94051]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-0d42a7b3-e110-4ac2-a938-632eda1c3957.a13ff939-9b3b-45cd-9727-d0afcdbd4350 Apr 29 19:09:32 devstack sudo[94051]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 19:09:33 devstack sudo[94051]: pam_unix(sudo:session): session closed for user root Apr 29 19:09:33 devstack cinder-volume[84538]: DEBUG oslo_concurrency.processutils [None req-62e65733-961f-497e-a03e-86013976f056 tempest-CinderUnicodeTest-2074336556 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-0d42a7b3-e110-4ac2-a938-632eda1c3957.a13ff939-9b3b-45cd-9727-d0afcdbd4350" returned: 0 in 1.275s {{(pid=84538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 19:09:33 devstack cinder-volume[84538]: DEBUG oslo_concurrency.processutils [None req-62e65733-961f-497e-a03e-86013976f056 tempest-CinderUnicodeTest-2074336556 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-0d42a7b3-e110-4ac2-a938-632eda1c3957.a13ff939-9b3b-45cd-9727-d0afcdbd4350 {{(pid=84538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 19:09:33 devstack sudo[94070]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-0d42a7b3-e110-4ac2-a938-632eda1c3957.a13ff939-9b3b-45cd-9727-d0afcdbd4350 Apr 29 19:09:33 devstack sudo[94070]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 19:09:34 devstack sudo[94070]: pam_unix(sudo:session): session closed for user root Apr 29 19:09:34 devstack cinder-volume[84538]: DEBUG oslo_concurrency.processutils [None req-62e65733-961f-497e-a03e-86013976f056 tempest-CinderUnicodeTest-2074336556 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-0d42a7b3-e110-4ac2-a938-632eda1c3957.a13ff939-9b3b-45cd-9727-d0afcdbd4350" returned: 0 in 1.597s {{(pid=84538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 19:09:35 devstack cinder-volume[84538]: DEBUG cinder.coordination [None req-62e65733-961f-497e-a03e-86013976f056 tempest-CinderUnicodeTest-2074336556 None] Lock "cinder-quobyte-a13ff939-9b3b-45cd-9727-d0afcdbd4350" released by "_delete_snapshot" :: held 4.732s {{(pid=84538) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 19:09:35 devstack cinder-volume[84538]: DEBUG cinder.coordination [None req-62e65733-961f-497e-a03e-86013976f056 tempest-CinderUnicodeTest-2074336556 None] Lock "cinder-quobyte-0d42a7b3-e110-4ac2-a938-632eda1c3957" released by "delete_snapshot" :: held 4.778s {{(pid=84538) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 19:09:35 devstack cinder-volume[84538]: DEBUG cinder.quota [None req-62e65733-961f-497e-a03e-86013976f056 tempest-CinderUnicodeTest-2074336556 None] Created reservations ['5c5646eb-e0e8-47ab-9deb-d2611b109b8e', '5d928b00-1f66-4a0e-8d0b-a6644708db49', '1e26259b-467f-40b2-9a7e-4c9d2e14aa25', 'c9fbafc6-0fb9-4497-a9eb-3e2bb644326c'] {{(pid=84538) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 29 19:09:35 devstack cinder-volume[84538]: INFO cinder.volume.manager [None req-62e65733-961f-497e-a03e-86013976f056 tempest-CinderUnicodeTest-2074336556 None] Delete snapshot completed successfully. Apr 29 19:09:35 devstack cinder-volume[84538]: DEBUG cinder.coordination [None req-62e65733-961f-497e-a03e-86013976f056 tempest-CinderUnicodeTest-2074336556 None] Lock "cinder-a13ff939-9b3b-45cd-9727-d0afcdbd4350-delete_snapshot" released by "delete_snapshot" :: held 5.046s {{(pid=84538) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 19:09:35 devstack cinder-volume[84538]: DEBUG cinder.coordination [None req-0244e420-a177-4d85-b801-ed08af42ad65 tempest-CinderUnicodeTest-2074336556 None] Acquiring lock "cinder-0d42a7b3-e110-4ac2-a938-632eda1c3957-delete_volume" by "delete_volume" {{(pid=84538) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 19:09:35 devstack cinder-volume[84538]: DEBUG cinder.coordination [None req-0244e420-a177-4d85-b801-ed08af42ad65 tempest-CinderUnicodeTest-2074336556 None] Lock "cinder-0d42a7b3-e110-4ac2-a938-632eda1c3957-delete_volume" acquired by "delete_volume" :: waited 0.054s {{(pid=84538) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 19:09:36 devstack cinder-volume[84538]: DEBUG cinder.coordination [None req-0244e420-a177-4d85-b801-ed08af42ad65 tempest-CinderUnicodeTest-2074336556 None] Acquiring lock "cinder-quobyte-0d42a7b3-e110-4ac2-a938-632eda1c3957" by "delete_volume" {{(pid=84538) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 19:09:36 devstack cinder-volume[84538]: DEBUG cinder.coordination [None req-0244e420-a177-4d85-b801-ed08af42ad65 tempest-CinderUnicodeTest-2074336556 None] Lock "cinder-quobyte-0d42a7b3-e110-4ac2-a938-632eda1c3957" acquired by "delete_volume" :: waited 0.031s {{(pid=84538) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 19:09:36 devstack cinder-volume[84538]: DEBUG oslo.privsep.daemon [-] privsep: reply[f534140c-f78d-41c6-a8da-6f5c92ab6831]: (4, 'qcow2') {{(pid=85803) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 19:09:36 devstack cinder-volume[84538]: DEBUG oslo_concurrency.processutils [None req-0244e420-a177-4d85-b801-ed08af42ad65 tempest-CinderUnicodeTest-2074336556 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-0d42a7b3-e110-4ac2-a938-632eda1c3957 {{(pid=84538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 19:09:36 devstack sudo[94074]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-0d42a7b3-e110-4ac2-a938-632eda1c3957 Apr 29 19:09:36 devstack sudo[94074]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 19:09:37 devstack sudo[94046]: pam_unix(sudo:session): session closed for user root Apr 29 19:09:37 devstack cinder-volume[84538]: DEBUG oslo_concurrency.processutils [None req-0a9a7be7-cad7-40a2-aaaf-c4914eba2feb tempest-VolumeDependencyTests-868648422 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-a86ac317-c9ef-4185-8a8c-2cb05a50fdf9 /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-90a642e5-d251-44d5-aa73-d01b4f57c2b2" returned: 0 in 5.952s {{(pid=84538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 19:09:37 devstack cinder-volume[84538]: DEBUG oslo.privsep.daemon [-] privsep: reply[760fa1cb-5d52-4444-a89a-0e819587428b]: (4, 'qcow2') {{(pid=85803) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 19:09:37 devstack cinder-volume[84538]: DEBUG oslo_concurrency.processutils [None req-0a9a7be7-cad7-40a2-aaaf-c4914eba2feb tempest-VolumeDependencyTests-868648422 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-a86ac317-c9ef-4185-8a8c-2cb05a50fdf9 {{(pid=84538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 19:09:37 devstack sudo[94074]: pam_unix(sudo:session): session closed for user root Apr 29 19:09:37 devstack cinder-volume[84538]: DEBUG oslo_concurrency.processutils [None req-0244e420-a177-4d85-b801-ed08af42ad65 tempest-CinderUnicodeTest-2074336556 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-0d42a7b3-e110-4ac2-a938-632eda1c3957" returned: 0 in 1.354s {{(pid=84538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 19:09:37 devstack cinder-volume[84538]: DEBUG oslo_concurrency.processutils [None req-0244e420-a177-4d85-b801-ed08af42ad65 tempest-CinderUnicodeTest-2074336556 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-0d42a7b3-e110-4ac2-a938-632eda1c3957 {{(pid=84538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 19:09:37 devstack sudo[94080]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-0d42a7b3-e110-4ac2-a938-632eda1c3957 Apr 29 19:09:37 devstack sudo[94080]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 19:09:37 devstack sudo[94079]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-a86ac317-c9ef-4185-8a8c-2cb05a50fdf9 Apr 29 19:09:37 devstack sudo[94079]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 19:09:38 devstack sudo[94080]: pam_unix(sudo:session): session closed for user root Apr 29 19:09:38 devstack cinder-volume[84538]: DEBUG oslo_concurrency.processutils [None req-0244e420-a177-4d85-b801-ed08af42ad65 tempest-CinderUnicodeTest-2074336556 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-0d42a7b3-e110-4ac2-a938-632eda1c3957" returned: 0 in 0.759s {{(pid=84538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 19:09:38 devstack cinder-volume[84538]: DEBUG cinder.coordination [None req-0244e420-a177-4d85-b801-ed08af42ad65 tempest-CinderUnicodeTest-2074336556 None] Lock "cinder-quobyte-0d42a7b3-e110-4ac2-a938-632eda1c3957" released by "delete_volume" :: held 2.276s {{(pid=84538) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 19:09:38 devstack cinder-volume[84538]: DEBUG cinder.quota [None req-0244e420-a177-4d85-b801-ed08af42ad65 tempest-CinderUnicodeTest-2074336556 None] Created reservations ['c9873dfb-ae8e-4cfe-8f9c-915a02c3f9c0', 'd8ed3dfe-fb9c-4c37-9b98-661e34b95423', 'ff48fc5e-f333-4545-a039-61bb8f39f748', '4e64a4c9-025b-4fec-85fe-ec757c07c7ba'] {{(pid=84538) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 29 19:09:38 devstack cinder-volume[84538]: DEBUG oslo_concurrency.lockutils [None req-0244e420-a177-4d85-b801-ed08af42ad65 tempest-CinderUnicodeTest-2074336556 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 19:09:38 devstack cinder-volume[84538]: DEBUG oslo_concurrency.lockutils [None req-0244e420-a177-4d85-b801-ed08af42ad65 tempest-CinderUnicodeTest-2074336556 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 19:09:38 devstack cinder-volume[84538]: DEBUG cinder.volume.drivers.quobyte [None req-0244e420-a177-4d85-b801-ed08af42ad65 tempest-CinderUnicodeTest-2074336556 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-34312b00-dd6d-45bb-af98-75855cea8e48': None} {{(pid=84538) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 19:09:38 devstack cinder-volume[84538]: DEBUG cinder.volume.drivers.quobyte [None req-0244e420-a177-4d85-b801-ed08af42ad65 tempest-CinderUnicodeTest-2074336556 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-34312b00-dd6d-45bb-af98-75855cea8e48'] {{(pid=84538) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 19:09:38 devstack cinder-volume[84538]: DEBUG oslo_concurrency.lockutils [None req-0244e420-a177-4d85-b801-ed08af42ad65 tempest-CinderUnicodeTest-2074336556 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=84538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 19:09:38 devstack cinder-volume[84538]: DEBUG oslo_concurrency.processutils [None req-0244e420-a177-4d85-b801-ed08af42ad65 tempest-CinderUnicodeTest-2074336556 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d {{(pid=84538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 19:09:38 devstack sudo[94090]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d Apr 29 19:09:38 devstack sudo[94090]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 19:09:38 devstack sudo[94079]: pam_unix(sudo:session): session closed for user root Apr 29 19:09:38 devstack cinder-volume[84538]: DEBUG oslo_concurrency.processutils [None req-0a9a7be7-cad7-40a2-aaaf-c4914eba2feb tempest-VolumeDependencyTests-868648422 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-a86ac317-c9ef-4185-8a8c-2cb05a50fdf9" returned: 0 in 1.058s {{(pid=84538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 19:09:38 devstack cinder-volume[84538]: DEBUG cinder.image.image_utils [None req-0a9a7be7-cad7-40a2-aaaf-c4914eba2feb tempest-VolumeDependencyTests-868648422 None] Image conversion details: src /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-a86ac317-c9ef-4185-8a8c-2cb05a50fdf9, size 1024.00 MB, duration 5.95 sec, destination /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-90a642e5-d251-44d5-aa73-d01b4f57c2b2 {{(pid=84538) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}} Apr 29 19:09:38 devstack cinder-volume[84538]: INFO cinder.image.image_utils [None req-0a9a7be7-cad7-40a2-aaaf-c4914eba2feb tempest-VolumeDependencyTests-868648422 None] Converted 1024.00 MB image at 172.00 MB/s Apr 29 19:09:38 devstack cinder-volume[84538]: WARNING cinder.volume.drivers.remotefs [None req-0a9a7be7-cad7-40a2-aaaf-c4914eba2feb tempest-VolumeDependencyTests-868648422 None] /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-90a642e5-d251-44d5-aa73-d01b4f57c2b2 is being set with open permissions: ugo+rw Apr 29 19:09:38 devstack cinder-volume[84538]: DEBUG oslo_concurrency.processutils [None req-0a9a7be7-cad7-40a2-aaaf-c4914eba2feb tempest-VolumeDependencyTests-868648422 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-90a642e5-d251-44d5-aa73-d01b4f57c2b2 {{(pid=84538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 19:09:38 devstack sudo[94092]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-90a642e5-d251-44d5-aa73-d01b4f57c2b2 Apr 29 19:09:38 devstack sudo[94092]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 19:09:39 devstack sudo[94090]: pam_unix(sudo:session): session closed for user root Apr 29 19:09:39 devstack cinder-volume[84538]: DEBUG oslo_concurrency.processutils [None req-0244e420-a177-4d85-b801-ed08af42ad65 tempest-CinderUnicodeTest-2074336556 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d" returned: 0 in 0.730s {{(pid=84538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 19:09:39 devstack cinder-volume[84538]: DEBUG cinder.manager [None req-0244e420-a177-4d85-b801-ed08af42ad65 tempest-CinderUnicodeTest-2074336556 None] Notifying Schedulers of capabilities ... {{(pid=84538) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 29 19:09:39 devstack cinder-volume[84538]: INFO cinder.volume.manager [None req-0244e420-a177-4d85-b801-ed08af42ad65 tempest-CinderUnicodeTest-2074336556 None] Deleted volume successfully. Apr 29 19:09:39 devstack cinder-volume[84538]: DEBUG cinder.coordination [None req-0244e420-a177-4d85-b801-ed08af42ad65 tempest-CinderUnicodeTest-2074336556 None] Lock "cinder-0d42a7b3-e110-4ac2-a938-632eda1c3957-delete_volume" released by "delete_volume" :: held 3.340s {{(pid=84538) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 19:09:39 devstack sudo[94092]: pam_unix(sudo:session): session closed for user root Apr 29 19:09:39 devstack cinder-volume[84538]: DEBUG oslo_concurrency.processutils [None req-0a9a7be7-cad7-40a2-aaaf-c4914eba2feb tempest-VolumeDependencyTests-868648422 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-90a642e5-d251-44d5-aa73-d01b4f57c2b2" returned: 0 in 0.815s {{(pid=84538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 19:09:39 devstack cinder-volume[84538]: DEBUG cinder.coordination [None req-0a9a7be7-cad7-40a2-aaaf-c4914eba2feb tempest-VolumeDependencyTests-868648422 None] Lock "cinder-quobyte-90a642e5-d251-44d5-aa73-d01b4f57c2b2" released by "_copy_volume_from_snapshot" :: held 9.628s {{(pid=84538) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 19:09:39 devstack cinder-volume[84538]: DEBUG cinder.coordination [None req-9ed1a4ed-5f1f-423e-9b5f-f3fea385b9fb tempest-CinderUnicodeTest-2074336556 None] Acquiring lock "cinder-8d006829-6569-42c5-9f2c-536782b876a7-delete_volume" by "delete_volume" {{(pid=84538) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 19:09:39 devstack cinder-volume[84538]: DEBUG cinder.coordination [None req-0a9a7be7-cad7-40a2-aaaf-c4914eba2feb tempest-VolumeDependencyTests-868648422 None] Lock "cinder-quobyte-198e6df2-3e81-4d9e-ac11-ea6277a3032d-90a642e5-d251-44d5-aa73-d01b4f57c2b2" released by "_create_volume_from_snapshot" :: held 9.668s {{(pid=84538) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 19:09:39 devstack cinder-volume[84538]: DEBUG oslo_concurrency.lockutils [None req-0a9a7be7-cad7-40a2-aaaf-c4914eba2feb tempest-VolumeDependencyTests-868648422 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 9.692s {{(pid=84538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 19:09:39 devstack cinder-volume[84538]: DEBUG oslo_concurrency.lockutils [None req-ebb9d5fb-54f2-4816-ac1d-2e4965a19259 tempest-CreateVolumesFromSnapshotTest-1938046858 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 13.337s {{(pid=84538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 19:09:39 devstack cinder-volume[84538]: DEBUG cinder.volume.drivers.quobyte [None req-ebb9d5fb-54f2-4816-ac1d-2e4965a19259 tempest-CreateVolumesFromSnapshotTest-1938046858 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-29T17:09:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1390241809',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=22adfb3f-e963-4c06-9e74-8cd5868c13b3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='43976132c7c54fdaa06722c210f732f0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T17:09:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T17:09:26Z,use_quota=True,user_id='6ffeea78e69b4e0d8fe06ce426cac057',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(62b05900-93e3-4190-a88f-1d87324303d1),volume_type_id=62b05900-93e3-4190-a88f-1d87324303d1)}" {{(pid=84538) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 29 19:09:39 devstack cinder-volume[84538]: DEBUG cinder.volume.drivers.remotefs [None req-ebb9d5fb-54f2-4816-ac1d-2e4965a19259 tempest-CreateVolumesFromSnapshotTest-1938046858 None] Creating volume 22adfb3f-e963-4c06-9e74-8cd5868c13b3 {{(pid=84538) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 29 19:09:39 devstack cinder-volume[84538]: DEBUG oslo_concurrency.lockutils [None req-ebb9d5fb-54f2-4816-ac1d-2e4965a19259 tempest-CreateVolumesFromSnapshotTest-1938046858 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 19:09:39 devstack cinder-volume[84538]: DEBUG oslo_concurrency.lockutils [None req-ebb9d5fb-54f2-4816-ac1d-2e4965a19259 tempest-CreateVolumesFromSnapshotTest-1938046858 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=84538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 19:09:39 devstack cinder-volume[84538]: DEBUG cinder.volume.drivers.quobyte [None req-ebb9d5fb-54f2-4816-ac1d-2e4965a19259 tempest-CreateVolumesFromSnapshotTest-1938046858 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-34312b00-dd6d-45bb-af98-75855cea8e48': None} {{(pid=84538) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 19:09:39 devstack cinder-volume[84538]: DEBUG cinder.volume.drivers.quobyte [None req-ebb9d5fb-54f2-4816-ac1d-2e4965a19259 tempest-CreateVolumesFromSnapshotTest-1938046858 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-34312b00-dd6d-45bb-af98-75855cea8e48'] {{(pid=84538) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 19:09:39 devstack cinder-volume[84538]: DEBUG oslo_concurrency.lockutils [None req-ebb9d5fb-54f2-4816-ac1d-2e4965a19259 tempest-CreateVolumesFromSnapshotTest-1938046858 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=84538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 19:09:39 devstack cinder-volume[84538]: DEBUG cinder.volume.drivers.quobyte [None req-ebb9d5fb-54f2-4816-ac1d-2e4965a19259 tempest-CreateVolumesFromSnapshotTest-1938046858 None] Selected osci02.corp.quobyte.com/cinder-vol-34312b00-dd6d-45bb-af98-75855cea8e48 as target Quobyte volume. {{(pid=84538) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 29 19:09:39 devstack cinder-volume[84538]: INFO cinder.volume.drivers.remotefs [None req-ebb9d5fb-54f2-4816-ac1d-2e4965a19259 tempest-CreateVolumesFromSnapshotTest-1938046858 None] casted to osci02.corp.quobyte.com/cinder-vol-34312b00-dd6d-45bb-af98-75855cea8e48 Apr 29 19:09:39 devstack cinder-volume[84538]: DEBUG oslo_concurrency.processutils [None req-ebb9d5fb-54f2-4816-ac1d-2e4965a19259 tempest-CreateVolumesFromSnapshotTest-1938046858 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-22adfb3f-e963-4c06-9e74-8cd5868c13b3 1073741824 {{(pid=84538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 19:09:39 devstack sudo[94096]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-22adfb3f-e963-4c06-9e74-8cd5868c13b3 1073741824 Apr 29 19:09:39 devstack sudo[94096]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 19:09:39 devstack cinder-volume[84538]: DEBUG cinder.coordination [None req-9ed1a4ed-5f1f-423e-9b5f-f3fea385b9fb tempest-CinderUnicodeTest-2074336556 None] Lock "cinder-8d006829-6569-42c5-9f2c-536782b876a7-delete_volume" acquired by "delete_volume" :: waited 0.094s {{(pid=84538) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 19:09:39 devstack cinder-volume[84538]: DEBUG cinder.volume.manager [None req-0a9a7be7-cad7-40a2-aaaf-c4914eba2feb tempest-VolumeDependencyTests-868648422 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (784f0ff3-d984-4696-86a0-8ddfa50eed72) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-90a642e5-d251-44d5-aa73-d01b4f57c2b2', 'volume_size': 1, 'snapshot_id': '198e6df2-3e81-4d9e-ac11-ea6277a3032d'}' {{(pid=84538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 19:09:39 devstack cinder-volume[84538]: DEBUG cinder.volume.manager [None req-0a9a7be7-cad7-40a2-aaaf-c4914eba2feb tempest-VolumeDependencyTests-868648422 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (68e0724f-7548-4153-85ea-d81306a4806f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 19:09:39 devstack cinder-volume[84538]: INFO cinder.volume.flows.manager.create_volume [None req-0a9a7be7-cad7-40a2-aaaf-c4914eba2feb tempest-VolumeDependencyTests-868648422 None] Volume volume-90a642e5-d251-44d5-aa73-d01b4f57c2b2 (90a642e5-d251-44d5-aa73-d01b4f57c2b2): created successfully Apr 29 19:09:39 devstack cinder-volume[84538]: DEBUG cinder.volume.manager [None req-0a9a7be7-cad7-40a2-aaaf-c4914eba2feb tempest-VolumeDependencyTests-868648422 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (68e0724f-7548-4153-85ea-d81306a4806f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 19:09:39 devstack cinder-volume[84538]: DEBUG cinder.volume.manager [None req-0a9a7be7-cad7-40a2-aaaf-c4914eba2feb tempest-VolumeDependencyTests-868648422 None] Flow 'volume_create_manager' (7d6725b5-c4ca-4f9e-8945-b649e1610282) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84538) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 19:09:39 devstack cinder-volume[84538]: DEBUG cinder.coordination [None req-9ed1a4ed-5f1f-423e-9b5f-f3fea385b9fb tempest-CinderUnicodeTest-2074336556 None] Acquiring lock "cinder-quobyte-8d006829-6569-42c5-9f2c-536782b876a7" by "delete_volume" {{(pid=84538) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 19:09:39 devstack cinder-volume[84538]: DEBUG cinder.coordination [None req-9ed1a4ed-5f1f-423e-9b5f-f3fea385b9fb tempest-CinderUnicodeTest-2074336556 None] Lock "cinder-quobyte-8d006829-6569-42c5-9f2c-536782b876a7" acquired by "delete_volume" :: waited 0.019s {{(pid=84538) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 19:09:39 devstack cinder-volume[84538]: INFO cinder.volume.manager [None req-0a9a7be7-cad7-40a2-aaaf-c4914eba2feb tempest-VolumeDependencyTests-868648422 None] Created volume successfully. Apr 29 19:09:39 devstack cinder-volume[84538]: DEBUG oslo.privsep.daemon [-] privsep: reply[48749393-977a-404e-bcf6-344689c19242]: (4, 'qcow2') {{(pid=85803) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 19:09:39 devstack cinder-volume[84538]: DEBUG oslo_concurrency.processutils [None req-9ed1a4ed-5f1f-423e-9b5f-f3fea385b9fb tempest-CinderUnicodeTest-2074336556 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-8d006829-6569-42c5-9f2c-536782b876a7 {{(pid=84538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 19:09:39 devstack sudo[94098]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-8d006829-6569-42c5-9f2c-536782b876a7 Apr 29 19:09:39 devstack sudo[94098]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 19:09:40 devstack cinder-volume[84538]: DEBUG cinder.coordination [None req-4bc04c3d-1be5-4ff9-afa9-bd10f5b8645d tempest-VolumeDependencyTests-868648422 None] Acquiring lock "cinder-198e6df2-3e81-4d9e-ac11-ea6277a3032d-delete_snapshot" by "delete_snapshot" {{(pid=84538) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 19:09:40 devstack cinder-volume[84538]: DEBUG cinder.coordination [None req-4bc04c3d-1be5-4ff9-afa9-bd10f5b8645d tempest-VolumeDependencyTests-868648422 None] Lock "cinder-198e6df2-3e81-4d9e-ac11-ea6277a3032d-delete_snapshot" acquired by "delete_snapshot" :: waited 0.024s {{(pid=84538) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 19:09:40 devstack cinder-volume[84538]: DEBUG cinder.coordination [None req-4bc04c3d-1be5-4ff9-afa9-bd10f5b8645d tempest-VolumeDependencyTests-868648422 None] Acquiring lock "cinder-quobyte-a86ac317-c9ef-4185-8a8c-2cb05a50fdf9" by "delete_snapshot" {{(pid=84538) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 19:09:40 devstack cinder-volume[84538]: DEBUG cinder.coordination [None req-4bc04c3d-1be5-4ff9-afa9-bd10f5b8645d tempest-VolumeDependencyTests-868648422 None] Lock "cinder-quobyte-a86ac317-c9ef-4185-8a8c-2cb05a50fdf9" acquired by "delete_snapshot" :: waited 0.016s {{(pid=84538) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 19:09:40 devstack cinder-volume[84538]: DEBUG cinder.coordination [None req-4bc04c3d-1be5-4ff9-afa9-bd10f5b8645d tempest-VolumeDependencyTests-868648422 None] Acquiring lock "cinder-quobyte-198e6df2-3e81-4d9e-ac11-ea6277a3032d" by "_delete_snapshot" {{(pid=84538) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 19:09:40 devstack sudo[94096]: pam_unix(sudo:session): session closed for user root Apr 29 19:09:40 devstack cinder-volume[84538]: DEBUG oslo_concurrency.processutils [None req-ebb9d5fb-54f2-4816-ac1d-2e4965a19259 tempest-CreateVolumesFromSnapshotTest-1938046858 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-22adfb3f-e963-4c06-9e74-8cd5868c13b3 1073741824" returned: 0 in 1.105s {{(pid=84538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 19:09:40 devstack cinder-volume[84538]: DEBUG cinder.coordination [None req-4bc04c3d-1be5-4ff9-afa9-bd10f5b8645d tempest-VolumeDependencyTests-868648422 None] Lock "cinder-quobyte-198e6df2-3e81-4d9e-ac11-ea6277a3032d" acquired by "_delete_snapshot" :: waited 0.039s {{(pid=84538) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 19:09:40 devstack cinder-volume[84538]: DEBUG cinder.volume.drivers.remotefs [None req-4bc04c3d-1be5-4ff9-afa9-bd10f5b8645d tempest-VolumeDependencyTests-868648422 None] Deleting offline snapshot 198e6df2-3e81-4d9e-ac11-ea6277a3032d of volume a86ac317-c9ef-4185-8a8c-2cb05a50fdf9 {{(pid=84538) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 29 19:09:40 devstack cinder-volume[84538]: DEBUG cinder.volume.drivers.remotefs [None req-4bc04c3d-1be5-4ff9-afa9-bd10f5b8645d tempest-VolumeDependencyTests-868648422 None] snapshot_file for this snap is: volume-a86ac317-c9ef-4185-8a8c-2cb05a50fdf9.198e6df2-3e81-4d9e-ac11-ea6277a3032d {{(pid=84538) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 29 19:09:40 devstack cinder-volume[84538]: DEBUG oslo.privsep.daemon [-] privsep: reply[1a12dcc9-b372-44a6-8ff7-71d6fedf8277]: (4, 'qcow2') {{(pid=85803) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 19:09:40 devstack cinder-volume[84538]: DEBUG oslo_concurrency.processutils [None req-4bc04c3d-1be5-4ff9-afa9-bd10f5b8645d tempest-VolumeDependencyTests-868648422 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-a86ac317-c9ef-4185-8a8c-2cb05a50fdf9.198e6df2-3e81-4d9e-ac11-ea6277a3032d {{(pid=84538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 19:09:40 devstack cinder-volume[84538]: DEBUG oslo_concurrency.processutils [None req-ebb9d5fb-54f2-4816-ac1d-2e4965a19259 tempest-CreateVolumesFromSnapshotTest-1938046858 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-22adfb3f-e963-4c06-9e74-8cd5868c13b3 {{(pid=84538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 19:09:40 devstack sudo[94098]: pam_unix(sudo:session): session closed for user root Apr 29 19:09:40 devstack cinder-volume[84538]: DEBUG oslo_concurrency.processutils [None req-9ed1a4ed-5f1f-423e-9b5f-f3fea385b9fb tempest-CinderUnicodeTest-2074336556 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-8d006829-6569-42c5-9f2c-536782b876a7" returned: 0 in 0.976s {{(pid=84538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 19:09:40 devstack cinder-volume[84538]: DEBUG oslo_concurrency.processutils [None req-9ed1a4ed-5f1f-423e-9b5f-f3fea385b9fb tempest-CinderUnicodeTest-2074336556 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-8d006829-6569-42c5-9f2c-536782b876a7 {{(pid=84538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 19:09:40 devstack sudo[94107]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-22adfb3f-e963-4c06-9e74-8cd5868c13b3 Apr 29 19:09:40 devstack sudo[94107]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 19:09:40 devstack sudo[94108]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-8d006829-6569-42c5-9f2c-536782b876a7 Apr 29 19:09:40 devstack sudo[94108]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 19:09:40 devstack sudo[94106]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-a86ac317-c9ef-4185-8a8c-2cb05a50fdf9.198e6df2-3e81-4d9e-ac11-ea6277a3032d Apr 29 19:09:40 devstack sudo[94106]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 19:09:41 devstack sudo[94107]: pam_unix(sudo:session): session closed for user root Apr 29 19:09:41 devstack cinder-volume[84538]: DEBUG oslo_concurrency.processutils [None req-ebb9d5fb-54f2-4816-ac1d-2e4965a19259 tempest-CreateVolumesFromSnapshotTest-1938046858 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-22adfb3f-e963-4c06-9e74-8cd5868c13b3" returned: 0 in 0.779s {{(pid=84538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 19:09:41 devstack cinder-volume[84538]: DEBUG cinder.volume.drivers.quobyte [None req-ebb9d5fb-54f2-4816-ac1d-2e4965a19259 tempest-CreateVolumesFromSnapshotTest-1938046858 None] <== create_volume: return (2000ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-34312b00-dd6d-45bb-af98-75855cea8e48'} {{(pid=84538) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 29 19:09:41 devstack cinder-volume[84538]: DEBUG oslo_concurrency.lockutils [None req-ebb9d5fb-54f2-4816-ac1d-2e4965a19259 tempest-CreateVolumesFromSnapshotTest-1938046858 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.007s {{(pid=84538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 19:09:41 devstack cinder-volume[84538]: DEBUG oslo_concurrency.lockutils [None req-ee354d37-2ea3-454b-be13-69075c29022a tempest-CreateVolumesFromSnapshotTest-1938046858 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 14.872s {{(pid=84538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 19:09:41 devstack cinder-volume[84538]: DEBUG cinder.volume.drivers.quobyte [None req-ee354d37-2ea3-454b-be13-69075c29022a tempest-CreateVolumesFromSnapshotTest-1938046858 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-29T17:09:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1802905063',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4474a441-c5bf-4439-86a5-e8e00aef1394,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='43976132c7c54fdaa06722c210f732f0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T17:09:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T17:09:26Z,use_quota=True,user_id='6ffeea78e69b4e0d8fe06ce426cac057',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(62b05900-93e3-4190-a88f-1d87324303d1),volume_type_id=62b05900-93e3-4190-a88f-1d87324303d1)}" {{(pid=84538) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 29 19:09:41 devstack cinder-volume[84538]: DEBUG cinder.volume.drivers.remotefs [None req-ee354d37-2ea3-454b-be13-69075c29022a tempest-CreateVolumesFromSnapshotTest-1938046858 None] Creating volume 4474a441-c5bf-4439-86a5-e8e00aef1394 {{(pid=84538) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 29 19:09:41 devstack cinder-volume[84538]: DEBUG oslo_concurrency.lockutils [None req-ee354d37-2ea3-454b-be13-69075c29022a tempest-CreateVolumesFromSnapshotTest-1938046858 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 19:09:41 devstack cinder-volume[84538]: DEBUG oslo_concurrency.lockutils [None req-ee354d37-2ea3-454b-be13-69075c29022a tempest-CreateVolumesFromSnapshotTest-1938046858 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=84538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 19:09:41 devstack cinder-volume[84538]: DEBUG cinder.volume.drivers.quobyte [None req-ee354d37-2ea3-454b-be13-69075c29022a tempest-CreateVolumesFromSnapshotTest-1938046858 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-34312b00-dd6d-45bb-af98-75855cea8e48': None} {{(pid=84538) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 19:09:41 devstack cinder-volume[84538]: DEBUG cinder.volume.drivers.quobyte [None req-ee354d37-2ea3-454b-be13-69075c29022a tempest-CreateVolumesFromSnapshotTest-1938046858 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-34312b00-dd6d-45bb-af98-75855cea8e48'] {{(pid=84538) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 19:09:41 devstack cinder-volume[84538]: DEBUG oslo_concurrency.lockutils [None req-ee354d37-2ea3-454b-be13-69075c29022a tempest-CreateVolumesFromSnapshotTest-1938046858 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=84538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 19:09:41 devstack cinder-volume[84538]: DEBUG cinder.volume.drivers.quobyte [None req-ee354d37-2ea3-454b-be13-69075c29022a tempest-CreateVolumesFromSnapshotTest-1938046858 None] Selected osci02.corp.quobyte.com/cinder-vol-34312b00-dd6d-45bb-af98-75855cea8e48 as target Quobyte volume. {{(pid=84538) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 29 19:09:41 devstack cinder-volume[84538]: INFO cinder.volume.drivers.remotefs [None req-ee354d37-2ea3-454b-be13-69075c29022a tempest-CreateVolumesFromSnapshotTest-1938046858 None] casted to osci02.corp.quobyte.com/cinder-vol-34312b00-dd6d-45bb-af98-75855cea8e48 Apr 29 19:09:41 devstack cinder-volume[84538]: DEBUG oslo_concurrency.processutils [None req-ee354d37-2ea3-454b-be13-69075c29022a tempest-CreateVolumesFromSnapshotTest-1938046858 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-4474a441-c5bf-4439-86a5-e8e00aef1394 1073741824 {{(pid=84538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 19:09:41 devstack cinder-volume[84538]: DEBUG cinder.volume.manager [None req-ebb9d5fb-54f2-4816-ac1d-2e4965a19259 tempest-CreateVolumesFromSnapshotTest-1938046858 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6ebcf03f-b638-4fea-8947-a50bc27ccb8a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-22adfb3f-e963-4c06-9e74-8cd5868c13b3', 'volume_size': 1}' {{(pid=84538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 19:09:41 devstack sudo[94106]: pam_unix(sudo:session): session closed for user root Apr 29 19:09:41 devstack sudo[94120]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-4474a441-c5bf-4439-86a5-e8e00aef1394 1073741824 Apr 29 19:09:41 devstack sudo[94120]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 19:09:41 devstack cinder-volume[84538]: DEBUG cinder.volume.manager [None req-ebb9d5fb-54f2-4816-ac1d-2e4965a19259 tempest-CreateVolumesFromSnapshotTest-1938046858 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b5f6e748-8b1d-446a-8add-6ae2ddf89022) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 19:09:41 devstack cinder-volume[84538]: DEBUG oslo_concurrency.processutils [None req-4bc04c3d-1be5-4ff9-afa9-bd10f5b8645d tempest-VolumeDependencyTests-868648422 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-a86ac317-c9ef-4185-8a8c-2cb05a50fdf9.198e6df2-3e81-4d9e-ac11-ea6277a3032d" returned: 0 in 0.887s {{(pid=84538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 19:09:41 devstack cinder-volume[84538]: DEBUG cinder.volume.drivers.remotefs [None req-4bc04c3d-1be5-4ff9-afa9-bd10f5b8645d tempest-VolumeDependencyTests-868648422 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-a86ac317-c9ef-4185-8a8c-2cb05a50fdf9(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=84538) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 29 19:09:41 devstack sudo[94108]: pam_unix(sudo:session): session closed for user root Apr 29 19:09:41 devstack cinder-volume[84538]: DEBUG oslo_concurrency.processutils [None req-9ed1a4ed-5f1f-423e-9b5f-f3fea385b9fb tempest-CinderUnicodeTest-2074336556 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-8d006829-6569-42c5-9f2c-536782b876a7" returned: 0 in 0.840s {{(pid=84538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 19:09:41 devstack cinder-volume[84538]: INFO cinder.volume.flows.manager.create_volume [None req-ebb9d5fb-54f2-4816-ac1d-2e4965a19259 tempest-CreateVolumesFromSnapshotTest-1938046858 None] Volume volume-22adfb3f-e963-4c06-9e74-8cd5868c13b3 (22adfb3f-e963-4c06-9e74-8cd5868c13b3): created successfully Apr 29 19:09:41 devstack cinder-volume[84538]: DEBUG cinder.volume.manager [None req-ebb9d5fb-54f2-4816-ac1d-2e4965a19259 tempest-CreateVolumesFromSnapshotTest-1938046858 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b5f6e748-8b1d-446a-8add-6ae2ddf89022) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 19:09:41 devstack cinder-volume[84538]: DEBUG cinder.volume.manager [None req-ebb9d5fb-54f2-4816-ac1d-2e4965a19259 tempest-CreateVolumesFromSnapshotTest-1938046858 None] Flow 'volume_create_manager' (cff1844d-5d22-4beb-9e9f-dafcd140b588) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84538) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 19:09:41 devstack cinder-volume[84538]: DEBUG cinder.coordination [None req-9ed1a4ed-5f1f-423e-9b5f-f3fea385b9fb tempest-CinderUnicodeTest-2074336556 None] Lock "cinder-quobyte-8d006829-6569-42c5-9f2c-536782b876a7" released by "delete_volume" :: held 1.909s {{(pid=84538) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 19:09:41 devstack cinder-volume[84538]: DEBUG oslo.privsep.daemon [-] privsep: reply[7dcd7cd0-e73b-4709-8f29-bea2ce3c3836]: (4, 'qcow2') {{(pid=85803) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 19:09:41 devstack cinder-volume[84538]: DEBUG oslo_concurrency.processutils [None req-4bc04c3d-1be5-4ff9-afa9-bd10f5b8645d tempest-VolumeDependencyTests-868648422 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-a86ac317-c9ef-4185-8a8c-2cb05a50fdf9 {{(pid=84538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 19:09:41 devstack cinder-volume[84538]: INFO cinder.volume.manager [None req-ebb9d5fb-54f2-4816-ac1d-2e4965a19259 tempest-CreateVolumesFromSnapshotTest-1938046858 None] Created volume successfully. Apr 29 19:09:41 devstack cinder-volume[84538]: DEBUG cinder.quota [None req-9ed1a4ed-5f1f-423e-9b5f-f3fea385b9fb tempest-CinderUnicodeTest-2074336556 None] Created reservations ['95b329b4-718f-40c5-9f72-15feef0a14ed', '9b16dba2-6a29-4a57-b042-1987f4476729', '7281058c-408b-4f35-9f26-4d1f4a4cb74a', 'b52c9e91-a590-4950-8eed-7cb84af63a24'] {{(pid=84538) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 29 19:09:41 devstack cinder-volume[84538]: DEBUG oslo_concurrency.lockutils [None req-9ed1a4ed-5f1f-423e-9b5f-f3fea385b9fb tempest-CinderUnicodeTest-2074336556 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 19:09:41 devstack cinder-volume[84538]: DEBUG oslo_concurrency.lockutils [None req-9ed1a4ed-5f1f-423e-9b5f-f3fea385b9fb tempest-CinderUnicodeTest-2074336556 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 19:09:41 devstack cinder-volume[84538]: DEBUG cinder.volume.drivers.quobyte [None req-9ed1a4ed-5f1f-423e-9b5f-f3fea385b9fb tempest-CinderUnicodeTest-2074336556 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-34312b00-dd6d-45bb-af98-75855cea8e48': None} {{(pid=84538) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 19:09:41 devstack cinder-volume[84538]: DEBUG cinder.volume.drivers.quobyte [None req-9ed1a4ed-5f1f-423e-9b5f-f3fea385b9fb tempest-CinderUnicodeTest-2074336556 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-34312b00-dd6d-45bb-af98-75855cea8e48'] {{(pid=84538) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 19:09:41 devstack cinder-volume[84538]: DEBUG oslo_concurrency.lockutils [None req-9ed1a4ed-5f1f-423e-9b5f-f3fea385b9fb tempest-CinderUnicodeTest-2074336556 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=84538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 19:09:41 devstack cinder-volume[84538]: DEBUG oslo_concurrency.processutils [None req-9ed1a4ed-5f1f-423e-9b5f-f3fea385b9fb tempest-CinderUnicodeTest-2074336556 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d {{(pid=84538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 19:09:41 devstack sudo[94122]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-a86ac317-c9ef-4185-8a8c-2cb05a50fdf9 Apr 29 19:09:41 devstack sudo[94122]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 19:09:41 devstack sudo[94123]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d Apr 29 19:09:41 devstack sudo[94123]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 19:09:42 devstack sudo[94123]: pam_unix(sudo:session): session closed for user root Apr 29 19:09:42 devstack cinder-volume[84538]: DEBUG oslo_concurrency.processutils [None req-9ed1a4ed-5f1f-423e-9b5f-f3fea385b9fb tempest-CinderUnicodeTest-2074336556 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d" returned: 0 in 0.728s {{(pid=84538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 19:09:42 devstack cinder-volume[84538]: DEBUG cinder.manager [None req-9ed1a4ed-5f1f-423e-9b5f-f3fea385b9fb tempest-CinderUnicodeTest-2074336556 None] Notifying Schedulers of capabilities ... {{(pid=84538) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 29 19:09:42 devstack cinder-volume[84538]: INFO cinder.volume.manager [None req-9ed1a4ed-5f1f-423e-9b5f-f3fea385b9fb tempest-CinderUnicodeTest-2074336556 None] Deleted volume successfully. Apr 29 19:09:42 devstack sudo[94122]: pam_unix(sudo:session): session closed for user root Apr 29 19:09:42 devstack sudo[94120]: pam_unix(sudo:session): session closed for user root Apr 29 19:09:42 devstack cinder-volume[84538]: DEBUG cinder.coordination [None req-9ed1a4ed-5f1f-423e-9b5f-f3fea385b9fb tempest-CinderUnicodeTest-2074336556 None] Lock "cinder-8d006829-6569-42c5-9f2c-536782b876a7-delete_volume" released by "delete_volume" :: held 2.985s {{(pid=84538) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 19:09:42 devstack cinder-volume[84538]: DEBUG oslo_concurrency.processutils [None req-4bc04c3d-1be5-4ff9-afa9-bd10f5b8645d tempest-VolumeDependencyTests-868648422 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-a86ac317-c9ef-4185-8a8c-2cb05a50fdf9" returned: 0 in 0.940s {{(pid=84538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 19:09:42 devstack cinder-volume[84538]: DEBUG oslo_concurrency.processutils [None req-4bc04c3d-1be5-4ff9-afa9-bd10f5b8645d tempest-VolumeDependencyTests-868648422 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-a86ac317-c9ef-4185-8a8c-2cb05a50fdf9.198e6df2-3e81-4d9e-ac11-ea6277a3032d {{(pid=84538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 19:09:42 devstack cinder-volume[84538]: DEBUG oslo_concurrency.processutils [None req-ee354d37-2ea3-454b-be13-69075c29022a tempest-CreateVolumesFromSnapshotTest-1938046858 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-4474a441-c5bf-4439-86a5-e8e00aef1394 1073741824" returned: 0 in 1.056s {{(pid=84538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 19:09:42 devstack sudo[94134]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-a86ac317-c9ef-4185-8a8c-2cb05a50fdf9.198e6df2-3e81-4d9e-ac11-ea6277a3032d Apr 29 19:09:42 devstack sudo[94134]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 19:09:42 devstack cinder-volume[84538]: DEBUG oslo_concurrency.processutils [None req-ee354d37-2ea3-454b-be13-69075c29022a tempest-CreateVolumesFromSnapshotTest-1938046858 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-4474a441-c5bf-4439-86a5-e8e00aef1394 {{(pid=84538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 19:09:42 devstack sudo[94136]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-4474a441-c5bf-4439-86a5-e8e00aef1394 Apr 29 19:09:42 devstack sudo[94136]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 19:09:43 devstack sudo[94136]: pam_unix(sudo:session): session closed for user root Apr 29 19:09:43 devstack cinder-volume[84538]: DEBUG oslo_concurrency.processutils [None req-ee354d37-2ea3-454b-be13-69075c29022a tempest-CreateVolumesFromSnapshotTest-1938046858 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-4474a441-c5bf-4439-86a5-e8e00aef1394" returned: 0 in 0.892s {{(pid=84538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 19:09:43 devstack cinder-volume[84538]: DEBUG cinder.volume.drivers.quobyte [None req-ee354d37-2ea3-454b-be13-69075c29022a tempest-CreateVolumesFromSnapshotTest-1938046858 None] <== create_volume: return (1998ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-34312b00-dd6d-45bb-af98-75855cea8e48'} {{(pid=84538) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 29 19:09:43 devstack cinder-volume[84538]: DEBUG oslo_concurrency.lockutils [None req-ee354d37-2ea3-454b-be13-69075c29022a tempest-CreateVolumesFromSnapshotTest-1938046858 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.002s {{(pid=84538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 19:09:43 devstack cinder-volume[84538]: DEBUG oslo_concurrency.lockutils [None req-20f128b0-cbc8-441b-a075-c7a197e90479 tempest-CreateVolumesFromSnapshotTest-1938046858 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 16.413s {{(pid=84538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 19:09:43 devstack cinder-volume[84538]: DEBUG cinder.volume.drivers.quobyte [None req-20f128b0-cbc8-441b-a075-c7a197e90479 tempest-CreateVolumesFromSnapshotTest-1938046858 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-29T17:09:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1937614316',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5e3d9ffe-6145-432b-889f-53ac70d96f1e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='43976132c7c54fdaa06722c210f732f0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T17:09:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T17:09:27Z,use_quota=True,user_id='6ffeea78e69b4e0d8fe06ce426cac057',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(62b05900-93e3-4190-a88f-1d87324303d1),volume_type_id=62b05900-93e3-4190-a88f-1d87324303d1)}" {{(pid=84538) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 29 19:09:43 devstack cinder-volume[84538]: DEBUG cinder.volume.drivers.remotefs [None req-20f128b0-cbc8-441b-a075-c7a197e90479 tempest-CreateVolumesFromSnapshotTest-1938046858 None] Creating volume 5e3d9ffe-6145-432b-889f-53ac70d96f1e {{(pid=84538) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 29 19:09:43 devstack cinder-volume[84538]: DEBUG oslo_concurrency.lockutils [None req-20f128b0-cbc8-441b-a075-c7a197e90479 tempest-CreateVolumesFromSnapshotTest-1938046858 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 19:09:43 devstack cinder-volume[84538]: DEBUG oslo_concurrency.lockutils [None req-20f128b0-cbc8-441b-a075-c7a197e90479 tempest-CreateVolumesFromSnapshotTest-1938046858 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 19:09:43 devstack cinder-volume[84538]: DEBUG cinder.volume.drivers.quobyte [None req-20f128b0-cbc8-441b-a075-c7a197e90479 tempest-CreateVolumesFromSnapshotTest-1938046858 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-34312b00-dd6d-45bb-af98-75855cea8e48': None} {{(pid=84538) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 19:09:43 devstack sudo[94134]: pam_unix(sudo:session): session closed for user root Apr 29 19:09:43 devstack cinder-volume[84538]: DEBUG cinder.volume.drivers.quobyte [None req-20f128b0-cbc8-441b-a075-c7a197e90479 tempest-CreateVolumesFromSnapshotTest-1938046858 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-34312b00-dd6d-45bb-af98-75855cea8e48'] {{(pid=84538) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 19:09:43 devstack cinder-volume[84538]: DEBUG oslo_concurrency.lockutils [None req-20f128b0-cbc8-441b-a075-c7a197e90479 tempest-CreateVolumesFromSnapshotTest-1938046858 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=84538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 19:09:43 devstack cinder-volume[84538]: DEBUG cinder.volume.drivers.quobyte [None req-20f128b0-cbc8-441b-a075-c7a197e90479 tempest-CreateVolumesFromSnapshotTest-1938046858 None] Selected osci02.corp.quobyte.com/cinder-vol-34312b00-dd6d-45bb-af98-75855cea8e48 as target Quobyte volume. {{(pid=84538) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 29 19:09:43 devstack cinder-volume[84538]: INFO cinder.volume.drivers.remotefs [None req-20f128b0-cbc8-441b-a075-c7a197e90479 tempest-CreateVolumesFromSnapshotTest-1938046858 None] casted to osci02.corp.quobyte.com/cinder-vol-34312b00-dd6d-45bb-af98-75855cea8e48 Apr 29 19:09:43 devstack cinder-volume[84538]: DEBUG oslo_concurrency.processutils [None req-20f128b0-cbc8-441b-a075-c7a197e90479 tempest-CreateVolumesFromSnapshotTest-1938046858 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-5e3d9ffe-6145-432b-889f-53ac70d96f1e 1073741824 {{(pid=84538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 19:09:43 devstack cinder-volume[84538]: DEBUG cinder.volume.manager [None req-ee354d37-2ea3-454b-be13-69075c29022a tempest-CreateVolumesFromSnapshotTest-1938046858 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (05477688-2160-42e5-8bba-3f089439bb13) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4474a441-c5bf-4439-86a5-e8e00aef1394', 'volume_size': 1}' {{(pid=84538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 19:09:43 devstack cinder-volume[84538]: DEBUG cinder.volume.manager [None req-ee354d37-2ea3-454b-be13-69075c29022a tempest-CreateVolumesFromSnapshotTest-1938046858 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ad384af7-dabf-4a04-88b1-eec316cf1b6c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 19:09:43 devstack sudo[94143]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-5e3d9ffe-6145-432b-889f-53ac70d96f1e 1073741824 Apr 29 19:09:43 devstack cinder-volume[84538]: DEBUG oslo_concurrency.processutils [None req-4bc04c3d-1be5-4ff9-afa9-bd10f5b8645d tempest-VolumeDependencyTests-868648422 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-a86ac317-c9ef-4185-8a8c-2cb05a50fdf9.198e6df2-3e81-4d9e-ac11-ea6277a3032d" returned: 0 in 0.998s {{(pid=84538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 19:09:43 devstack sudo[94143]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 19:09:43 devstack cinder-volume[84538]: DEBUG oslo_concurrency.processutils [None req-4bc04c3d-1be5-4ff9-afa9-bd10f5b8645d tempest-VolumeDependencyTests-868648422 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-a86ac317-c9ef-4185-8a8c-2cb05a50fdf9.198e6df2-3e81-4d9e-ac11-ea6277a3032d {{(pid=84538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 19:09:43 devstack cinder-volume[84538]: INFO cinder.volume.flows.manager.create_volume [None req-ee354d37-2ea3-454b-be13-69075c29022a tempest-CreateVolumesFromSnapshotTest-1938046858 None] Volume volume-4474a441-c5bf-4439-86a5-e8e00aef1394 (4474a441-c5bf-4439-86a5-e8e00aef1394): created successfully Apr 29 19:09:43 devstack cinder-volume[84538]: DEBUG cinder.volume.manager [None req-ee354d37-2ea3-454b-be13-69075c29022a tempest-CreateVolumesFromSnapshotTest-1938046858 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ad384af7-dabf-4a04-88b1-eec316cf1b6c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 19:09:43 devstack cinder-volume[84538]: DEBUG cinder.volume.manager [None req-ee354d37-2ea3-454b-be13-69075c29022a tempest-CreateVolumesFromSnapshotTest-1938046858 None] Flow 'volume_create_manager' (4270e196-88be-4c61-9f62-008c1969cae3) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84538) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 19:09:43 devstack cinder-volume[84538]: INFO cinder.volume.manager [None req-ee354d37-2ea3-454b-be13-69075c29022a tempest-CreateVolumesFromSnapshotTest-1938046858 None] Created volume successfully. Apr 29 19:09:43 devstack sudo[94145]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-a86ac317-c9ef-4185-8a8c-2cb05a50fdf9.198e6df2-3e81-4d9e-ac11-ea6277a3032d Apr 29 19:09:43 devstack sudo[94145]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 19:09:44 devstack sudo[94145]: pam_unix(sudo:session): session closed for user root Apr 29 19:09:44 devstack cinder-volume[84538]: DEBUG oslo_concurrency.processutils [None req-4bc04c3d-1be5-4ff9-afa9-bd10f5b8645d tempest-VolumeDependencyTests-868648422 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-a86ac317-c9ef-4185-8a8c-2cb05a50fdf9.198e6df2-3e81-4d9e-ac11-ea6277a3032d" returned: 0 in 0.800s {{(pid=84538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 19:09:44 devstack cinder-volume[84538]: DEBUG cinder.coordination [None req-4bc04c3d-1be5-4ff9-afa9-bd10f5b8645d tempest-VolumeDependencyTests-868648422 None] Lock "cinder-quobyte-198e6df2-3e81-4d9e-ac11-ea6277a3032d" released by "_delete_snapshot" :: held 3.804s {{(pid=84538) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 19:09:44 devstack cinder-volume[84538]: DEBUG cinder.coordination [None req-4bc04c3d-1be5-4ff9-afa9-bd10f5b8645d tempest-VolumeDependencyTests-868648422 None] Lock "cinder-quobyte-a86ac317-c9ef-4185-8a8c-2cb05a50fdf9" released by "delete_snapshot" :: held 3.858s {{(pid=84538) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 19:09:44 devstack cinder-volume[84538]: DEBUG cinder.quota [None req-4bc04c3d-1be5-4ff9-afa9-bd10f5b8645d tempest-VolumeDependencyTests-868648422 None] Created reservations ['df7bfbb8-5122-439d-8f58-d35f8e36b79d', 'e6a1e0ed-76a8-4b63-82a8-a2362e07baa2', 'f6ca725d-ebbb-429d-8bed-41ae285c5a2e', '7c7046d2-443c-49ac-ac8d-c13461cb4d68'] {{(pid=84538) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 29 19:09:44 devstack cinder-volume[84538]: INFO cinder.volume.manager [None req-4bc04c3d-1be5-4ff9-afa9-bd10f5b8645d tempest-VolumeDependencyTests-868648422 None] Delete snapshot completed successfully. Apr 29 19:09:44 devstack cinder-volume[84538]: DEBUG cinder.coordination [None req-4bc04c3d-1be5-4ff9-afa9-bd10f5b8645d tempest-VolumeDependencyTests-868648422 None] Lock "cinder-198e6df2-3e81-4d9e-ac11-ea6277a3032d-delete_snapshot" released by "delete_snapshot" :: held 4.001s {{(pid=84538) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 19:09:44 devstack sudo[94143]: pam_unix(sudo:session): session closed for user root Apr 29 19:09:44 devstack cinder-volume[84538]: DEBUG oslo_concurrency.processutils [None req-20f128b0-cbc8-441b-a075-c7a197e90479 tempest-CreateVolumesFromSnapshotTest-1938046858 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-5e3d9ffe-6145-432b-889f-53ac70d96f1e 1073741824" returned: 0 in 1.145s {{(pid=84538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 19:09:44 devstack cinder-volume[84538]: DEBUG oslo_concurrency.processutils [None req-20f128b0-cbc8-441b-a075-c7a197e90479 tempest-CreateVolumesFromSnapshotTest-1938046858 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-5e3d9ffe-6145-432b-889f-53ac70d96f1e {{(pid=84538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 19:09:44 devstack sudo[94152]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-5e3d9ffe-6145-432b-889f-53ac70d96f1e Apr 29 19:09:44 devstack sudo[94152]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 19:09:44 devstack cinder-volume[84538]: DEBUG cinder.coordination [None req-b2119277-8182-4dd5-bc30-48183b85dd4b tempest-VolumeDependencyTests-868648422 None] Acquiring lock "cinder-a86ac317-c9ef-4185-8a8c-2cb05a50fdf9-delete_volume" by "delete_volume" {{(pid=84538) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 19:09:44 devstack cinder-volume[84538]: DEBUG cinder.coordination [None req-b2119277-8182-4dd5-bc30-48183b85dd4b tempest-VolumeDependencyTests-868648422 None] Lock "cinder-a86ac317-c9ef-4185-8a8c-2cb05a50fdf9-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=84538) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 19:09:44 devstack cinder-volume[84538]: DEBUG cinder.coordination [None req-b2119277-8182-4dd5-bc30-48183b85dd4b tempest-VolumeDependencyTests-868648422 None] Acquiring lock "cinder-quobyte-a86ac317-c9ef-4185-8a8c-2cb05a50fdf9" by "delete_volume" {{(pid=84538) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 19:09:44 devstack cinder-volume[84538]: DEBUG cinder.coordination [None req-b2119277-8182-4dd5-bc30-48183b85dd4b tempest-VolumeDependencyTests-868648422 None] Lock "cinder-quobyte-a86ac317-c9ef-4185-8a8c-2cb05a50fdf9" acquired by "delete_volume" :: waited 0.017s {{(pid=84538) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 19:09:44 devstack cinder-volume[84538]: DEBUG oslo.privsep.daemon [-] privsep: reply[48c76b99-4584-4890-af05-193d8a239061]: (4, 'qcow2') {{(pid=85803) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 19:09:44 devstack cinder-volume[84538]: DEBUG oslo_concurrency.processutils [None req-b2119277-8182-4dd5-bc30-48183b85dd4b tempest-VolumeDependencyTests-868648422 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-a86ac317-c9ef-4185-8a8c-2cb05a50fdf9 {{(pid=84538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 19:09:45 devstack sudo[94154]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-a86ac317-c9ef-4185-8a8c-2cb05a50fdf9 Apr 29 19:09:45 devstack sudo[94154]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 19:09:45 devstack sudo[94152]: pam_unix(sudo:session): session closed for user root Apr 29 19:09:45 devstack cinder-volume[84538]: DEBUG oslo_concurrency.processutils [None req-20f128b0-cbc8-441b-a075-c7a197e90479 tempest-CreateVolumesFromSnapshotTest-1938046858 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-5e3d9ffe-6145-432b-889f-53ac70d96f1e" returned: 0 in 0.743s {{(pid=84538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 19:09:45 devstack cinder-volume[84538]: DEBUG cinder.volume.drivers.quobyte [None req-20f128b0-cbc8-441b-a075-c7a197e90479 tempest-CreateVolumesFromSnapshotTest-1938046858 None] <== create_volume: return (1933ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-34312b00-dd6d-45bb-af98-75855cea8e48'} {{(pid=84538) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 29 19:09:45 devstack cinder-volume[84538]: DEBUG oslo_concurrency.lockutils [None req-20f128b0-cbc8-441b-a075-c7a197e90479 tempest-CreateVolumesFromSnapshotTest-1938046858 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.937s {{(pid=84538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 19:09:45 devstack cinder-volume[84538]: DEBUG oslo_concurrency.lockutils [None req-083c5a03-40ba-48b2-aff9-82b04c009eb9 tempest-CreateVolumesFromSnapshotTest-1938046858 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 17.973s {{(pid=84538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 19:09:45 devstack cinder-volume[84538]: DEBUG cinder.volume.drivers.quobyte [None req-083c5a03-40ba-48b2-aff9-82b04c009eb9 tempest-CreateVolumesFromSnapshotTest-1938046858 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-29T17:09:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1703762989',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1940ddaf-9cec-4a2b-809e-d58e15e38dac,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='43976132c7c54fdaa06722c210f732f0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T17:09:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T17:09:27Z,use_quota=True,user_id='6ffeea78e69b4e0d8fe06ce426cac057',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(62b05900-93e3-4190-a88f-1d87324303d1),volume_type_id=62b05900-93e3-4190-a88f-1d87324303d1)}" {{(pid=84538) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 29 19:09:45 devstack cinder-volume[84538]: DEBUG cinder.volume.drivers.remotefs [None req-083c5a03-40ba-48b2-aff9-82b04c009eb9 tempest-CreateVolumesFromSnapshotTest-1938046858 None] Creating volume 1940ddaf-9cec-4a2b-809e-d58e15e38dac {{(pid=84538) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 29 19:09:45 devstack cinder-volume[84538]: DEBUG oslo_concurrency.lockutils [None req-083c5a03-40ba-48b2-aff9-82b04c009eb9 tempest-CreateVolumesFromSnapshotTest-1938046858 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 19:09:45 devstack cinder-volume[84538]: DEBUG oslo_concurrency.lockutils [None req-083c5a03-40ba-48b2-aff9-82b04c009eb9 tempest-CreateVolumesFromSnapshotTest-1938046858 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 19:09:45 devstack cinder-volume[84538]: DEBUG cinder.volume.drivers.quobyte [None req-083c5a03-40ba-48b2-aff9-82b04c009eb9 tempest-CreateVolumesFromSnapshotTest-1938046858 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-34312b00-dd6d-45bb-af98-75855cea8e48': None} {{(pid=84538) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 19:09:45 devstack cinder-volume[84538]: DEBUG cinder.volume.drivers.quobyte [None req-083c5a03-40ba-48b2-aff9-82b04c009eb9 tempest-CreateVolumesFromSnapshotTest-1938046858 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-34312b00-dd6d-45bb-af98-75855cea8e48'] {{(pid=84538) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 19:09:45 devstack cinder-volume[84538]: DEBUG oslo_concurrency.lockutils [None req-083c5a03-40ba-48b2-aff9-82b04c009eb9 tempest-CreateVolumesFromSnapshotTest-1938046858 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=84538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 19:09:45 devstack cinder-volume[84538]: DEBUG cinder.volume.drivers.quobyte [None req-083c5a03-40ba-48b2-aff9-82b04c009eb9 tempest-CreateVolumesFromSnapshotTest-1938046858 None] Selected osci02.corp.quobyte.com/cinder-vol-34312b00-dd6d-45bb-af98-75855cea8e48 as target Quobyte volume. {{(pid=84538) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 29 19:09:45 devstack cinder-volume[84538]: INFO cinder.volume.drivers.remotefs [None req-083c5a03-40ba-48b2-aff9-82b04c009eb9 tempest-CreateVolumesFromSnapshotTest-1938046858 None] casted to osci02.corp.quobyte.com/cinder-vol-34312b00-dd6d-45bb-af98-75855cea8e48 Apr 29 19:09:45 devstack cinder-volume[84538]: DEBUG oslo_concurrency.processutils [None req-083c5a03-40ba-48b2-aff9-82b04c009eb9 tempest-CreateVolumesFromSnapshotTest-1938046858 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-1940ddaf-9cec-4a2b-809e-d58e15e38dac 1073741824 {{(pid=84538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 19:09:45 devstack sudo[94157]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-1940ddaf-9cec-4a2b-809e-d58e15e38dac 1073741824 Apr 29 19:09:45 devstack sudo[94157]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 19:09:45 devstack cinder-volume[84538]: DEBUG cinder.volume.manager [None req-20f128b0-cbc8-441b-a075-c7a197e90479 tempest-CreateVolumesFromSnapshotTest-1938046858 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (97de6274-09be-474f-baf1-83c69b42d887) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5e3d9ffe-6145-432b-889f-53ac70d96f1e', 'volume_size': 1}' {{(pid=84538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 19:09:45 devstack cinder-volume[84538]: DEBUG cinder.volume.manager [None req-20f128b0-cbc8-441b-a075-c7a197e90479 tempest-CreateVolumesFromSnapshotTest-1938046858 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d7ef3c9f-dad6-465d-976c-eb0673c36075) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 19:09:45 devstack cinder-volume[84538]: INFO cinder.volume.flows.manager.create_volume [None req-20f128b0-cbc8-441b-a075-c7a197e90479 tempest-CreateVolumesFromSnapshotTest-1938046858 None] Volume volume-5e3d9ffe-6145-432b-889f-53ac70d96f1e (5e3d9ffe-6145-432b-889f-53ac70d96f1e): created successfully Apr 29 19:09:45 devstack cinder-volume[84538]: DEBUG cinder.volume.manager [None req-20f128b0-cbc8-441b-a075-c7a197e90479 tempest-CreateVolumesFromSnapshotTest-1938046858 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d7ef3c9f-dad6-465d-976c-eb0673c36075) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 19:09:45 devstack cinder-volume[84538]: DEBUG cinder.volume.manager [None req-20f128b0-cbc8-441b-a075-c7a197e90479 tempest-CreateVolumesFromSnapshotTest-1938046858 None] Flow 'volume_create_manager' (8012b9f5-7564-44dc-84dc-688a8a7a404d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84538) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 19:09:45 devstack cinder-volume[84538]: INFO cinder.volume.manager [None req-20f128b0-cbc8-441b-a075-c7a197e90479 tempest-CreateVolumesFromSnapshotTest-1938046858 None] Created volume successfully. Apr 29 19:09:45 devstack sudo[94154]: pam_unix(sudo:session): session closed for user root Apr 29 19:09:45 devstack cinder-volume[84538]: DEBUG oslo_concurrency.processutils [None req-b2119277-8182-4dd5-bc30-48183b85dd4b tempest-VolumeDependencyTests-868648422 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-a86ac317-c9ef-4185-8a8c-2cb05a50fdf9" returned: 0 in 0.833s {{(pid=84538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 19:09:45 devstack cinder-volume[84538]: DEBUG oslo_concurrency.processutils [None req-b2119277-8182-4dd5-bc30-48183b85dd4b tempest-VolumeDependencyTests-868648422 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-a86ac317-c9ef-4185-8a8c-2cb05a50fdf9 {{(pid=84538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 19:09:45 devstack sudo[94162]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-a86ac317-c9ef-4185-8a8c-2cb05a50fdf9 Apr 29 19:09:45 devstack sudo[94162]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 19:09:46 devstack sudo[94157]: pam_unix(sudo:session): session closed for user root Apr 29 19:09:46 devstack cinder-volume[84538]: DEBUG oslo_concurrency.processutils [None req-083c5a03-40ba-48b2-aff9-82b04c009eb9 tempest-CreateVolumesFromSnapshotTest-1938046858 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-1940ddaf-9cec-4a2b-809e-d58e15e38dac 1073741824" returned: 0 in 0.919s {{(pid=84538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 19:09:46 devstack cinder-volume[84538]: DEBUG oslo_concurrency.processutils [None req-083c5a03-40ba-48b2-aff9-82b04c009eb9 tempest-CreateVolumesFromSnapshotTest-1938046858 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-1940ddaf-9cec-4a2b-809e-d58e15e38dac {{(pid=84538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 19:09:46 devstack sudo[94169]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-1940ddaf-9cec-4a2b-809e-d58e15e38dac Apr 29 19:09:46 devstack sudo[94169]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 19:09:46 devstack sudo[94162]: pam_unix(sudo:session): session closed for user root Apr 29 19:09:46 devstack cinder-volume[84538]: DEBUG oslo_concurrency.processutils [None req-b2119277-8182-4dd5-bc30-48183b85dd4b tempest-VolumeDependencyTests-868648422 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-a86ac317-c9ef-4185-8a8c-2cb05a50fdf9" returned: 0 in 0.655s {{(pid=84538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 19:09:46 devstack cinder-volume[84538]: DEBUG cinder.coordination [None req-b2119277-8182-4dd5-bc30-48183b85dd4b tempest-VolumeDependencyTests-868648422 None] Lock "cinder-quobyte-a86ac317-c9ef-4185-8a8c-2cb05a50fdf9" released by "delete_volume" :: held 1.578s {{(pid=84538) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 19:09:46 devstack cinder-volume[84538]: DEBUG cinder.quota [None req-b2119277-8182-4dd5-bc30-48183b85dd4b tempest-VolumeDependencyTests-868648422 None] Created reservations ['875c7ac6-2071-42b5-89d2-7442aacfceb3', 'b2b0e261-2407-400a-a1c4-bb40ddb93bbc', '5b9758c1-ffa5-4c5d-87f0-ac438b83221a', '64fd6be3-9197-4fea-aa83-618f0cd4a463'] {{(pid=84538) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 29 19:09:46 devstack cinder-volume[84538]: DEBUG oslo_concurrency.lockutils [None req-b2119277-8182-4dd5-bc30-48183b85dd4b tempest-VolumeDependencyTests-868648422 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 19:09:46 devstack cinder-volume[84538]: DEBUG oslo_concurrency.lockutils [None req-b2119277-8182-4dd5-bc30-48183b85dd4b tempest-VolumeDependencyTests-868648422 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 19:09:46 devstack cinder-volume[84538]: DEBUG cinder.volume.drivers.quobyte [None req-b2119277-8182-4dd5-bc30-48183b85dd4b tempest-VolumeDependencyTests-868648422 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-34312b00-dd6d-45bb-af98-75855cea8e48': None} {{(pid=84538) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 19:09:46 devstack cinder-volume[84538]: DEBUG cinder.volume.drivers.quobyte [None req-b2119277-8182-4dd5-bc30-48183b85dd4b tempest-VolumeDependencyTests-868648422 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-34312b00-dd6d-45bb-af98-75855cea8e48'] {{(pid=84538) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 19:09:46 devstack cinder-volume[84538]: DEBUG oslo_concurrency.lockutils [None req-b2119277-8182-4dd5-bc30-48183b85dd4b tempest-VolumeDependencyTests-868648422 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.028s {{(pid=84538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 19:09:46 devstack cinder-volume[84538]: DEBUG oslo_concurrency.processutils [None req-b2119277-8182-4dd5-bc30-48183b85dd4b tempest-VolumeDependencyTests-868648422 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d {{(pid=84538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 19:09:46 devstack sudo[94171]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d Apr 29 19:09:46 devstack sudo[94171]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 19:09:47 devstack sudo[94169]: pam_unix(sudo:session): session closed for user root Apr 29 19:09:47 devstack cinder-volume[84538]: DEBUG oslo_concurrency.processutils [None req-083c5a03-40ba-48b2-aff9-82b04c009eb9 tempest-CreateVolumesFromSnapshotTest-1938046858 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-1940ddaf-9cec-4a2b-809e-d58e15e38dac" returned: 0 in 0.661s {{(pid=84538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 19:09:47 devstack cinder-volume[84538]: DEBUG cinder.volume.drivers.quobyte [None req-083c5a03-40ba-48b2-aff9-82b04c009eb9 tempest-CreateVolumesFromSnapshotTest-1938046858 None] <== create_volume: return (1637ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-34312b00-dd6d-45bb-af98-75855cea8e48'} {{(pid=84538) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 29 19:09:47 devstack cinder-volume[84538]: DEBUG oslo_concurrency.lockutils [None req-083c5a03-40ba-48b2-aff9-82b04c009eb9 tempest-CreateVolumesFromSnapshotTest-1938046858 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.643s {{(pid=84538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 19:09:47 devstack cinder-volume[84538]: DEBUG oslo_concurrency.lockutils [None req-9c219846-3043-4c73-b7bc-9ea33c0894d6 tempest-CreateVolumesFromSnapshotTest-1938046858 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 19.112s {{(pid=84538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 19:09:47 devstack cinder-volume[84538]: DEBUG cinder.volume.drivers.quobyte [None req-9c219846-3043-4c73-b7bc-9ea33c0894d6 tempest-CreateVolumesFromSnapshotTest-1938046858 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-29T17:09:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1699117096',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e9b9e08b-e0a6-4853-99a3-377c499d6950,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='43976132c7c54fdaa06722c210f732f0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T17:09:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T17:09:28Z,use_quota=True,user_id='6ffeea78e69b4e0d8fe06ce426cac057',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(62b05900-93e3-4190-a88f-1d87324303d1),volume_type_id=62b05900-93e3-4190-a88f-1d87324303d1)}" {{(pid=84538) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 29 19:09:47 devstack cinder-volume[84538]: DEBUG cinder.volume.drivers.remotefs [None req-9c219846-3043-4c73-b7bc-9ea33c0894d6 tempest-CreateVolumesFromSnapshotTest-1938046858 None] Creating volume e9b9e08b-e0a6-4853-99a3-377c499d6950 {{(pid=84538) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 29 19:09:47 devstack cinder-volume[84538]: DEBUG oslo_concurrency.lockutils [None req-9c219846-3043-4c73-b7bc-9ea33c0894d6 tempest-CreateVolumesFromSnapshotTest-1938046858 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 19:09:47 devstack cinder-volume[84538]: DEBUG oslo_concurrency.lockutils [None req-9c219846-3043-4c73-b7bc-9ea33c0894d6 tempest-CreateVolumesFromSnapshotTest-1938046858 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 19:09:47 devstack cinder-volume[84538]: DEBUG cinder.volume.drivers.quobyte [None req-9c219846-3043-4c73-b7bc-9ea33c0894d6 tempest-CreateVolumesFromSnapshotTest-1938046858 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-34312b00-dd6d-45bb-af98-75855cea8e48': None} {{(pid=84538) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 19:09:47 devstack cinder-volume[84538]: DEBUG cinder.volume.drivers.quobyte [None req-9c219846-3043-4c73-b7bc-9ea33c0894d6 tempest-CreateVolumesFromSnapshotTest-1938046858 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-34312b00-dd6d-45bb-af98-75855cea8e48'] {{(pid=84538) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 19:09:47 devstack cinder-volume[84538]: DEBUG oslo_concurrency.lockutils [None req-9c219846-3043-4c73-b7bc-9ea33c0894d6 tempest-CreateVolumesFromSnapshotTest-1938046858 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=84538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 19:09:47 devstack cinder-volume[84538]: DEBUG cinder.volume.drivers.quobyte [None req-9c219846-3043-4c73-b7bc-9ea33c0894d6 tempest-CreateVolumesFromSnapshotTest-1938046858 None] Selected osci02.corp.quobyte.com/cinder-vol-34312b00-dd6d-45bb-af98-75855cea8e48 as target Quobyte volume. {{(pid=84538) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 29 19:09:47 devstack cinder-volume[84538]: INFO cinder.volume.drivers.remotefs [None req-9c219846-3043-4c73-b7bc-9ea33c0894d6 tempest-CreateVolumesFromSnapshotTest-1938046858 None] casted to osci02.corp.quobyte.com/cinder-vol-34312b00-dd6d-45bb-af98-75855cea8e48 Apr 29 19:09:47 devstack cinder-volume[84538]: DEBUG oslo_concurrency.processutils [None req-9c219846-3043-4c73-b7bc-9ea33c0894d6 tempest-CreateVolumesFromSnapshotTest-1938046858 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-e9b9e08b-e0a6-4853-99a3-377c499d6950 1073741824 {{(pid=84538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 19:09:47 devstack cinder-volume[84538]: DEBUG cinder.volume.manager [None req-083c5a03-40ba-48b2-aff9-82b04c009eb9 tempest-CreateVolumesFromSnapshotTest-1938046858 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5b5415f6-ccc4-45d0-9875-ae074fca43fc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1940ddaf-9cec-4a2b-809e-d58e15e38dac', 'volume_size': 1}' {{(pid=84538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 19:09:47 devstack cinder-volume[84538]: DEBUG cinder.volume.manager [None req-083c5a03-40ba-48b2-aff9-82b04c009eb9 tempest-CreateVolumesFromSnapshotTest-1938046858 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e265ceea-6e6d-4ea5-bd23-400f3c7b19bc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 19:09:47 devstack sudo[94174]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-e9b9e08b-e0a6-4853-99a3-377c499d6950 1073741824 Apr 29 19:09:47 devstack sudo[94174]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 19:09:47 devstack cinder-volume[84538]: INFO cinder.volume.flows.manager.create_volume [None req-083c5a03-40ba-48b2-aff9-82b04c009eb9 tempest-CreateVolumesFromSnapshotTest-1938046858 None] Volume volume-1940ddaf-9cec-4a2b-809e-d58e15e38dac (1940ddaf-9cec-4a2b-809e-d58e15e38dac): created successfully Apr 29 19:09:47 devstack cinder-volume[84538]: DEBUG cinder.volume.manager [None req-083c5a03-40ba-48b2-aff9-82b04c009eb9 tempest-CreateVolumesFromSnapshotTest-1938046858 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e265ceea-6e6d-4ea5-bd23-400f3c7b19bc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 19:09:47 devstack cinder-volume[84538]: DEBUG cinder.volume.manager [None req-083c5a03-40ba-48b2-aff9-82b04c009eb9 tempest-CreateVolumesFromSnapshotTest-1938046858 None] Flow 'volume_create_manager' (bdabba57-e7db-4585-94a0-336bdb7d9718) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84538) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 19:09:47 devstack cinder-volume[84538]: INFO cinder.volume.manager [None req-083c5a03-40ba-48b2-aff9-82b04c009eb9 tempest-CreateVolumesFromSnapshotTest-1938046858 None] Created volume successfully. Apr 29 19:09:47 devstack sudo[94171]: pam_unix(sudo:session): session closed for user root Apr 29 19:09:47 devstack cinder-volume[84538]: DEBUG oslo_concurrency.processutils [None req-b2119277-8182-4dd5-bc30-48183b85dd4b tempest-VolumeDependencyTests-868648422 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d" returned: 0 in 0.716s {{(pid=84538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 19:09:47 devstack cinder-volume[84538]: DEBUG cinder.manager [None req-b2119277-8182-4dd5-bc30-48183b85dd4b tempest-VolumeDependencyTests-868648422 None] Notifying Schedulers of capabilities ... {{(pid=84538) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 29 19:09:47 devstack cinder-volume[84538]: INFO cinder.volume.manager [None req-b2119277-8182-4dd5-bc30-48183b85dd4b tempest-VolumeDependencyTests-868648422 None] Deleted volume successfully. Apr 29 19:09:47 devstack cinder-volume[84538]: DEBUG cinder.coordination [None req-b2119277-8182-4dd5-bc30-48183b85dd4b tempest-VolumeDependencyTests-868648422 None] Lock "cinder-a86ac317-c9ef-4185-8a8c-2cb05a50fdf9-delete_volume" released by "delete_volume" :: held 2.635s {{(pid=84538) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 19:09:47 devstack cinder-volume[84538]: DEBUG cinder.volume.flows.manager.create_volume [None req-8f7d791e-553e-41b3-9e73-c92058b9abc2 tempest-VolumeDependencyTests-868648422 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84538) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Apr 29 19:09:47 devstack cinder-volume[84538]: DEBUG cinder.volume.manager [None req-8f7d791e-553e-41b3-9e73-c92058b9abc2 tempest-VolumeDependencyTests-868648422 None] Flow 'volume_create_manager' (404bc042-bea8-4fe1-8daa-5ee2aa09d488) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84538) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 19:09:47 devstack cinder-volume[84538]: DEBUG cinder.volume.manager [None req-8f7d791e-553e-41b3-9e73-c92058b9abc2 tempest-VolumeDependencyTests-868648422 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1363d32d-3804-417a-8da3-39b0519fc191) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 19:09:47 devstack cinder-volume[84538]: DEBUG cinder.volume.manager [None req-8f7d791e-553e-41b3-9e73-c92058b9abc2 tempest-VolumeDependencyTests-868648422 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1363d32d-3804-417a-8da3-39b0519fc191) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-29T17:09:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-1655297590',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a64b4eb3-d814-459e-9081-f2e0e52cd475,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5af39d55694c40d7b5395e79cb6623fa',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T17:09:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T17:09:48Z,use_quota=True,user_id='d13112c160bd44458a48dc463fb78a07',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(62b05900-93e3-4190-a88f-1d87324303d1),volume_type_id=62b05900-93e3-4190-a88f-1d87324303d1)' {{(pid=84538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 19:09:47 devstack cinder-volume[84538]: DEBUG cinder.volume.manager [None req-8f7d791e-553e-41b3-9e73-c92058b9abc2 tempest-VolumeDependencyTests-868648422 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7a7273d8-fe36-47a6-a9ec-f62a5ab00016) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 19:09:47 devstack cinder-volume[84538]: DEBUG cinder.volume.manager [None req-8f7d791e-553e-41b3-9e73-c92058b9abc2 tempest-VolumeDependencyTests-868648422 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7a7273d8-fe36-47a6-a9ec-f62a5ab00016) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 19:09:47 devstack cinder-volume[84538]: DEBUG cinder.volume.manager [None req-8f7d791e-553e-41b3-9e73-c92058b9abc2 tempest-VolumeDependencyTests-868648422 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (50c540fe-caae-48d9-aa5a-5475437d41f7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 19:09:47 devstack cinder-volume[84538]: DEBUG cinder.volume.manager [None req-8f7d791e-553e-41b3-9e73-c92058b9abc2 tempest-VolumeDependencyTests-868648422 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (50c540fe-caae-48d9-aa5a-5475437d41f7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a64b4eb3-d814-459e-9081-f2e0e52cd475', 'volume_name': 'volume-a64b4eb3-d814-459e-9081-f2e0e52cd475', 'volume_size': 1}' {{(pid=84538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 19:09:47 devstack cinder-volume[84538]: DEBUG cinder.volume.manager [None req-8f7d791e-553e-41b3-9e73-c92058b9abc2 tempest-VolumeDependencyTests-868648422 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (325a219c-d619-41b3-9eea-51c997785cd8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 19:09:47 devstack cinder-volume[84538]: DEBUG cinder.volume.manager [None req-8f7d791e-553e-41b3-9e73-c92058b9abc2 tempest-VolumeDependencyTests-868648422 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (325a219c-d619-41b3-9eea-51c997785cd8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 19:09:47 devstack cinder-volume[84538]: DEBUG cinder.volume.manager [None req-8f7d791e-553e-41b3-9e73-c92058b9abc2 tempest-VolumeDependencyTests-868648422 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (385f63b1-68a7-4e6b-9db9-f60ae4c7b13c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 19:09:47 devstack cinder-volume[84538]: INFO cinder.volume.flows.manager.create_volume [None req-8f7d791e-553e-41b3-9e73-c92058b9abc2 tempest-VolumeDependencyTests-868648422 None] Volume a64b4eb3-d814-459e-9081-f2e0e52cd475: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a64b4eb3-d814-459e-9081-f2e0e52cd475', 'volume_size': 1} Apr 29 19:09:47 devstack cinder-volume[84538]: DEBUG oslo_concurrency.lockutils [None req-8f7d791e-553e-41b3-9e73-c92058b9abc2 tempest-VolumeDependencyTests-868648422 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 19:09:48 devstack sudo[94174]: pam_unix(sudo:session): session closed for user root Apr 29 19:09:48 devstack cinder-volume[84538]: DEBUG oslo_concurrency.processutils [None req-9c219846-3043-4c73-b7bc-9ea33c0894d6 tempest-CreateVolumesFromSnapshotTest-1938046858 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-e9b9e08b-e0a6-4853-99a3-377c499d6950 1073741824" returned: 0 in 1.018s {{(pid=84538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 19:09:48 devstack cinder-volume[84538]: DEBUG oslo_concurrency.processutils [None req-9c219846-3043-4c73-b7bc-9ea33c0894d6 tempest-CreateVolumesFromSnapshotTest-1938046858 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-e9b9e08b-e0a6-4853-99a3-377c499d6950 {{(pid=84538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 19:09:48 devstack sudo[94182]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-e9b9e08b-e0a6-4853-99a3-377c499d6950 Apr 29 19:09:48 devstack sudo[94182]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 19:09:48 devstack sudo[94182]: pam_unix(sudo:session): session closed for user root Apr 29 19:09:48 devstack cinder-volume[84538]: DEBUG oslo_concurrency.processutils [None req-9c219846-3043-4c73-b7bc-9ea33c0894d6 tempest-CreateVolumesFromSnapshotTest-1938046858 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-e9b9e08b-e0a6-4853-99a3-377c499d6950" returned: 0 in 0.767s {{(pid=84538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 19:09:48 devstack cinder-volume[84538]: DEBUG cinder.volume.drivers.quobyte [None req-9c219846-3043-4c73-b7bc-9ea33c0894d6 tempest-CreateVolumesFromSnapshotTest-1938046858 None] <== create_volume: return (1825ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-34312b00-dd6d-45bb-af98-75855cea8e48'} {{(pid=84538) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 29 19:09:48 devstack cinder-volume[84538]: DEBUG oslo_concurrency.lockutils [None req-9c219846-3043-4c73-b7bc-9ea33c0894d6 tempest-CreateVolumesFromSnapshotTest-1938046858 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.828s {{(pid=84538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 19:09:48 devstack cinder-volume[84538]: DEBUG oslo_concurrency.lockutils [None req-8f7d791e-553e-41b3-9e73-c92058b9abc2 tempest-VolumeDependencyTests-868648422 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.161s {{(pid=84538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 19:09:48 devstack cinder-volume[84538]: DEBUG cinder.volume.drivers.quobyte [None req-8f7d791e-553e-41b3-9e73-c92058b9abc2 tempest-VolumeDependencyTests-868648422 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-29T17:09:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-1655297590',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a64b4eb3-d814-459e-9081-f2e0e52cd475,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5af39d55694c40d7b5395e79cb6623fa',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T17:09:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T17:09:48Z,use_quota=True,user_id='d13112c160bd44458a48dc463fb78a07',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(62b05900-93e3-4190-a88f-1d87324303d1),volume_type_id=62b05900-93e3-4190-a88f-1d87324303d1)}" {{(pid=84538) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 29 19:09:48 devstack cinder-volume[84538]: DEBUG cinder.volume.drivers.remotefs [None req-8f7d791e-553e-41b3-9e73-c92058b9abc2 tempest-VolumeDependencyTests-868648422 None] Creating volume a64b4eb3-d814-459e-9081-f2e0e52cd475 {{(pid=84538) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 29 19:09:48 devstack cinder-volume[84538]: DEBUG oslo_concurrency.lockutils [None req-8f7d791e-553e-41b3-9e73-c92058b9abc2 tempest-VolumeDependencyTests-868648422 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 19:09:48 devstack cinder-volume[84538]: DEBUG oslo_concurrency.lockutils [None req-8f7d791e-553e-41b3-9e73-c92058b9abc2 tempest-VolumeDependencyTests-868648422 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=84538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 19:09:48 devstack cinder-volume[84538]: DEBUG cinder.volume.drivers.quobyte [None req-8f7d791e-553e-41b3-9e73-c92058b9abc2 tempest-VolumeDependencyTests-868648422 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-34312b00-dd6d-45bb-af98-75855cea8e48': None} {{(pid=84538) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 19:09:48 devstack cinder-volume[84538]: DEBUG cinder.volume.drivers.quobyte [None req-8f7d791e-553e-41b3-9e73-c92058b9abc2 tempest-VolumeDependencyTests-868648422 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-34312b00-dd6d-45bb-af98-75855cea8e48'] {{(pid=84538) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 19:09:48 devstack cinder-volume[84538]: DEBUG oslo_concurrency.lockutils [None req-8f7d791e-553e-41b3-9e73-c92058b9abc2 tempest-VolumeDependencyTests-868648422 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=84538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 19:09:48 devstack cinder-volume[84538]: DEBUG cinder.volume.drivers.quobyte [None req-8f7d791e-553e-41b3-9e73-c92058b9abc2 tempest-VolumeDependencyTests-868648422 None] Selected osci02.corp.quobyte.com/cinder-vol-34312b00-dd6d-45bb-af98-75855cea8e48 as target Quobyte volume. {{(pid=84538) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 29 19:09:48 devstack cinder-volume[84538]: INFO cinder.volume.drivers.remotefs [None req-8f7d791e-553e-41b3-9e73-c92058b9abc2 tempest-VolumeDependencyTests-868648422 None] casted to osci02.corp.quobyte.com/cinder-vol-34312b00-dd6d-45bb-af98-75855cea8e48 Apr 29 19:09:48 devstack cinder-volume[84538]: DEBUG oslo_concurrency.processutils [None req-8f7d791e-553e-41b3-9e73-c92058b9abc2 tempest-VolumeDependencyTests-868648422 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-a64b4eb3-d814-459e-9081-f2e0e52cd475 1073741824 {{(pid=84538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 19:09:48 devstack cinder-volume[84538]: DEBUG cinder.volume.manager [None req-9c219846-3043-4c73-b7bc-9ea33c0894d6 tempest-CreateVolumesFromSnapshotTest-1938046858 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c58d3f8f-488d-430e-8e8c-2a7eaf8a9d90) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e9b9e08b-e0a6-4853-99a3-377c499d6950', 'volume_size': 1}' {{(pid=84538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 19:09:48 devstack cinder-volume[84538]: DEBUG cinder.volume.manager [None req-9c219846-3043-4c73-b7bc-9ea33c0894d6 tempest-CreateVolumesFromSnapshotTest-1938046858 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (71a19c16-48ea-43cb-b48f-43217a237568) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 19:09:48 devstack sudo[94222]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-a64b4eb3-d814-459e-9081-f2e0e52cd475 1073741824 Apr 29 19:09:48 devstack sudo[94222]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 19:09:48 devstack cinder-volume[84538]: INFO cinder.volume.flows.manager.create_volume [None req-9c219846-3043-4c73-b7bc-9ea33c0894d6 tempest-CreateVolumesFromSnapshotTest-1938046858 None] Volume volume-e9b9e08b-e0a6-4853-99a3-377c499d6950 (e9b9e08b-e0a6-4853-99a3-377c499d6950): created successfully Apr 29 19:09:48 devstack cinder-volume[84538]: DEBUG cinder.volume.manager [None req-9c219846-3043-4c73-b7bc-9ea33c0894d6 tempest-CreateVolumesFromSnapshotTest-1938046858 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (71a19c16-48ea-43cb-b48f-43217a237568) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 19:09:48 devstack cinder-volume[84538]: DEBUG cinder.volume.manager [None req-9c219846-3043-4c73-b7bc-9ea33c0894d6 tempest-CreateVolumesFromSnapshotTest-1938046858 None] Flow 'volume_create_manager' (ac5765e1-d3a8-4a61-85de-b343739847f5) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84538) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 19:09:48 devstack cinder-volume[84538]: INFO cinder.volume.manager [None req-9c219846-3043-4c73-b7bc-9ea33c0894d6 tempest-CreateVolumesFromSnapshotTest-1938046858 None] Created volume successfully. Apr 29 19:09:49 devstack sudo[94222]: pam_unix(sudo:session): session closed for user root Apr 29 19:09:49 devstack cinder-volume[84538]: DEBUG oslo_concurrency.processutils [None req-8f7d791e-553e-41b3-9e73-c92058b9abc2 tempest-VolumeDependencyTests-868648422 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-a64b4eb3-d814-459e-9081-f2e0e52cd475 1073741824" returned: 0 in 0.945s {{(pid=84538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 19:09:49 devstack cinder-volume[84538]: DEBUG oslo_concurrency.processutils [None req-8f7d791e-553e-41b3-9e73-c92058b9abc2 tempest-VolumeDependencyTests-868648422 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-a64b4eb3-d814-459e-9081-f2e0e52cd475 {{(pid=84538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 19:09:49 devstack sudo[94227]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-a64b4eb3-d814-459e-9081-f2e0e52cd475 Apr 29 19:09:49 devstack sudo[94227]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 19:09:50 devstack cinder-volume[84538]: DEBUG cinder.coordination [None req-0414c2e8-5f78-4532-9f4f-6bef3cd093d2 tempest-CreateVolumesFromSnapshotTest-1938046858 None] Acquiring lock "cinder-e9b9e08b-e0a6-4853-99a3-377c499d6950-delete_volume" by "delete_volume" {{(pid=84538) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 19:09:50 devstack cinder-volume[84538]: DEBUG cinder.coordination [None req-0414c2e8-5f78-4532-9f4f-6bef3cd093d2 tempest-CreateVolumesFromSnapshotTest-1938046858 None] Lock "cinder-e9b9e08b-e0a6-4853-99a3-377c499d6950-delete_volume" acquired by "delete_volume" :: waited 0.032s {{(pid=84538) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 19:09:50 devstack cinder-volume[84538]: DEBUG cinder.coordination [None req-0414c2e8-5f78-4532-9f4f-6bef3cd093d2 tempest-CreateVolumesFromSnapshotTest-1938046858 None] Acquiring lock "cinder-quobyte-e9b9e08b-e0a6-4853-99a3-377c499d6950" by "delete_volume" {{(pid=84538) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 19:09:50 devstack cinder-volume[84538]: DEBUG cinder.coordination [None req-0414c2e8-5f78-4532-9f4f-6bef3cd093d2 tempest-CreateVolumesFromSnapshotTest-1938046858 None] Lock "cinder-quobyte-e9b9e08b-e0a6-4853-99a3-377c499d6950" acquired by "delete_volume" :: waited 0.014s {{(pid=84538) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 19:09:50 devstack cinder-volume[84538]: DEBUG oslo.privsep.daemon [-] privsep: reply[750b6ba9-440a-444a-b4ff-d1fe7df5b769]: (4, 'qcow2') {{(pid=85803) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 19:09:50 devstack cinder-volume[84538]: DEBUG oslo_concurrency.processutils [None req-0414c2e8-5f78-4532-9f4f-6bef3cd093d2 tempest-CreateVolumesFromSnapshotTest-1938046858 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-e9b9e08b-e0a6-4853-99a3-377c499d6950 {{(pid=84538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 19:09:50 devstack sudo[94229]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-e9b9e08b-e0a6-4853-99a3-377c499d6950 Apr 29 19:09:50 devstack sudo[94229]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 19:09:50 devstack sudo[94227]: pam_unix(sudo:session): session closed for user root Apr 29 19:09:50 devstack cinder-volume[84538]: DEBUG oslo_concurrency.processutils [None req-8f7d791e-553e-41b3-9e73-c92058b9abc2 tempest-VolumeDependencyTests-868648422 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-a64b4eb3-d814-459e-9081-f2e0e52cd475" returned: 0 in 0.661s {{(pid=84538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 19:09:50 devstack cinder-volume[84538]: DEBUG cinder.volume.drivers.quobyte [None req-8f7d791e-553e-41b3-9e73-c92058b9abc2 tempest-VolumeDependencyTests-868648422 None] <== create_volume: return (1648ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-34312b00-dd6d-45bb-af98-75855cea8e48'} {{(pid=84538) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 29 19:09:50 devstack cinder-volume[84538]: DEBUG oslo_concurrency.lockutils [None req-8f7d791e-553e-41b3-9e73-c92058b9abc2 tempest-VolumeDependencyTests-868648422 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.652s {{(pid=84538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 19:09:50 devstack cinder-volume[84538]: DEBUG cinder.volume.manager [None req-8f7d791e-553e-41b3-9e73-c92058b9abc2 tempest-VolumeDependencyTests-868648422 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (385f63b1-68a7-4e6b-9db9-f60ae4c7b13c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a64b4eb3-d814-459e-9081-f2e0e52cd475', 'volume_size': 1}' {{(pid=84538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 19:09:50 devstack cinder-volume[84538]: DEBUG cinder.volume.manager [None req-8f7d791e-553e-41b3-9e73-c92058b9abc2 tempest-VolumeDependencyTests-868648422 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (286254c4-a8b0-4833-a8d7-17daf6639be3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 19:09:50 devstack cinder-volume[84538]: INFO cinder.volume.flows.manager.create_volume [None req-8f7d791e-553e-41b3-9e73-c92058b9abc2 tempest-VolumeDependencyTests-868648422 None] Volume volume-a64b4eb3-d814-459e-9081-f2e0e52cd475 (a64b4eb3-d814-459e-9081-f2e0e52cd475): created successfully Apr 29 19:09:50 devstack cinder-volume[84538]: DEBUG cinder.volume.manager [None req-8f7d791e-553e-41b3-9e73-c92058b9abc2 tempest-VolumeDependencyTests-868648422 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (286254c4-a8b0-4833-a8d7-17daf6639be3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 19:09:50 devstack cinder-volume[84538]: DEBUG cinder.volume.manager [None req-8f7d791e-553e-41b3-9e73-c92058b9abc2 tempest-VolumeDependencyTests-868648422 None] Flow 'volume_create_manager' (404bc042-bea8-4fe1-8daa-5ee2aa09d488) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84538) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 19:09:50 devstack cinder-volume[84538]: INFO cinder.volume.manager [None req-8f7d791e-553e-41b3-9e73-c92058b9abc2 tempest-VolumeDependencyTests-868648422 None] Created volume successfully. Apr 29 19:09:50 devstack sudo[94229]: pam_unix(sudo:session): session closed for user root Apr 29 19:09:50 devstack cinder-volume[84538]: DEBUG oslo_concurrency.processutils [None req-0414c2e8-5f78-4532-9f4f-6bef3cd093d2 tempest-CreateVolumesFromSnapshotTest-1938046858 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-e9b9e08b-e0a6-4853-99a3-377c499d6950" returned: 0 in 0.733s {{(pid=84538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 19:09:50 devstack cinder-volume[84538]: DEBUG oslo_concurrency.processutils [None req-0414c2e8-5f78-4532-9f4f-6bef3cd093d2 tempest-CreateVolumesFromSnapshotTest-1938046858 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-e9b9e08b-e0a6-4853-99a3-377c499d6950 {{(pid=84538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 19:09:50 devstack sudo[94235]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-e9b9e08b-e0a6-4853-99a3-377c499d6950 Apr 29 19:09:50 devstack sudo[94235]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 19:09:51 devstack cinder-volume[84538]: DEBUG cinder.volume.flows.manager.create_volume [None req-1c118057-a2b7-4871-94cf-714f4f3debf8 tempest-VolumeDependencyTests-868648422 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84538) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Apr 29 19:09:51 devstack cinder-volume[84538]: DEBUG cinder.volume.manager [None req-1c118057-a2b7-4871-94cf-714f4f3debf8 tempest-VolumeDependencyTests-868648422 None] Flow 'volume_create_manager' (826cf5d7-0e4f-4ef8-8226-907d77a4d8d1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84538) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 19:09:51 devstack cinder-volume[84538]: DEBUG cinder.volume.manager [None req-1c118057-a2b7-4871-94cf-714f4f3debf8 tempest-VolumeDependencyTests-868648422 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ac769e9e-09e3-4046-aedc-7fab3a538b1a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 19:09:51 devstack cinder-volume[84538]: DEBUG cinder.volume.manager [None req-1c118057-a2b7-4871-94cf-714f4f3debf8 tempest-VolumeDependencyTests-868648422 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ac769e9e-09e3-4046-aedc-7fab3a538b1a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-29T17:09:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-1074114233',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=13fa762d-2e94-4381-bb35-2cb334499ba2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5af39d55694c40d7b5395e79cb6623fa',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T17:09:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=a64b4eb3-d814-459e-9081-f2e0e52cd475,status='creating',terminated_at=None,updated_at=2026-04-29T17:09:51Z,use_quota=True,user_id='d13112c160bd44458a48dc463fb78a07',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(62b05900-93e3-4190-a88f-1d87324303d1),volume_type_id=62b05900-93e3-4190-a88f-1d87324303d1)' {{(pid=84538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 19:09:51 devstack cinder-volume[84538]: DEBUG cinder.volume.manager [None req-1c118057-a2b7-4871-94cf-714f4f3debf8 tempest-VolumeDependencyTests-868648422 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2a6fe42b-9ca9-4c4d-bdf7-8203dec30abd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 19:09:51 devstack cinder-volume[84538]: DEBUG cinder.volume.manager [None req-1c118057-a2b7-4871-94cf-714f4f3debf8 tempest-VolumeDependencyTests-868648422 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2a6fe42b-9ca9-4c4d-bdf7-8203dec30abd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 19:09:51 devstack cinder-volume[84538]: DEBUG cinder.volume.manager [None req-1c118057-a2b7-4871-94cf-714f4f3debf8 tempest-VolumeDependencyTests-868648422 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (02c922f7-8e2e-4ec1-bb2f-0966f2022ff8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 19:09:51 devstack cinder-volume[84538]: DEBUG cinder.volume.manager [None req-1c118057-a2b7-4871-94cf-714f4f3debf8 tempest-VolumeDependencyTests-868648422 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (02c922f7-8e2e-4ec1-bb2f-0966f2022ff8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'source_vol', 'volume_id': '13fa762d-2e94-4381-bb35-2cb334499ba2', 'volume_name': 'volume-13fa762d-2e94-4381-bb35-2cb334499ba2', 'volume_size': 1, 'source_volid': 'a64b4eb3-d814-459e-9081-f2e0e52cd475', 'source_volstatus': 'available'}' {{(pid=84538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 19:09:51 devstack cinder-volume[84538]: DEBUG cinder.volume.manager [None req-1c118057-a2b7-4871-94cf-714f4f3debf8 tempest-VolumeDependencyTests-868648422 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (228686e4-99a3-41aa-9b03-04b5bac928e8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 19:09:51 devstack cinder-volume[84538]: DEBUG cinder.volume.manager [None req-1c118057-a2b7-4871-94cf-714f4f3debf8 tempest-VolumeDependencyTests-868648422 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (228686e4-99a3-41aa-9b03-04b5bac928e8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 19:09:51 devstack cinder-volume[84538]: DEBUG cinder.volume.manager [None req-1c118057-a2b7-4871-94cf-714f4f3debf8 tempest-VolumeDependencyTests-868648422 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (dd8a28c6-ac7f-4655-a7cd-50731dafb08a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 19:09:51 devstack cinder-volume[84538]: INFO cinder.volume.flows.manager.create_volume [None req-1c118057-a2b7-4871-94cf-714f4f3debf8 tempest-VolumeDependencyTests-868648422 None] Volume 13fa762d-2e94-4381-bb35-2cb334499ba2: being created as source_vol with specification: {'status': 'creating', 'volume_name': 'volume-13fa762d-2e94-4381-bb35-2cb334499ba2', 'volume_size': 1, 'source_volid': 'a64b4eb3-d814-459e-9081-f2e0e52cd475', 'source_volstatus': 'available'} Apr 29 19:09:51 devstack cinder-volume[84538]: DEBUG oslo_concurrency.lockutils [None req-1c118057-a2b7-4871-94cf-714f4f3debf8 tempest-VolumeDependencyTests-868648422 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" {{(pid=84538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 19:09:51 devstack cinder-volume[84538]: DEBUG oslo_concurrency.lockutils [None req-1c118057-a2b7-4871-94cf-714f4f3debf8 tempest-VolumeDependencyTests-868648422 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: waited 0.001s {{(pid=84538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 19:09:51 devstack cinder-volume[84538]: INFO cinder.volume.drivers.remotefs [None req-1c118057-a2b7-4871-94cf-714f4f3debf8 tempest-VolumeDependencyTests-868648422 None] Cloning volume a64b4eb3-d814-459e-9081-f2e0e52cd475 to volume 13fa762d-2e94-4381-bb35-2cb334499ba2 Apr 29 19:09:51 devstack cinder-volume[84538]: DEBUG cinder.volume.drivers.remotefs [None req-1c118057-a2b7-4871-94cf-714f4f3debf8 tempest-VolumeDependencyTests-868648422 None] Creating offline snapshot 13b48b83-b65d-4994-8a25-ef96f12f6568 of volume a64b4eb3-d814-459e-9081-f2e0e52cd475 {{(pid=84538) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}} Apr 29 19:09:51 devstack sudo[94235]: pam_unix(sudo:session): session closed for user root Apr 29 19:09:51 devstack cinder-volume[84538]: DEBUG oslo_concurrency.processutils [None req-0414c2e8-5f78-4532-9f4f-6bef3cd093d2 tempest-CreateVolumesFromSnapshotTest-1938046858 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-e9b9e08b-e0a6-4853-99a3-377c499d6950" returned: 0 in 0.706s {{(pid=84538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 19:09:51 devstack cinder-volume[84538]: DEBUG cinder.coordination [None req-0414c2e8-5f78-4532-9f4f-6bef3cd093d2 tempest-CreateVolumesFromSnapshotTest-1938046858 None] Lock "cinder-quobyte-e9b9e08b-e0a6-4853-99a3-377c499d6950" released by "delete_volume" :: held 1.495s {{(pid=84538) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 19:09:51 devstack cinder-volume[84538]: DEBUG oslo.privsep.daemon [-] privsep: reply[7d4f95ef-b98a-4d79-b765-95b60846c6e3]: (4, 'qcow2') {{(pid=85803) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 19:09:51 devstack cinder-volume[84538]: DEBUG oslo_concurrency.processutils [None req-1c118057-a2b7-4871-94cf-714f4f3debf8 tempest-VolumeDependencyTests-868648422 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-a64b4eb3-d814-459e-9081-f2e0e52cd475 {{(pid=84538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 19:09:51 devstack cinder-volume[84538]: DEBUG cinder.quota [None req-0414c2e8-5f78-4532-9f4f-6bef3cd093d2 tempest-CreateVolumesFromSnapshotTest-1938046858 None] Created reservations ['f10845f3-3e9d-416b-adf2-b541a16a7a48', '039db280-2ff1-4674-94a1-394024c2ee48', '9f550fe8-2650-4327-91a1-e01d9cfe7e88', 'ece71f20-a9b4-434b-8a0e-0d9823a963b0'] {{(pid=84538) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 29 19:09:51 devstack sudo[94238]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-a64b4eb3-d814-459e-9081-f2e0e52cd475 Apr 29 19:09:51 devstack sudo[94238]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 19:09:51 devstack cinder-volume[84538]: DEBUG oslo_concurrency.lockutils [None req-0414c2e8-5f78-4532-9f4f-6bef3cd093d2 tempest-CreateVolumesFromSnapshotTest-1938046858 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 19:09:51 devstack cinder-volume[84538]: DEBUG oslo_concurrency.lockutils [None req-0414c2e8-5f78-4532-9f4f-6bef3cd093d2 tempest-CreateVolumesFromSnapshotTest-1938046858 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 19:09:51 devstack cinder-volume[84538]: DEBUG cinder.volume.drivers.quobyte [None req-0414c2e8-5f78-4532-9f4f-6bef3cd093d2 tempest-CreateVolumesFromSnapshotTest-1938046858 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-34312b00-dd6d-45bb-af98-75855cea8e48': None} {{(pid=84538) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 19:09:51 devstack cinder-volume[84538]: DEBUG cinder.volume.drivers.quobyte [None req-0414c2e8-5f78-4532-9f4f-6bef3cd093d2 tempest-CreateVolumesFromSnapshotTest-1938046858 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-34312b00-dd6d-45bb-af98-75855cea8e48'] {{(pid=84538) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 19:09:51 devstack cinder-volume[84538]: DEBUG oslo_concurrency.lockutils [None req-0414c2e8-5f78-4532-9f4f-6bef3cd093d2 tempest-CreateVolumesFromSnapshotTest-1938046858 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=84538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 19:09:51 devstack cinder-volume[84538]: DEBUG oslo_concurrency.processutils [None req-0414c2e8-5f78-4532-9f4f-6bef3cd093d2 tempest-CreateVolumesFromSnapshotTest-1938046858 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d {{(pid=84538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 19:09:51 devstack sudo[94240]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d Apr 29 19:09:51 devstack sudo[94240]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 19:09:52 devstack cinder-volume[84538]: DEBUG cinder.coordination [None req-41aaa47d-71b3-4c10-b60f-5b56dc5ec719 tempest-CreateVolumesFromSnapshotTest-1938046858 None] Acquiring lock "cinder-1940ddaf-9cec-4a2b-809e-d58e15e38dac-delete_volume" by "delete_volume" {{(pid=84538) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 19:09:52 devstack cinder-volume[84538]: DEBUG cinder.coordination [None req-41aaa47d-71b3-4c10-b60f-5b56dc5ec719 tempest-CreateVolumesFromSnapshotTest-1938046858 None] Lock "cinder-1940ddaf-9cec-4a2b-809e-d58e15e38dac-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=84538) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 19:09:52 devstack cinder-volume[84538]: DEBUG cinder.coordination [None req-41aaa47d-71b3-4c10-b60f-5b56dc5ec719 tempest-CreateVolumesFromSnapshotTest-1938046858 None] Acquiring lock "cinder-quobyte-1940ddaf-9cec-4a2b-809e-d58e15e38dac" by "delete_volume" {{(pid=84538) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 19:09:52 devstack cinder-volume[84538]: DEBUG cinder.coordination [None req-41aaa47d-71b3-4c10-b60f-5b56dc5ec719 tempest-CreateVolumesFromSnapshotTest-1938046858 None] Lock "cinder-quobyte-1940ddaf-9cec-4a2b-809e-d58e15e38dac" acquired by "delete_volume" :: waited 0.020s {{(pid=84538) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 19:09:52 devstack cinder-volume[84538]: DEBUG oslo.privsep.daemon [-] privsep: reply[354eaf38-151e-46ed-abd1-8b2ce9ea2e7f]: (4, 'qcow2') {{(pid=85803) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 19:09:52 devstack cinder-volume[84538]: DEBUG oslo_concurrency.processutils [None req-41aaa47d-71b3-4c10-b60f-5b56dc5ec719 tempest-CreateVolumesFromSnapshotTest-1938046858 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-1940ddaf-9cec-4a2b-809e-d58e15e38dac {{(pid=84538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 19:09:52 devstack sudo[94240]: pam_unix(sudo:session): session closed for user root Apr 29 19:09:52 devstack cinder-volume[84538]: DEBUG oslo_concurrency.processutils [None req-0414c2e8-5f78-4532-9f4f-6bef3cd093d2 tempest-CreateVolumesFromSnapshotTest-1938046858 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d" returned: 0 in 0.742s {{(pid=84538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 19:09:52 devstack cinder-volume[84538]: DEBUG cinder.manager [None req-0414c2e8-5f78-4532-9f4f-6bef3cd093d2 tempest-CreateVolumesFromSnapshotTest-1938046858 None] Notifying Schedulers of capabilities ... {{(pid=84538) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 29 19:09:52 devstack cinder-volume[84538]: INFO cinder.volume.manager [None req-0414c2e8-5f78-4532-9f4f-6bef3cd093d2 tempest-CreateVolumesFromSnapshotTest-1938046858 None] Deleted volume successfully. Apr 29 19:09:52 devstack sudo[94238]: pam_unix(sudo:session): session closed for user root Apr 29 19:09:52 devstack cinder-volume[84538]: DEBUG oslo_concurrency.processutils [None req-1c118057-a2b7-4871-94cf-714f4f3debf8 tempest-VolumeDependencyTests-868648422 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-a64b4eb3-d814-459e-9081-f2e0e52cd475" returned: 0 in 0.933s {{(pid=84538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 19:09:52 devstack cinder-volume[84538]: DEBUG oslo_concurrency.processutils [None req-1c118057-a2b7-4871-94cf-714f4f3debf8 tempest-VolumeDependencyTests-868648422 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-a64b4eb3-d814-459e-9081-f2e0e52cd475,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-a64b4eb3-d814-459e-9081-f2e0e52cd475.13b48b83-b65d-4994-8a25-ef96f12f6568 1G {{(pid=84538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 19:09:52 devstack cinder-volume[84538]: DEBUG cinder.coordination [None req-0414c2e8-5f78-4532-9f4f-6bef3cd093d2 tempest-CreateVolumesFromSnapshotTest-1938046858 None] Lock "cinder-e9b9e08b-e0a6-4853-99a3-377c499d6950-delete_volume" released by "delete_volume" :: held 2.510s {{(pid=84538) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 19:09:52 devstack sudo[94247]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-a64b4eb3-d814-459e-9081-f2e0e52cd475,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-a64b4eb3-d814-459e-9081-f2e0e52cd475.13b48b83-b65d-4994-8a25-ef96f12f6568 1G Apr 29 19:09:52 devstack sudo[94247]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 19:09:52 devstack sudo[94246]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-1940ddaf-9cec-4a2b-809e-d58e15e38dac Apr 29 19:09:52 devstack sudo[94246]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 19:09:53 devstack sudo[94246]: pam_unix(sudo:session): session closed for user root Apr 29 19:09:53 devstack cinder-volume[84538]: DEBUG oslo_concurrency.processutils [None req-41aaa47d-71b3-4c10-b60f-5b56dc5ec719 tempest-CreateVolumesFromSnapshotTest-1938046858 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-1940ddaf-9cec-4a2b-809e-d58e15e38dac" returned: 0 in 0.772s {{(pid=84538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 19:09:53 devstack cinder-volume[84538]: DEBUG oslo_concurrency.processutils [None req-41aaa47d-71b3-4c10-b60f-5b56dc5ec719 tempest-CreateVolumesFromSnapshotTest-1938046858 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-1940ddaf-9cec-4a2b-809e-d58e15e38dac {{(pid=84538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 19:09:53 devstack sudo[94256]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-1940ddaf-9cec-4a2b-809e-d58e15e38dac Apr 29 19:09:53 devstack sudo[94256]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 19:09:53 devstack sudo[94247]: pam_unix(sudo:session): session closed for user root Apr 29 19:09:53 devstack cinder-volume[84538]: DEBUG oslo_concurrency.processutils [None req-1c118057-a2b7-4871-94cf-714f4f3debf8 tempest-VolumeDependencyTests-868648422 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-a64b4eb3-d814-459e-9081-f2e0e52cd475,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-a64b4eb3-d814-459e-9081-f2e0e52cd475.13b48b83-b65d-4994-8a25-ef96f12f6568 1G" returned: 0 in 0.851s {{(pid=84538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 19:09:53 devstack cinder-volume[84538]: DEBUG oslo_concurrency.processutils [None req-1c118057-a2b7-4871-94cf-714f4f3debf8 tempest-VolumeDependencyTests-868648422 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a64b4eb3-d814-459e-9081-f2e0e52cd475 -F qcow2 /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-a64b4eb3-d814-459e-9081-f2e0e52cd475.13b48b83-b65d-4994-8a25-ef96f12f6568 {{(pid=84538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 19:09:53 devstack sudo[94259]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a64b4eb3-d814-459e-9081-f2e0e52cd475 -F qcow2 /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-a64b4eb3-d814-459e-9081-f2e0e52cd475.13b48b83-b65d-4994-8a25-ef96f12f6568 Apr 29 19:09:53 devstack sudo[94259]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 19:09:53 devstack sudo[94256]: pam_unix(sudo:session): session closed for user root Apr 29 19:09:53 devstack cinder-volume[84538]: DEBUG oslo_concurrency.processutils [None req-41aaa47d-71b3-4c10-b60f-5b56dc5ec719 tempest-CreateVolumesFromSnapshotTest-1938046858 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-1940ddaf-9cec-4a2b-809e-d58e15e38dac" returned: 0 in 0.698s {{(pid=84538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 19:09:53 devstack cinder-volume[84538]: DEBUG cinder.coordination [None req-41aaa47d-71b3-4c10-b60f-5b56dc5ec719 tempest-CreateVolumesFromSnapshotTest-1938046858 None] Lock "cinder-quobyte-1940ddaf-9cec-4a2b-809e-d58e15e38dac" released by "delete_volume" :: held 1.529s {{(pid=84538) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 19:09:54 devstack cinder-volume[84538]: DEBUG cinder.quota [None req-41aaa47d-71b3-4c10-b60f-5b56dc5ec719 tempest-CreateVolumesFromSnapshotTest-1938046858 None] Created reservations ['0b0dd68d-1697-4a21-9178-ada5ad7ffea1', 'b0b05684-c907-46d4-8e1d-ad556d37cb53', '1f5e42e0-4100-4277-aaaf-03382975bdac', '79d886b1-f068-41ee-b84e-c6f648ea3bad'] {{(pid=84538) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 29 19:09:54 devstack cinder-volume[84538]: DEBUG oslo_concurrency.lockutils [None req-41aaa47d-71b3-4c10-b60f-5b56dc5ec719 tempest-CreateVolumesFromSnapshotTest-1938046858 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 19:09:54 devstack cinder-volume[84538]: DEBUG oslo_concurrency.lockutils [None req-41aaa47d-71b3-4c10-b60f-5b56dc5ec719 tempest-CreateVolumesFromSnapshotTest-1938046858 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 19:09:54 devstack cinder-volume[84538]: DEBUG cinder.volume.drivers.quobyte [None req-41aaa47d-71b3-4c10-b60f-5b56dc5ec719 tempest-CreateVolumesFromSnapshotTest-1938046858 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-34312b00-dd6d-45bb-af98-75855cea8e48': None} {{(pid=84538) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 19:09:54 devstack cinder-volume[84538]: DEBUG cinder.volume.drivers.quobyte [None req-41aaa47d-71b3-4c10-b60f-5b56dc5ec719 tempest-CreateVolumesFromSnapshotTest-1938046858 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-34312b00-dd6d-45bb-af98-75855cea8e48'] {{(pid=84538) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 19:09:54 devstack cinder-volume[84538]: DEBUG oslo_concurrency.lockutils [None req-41aaa47d-71b3-4c10-b60f-5b56dc5ec719 tempest-CreateVolumesFromSnapshotTest-1938046858 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=84538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 19:09:54 devstack cinder-volume[84538]: DEBUG oslo_concurrency.processutils [None req-41aaa47d-71b3-4c10-b60f-5b56dc5ec719 tempest-CreateVolumesFromSnapshotTest-1938046858 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d {{(pid=84538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 19:09:54 devstack sudo[94266]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d Apr 29 19:09:54 devstack sudo[94266]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 19:09:54 devstack sudo[94259]: pam_unix(sudo:session): session closed for user root Apr 29 19:09:54 devstack cinder-volume[84538]: DEBUG oslo_concurrency.processutils [None req-1c118057-a2b7-4871-94cf-714f4f3debf8 tempest-VolumeDependencyTests-868648422 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a64b4eb3-d814-459e-9081-f2e0e52cd475 -F qcow2 /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-a64b4eb3-d814-459e-9081-f2e0e52cd475.13b48b83-b65d-4994-8a25-ef96f12f6568" returned: 0 in 0.809s {{(pid=84538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 19:09:54 devstack cinder-volume[84538]: WARNING cinder.volume.drivers.remotefs [None req-1c118057-a2b7-4871-94cf-714f4f3debf8 tempest-VolumeDependencyTests-868648422 None] /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-a64b4eb3-d814-459e-9081-f2e0e52cd475.13b48b83-b65d-4994-8a25-ef96f12f6568 is being set with open permissions: ugo+rw Apr 29 19:09:54 devstack cinder-volume[84538]: DEBUG oslo_concurrency.processutils [None req-1c118057-a2b7-4871-94cf-714f4f3debf8 tempest-VolumeDependencyTests-868648422 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-a64b4eb3-d814-459e-9081-f2e0e52cd475.13b48b83-b65d-4994-8a25-ef96f12f6568 {{(pid=84538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 19:09:54 devstack sudo[94268]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-a64b4eb3-d814-459e-9081-f2e0e52cd475.13b48b83-b65d-4994-8a25-ef96f12f6568 Apr 29 19:09:54 devstack sudo[94268]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 19:09:54 devstack cinder-volume[84538]: DEBUG cinder.coordination [None req-1aab9715-febd-4d6e-8126-01b3d2bd550f tempest-CreateVolumesFromSnapshotTest-1938046858 None] Acquiring lock "cinder-5e3d9ffe-6145-432b-889f-53ac70d96f1e-delete_volume" by "delete_volume" {{(pid=84538) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 19:09:54 devstack cinder-volume[84538]: DEBUG cinder.coordination [None req-1aab9715-febd-4d6e-8126-01b3d2bd550f tempest-CreateVolumesFromSnapshotTest-1938046858 None] Lock "cinder-5e3d9ffe-6145-432b-889f-53ac70d96f1e-delete_volume" acquired by "delete_volume" :: waited 0.055s {{(pid=84538) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 19:09:54 devstack cinder-volume[84538]: DEBUG dbcounter [-] [84538] Writing DB stats cinder:UPDATE=152,cinder:SELECT=103,cinder:DELETE=16,cinder:INSERT=38 {{(pid=84538) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Apr 29 19:09:54 devstack cinder-volume[84538]: DEBUG cinder.coordination [None req-1aab9715-febd-4d6e-8126-01b3d2bd550f tempest-CreateVolumesFromSnapshotTest-1938046858 None] Acquiring lock "cinder-quobyte-5e3d9ffe-6145-432b-889f-53ac70d96f1e" by "delete_volume" {{(pid=84538) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 19:09:54 devstack cinder-volume[84538]: DEBUG cinder.coordination [None req-1aab9715-febd-4d6e-8126-01b3d2bd550f tempest-CreateVolumesFromSnapshotTest-1938046858 None] Lock "cinder-quobyte-5e3d9ffe-6145-432b-889f-53ac70d96f1e" acquired by "delete_volume" :: waited 0.031s {{(pid=84538) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 19:09:54 devstack cinder-volume[84538]: DEBUG oslo.privsep.daemon [-] privsep: reply[fc6d2c17-27c5-47a4-9cf2-8e376f2f980f]: (4, 'qcow2') {{(pid=85803) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 19:09:54 devstack cinder-volume[84538]: DEBUG oslo_concurrency.processutils [None req-1aab9715-febd-4d6e-8126-01b3d2bd550f tempest-CreateVolumesFromSnapshotTest-1938046858 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-5e3d9ffe-6145-432b-889f-53ac70d96f1e {{(pid=84538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 19:09:55 devstack sudo[94266]: pam_unix(sudo:session): session closed for user root Apr 29 19:09:55 devstack cinder-volume[84538]: DEBUG oslo_concurrency.processutils [None req-41aaa47d-71b3-4c10-b60f-5b56dc5ec719 tempest-CreateVolumesFromSnapshotTest-1938046858 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d" returned: 0 in 0.883s {{(pid=84538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 19:09:55 devstack cinder-volume[84538]: DEBUG cinder.manager [None req-41aaa47d-71b3-4c10-b60f-5b56dc5ec719 tempest-CreateVolumesFromSnapshotTest-1938046858 None] Notifying Schedulers of capabilities ... {{(pid=84538) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 29 19:09:55 devstack cinder-volume[84538]: INFO cinder.volume.manager [None req-41aaa47d-71b3-4c10-b60f-5b56dc5ec719 tempest-CreateVolumesFromSnapshotTest-1938046858 None] Deleted volume successfully. Apr 29 19:09:55 devstack cinder-volume[84538]: DEBUG cinder.coordination [None req-41aaa47d-71b3-4c10-b60f-5b56dc5ec719 tempest-CreateVolumesFromSnapshotTest-1938046858 None] Lock "cinder-1940ddaf-9cec-4a2b-809e-d58e15e38dac-delete_volume" released by "delete_volume" :: held 2.654s {{(pid=84538) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 19:09:55 devstack sudo[94268]: pam_unix(sudo:session): session closed for user root Apr 29 19:09:55 devstack cinder-volume[84538]: DEBUG oslo_concurrency.processutils [None req-1c118057-a2b7-4871-94cf-714f4f3debf8 tempest-VolumeDependencyTests-868648422 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-a64b4eb3-d814-459e-9081-f2e0e52cd475.13b48b83-b65d-4994-8a25-ef96f12f6568" returned: 0 in 0.825s {{(pid=84538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 19:09:55 devstack sudo[94278]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-5e3d9ffe-6145-432b-889f-53ac70d96f1e Apr 29 19:09:55 devstack sudo[94278]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 19:09:55 devstack cinder-volume[84538]: DEBUG oslo_concurrency.processutils [None req-1c118057-a2b7-4871-94cf-714f4f3debf8 tempest-VolumeDependencyTests-868648422 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-a64b4eb3-d814-459e-9081-f2e0e52cd475.info {{(pid=84538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 19:09:55 devstack sudo[94280]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-a64b4eb3-d814-459e-9081-f2e0e52cd475.info Apr 29 19:09:55 devstack sudo[94280]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 19:09:55 devstack sudo[94280]: pam_unix(sudo:session): session closed for user root Apr 29 19:09:55 devstack cinder-volume[84538]: DEBUG oslo_concurrency.processutils [None req-1c118057-a2b7-4871-94cf-714f4f3debf8 tempest-VolumeDependencyTests-868648422 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-a64b4eb3-d814-459e-9081-f2e0e52cd475.info" returned: 0 in 0.655s {{(pid=84538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 19:09:55 devstack cinder-volume[84538]: WARNING cinder.volume.drivers.remotefs [None req-1c118057-a2b7-4871-94cf-714f4f3debf8 tempest-VolumeDependencyTests-868648422 None] /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-a64b4eb3-d814-459e-9081-f2e0e52cd475.info is being set with open permissions: ugo+rw Apr 29 19:09:55 devstack cinder-volume[84538]: DEBUG oslo_concurrency.processutils [None req-1c118057-a2b7-4871-94cf-714f4f3debf8 tempest-VolumeDependencyTests-868648422 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-a64b4eb3-d814-459e-9081-f2e0e52cd475.info {{(pid=84538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 19:09:55 devstack sudo[94287]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-a64b4eb3-d814-459e-9081-f2e0e52cd475.info Apr 29 19:09:55 devstack sudo[94287]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 19:09:55 devstack cinder-volume[84538]: DEBUG dbcounter [-] [84538] Writing DB stats cinder:SELECT=117,cinder:UPDATE=136,cinder:INSERT=30,cinder:DELETE=12 {{(pid=84538) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Apr 29 19:09:55 devstack sudo[94278]: pam_unix(sudo:session): session closed for user root Apr 29 19:09:55 devstack cinder-volume[84538]: DEBUG oslo_concurrency.processutils [None req-1aab9715-febd-4d6e-8126-01b3d2bd550f tempest-CreateVolumesFromSnapshotTest-1938046858 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-5e3d9ffe-6145-432b-889f-53ac70d96f1e" returned: 0 in 0.893s {{(pid=84538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 19:09:55 devstack cinder-volume[84538]: DEBUG oslo_concurrency.processutils [None req-1aab9715-febd-4d6e-8126-01b3d2bd550f tempest-CreateVolumesFromSnapshotTest-1938046858 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-5e3d9ffe-6145-432b-889f-53ac70d96f1e {{(pid=84538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 19:09:55 devstack cinder-volume[84538]: DEBUG cinder.volume.flows.manager.create_volume [None req-1f67b9c0-552d-44e3-ab59-c3af6946018c tempest-SnapshotDependencyTests-220526168 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84538) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Apr 29 19:09:55 devstack sudo[94289]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-5e3d9ffe-6145-432b-889f-53ac70d96f1e Apr 29 19:09:55 devstack sudo[94289]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 19:09:55 devstack cinder-volume[84538]: DEBUG cinder.volume.manager [None req-1f67b9c0-552d-44e3-ab59-c3af6946018c tempest-SnapshotDependencyTests-220526168 None] Flow 'volume_create_manager' (24f012c1-4482-4877-b500-d433a32f7006) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84538) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 19:09:55 devstack cinder-volume[84538]: DEBUG cinder.volume.manager [None req-1f67b9c0-552d-44e3-ab59-c3af6946018c tempest-SnapshotDependencyTests-220526168 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7b1a38f4-18c9-40b7-8e5a-2370e525a8bb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 19:09:55 devstack cinder-volume[84538]: DEBUG cinder.volume.manager [None req-1f67b9c0-552d-44e3-ab59-c3af6946018c tempest-SnapshotDependencyTests-220526168 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7b1a38f4-18c9-40b7-8e5a-2370e525a8bb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-29T17:09:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDependencyTests-volume-1369785444',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=eda1676c-f078-4f06-beb1-99694d364faa,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f2f36b8c787d4693bef9d68f812cd2f2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T17:09:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T17:09:56Z,use_quota=True,user_id='24efb97024ea4e56b866373a52b82b15',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(62b05900-93e3-4190-a88f-1d87324303d1),volume_type_id=62b05900-93e3-4190-a88f-1d87324303d1)' {{(pid=84538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 19:09:55 devstack cinder-volume[84538]: DEBUG cinder.volume.manager [None req-1f67b9c0-552d-44e3-ab59-c3af6946018c tempest-SnapshotDependencyTests-220526168 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9eaf4625-707b-48bb-9420-ae10ab35bc3f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 19:09:55 devstack cinder-volume[84538]: DEBUG cinder.volume.manager [None req-1f67b9c0-552d-44e3-ab59-c3af6946018c tempest-SnapshotDependencyTests-220526168 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9eaf4625-707b-48bb-9420-ae10ab35bc3f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 19:09:55 devstack cinder-volume[84538]: DEBUG cinder.volume.manager [None req-1f67b9c0-552d-44e3-ab59-c3af6946018c tempest-SnapshotDependencyTests-220526168 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7fcaf756-b2b1-45de-8634-cdb6a93cadbe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 19:09:55 devstack cinder-volume[84538]: DEBUG cinder.volume.manager [None req-1f67b9c0-552d-44e3-ab59-c3af6946018c tempest-SnapshotDependencyTests-220526168 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7fcaf756-b2b1-45de-8634-cdb6a93cadbe) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'eda1676c-f078-4f06-beb1-99694d364faa', 'volume_name': 'volume-eda1676c-f078-4f06-beb1-99694d364faa', 'volume_size': 1}' {{(pid=84538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 19:09:55 devstack cinder-volume[84538]: DEBUG cinder.volume.manager [None req-1f67b9c0-552d-44e3-ab59-c3af6946018c tempest-SnapshotDependencyTests-220526168 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (983efeb4-e280-43cc-ac47-12871b42fb44) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 19:09:55 devstack cinder-volume[84538]: DEBUG cinder.volume.manager [None req-1f67b9c0-552d-44e3-ab59-c3af6946018c tempest-SnapshotDependencyTests-220526168 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (983efeb4-e280-43cc-ac47-12871b42fb44) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 19:09:55 devstack cinder-volume[84538]: DEBUG cinder.volume.manager [None req-1f67b9c0-552d-44e3-ab59-c3af6946018c tempest-SnapshotDependencyTests-220526168 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1b8c784b-63be-40ff-a99d-de3f845f84c3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 19:09:55 devstack cinder-volume[84538]: INFO cinder.volume.flows.manager.create_volume [None req-1f67b9c0-552d-44e3-ab59-c3af6946018c tempest-SnapshotDependencyTests-220526168 None] Volume eda1676c-f078-4f06-beb1-99694d364faa: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-eda1676c-f078-4f06-beb1-99694d364faa', 'volume_size': 1} Apr 29 19:09:55 devstack cinder-volume[84538]: DEBUG oslo_concurrency.lockutils [None req-1f67b9c0-552d-44e3-ab59-c3af6946018c tempest-SnapshotDependencyTests-220526168 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 19:09:56 devstack sudo[94287]: pam_unix(sudo:session): session closed for user root Apr 29 19:09:56 devstack cinder-volume[84538]: DEBUG oslo_concurrency.processutils [None req-1c118057-a2b7-4871-94cf-714f4f3debf8 tempest-VolumeDependencyTests-868648422 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-a64b4eb3-d814-459e-9081-f2e0e52cd475.info" returned: 0 in 0.633s {{(pid=84538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 19:09:56 devstack cinder-volume[84538]: DEBUG cinder.coordination [None req-1c118057-a2b7-4871-94cf-714f4f3debf8 tempest-VolumeDependencyTests-868648422 None] Acquiring lock "cinder-quobyte-13fa762d-2e94-4381-bb35-2cb334499ba2" by "_copy_volume_from_snapshot" {{(pid=84538) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 19:09:56 devstack cinder-volume[84538]: DEBUG cinder.coordination [None req-1c118057-a2b7-4871-94cf-714f4f3debf8 tempest-VolumeDependencyTests-868648422 None] Lock "cinder-quobyte-13fa762d-2e94-4381-bb35-2cb334499ba2" acquired by "_copy_volume_from_snapshot" :: waited 0.017s {{(pid=84538) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 19:09:56 devstack cinder-volume[84538]: DEBUG cinder.volume.drivers.quobyte [None req-1c118057-a2b7-4871-94cf-714f4f3debf8 tempest-VolumeDependencyTests-868648422 None] snapshot: 13b48b83-b65d-4994-8a25-ef96f12f6568, volume: 13fa762d-2e94-4381-bb35-2cb334499ba2, {{(pid=84538) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Apr 29 19:09:56 devstack cinder-volume[84538]: DEBUG oslo_concurrency.lockutils [None req-1c118057-a2b7-4871-94cf-714f4f3debf8 tempest-VolumeDependencyTests-868648422 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 19:09:56 devstack cinder-volume[84538]: DEBUG oslo_concurrency.lockutils [None req-1c118057-a2b7-4871-94cf-714f4f3debf8 tempest-VolumeDependencyTests-868648422 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 19:09:56 devstack cinder-volume[84538]: DEBUG cinder.volume.drivers.quobyte [None req-1c118057-a2b7-4871-94cf-714f4f3debf8 tempest-VolumeDependencyTests-868648422 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-34312b00-dd6d-45bb-af98-75855cea8e48': None} {{(pid=84538) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 19:09:56 devstack cinder-volume[84538]: DEBUG cinder.volume.drivers.quobyte [None req-1c118057-a2b7-4871-94cf-714f4f3debf8 tempest-VolumeDependencyTests-868648422 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-34312b00-dd6d-45bb-af98-75855cea8e48'] {{(pid=84538) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 19:09:56 devstack cinder-volume[84538]: DEBUG oslo_concurrency.lockutils [None req-1c118057-a2b7-4871-94cf-714f4f3debf8 tempest-VolumeDependencyTests-868648422 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=84538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 19:09:56 devstack cinder-volume[84538]: DEBUG oslo.privsep.daemon [-] privsep: reply[4bfeffd4-d12f-4c15-a0d5-a140e128f8f3]: (4, 'qcow2') {{(pid=85803) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 19:09:56 devstack cinder-volume[84538]: DEBUG oslo_concurrency.processutils [None req-1c118057-a2b7-4871-94cf-714f4f3debf8 tempest-VolumeDependencyTests-868648422 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-a64b4eb3-d814-459e-9081-f2e0e52cd475.13b48b83-b65d-4994-8a25-ef96f12f6568 {{(pid=84538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 19:09:56 devstack sudo[94289]: pam_unix(sudo:session): session closed for user root Apr 29 19:09:56 devstack cinder-volume[84538]: DEBUG oslo_concurrency.processutils [None req-1aab9715-febd-4d6e-8126-01b3d2bd550f tempest-CreateVolumesFromSnapshotTest-1938046858 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-5e3d9ffe-6145-432b-889f-53ac70d96f1e" returned: 0 in 0.626s {{(pid=84538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 19:09:56 devstack cinder-volume[84538]: DEBUG cinder.coordination [None req-1aab9715-febd-4d6e-8126-01b3d2bd550f tempest-CreateVolumesFromSnapshotTest-1938046858 None] Lock "cinder-quobyte-5e3d9ffe-6145-432b-889f-53ac70d96f1e" released by "delete_volume" :: held 1.594s {{(pid=84538) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 19:09:56 devstack cinder-volume[84538]: DEBUG cinder.quota [None req-1aab9715-febd-4d6e-8126-01b3d2bd550f tempest-CreateVolumesFromSnapshotTest-1938046858 None] Created reservations ['37824474-a95d-4e85-be4f-c6d1c7731286', '0899ca65-3da1-4711-84ea-83e8cc77aef4', '5ff2c464-79b6-4a3c-8599-7fec719f1e5e', '87a9ae9e-bb3a-4b64-8e62-7e27f281fc42'] {{(pid=84538) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 29 19:09:56 devstack sudo[94293]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-a64b4eb3-d814-459e-9081-f2e0e52cd475.13b48b83-b65d-4994-8a25-ef96f12f6568 Apr 29 19:09:56 devstack sudo[94293]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 19:09:56 devstack cinder-volume[84538]: DEBUG oslo_concurrency.lockutils [None req-1aab9715-febd-4d6e-8126-01b3d2bd550f tempest-CreateVolumesFromSnapshotTest-1938046858 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 19:09:56 devstack cinder-volume[84538]: DEBUG oslo_concurrency.lockutils [None req-1aab9715-febd-4d6e-8126-01b3d2bd550f tempest-CreateVolumesFromSnapshotTest-1938046858 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 19:09:56 devstack cinder-volume[84538]: DEBUG cinder.volume.drivers.quobyte [None req-1aab9715-febd-4d6e-8126-01b3d2bd550f tempest-CreateVolumesFromSnapshotTest-1938046858 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-34312b00-dd6d-45bb-af98-75855cea8e48': None} {{(pid=84538) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 19:09:56 devstack cinder-volume[84538]: DEBUG cinder.volume.drivers.quobyte [None req-1aab9715-febd-4d6e-8126-01b3d2bd550f tempest-CreateVolumesFromSnapshotTest-1938046858 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-34312b00-dd6d-45bb-af98-75855cea8e48'] {{(pid=84538) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 19:09:56 devstack cinder-volume[84538]: DEBUG oslo_concurrency.lockutils [None req-1aab9715-febd-4d6e-8126-01b3d2bd550f tempest-CreateVolumesFromSnapshotTest-1938046858 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=84538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 19:09:56 devstack cinder-volume[84538]: DEBUG oslo_concurrency.processutils [None req-1aab9715-febd-4d6e-8126-01b3d2bd550f tempest-CreateVolumesFromSnapshotTest-1938046858 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d {{(pid=84538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 19:09:56 devstack sudo[94295]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d Apr 29 19:09:56 devstack sudo[94295]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 19:09:57 devstack cinder-volume[84538]: DEBUG cinder.coordination [None req-c338e412-bd25-40f7-8a36-7ef3ee06abe8 tempest-CreateVolumesFromSnapshotTest-1938046858 None] Acquiring lock "cinder-4474a441-c5bf-4439-86a5-e8e00aef1394-delete_volume" by "delete_volume" {{(pid=84538) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 19:09:57 devstack cinder-volume[84538]: DEBUG cinder.coordination [None req-c338e412-bd25-40f7-8a36-7ef3ee06abe8 tempest-CreateVolumesFromSnapshotTest-1938046858 None] Lock "cinder-4474a441-c5bf-4439-86a5-e8e00aef1394-delete_volume" acquired by "delete_volume" :: waited 0.035s {{(pid=84538) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 19:09:57 devstack cinder-volume[84538]: DEBUG cinder.coordination [None req-c338e412-bd25-40f7-8a36-7ef3ee06abe8 tempest-CreateVolumesFromSnapshotTest-1938046858 None] Acquiring lock "cinder-quobyte-4474a441-c5bf-4439-86a5-e8e00aef1394" by "delete_volume" {{(pid=84538) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 19:09:57 devstack cinder-volume[84538]: DEBUG cinder.coordination [None req-c338e412-bd25-40f7-8a36-7ef3ee06abe8 tempest-CreateVolumesFromSnapshotTest-1938046858 None] Lock "cinder-quobyte-4474a441-c5bf-4439-86a5-e8e00aef1394" acquired by "delete_volume" :: waited 0.028s {{(pid=84538) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 19:09:57 devstack cinder-volume[84538]: DEBUG oslo.privsep.daemon [-] privsep: reply[da71e206-6bbd-4b14-b997-d897acfd25a6]: (4, 'qcow2') {{(pid=85803) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 19:09:57 devstack cinder-volume[84538]: DEBUG oslo_concurrency.processutils [None req-c338e412-bd25-40f7-8a36-7ef3ee06abe8 tempest-CreateVolumesFromSnapshotTest-1938046858 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-4474a441-c5bf-4439-86a5-e8e00aef1394 {{(pid=84538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 19:09:57 devstack sudo[94295]: pam_unix(sudo:session): session closed for user root Apr 29 19:09:57 devstack cinder-volume[84538]: DEBUG oslo_concurrency.processutils [None req-1aab9715-febd-4d6e-8126-01b3d2bd550f tempest-CreateVolumesFromSnapshotTest-1938046858 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d" returned: 0 in 0.657s {{(pid=84538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 19:09:57 devstack cinder-volume[84538]: DEBUG cinder.manager [None req-1aab9715-febd-4d6e-8126-01b3d2bd550f tempest-CreateVolumesFromSnapshotTest-1938046858 None] Notifying Schedulers of capabilities ... {{(pid=84538) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 29 19:09:57 devstack cinder-volume[84538]: INFO cinder.volume.manager [None req-1aab9715-febd-4d6e-8126-01b3d2bd550f tempest-CreateVolumesFromSnapshotTest-1938046858 None] Deleted volume successfully. Apr 29 19:09:57 devstack sudo[94293]: pam_unix(sudo:session): session closed for user root Apr 29 19:09:57 devstack cinder-volume[84538]: DEBUG cinder.coordination [None req-1aab9715-febd-4d6e-8126-01b3d2bd550f tempest-CreateVolumesFromSnapshotTest-1938046858 None] Lock "cinder-5e3d9ffe-6145-432b-889f-53ac70d96f1e-delete_volume" released by "delete_volume" :: held 2.553s {{(pid=84538) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 19:09:57 devstack cinder-volume[84538]: DEBUG oslo_concurrency.processutils [None req-1c118057-a2b7-4871-94cf-714f4f3debf8 tempest-VolumeDependencyTests-868648422 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-a64b4eb3-d814-459e-9081-f2e0e52cd475.13b48b83-b65d-4994-8a25-ef96f12f6568" returned: 0 in 0.839s {{(pid=84538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 19:09:57 devstack cinder-volume[84538]: DEBUG cinder.volume.drivers.remotefs [None req-1c118057-a2b7-4871-94cf-714f4f3debf8 tempest-VolumeDependencyTests-868648422 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-a64b4eb3-d814-459e-9081-f2e0e52cd475(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=84538) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 29 19:09:57 devstack cinder-volume[84538]: DEBUG cinder.volume.drivers.quobyte [None req-1c118057-a2b7-4871-94cf-714f4f3debf8 tempest-VolumeDependencyTests-868648422 None] will copy from snapshot at /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-a64b4eb3-d814-459e-9081-f2e0e52cd475 {{(pid=84538) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Apr 29 19:09:57 devstack cinder-volume[84538]: DEBUG cinder.volume.drivers.quobyte [None req-1c118057-a2b7-4871-94cf-714f4f3debf8 tempest-VolumeDependencyTests-868648422 None] Creating direct copy from snapshot {{(pid=84538) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Apr 29 19:09:57 devstack sudo[94301]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-4474a441-c5bf-4439-86a5-e8e00aef1394 Apr 29 19:09:57 devstack sudo[94301]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 19:09:57 devstack cinder-volume[84538]: DEBUG oslo.privsep.daemon [-] privsep: reply[36a3c3f2-7afb-4ba3-ab25-780a32e87565]: (4, 'qcow2') {{(pid=85803) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 19:09:57 devstack cinder-volume[84538]: DEBUG oslo_concurrency.processutils [None req-1c118057-a2b7-4871-94cf-714f4f3debf8 tempest-VolumeDependencyTests-868648422 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-a64b4eb3-d814-459e-9081-f2e0e52cd475 {{(pid=84538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 19:09:57 devstack sudo[94303]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-a64b4eb3-d814-459e-9081-f2e0e52cd475 Apr 29 19:09:57 devstack sudo[94303]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 19:09:57 devstack sudo[94301]: pam_unix(sudo:session): session closed for user root Apr 29 19:09:57 devstack cinder-volume[84538]: DEBUG oslo_concurrency.processutils [None req-c338e412-bd25-40f7-8a36-7ef3ee06abe8 tempest-CreateVolumesFromSnapshotTest-1938046858 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-4474a441-c5bf-4439-86a5-e8e00aef1394" returned: 0 in 0.744s {{(pid=84538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 19:09:57 devstack cinder-volume[84538]: DEBUG oslo_concurrency.processutils [None req-c338e412-bd25-40f7-8a36-7ef3ee06abe8 tempest-CreateVolumesFromSnapshotTest-1938046858 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-4474a441-c5bf-4439-86a5-e8e00aef1394 {{(pid=84538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 19:09:57 devstack sudo[94309]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-4474a441-c5bf-4439-86a5-e8e00aef1394 Apr 29 19:09:57 devstack sudo[94309]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 19:09:58 devstack sudo[94303]: pam_unix(sudo:session): session closed for user root Apr 29 19:09:58 devstack cinder-volume[84538]: DEBUG oslo_concurrency.processutils [None req-1c118057-a2b7-4871-94cf-714f4f3debf8 tempest-VolumeDependencyTests-868648422 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-a64b4eb3-d814-459e-9081-f2e0e52cd475" returned: 0 in 0.760s {{(pid=84538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 19:09:58 devstack cinder-volume[84538]: DEBUG cinder.utils [None req-1c118057-a2b7-4871-94cf-714f4f3debf8 tempest-VolumeDependencyTests-868648422 None] Path /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-13fa762d-2e94-4381-bb35-2cb334499ba2 not found in is_blk_device check {{(pid=84538) is_blk_device /opt/stack/cinder/cinder/utils.py:602}} Apr 29 19:09:58 devstack cinder-volume[84538]: DEBUG oslo_concurrency.processutils [None req-1c118057-a2b7-4871-94cf-714f4f3debf8 tempest-VolumeDependencyTests-868648422 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-a64b4eb3-d814-459e-9081-f2e0e52cd475 /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-13fa762d-2e94-4381-bb35-2cb334499ba2 {{(pid=84538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 19:09:58 devstack sudo[94313]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-a64b4eb3-d814-459e-9081-f2e0e52cd475 /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-13fa762d-2e94-4381-bb35-2cb334499ba2 Apr 29 19:09:58 devstack sudo[94313]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 19:09:58 devstack sudo[94309]: pam_unix(sudo:session): session closed for user root Apr 29 19:09:58 devstack cinder-volume[84538]: DEBUG oslo_concurrency.processutils [None req-c338e412-bd25-40f7-8a36-7ef3ee06abe8 tempest-CreateVolumesFromSnapshotTest-1938046858 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-4474a441-c5bf-4439-86a5-e8e00aef1394" returned: 0 in 0.595s {{(pid=84538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 19:09:58 devstack cinder-volume[84538]: DEBUG cinder.coordination [None req-c338e412-bd25-40f7-8a36-7ef3ee06abe8 tempest-CreateVolumesFromSnapshotTest-1938046858 None] Lock "cinder-quobyte-4474a441-c5bf-4439-86a5-e8e00aef1394" released by "delete_volume" :: held 1.386s {{(pid=84538) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 19:09:58 devstack cinder-volume[84538]: DEBUG cinder.quota [None req-c338e412-bd25-40f7-8a36-7ef3ee06abe8 tempest-CreateVolumesFromSnapshotTest-1938046858 None] Created reservations ['eb77e144-d2be-4832-bd39-ebf6d8c9864f', '59fa9d23-f4ec-4f8e-8089-e2d06a0eb126', '86f8fae6-a4aa-4944-ad5d-07c16d64368a', 'd2aab1e3-fcc8-4ca7-89d9-934ba815a4a5'] {{(pid=84538) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 29 19:09:58 devstack cinder-volume[84538]: DEBUG oslo_concurrency.lockutils [None req-c338e412-bd25-40f7-8a36-7ef3ee06abe8 tempest-CreateVolumesFromSnapshotTest-1938046858 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 19:09:58 devstack cinder-volume[84538]: DEBUG oslo_concurrency.lockutils [None req-c338e412-bd25-40f7-8a36-7ef3ee06abe8 tempest-CreateVolumesFromSnapshotTest-1938046858 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 19:09:58 devstack cinder-volume[84538]: DEBUG cinder.volume.drivers.quobyte [None req-c338e412-bd25-40f7-8a36-7ef3ee06abe8 tempest-CreateVolumesFromSnapshotTest-1938046858 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-34312b00-dd6d-45bb-af98-75855cea8e48': None} {{(pid=84538) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 19:09:58 devstack cinder-volume[84538]: DEBUG cinder.volume.drivers.quobyte [None req-c338e412-bd25-40f7-8a36-7ef3ee06abe8 tempest-CreateVolumesFromSnapshotTest-1938046858 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-34312b00-dd6d-45bb-af98-75855cea8e48'] {{(pid=84538) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 19:09:58 devstack cinder-volume[84538]: DEBUG oslo_concurrency.lockutils [None req-c338e412-bd25-40f7-8a36-7ef3ee06abe8 tempest-CreateVolumesFromSnapshotTest-1938046858 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=84538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 19:09:58 devstack cinder-volume[84538]: DEBUG oslo_concurrency.processutils [None req-c338e412-bd25-40f7-8a36-7ef3ee06abe8 tempest-CreateVolumesFromSnapshotTest-1938046858 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d {{(pid=84538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 19:09:58 devstack sudo[94320]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d Apr 29 19:09:58 devstack sudo[94320]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 19:09:59 devstack cinder-volume[84538]: DEBUG cinder.coordination [None req-7cdc988a-2c9c-4cf0-88fd-30882e8ae9c9 tempest-CreateVolumesFromSnapshotTest-1938046858 None] Acquiring lock "cinder-22adfb3f-e963-4c06-9e74-8cd5868c13b3-delete_volume" by "delete_volume" {{(pid=84538) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 19:09:59 devstack cinder-volume[84538]: DEBUG cinder.coordination [None req-7cdc988a-2c9c-4cf0-88fd-30882e8ae9c9 tempest-CreateVolumesFromSnapshotTest-1938046858 None] Lock "cinder-22adfb3f-e963-4c06-9e74-8cd5868c13b3-delete_volume" acquired by "delete_volume" :: waited 0.042s {{(pid=84538) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 19:09:59 devstack cinder-volume[84538]: DEBUG cinder.coordination [None req-7cdc988a-2c9c-4cf0-88fd-30882e8ae9c9 tempest-CreateVolumesFromSnapshotTest-1938046858 None] Acquiring lock "cinder-quobyte-22adfb3f-e963-4c06-9e74-8cd5868c13b3" by "delete_volume" {{(pid=84538) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 19:09:59 devstack sudo[94320]: pam_unix(sudo:session): session closed for user root Apr 29 19:09:59 devstack cinder-volume[84538]: DEBUG oslo_concurrency.processutils [None req-c338e412-bd25-40f7-8a36-7ef3ee06abe8 tempest-CreateVolumesFromSnapshotTest-1938046858 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d" returned: 0 in 1.056s {{(pid=84538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 19:09:59 devstack cinder-volume[84538]: DEBUG cinder.manager [None req-c338e412-bd25-40f7-8a36-7ef3ee06abe8 tempest-CreateVolumesFromSnapshotTest-1938046858 None] Notifying Schedulers of capabilities ... {{(pid=84538) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 29 19:09:59 devstack cinder-volume[84538]: DEBUG cinder.coordination [None req-7cdc988a-2c9c-4cf0-88fd-30882e8ae9c9 tempest-CreateVolumesFromSnapshotTest-1938046858 None] Lock "cinder-quobyte-22adfb3f-e963-4c06-9e74-8cd5868c13b3" acquired by "delete_volume" :: waited 0.068s {{(pid=84538) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 19:09:59 devstack cinder-volume[84538]: INFO cinder.volume.manager [None req-c338e412-bd25-40f7-8a36-7ef3ee06abe8 tempest-CreateVolumesFromSnapshotTest-1938046858 None] Deleted volume successfully. Apr 29 19:09:59 devstack cinder-volume[84538]: DEBUG oslo.privsep.daemon [-] privsep: reply[19f6d239-a23e-41ff-9365-ec07f84bfb7f]: (4, 'qcow2') {{(pid=85803) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 19:09:59 devstack cinder-volume[84538]: DEBUG oslo_concurrency.processutils [None req-7cdc988a-2c9c-4cf0-88fd-30882e8ae9c9 tempest-CreateVolumesFromSnapshotTest-1938046858 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-22adfb3f-e963-4c06-9e74-8cd5868c13b3 {{(pid=84538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 19:09:59 devstack cinder-volume[84538]: DEBUG cinder.coordination [None req-c338e412-bd25-40f7-8a36-7ef3ee06abe8 tempest-CreateVolumesFromSnapshotTest-1938046858 None] Lock "cinder-4474a441-c5bf-4439-86a5-e8e00aef1394-delete_volume" released by "delete_volume" :: held 2.761s {{(pid=84538) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 19:09:59 devstack sudo[94330]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-22adfb3f-e963-4c06-9e74-8cd5868c13b3 Apr 29 19:09:59 devstack sudo[94330]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 19:10:00 devstack sudo[94330]: pam_unix(sudo:session): session closed for user root Apr 29 19:10:00 devstack cinder-volume[84538]: DEBUG oslo_concurrency.processutils [None req-7cdc988a-2c9c-4cf0-88fd-30882e8ae9c9 tempest-CreateVolumesFromSnapshotTest-1938046858 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-22adfb3f-e963-4c06-9e74-8cd5868c13b3" returned: 0 in 1.027s {{(pid=84538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 19:10:00 devstack cinder-volume[84538]: DEBUG oslo_concurrency.processutils [None req-7cdc988a-2c9c-4cf0-88fd-30882e8ae9c9 tempest-CreateVolumesFromSnapshotTest-1938046858 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-22adfb3f-e963-4c06-9e74-8cd5868c13b3 {{(pid=84538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 19:10:00 devstack sudo[94337]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-22adfb3f-e963-4c06-9e74-8cd5868c13b3 Apr 29 19:10:00 devstack sudo[94337]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 19:10:02 devstack sudo[94337]: pam_unix(sudo:session): session closed for user root Apr 29 19:10:02 devstack cinder-volume[84538]: DEBUG oslo_concurrency.processutils [None req-7cdc988a-2c9c-4cf0-88fd-30882e8ae9c9 tempest-CreateVolumesFromSnapshotTest-1938046858 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-22adfb3f-e963-4c06-9e74-8cd5868c13b3" returned: 0 in 1.906s {{(pid=84538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 19:10:02 devstack cinder-volume[84538]: DEBUG cinder.coordination [None req-7cdc988a-2c9c-4cf0-88fd-30882e8ae9c9 tempest-CreateVolumesFromSnapshotTest-1938046858 None] Lock "cinder-quobyte-22adfb3f-e963-4c06-9e74-8cd5868c13b3" released by "delete_volume" :: held 3.037s {{(pid=84538) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 19:10:02 devstack cinder-volume[84538]: DEBUG cinder.quota [None req-7cdc988a-2c9c-4cf0-88fd-30882e8ae9c9 tempest-CreateVolumesFromSnapshotTest-1938046858 None] Created reservations ['54947229-279d-4356-bc25-dae1ec7cf0a2', '4d4ae6b4-b433-4101-a4ed-d98c98fbc8a7', '4ebf241c-44b4-4539-8c45-084bda3db033', '3713db6a-cd67-4779-bae2-cc44d50d784a'] {{(pid=84538) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 29 19:10:02 devstack cinder-volume[84538]: DEBUG oslo_concurrency.lockutils [None req-7cdc988a-2c9c-4cf0-88fd-30882e8ae9c9 tempest-CreateVolumesFromSnapshotTest-1938046858 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 19:10:02 devstack cinder-volume[84538]: DEBUG oslo_concurrency.lockutils [None req-7cdc988a-2c9c-4cf0-88fd-30882e8ae9c9 tempest-CreateVolumesFromSnapshotTest-1938046858 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 19:10:02 devstack cinder-volume[84538]: DEBUG cinder.volume.drivers.quobyte [None req-7cdc988a-2c9c-4cf0-88fd-30882e8ae9c9 tempest-CreateVolumesFromSnapshotTest-1938046858 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-34312b00-dd6d-45bb-af98-75855cea8e48': None} {{(pid=84538) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 19:10:03 devstack cinder-volume[84538]: DEBUG cinder.volume.drivers.quobyte [None req-7cdc988a-2c9c-4cf0-88fd-30882e8ae9c9 tempest-CreateVolumesFromSnapshotTest-1938046858 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-34312b00-dd6d-45bb-af98-75855cea8e48'] {{(pid=84538) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 19:10:03 devstack cinder-volume[84538]: DEBUG oslo_concurrency.lockutils [None req-7cdc988a-2c9c-4cf0-88fd-30882e8ae9c9 tempest-CreateVolumesFromSnapshotTest-1938046858 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.021s {{(pid=84538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 19:10:03 devstack cinder-volume[84538]: DEBUG oslo_concurrency.processutils [None req-7cdc988a-2c9c-4cf0-88fd-30882e8ae9c9 tempest-CreateVolumesFromSnapshotTest-1938046858 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d {{(pid=84538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 19:10:03 devstack sudo[94340]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d Apr 29 19:10:03 devstack sudo[94340]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 19:10:03 devstack cinder-volume[84538]: DEBUG cinder.coordination [None req-7adfb5ba-95df-44dc-9282-11478a969a2f tempest-CreateVolumesFromSnapshotTest-1938046858 None] Acquiring lock "cinder-89bfd338-4f29-4224-b722-56ca888584d3-delete_snapshot" by "delete_snapshot" {{(pid=84538) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 19:10:03 devstack cinder-volume[84538]: DEBUG cinder.coordination [None req-7adfb5ba-95df-44dc-9282-11478a969a2f tempest-CreateVolumesFromSnapshotTest-1938046858 None] Lock "cinder-89bfd338-4f29-4224-b722-56ca888584d3-delete_snapshot" acquired by "delete_snapshot" :: waited 0.172s {{(pid=84538) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 19:10:03 devstack cinder-volume[84538]: DEBUG cinder.coordination [None req-7adfb5ba-95df-44dc-9282-11478a969a2f tempest-CreateVolumesFromSnapshotTest-1938046858 None] Acquiring lock "cinder-quobyte-2d2109ce-37b6-478b-bb3f-990749f03fc6" by "delete_snapshot" {{(pid=84538) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 19:10:03 devstack cinder-volume[84538]: DEBUG cinder.coordination [None req-7adfb5ba-95df-44dc-9282-11478a969a2f tempest-CreateVolumesFromSnapshotTest-1938046858 None] Lock "cinder-quobyte-2d2109ce-37b6-478b-bb3f-990749f03fc6" acquired by "delete_snapshot" :: waited 0.024s {{(pid=84538) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 19:10:03 devstack cinder-volume[84538]: DEBUG cinder.coordination [None req-7adfb5ba-95df-44dc-9282-11478a969a2f tempest-CreateVolumesFromSnapshotTest-1938046858 None] Acquiring lock "cinder-quobyte-89bfd338-4f29-4224-b722-56ca888584d3" by "_delete_snapshot" {{(pid=84538) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 19:10:03 devstack cinder-volume[84538]: DEBUG cinder.coordination [None req-7adfb5ba-95df-44dc-9282-11478a969a2f tempest-CreateVolumesFromSnapshotTest-1938046858 None] Lock "cinder-quobyte-89bfd338-4f29-4224-b722-56ca888584d3" acquired by "_delete_snapshot" :: waited 0.016s {{(pid=84538) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 19:10:03 devstack cinder-volume[84538]: DEBUG cinder.volume.drivers.remotefs [None req-7adfb5ba-95df-44dc-9282-11478a969a2f tempest-CreateVolumesFromSnapshotTest-1938046858 None] Deleting offline snapshot 89bfd338-4f29-4224-b722-56ca888584d3 of volume 2d2109ce-37b6-478b-bb3f-990749f03fc6 {{(pid=84538) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 29 19:10:03 devstack cinder-volume[84538]: DEBUG cinder.volume.drivers.remotefs [None req-7adfb5ba-95df-44dc-9282-11478a969a2f tempest-CreateVolumesFromSnapshotTest-1938046858 None] snapshot_file for this snap is: volume-2d2109ce-37b6-478b-bb3f-990749f03fc6.89bfd338-4f29-4224-b722-56ca888584d3 {{(pid=84538) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 29 19:10:03 devstack cinder-volume[84538]: DEBUG oslo.privsep.daemon [-] privsep: reply[83695361-1d56-4e5f-9622-1475fd623acb]: (4, 'qcow2') {{(pid=85803) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 19:10:03 devstack cinder-volume[84538]: DEBUG oslo_concurrency.processutils [None req-7adfb5ba-95df-44dc-9282-11478a969a2f tempest-CreateVolumesFromSnapshotTest-1938046858 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-2d2109ce-37b6-478b-bb3f-990749f03fc6.89bfd338-4f29-4224-b722-56ca888584d3 {{(pid=84538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 19:10:03 devstack sudo[94313]: pam_unix(sudo:session): session closed for user root Apr 29 19:10:03 devstack cinder-volume[84538]: DEBUG oslo_concurrency.processutils [None req-1c118057-a2b7-4871-94cf-714f4f3debf8 tempest-VolumeDependencyTests-868648422 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-a64b4eb3-d814-459e-9081-f2e0e52cd475 /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-13fa762d-2e94-4381-bb35-2cb334499ba2" returned: 0 in 5.513s {{(pid=84538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 19:10:03 devstack cinder-volume[84538]: DEBUG oslo.privsep.daemon [-] privsep: reply[50241e0d-346d-4a9e-b705-4012eb7d8ed6]: (4, 'qcow2') {{(pid=85803) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 19:10:03 devstack cinder-volume[84538]: DEBUG oslo_concurrency.processutils [None req-1c118057-a2b7-4871-94cf-714f4f3debf8 tempest-VolumeDependencyTests-868648422 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-a64b4eb3-d814-459e-9081-f2e0e52cd475 {{(pid=84538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 19:10:03 devstack sudo[94342]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-2d2109ce-37b6-478b-bb3f-990749f03fc6.89bfd338-4f29-4224-b722-56ca888584d3 Apr 29 19:10:03 devstack sudo[94342]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 19:10:03 devstack sudo[94343]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-a64b4eb3-d814-459e-9081-f2e0e52cd475 Apr 29 19:10:03 devstack sudo[94343]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 19:10:03 devstack sudo[94340]: pam_unix(sudo:session): session closed for user root Apr 29 19:10:03 devstack cinder-volume[84538]: DEBUG oslo_concurrency.processutils [None req-7cdc988a-2c9c-4cf0-88fd-30882e8ae9c9 tempest-CreateVolumesFromSnapshotTest-1938046858 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d" returned: 0 in 0.884s {{(pid=84538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 19:10:03 devstack cinder-volume[84538]: DEBUG cinder.manager [None req-7cdc988a-2c9c-4cf0-88fd-30882e8ae9c9 tempest-CreateVolumesFromSnapshotTest-1938046858 None] Notifying Schedulers of capabilities ... {{(pid=84538) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 29 19:10:03 devstack cinder-volume[84538]: INFO cinder.volume.manager [None req-7cdc988a-2c9c-4cf0-88fd-30882e8ae9c9 tempest-CreateVolumesFromSnapshotTest-1938046858 None] Deleted volume successfully. Apr 29 19:10:03 devstack cinder-volume[84538]: DEBUG cinder.coordination [None req-7cdc988a-2c9c-4cf0-88fd-30882e8ae9c9 tempest-CreateVolumesFromSnapshotTest-1938046858 None] Lock "cinder-22adfb3f-e963-4c06-9e74-8cd5868c13b3-delete_volume" released by "delete_volume" :: held 4.363s {{(pid=84538) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 19:10:04 devstack sudo[94342]: pam_unix(sudo:session): session closed for user root Apr 29 19:10:04 devstack cinder-volume[84538]: DEBUG oslo_concurrency.processutils [None req-7adfb5ba-95df-44dc-9282-11478a969a2f tempest-CreateVolumesFromSnapshotTest-1938046858 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-2d2109ce-37b6-478b-bb3f-990749f03fc6.89bfd338-4f29-4224-b722-56ca888584d3" returned: 0 in 0.767s {{(pid=84538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 19:10:04 devstack cinder-volume[84538]: DEBUG cinder.volume.drivers.remotefs [None req-7adfb5ba-95df-44dc-9282-11478a969a2f tempest-CreateVolumesFromSnapshotTest-1938046858 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-2d2109ce-37b6-478b-bb3f-990749f03fc6(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=84538) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 29 19:10:04 devstack cinder-volume[84538]: DEBUG oslo.privsep.daemon [-] privsep: reply[b2c69465-db59-4205-a61b-0c48153d29dd]: (4, 'qcow2') {{(pid=85803) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 19:10:04 devstack cinder-volume[84538]: DEBUG oslo_concurrency.processutils [None req-7adfb5ba-95df-44dc-9282-11478a969a2f tempest-CreateVolumesFromSnapshotTest-1938046858 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-2d2109ce-37b6-478b-bb3f-990749f03fc6 {{(pid=84538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 19:10:04 devstack sudo[94352]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-2d2109ce-37b6-478b-bb3f-990749f03fc6 Apr 29 19:10:04 devstack sudo[94352]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 19:10:04 devstack sudo[94343]: pam_unix(sudo:session): session closed for user root Apr 29 19:10:04 devstack cinder-volume[84538]: DEBUG oslo_concurrency.processutils [None req-1c118057-a2b7-4871-94cf-714f4f3debf8 tempest-VolumeDependencyTests-868648422 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-a64b4eb3-d814-459e-9081-f2e0e52cd475" returned: 0 in 0.904s {{(pid=84538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 19:10:04 devstack cinder-volume[84538]: DEBUG cinder.image.image_utils [None req-1c118057-a2b7-4871-94cf-714f4f3debf8 tempest-VolumeDependencyTests-868648422 None] Image conversion details: src /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-a64b4eb3-d814-459e-9081-f2e0e52cd475, size 1024.00 MB, duration 5.51 sec, destination /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-13fa762d-2e94-4381-bb35-2cb334499ba2 {{(pid=84538) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}} Apr 29 19:10:04 devstack cinder-volume[84538]: INFO cinder.image.image_utils [None req-1c118057-a2b7-4871-94cf-714f4f3debf8 tempest-VolumeDependencyTests-868648422 None] Converted 1024.00 MB image at 185.71 MB/s Apr 29 19:10:04 devstack cinder-volume[84538]: WARNING cinder.volume.drivers.remotefs [None req-1c118057-a2b7-4871-94cf-714f4f3debf8 tempest-VolumeDependencyTests-868648422 None] /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-13fa762d-2e94-4381-bb35-2cb334499ba2 is being set with open permissions: ugo+rw Apr 29 19:10:04 devstack cinder-volume[84538]: DEBUG oslo_concurrency.processutils [None req-1c118057-a2b7-4871-94cf-714f4f3debf8 tempest-VolumeDependencyTests-868648422 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-13fa762d-2e94-4381-bb35-2cb334499ba2 {{(pid=84538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 19:10:04 devstack sudo[94355]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-13fa762d-2e94-4381-bb35-2cb334499ba2 Apr 29 19:10:04 devstack sudo[94355]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 19:10:05 devstack sudo[94352]: pam_unix(sudo:session): session closed for user root Apr 29 19:10:05 devstack cinder-volume[84538]: DEBUG oslo_concurrency.processutils [None req-7adfb5ba-95df-44dc-9282-11478a969a2f tempest-CreateVolumesFromSnapshotTest-1938046858 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-2d2109ce-37b6-478b-bb3f-990749f03fc6" returned: 0 in 0.703s {{(pid=84538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 19:10:05 devstack cinder-volume[84538]: DEBUG oslo_concurrency.processutils [None req-7adfb5ba-95df-44dc-9282-11478a969a2f tempest-CreateVolumesFromSnapshotTest-1938046858 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-2d2109ce-37b6-478b-bb3f-990749f03fc6.89bfd338-4f29-4224-b722-56ca888584d3 {{(pid=84538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 19:10:05 devstack sudo[94361]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-2d2109ce-37b6-478b-bb3f-990749f03fc6.89bfd338-4f29-4224-b722-56ca888584d3 Apr 29 19:10:05 devstack sudo[94361]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 19:10:05 devstack sudo[94355]: pam_unix(sudo:session): session closed for user root Apr 29 19:10:05 devstack cinder-volume[84538]: DEBUG oslo_concurrency.processutils [None req-1c118057-a2b7-4871-94cf-714f4f3debf8 tempest-VolumeDependencyTests-868648422 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-13fa762d-2e94-4381-bb35-2cb334499ba2" returned: 0 in 0.628s {{(pid=84538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 19:10:05 devstack cinder-volume[84538]: DEBUG cinder.coordination [None req-1c118057-a2b7-4871-94cf-714f4f3debf8 tempest-VolumeDependencyTests-868648422 None] Lock "cinder-quobyte-13fa762d-2e94-4381-bb35-2cb334499ba2" released by "_copy_volume_from_snapshot" :: held 8.727s {{(pid=84538) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 19:10:05 devstack cinder-volume[84538]: DEBUG cinder.coordination [None req-1c118057-a2b7-4871-94cf-714f4f3debf8 tempest-VolumeDependencyTests-868648422 None] Acquiring lock "cinder-quobyte-13b48b83-b65d-4994-8a25-ef96f12f6568" by "_delete_snapshot" {{(pid=84538) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 19:10:05 devstack cinder-volume[84538]: DEBUG cinder.coordination [None req-1c118057-a2b7-4871-94cf-714f4f3debf8 tempest-VolumeDependencyTests-868648422 None] Lock "cinder-quobyte-13b48b83-b65d-4994-8a25-ef96f12f6568" acquired by "_delete_snapshot" :: waited 0.017s {{(pid=84538) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 19:10:05 devstack cinder-volume[84538]: DEBUG cinder.volume.drivers.remotefs [None req-1c118057-a2b7-4871-94cf-714f4f3debf8 tempest-VolumeDependencyTests-868648422 None] Deleting offline snapshot 13b48b83-b65d-4994-8a25-ef96f12f6568 of volume a64b4eb3-d814-459e-9081-f2e0e52cd475 {{(pid=84538) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 29 19:10:05 devstack cinder-volume[84538]: DEBUG cinder.volume.drivers.remotefs [None req-1c118057-a2b7-4871-94cf-714f4f3debf8 tempest-VolumeDependencyTests-868648422 None] snapshot_file for this snap is: volume-a64b4eb3-d814-459e-9081-f2e0e52cd475.13b48b83-b65d-4994-8a25-ef96f12f6568 {{(pid=84538) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 29 19:10:05 devstack cinder-volume[84538]: DEBUG oslo.privsep.daemon [-] privsep: reply[961c92a1-26e2-44db-853a-40f9b05043ee]: (4, 'qcow2') {{(pid=85803) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 19:10:05 devstack cinder-volume[84538]: DEBUG oslo_concurrency.processutils [None req-1c118057-a2b7-4871-94cf-714f4f3debf8 tempest-VolumeDependencyTests-868648422 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-a64b4eb3-d814-459e-9081-f2e0e52cd475.13b48b83-b65d-4994-8a25-ef96f12f6568 {{(pid=84538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 19:10:05 devstack sudo[94363]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-a64b4eb3-d814-459e-9081-f2e0e52cd475.13b48b83-b65d-4994-8a25-ef96f12f6568 Apr 29 19:10:05 devstack sudo[94363]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 19:10:05 devstack sudo[94361]: pam_unix(sudo:session): session closed for user root Apr 29 19:10:05 devstack cinder-volume[84538]: DEBUG oslo_concurrency.processutils [None req-7adfb5ba-95df-44dc-9282-11478a969a2f tempest-CreateVolumesFromSnapshotTest-1938046858 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-2d2109ce-37b6-478b-bb3f-990749f03fc6.89bfd338-4f29-4224-b722-56ca888584d3" returned: 0 in 0.725s {{(pid=84538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 19:10:05 devstack cinder-volume[84538]: DEBUG oslo_concurrency.processutils [None req-7adfb5ba-95df-44dc-9282-11478a969a2f tempest-CreateVolumesFromSnapshotTest-1938046858 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-2d2109ce-37b6-478b-bb3f-990749f03fc6.89bfd338-4f29-4224-b722-56ca888584d3 {{(pid=84538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 19:10:05 devstack sudo[94368]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-2d2109ce-37b6-478b-bb3f-990749f03fc6.89bfd338-4f29-4224-b722-56ca888584d3 Apr 29 19:10:05 devstack sudo[94368]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 19:10:05 devstack sudo[94363]: pam_unix(sudo:session): session closed for user root Apr 29 19:10:05 devstack cinder-volume[84538]: DEBUG oslo_concurrency.processutils [None req-1c118057-a2b7-4871-94cf-714f4f3debf8 tempest-VolumeDependencyTests-868648422 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-a64b4eb3-d814-459e-9081-f2e0e52cd475.13b48b83-b65d-4994-8a25-ef96f12f6568" returned: 0 in 0.760s {{(pid=84538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 19:10:05 devstack cinder-volume[84538]: DEBUG cinder.volume.drivers.remotefs [None req-1c118057-a2b7-4871-94cf-714f4f3debf8 tempest-VolumeDependencyTests-868648422 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-a64b4eb3-d814-459e-9081-f2e0e52cd475(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=84538) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 29 19:10:06 devstack cinder-volume[84538]: DEBUG oslo.privsep.daemon [-] privsep: reply[ad451de2-349f-4d3d-948f-1114f864a1f8]: (4, 'qcow2') {{(pid=85803) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 19:10:06 devstack cinder-volume[84538]: DEBUG oslo_concurrency.processutils [None req-1c118057-a2b7-4871-94cf-714f4f3debf8 tempest-VolumeDependencyTests-868648422 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-a64b4eb3-d814-459e-9081-f2e0e52cd475 {{(pid=84538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 19:10:06 devstack sudo[94376]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-a64b4eb3-d814-459e-9081-f2e0e52cd475 Apr 29 19:10:06 devstack sudo[94376]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 19:10:06 devstack sudo[94368]: pam_unix(sudo:session): session closed for user root Apr 29 19:10:06 devstack cinder-volume[84538]: DEBUG oslo_concurrency.processutils [None req-7adfb5ba-95df-44dc-9282-11478a969a2f tempest-CreateVolumesFromSnapshotTest-1938046858 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-2d2109ce-37b6-478b-bb3f-990749f03fc6.89bfd338-4f29-4224-b722-56ca888584d3" returned: 0 in 0.615s {{(pid=84538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 19:10:06 devstack cinder-volume[84538]: DEBUG cinder.coordination [None req-7adfb5ba-95df-44dc-9282-11478a969a2f tempest-CreateVolumesFromSnapshotTest-1938046858 None] Lock "cinder-quobyte-89bfd338-4f29-4224-b722-56ca888584d3" released by "_delete_snapshot" :: held 2.948s {{(pid=84538) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 19:10:06 devstack cinder-volume[84538]: DEBUG cinder.coordination [None req-7adfb5ba-95df-44dc-9282-11478a969a2f tempest-CreateVolumesFromSnapshotTest-1938046858 None] Lock "cinder-quobyte-2d2109ce-37b6-478b-bb3f-990749f03fc6" released by "delete_snapshot" :: held 2.972s {{(pid=84538) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 19:10:06 devstack cinder-volume[84538]: DEBUG cinder.quota [None req-7adfb5ba-95df-44dc-9282-11478a969a2f tempest-CreateVolumesFromSnapshotTest-1938046858 None] Created reservations ['8188fe28-8a65-4c29-8856-fedb4f78dd5d', '778dce9d-64c6-4b62-9a78-a5ee1820c654', 'aa103b87-6675-4b32-a0ee-9515fd803cd1', '7b6aebeb-9174-4363-a056-16c437dfe74d'] {{(pid=84538) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 29 19:10:06 devstack cinder-volume[84538]: INFO cinder.volume.manager [None req-7adfb5ba-95df-44dc-9282-11478a969a2f tempest-CreateVolumesFromSnapshotTest-1938046858 None] Delete snapshot completed successfully. Apr 29 19:10:06 devstack cinder-volume[84538]: DEBUG cinder.coordination [None req-7adfb5ba-95df-44dc-9282-11478a969a2f tempest-CreateVolumesFromSnapshotTest-1938046858 None] Lock "cinder-89bfd338-4f29-4224-b722-56ca888584d3-delete_snapshot" released by "delete_snapshot" :: held 3.107s {{(pid=84538) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 19:10:06 devstack sudo[94376]: pam_unix(sudo:session): session closed for user root Apr 29 19:10:06 devstack cinder-volume[84538]: DEBUG oslo_concurrency.processutils [None req-1c118057-a2b7-4871-94cf-714f4f3debf8 tempest-VolumeDependencyTests-868648422 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-a64b4eb3-d814-459e-9081-f2e0e52cd475" returned: 0 in 0.733s {{(pid=84538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 19:10:06 devstack cinder-volume[84538]: DEBUG oslo_concurrency.processutils [None req-1c118057-a2b7-4871-94cf-714f4f3debf8 tempest-VolumeDependencyTests-868648422 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-a64b4eb3-d814-459e-9081-f2e0e52cd475.13b48b83-b65d-4994-8a25-ef96f12f6568 {{(pid=84538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 19:10:06 devstack sudo[94382]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-a64b4eb3-d814-459e-9081-f2e0e52cd475.13b48b83-b65d-4994-8a25-ef96f12f6568 Apr 29 19:10:06 devstack sudo[94382]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 19:10:07 devstack sudo[94382]: pam_unix(sudo:session): session closed for user root Apr 29 19:10:07 devstack cinder-volume[84538]: DEBUG oslo_concurrency.processutils [None req-1c118057-a2b7-4871-94cf-714f4f3debf8 tempest-VolumeDependencyTests-868648422 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-a64b4eb3-d814-459e-9081-f2e0e52cd475.13b48b83-b65d-4994-8a25-ef96f12f6568" returned: 0 in 0.660s {{(pid=84538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 19:10:07 devstack cinder-volume[84538]: DEBUG oslo_concurrency.processutils [None req-1c118057-a2b7-4871-94cf-714f4f3debf8 tempest-VolumeDependencyTests-868648422 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-a64b4eb3-d814-459e-9081-f2e0e52cd475.13b48b83-b65d-4994-8a25-ef96f12f6568 {{(pid=84538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 19:10:07 devstack sudo[94387]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-a64b4eb3-d814-459e-9081-f2e0e52cd475.13b48b83-b65d-4994-8a25-ef96f12f6568 Apr 29 19:10:07 devstack sudo[94387]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 19:10:07 devstack cinder-volume[84538]: DEBUG cinder.coordination [None req-c0511b6f-69cc-48e5-92ba-9f61ea681596 tempest-CreateVolumesFromSnapshotTest-1938046858 None] Acquiring lock "cinder-2d2109ce-37b6-478b-bb3f-990749f03fc6-delete_volume" by "delete_volume" {{(pid=84538) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 19:10:07 devstack cinder-volume[84538]: DEBUG cinder.coordination [None req-c0511b6f-69cc-48e5-92ba-9f61ea681596 tempest-CreateVolumesFromSnapshotTest-1938046858 None] Lock "cinder-2d2109ce-37b6-478b-bb3f-990749f03fc6-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=84538) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 19:10:07 devstack cinder-volume[84538]: DEBUG cinder.coordination [None req-c0511b6f-69cc-48e5-92ba-9f61ea681596 tempest-CreateVolumesFromSnapshotTest-1938046858 None] Acquiring lock "cinder-quobyte-2d2109ce-37b6-478b-bb3f-990749f03fc6" by "delete_volume" {{(pid=84538) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 19:10:07 devstack cinder-volume[84538]: DEBUG cinder.coordination [None req-c0511b6f-69cc-48e5-92ba-9f61ea681596 tempest-CreateVolumesFromSnapshotTest-1938046858 None] Lock "cinder-quobyte-2d2109ce-37b6-478b-bb3f-990749f03fc6" acquired by "delete_volume" :: waited 0.015s {{(pid=84538) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 19:10:07 devstack cinder-volume[84538]: DEBUG oslo.privsep.daemon [-] privsep: reply[600e9bd6-e96f-4bf0-90fc-767aa4d5953a]: (4, 'qcow2') {{(pid=85803) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 19:10:07 devstack cinder-volume[84538]: DEBUG oslo_concurrency.processutils [None req-c0511b6f-69cc-48e5-92ba-9f61ea681596 tempest-CreateVolumesFromSnapshotTest-1938046858 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-2d2109ce-37b6-478b-bb3f-990749f03fc6 {{(pid=84538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 19:10:07 devstack sudo[94389]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-2d2109ce-37b6-478b-bb3f-990749f03fc6 Apr 29 19:10:07 devstack sudo[94389]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 19:10:08 devstack sudo[94387]: pam_unix(sudo:session): session closed for user root Apr 29 19:10:08 devstack cinder-volume[84538]: DEBUG oslo_concurrency.processutils [None req-1c118057-a2b7-4871-94cf-714f4f3debf8 tempest-VolumeDependencyTests-868648422 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-a64b4eb3-d814-459e-9081-f2e0e52cd475.13b48b83-b65d-4994-8a25-ef96f12f6568" returned: 0 in 0.619s {{(pid=84538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 19:10:08 devstack cinder-volume[84538]: DEBUG cinder.coordination [None req-1c118057-a2b7-4871-94cf-714f4f3debf8 tempest-VolumeDependencyTests-868648422 None] Lock "cinder-quobyte-13b48b83-b65d-4994-8a25-ef96f12f6568" released by "_delete_snapshot" :: held 2.893s {{(pid=84538) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 19:10:08 devstack cinder-volume[84538]: DEBUG oslo_concurrency.lockutils [None req-1c118057-a2b7-4871-94cf-714f4f3debf8 tempest-VolumeDependencyTests-868648422 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: held 16.533s {{(pid=84538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 19:10:08 devstack cinder-volume[84538]: DEBUG oslo_concurrency.lockutils [None req-1f67b9c0-552d-44e3-ab59-c3af6946018c tempest-SnapshotDependencyTests-220526168 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 12.147s {{(pid=84538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 19:10:08 devstack cinder-volume[84538]: DEBUG cinder.volume.drivers.quobyte [None req-1f67b9c0-552d-44e3-ab59-c3af6946018c tempest-SnapshotDependencyTests-220526168 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-29T17:09:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDependencyTests-volume-1369785444',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=eda1676c-f078-4f06-beb1-99694d364faa,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f2f36b8c787d4693bef9d68f812cd2f2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T17:09:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T17:09:56Z,use_quota=True,user_id='24efb97024ea4e56b866373a52b82b15',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(62b05900-93e3-4190-a88f-1d87324303d1),volume_type_id=62b05900-93e3-4190-a88f-1d87324303d1)}" {{(pid=84538) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 29 19:10:08 devstack cinder-volume[84538]: DEBUG cinder.volume.drivers.remotefs [None req-1f67b9c0-552d-44e3-ab59-c3af6946018c tempest-SnapshotDependencyTests-220526168 None] Creating volume eda1676c-f078-4f06-beb1-99694d364faa {{(pid=84538) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 29 19:10:08 devstack cinder-volume[84538]: DEBUG oslo_concurrency.lockutils [None req-1f67b9c0-552d-44e3-ab59-c3af6946018c tempest-SnapshotDependencyTests-220526168 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 19:10:08 devstack cinder-volume[84538]: DEBUG oslo_concurrency.lockutils [None req-1f67b9c0-552d-44e3-ab59-c3af6946018c tempest-SnapshotDependencyTests-220526168 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 19:10:08 devstack cinder-volume[84538]: DEBUG cinder.volume.drivers.quobyte [None req-1f67b9c0-552d-44e3-ab59-c3af6946018c tempest-SnapshotDependencyTests-220526168 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-34312b00-dd6d-45bb-af98-75855cea8e48': None} {{(pid=84538) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 19:10:08 devstack cinder-volume[84538]: DEBUG cinder.volume.drivers.quobyte [None req-1f67b9c0-552d-44e3-ab59-c3af6946018c tempest-SnapshotDependencyTests-220526168 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-34312b00-dd6d-45bb-af98-75855cea8e48'] {{(pid=84538) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 19:10:08 devstack cinder-volume[84538]: DEBUG oslo_concurrency.lockutils [None req-1f67b9c0-552d-44e3-ab59-c3af6946018c tempest-SnapshotDependencyTests-220526168 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=84538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 19:10:08 devstack cinder-volume[84538]: DEBUG cinder.volume.drivers.quobyte [None req-1f67b9c0-552d-44e3-ab59-c3af6946018c tempest-SnapshotDependencyTests-220526168 None] Selected osci02.corp.quobyte.com/cinder-vol-34312b00-dd6d-45bb-af98-75855cea8e48 as target Quobyte volume. {{(pid=84538) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 29 19:10:08 devstack cinder-volume[84538]: INFO cinder.volume.drivers.remotefs [None req-1f67b9c0-552d-44e3-ab59-c3af6946018c tempest-SnapshotDependencyTests-220526168 None] casted to osci02.corp.quobyte.com/cinder-vol-34312b00-dd6d-45bb-af98-75855cea8e48 Apr 29 19:10:08 devstack cinder-volume[84538]: DEBUG oslo_concurrency.processutils [None req-1f67b9c0-552d-44e3-ab59-c3af6946018c tempest-SnapshotDependencyTests-220526168 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-eda1676c-f078-4f06-beb1-99694d364faa 1073741824 {{(pid=84538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 19:10:08 devstack cinder-volume[84538]: DEBUG cinder.volume.manager [None req-1c118057-a2b7-4871-94cf-714f4f3debf8 tempest-VolumeDependencyTests-868648422 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (dd8a28c6-ac7f-4655-a7cd-50731dafb08a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-13fa762d-2e94-4381-bb35-2cb334499ba2', 'volume_size': 1, 'source_volid': 'a64b4eb3-d814-459e-9081-f2e0e52cd475', 'source_volstatus': 'available'}' {{(pid=84538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 19:10:08 devstack sudo[94392]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-eda1676c-f078-4f06-beb1-99694d364faa 1073741824 Apr 29 19:10:08 devstack sudo[94392]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 19:10:08 devstack cinder-volume[84538]: DEBUG cinder.volume.manager [None req-1c118057-a2b7-4871-94cf-714f4f3debf8 tempest-VolumeDependencyTests-868648422 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (775a3346-2c9c-4308-b704-e63d78817b35) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 19:10:08 devstack cinder-volume[84538]: INFO cinder.volume.flows.manager.create_volume [None req-1c118057-a2b7-4871-94cf-714f4f3debf8 tempest-VolumeDependencyTests-868648422 None] Volume volume-13fa762d-2e94-4381-bb35-2cb334499ba2 (13fa762d-2e94-4381-bb35-2cb334499ba2): created successfully Apr 29 19:10:08 devstack cinder-volume[84538]: DEBUG cinder.volume.manager [None req-1c118057-a2b7-4871-94cf-714f4f3debf8 tempest-VolumeDependencyTests-868648422 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (775a3346-2c9c-4308-b704-e63d78817b35) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 19:10:08 devstack cinder-volume[84538]: DEBUG cinder.volume.manager [None req-1c118057-a2b7-4871-94cf-714f4f3debf8 tempest-VolumeDependencyTests-868648422 None] Flow 'volume_create_manager' (826cf5d7-0e4f-4ef8-8226-907d77a4d8d1) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84538) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 19:10:08 devstack cinder-volume[84538]: INFO cinder.volume.manager [None req-1c118057-a2b7-4871-94cf-714f4f3debf8 tempest-VolumeDependencyTests-868648422 None] Created volume successfully. Apr 29 19:10:08 devstack sudo[94389]: pam_unix(sudo:session): session closed for user root Apr 29 19:10:08 devstack cinder-volume[84538]: DEBUG oslo_concurrency.processutils [None req-c0511b6f-69cc-48e5-92ba-9f61ea681596 tempest-CreateVolumesFromSnapshotTest-1938046858 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-2d2109ce-37b6-478b-bb3f-990749f03fc6" returned: 0 in 0.715s {{(pid=84538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 19:10:08 devstack cinder-volume[84538]: DEBUG oslo_concurrency.processutils [None req-c0511b6f-69cc-48e5-92ba-9f61ea681596 tempest-CreateVolumesFromSnapshotTest-1938046858 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-2d2109ce-37b6-478b-bb3f-990749f03fc6 {{(pid=84538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 19:10:08 devstack sudo[94397]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-2d2109ce-37b6-478b-bb3f-990749f03fc6 Apr 29 19:10:08 devstack sudo[94397]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 19:10:08 devstack cinder-volume[84538]: DEBUG cinder.coordination [None req-cad6c7a4-eaae-404d-9d4e-467245068579 tempest-VolumeDependencyTests-868648422 None] Acquiring lock "cinder-a64b4eb3-d814-459e-9081-f2e0e52cd475-delete_volume" by "delete_volume" {{(pid=84538) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 19:10:08 devstack cinder-volume[84538]: DEBUG cinder.coordination [None req-cad6c7a4-eaae-404d-9d4e-467245068579 tempest-VolumeDependencyTests-868648422 None] Lock "cinder-a64b4eb3-d814-459e-9081-f2e0e52cd475-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=84538) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 19:10:08 devstack sudo[94392]: pam_unix(sudo:session): session closed for user root Apr 29 19:10:08 devstack cinder-volume[84538]: DEBUG cinder.coordination [None req-cad6c7a4-eaae-404d-9d4e-467245068579 tempest-VolumeDependencyTests-868648422 None] Acquiring lock "cinder-quobyte-a64b4eb3-d814-459e-9081-f2e0e52cd475" by "delete_volume" {{(pid=84538) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 19:10:08 devstack cinder-volume[84538]: DEBUG oslo_concurrency.processutils [None req-1f67b9c0-552d-44e3-ab59-c3af6946018c tempest-SnapshotDependencyTests-220526168 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-eda1676c-f078-4f06-beb1-99694d364faa 1073741824" returned: 0 in 0.843s {{(pid=84538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 19:10:08 devstack cinder-volume[84538]: DEBUG cinder.coordination [None req-cad6c7a4-eaae-404d-9d4e-467245068579 tempest-VolumeDependencyTests-868648422 None] Lock "cinder-quobyte-a64b4eb3-d814-459e-9081-f2e0e52cd475" acquired by "delete_volume" :: waited 0.020s {{(pid=84538) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 19:10:09 devstack sudo[94397]: pam_unix(sudo:session): session closed for user root Apr 29 19:10:09 devstack cinder-volume[84538]: DEBUG oslo_concurrency.processutils [None req-c0511b6f-69cc-48e5-92ba-9f61ea681596 tempest-CreateVolumesFromSnapshotTest-1938046858 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-2d2109ce-37b6-478b-bb3f-990749f03fc6" returned: 0 in 0.670s {{(pid=84538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 19:10:09 devstack cinder-volume[84538]: DEBUG oslo.privsep.daemon [-] privsep: reply[729fdad1-9f49-471a-9e3c-1c49e3eb7840]: (4, 'qcow2') {{(pid=85803) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 19:10:09 devstack cinder-volume[84538]: DEBUG oslo_concurrency.processutils [None req-cad6c7a4-eaae-404d-9d4e-467245068579 tempest-VolumeDependencyTests-868648422 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-a64b4eb3-d814-459e-9081-f2e0e52cd475 {{(pid=84538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 19:10:09 devstack cinder-volume[84538]: DEBUG cinder.coordination [None req-c0511b6f-69cc-48e5-92ba-9f61ea681596 tempest-CreateVolumesFromSnapshotTest-1938046858 None] Lock "cinder-quobyte-2d2109ce-37b6-478b-bb3f-990749f03fc6" released by "delete_volume" :: held 1.470s {{(pid=84538) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 19:10:09 devstack cinder-volume[84538]: DEBUG oslo_concurrency.processutils [None req-1f67b9c0-552d-44e3-ab59-c3af6946018c tempest-SnapshotDependencyTests-220526168 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-eda1676c-f078-4f06-beb1-99694d364faa {{(pid=84538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 19:10:09 devstack sudo[94405]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-eda1676c-f078-4f06-beb1-99694d364faa Apr 29 19:10:09 devstack sudo[94405]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 19:10:09 devstack cinder-volume[84538]: DEBUG cinder.quota [None req-c0511b6f-69cc-48e5-92ba-9f61ea681596 tempest-CreateVolumesFromSnapshotTest-1938046858 None] Created reservations ['771a728d-eaa8-4c4c-9b8e-07dd9b924968', '1ff37105-7bff-4ab8-961f-ab9059ca666d', 'bf457764-cff0-4865-9690-4d18e8af8573', '32ec531d-4639-4252-a207-40ec5fda9f3e'] {{(pid=84538) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 29 19:10:09 devstack sudo[94404]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-a64b4eb3-d814-459e-9081-f2e0e52cd475 Apr 29 19:10:09 devstack sudo[94404]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 19:10:09 devstack cinder-volume[84538]: DEBUG oslo_concurrency.lockutils [None req-c0511b6f-69cc-48e5-92ba-9f61ea681596 tempest-CreateVolumesFromSnapshotTest-1938046858 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 19:10:09 devstack cinder-volume[84538]: DEBUG oslo_concurrency.lockutils [None req-c0511b6f-69cc-48e5-92ba-9f61ea681596 tempest-CreateVolumesFromSnapshotTest-1938046858 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=84538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 19:10:09 devstack cinder-volume[84538]: DEBUG cinder.volume.drivers.quobyte [None req-c0511b6f-69cc-48e5-92ba-9f61ea681596 tempest-CreateVolumesFromSnapshotTest-1938046858 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-34312b00-dd6d-45bb-af98-75855cea8e48': None} {{(pid=84538) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 19:10:09 devstack cinder-volume[84538]: DEBUG cinder.volume.drivers.quobyte [None req-c0511b6f-69cc-48e5-92ba-9f61ea681596 tempest-CreateVolumesFromSnapshotTest-1938046858 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-34312b00-dd6d-45bb-af98-75855cea8e48'] {{(pid=84538) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 19:10:09 devstack cinder-volume[84538]: DEBUG oslo_concurrency.lockutils [None req-c0511b6f-69cc-48e5-92ba-9f61ea681596 tempest-CreateVolumesFromSnapshotTest-1938046858 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=84538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 19:10:09 devstack cinder-volume[84538]: DEBUG oslo_concurrency.processutils [None req-c0511b6f-69cc-48e5-92ba-9f61ea681596 tempest-CreateVolumesFromSnapshotTest-1938046858 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d {{(pid=84538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 19:10:09 devstack sudo[94408]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d Apr 29 19:10:09 devstack sudo[94408]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 19:10:09 devstack sudo[94405]: pam_unix(sudo:session): session closed for user root Apr 29 19:10:09 devstack cinder-volume[84538]: DEBUG oslo_concurrency.processutils [None req-1f67b9c0-552d-44e3-ab59-c3af6946018c tempest-SnapshotDependencyTests-220526168 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-eda1676c-f078-4f06-beb1-99694d364faa" returned: 0 in 0.640s {{(pid=84538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 19:10:09 devstack cinder-volume[84538]: DEBUG cinder.volume.drivers.quobyte [None req-1f67b9c0-552d-44e3-ab59-c3af6946018c tempest-SnapshotDependencyTests-220526168 None] <== create_volume: return (1601ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-34312b00-dd6d-45bb-af98-75855cea8e48'} {{(pid=84538) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 29 19:10:09 devstack cinder-volume[84538]: DEBUG oslo_concurrency.lockutils [None req-1f67b9c0-552d-44e3-ab59-c3af6946018c tempest-SnapshotDependencyTests-220526168 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.606s {{(pid=84538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 19:10:09 devstack cinder-volume[84538]: DEBUG cinder.volume.manager [None req-1f67b9c0-552d-44e3-ab59-c3af6946018c tempest-SnapshotDependencyTests-220526168 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1b8c784b-63be-40ff-a99d-de3f845f84c3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-eda1676c-f078-4f06-beb1-99694d364faa', 'volume_size': 1}' {{(pid=84538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 19:10:09 devstack cinder-volume[84538]: DEBUG cinder.volume.manager [None req-1f67b9c0-552d-44e3-ab59-c3af6946018c tempest-SnapshotDependencyTests-220526168 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f4be27e8-3018-4c1b-9e52-70679c5e5c68) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 19:10:09 devstack cinder-volume[84538]: INFO cinder.volume.flows.manager.create_volume [None req-1f67b9c0-552d-44e3-ab59-c3af6946018c tempest-SnapshotDependencyTests-220526168 None] Volume volume-eda1676c-f078-4f06-beb1-99694d364faa (eda1676c-f078-4f06-beb1-99694d364faa): created successfully Apr 29 19:10:09 devstack cinder-volume[84538]: DEBUG cinder.volume.manager [None req-1f67b9c0-552d-44e3-ab59-c3af6946018c tempest-SnapshotDependencyTests-220526168 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f4be27e8-3018-4c1b-9e52-70679c5e5c68) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 19:10:09 devstack cinder-volume[84538]: DEBUG cinder.volume.manager [None req-1f67b9c0-552d-44e3-ab59-c3af6946018c tempest-SnapshotDependencyTests-220526168 None] Flow 'volume_create_manager' (24f012c1-4482-4877-b500-d433a32f7006) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84538) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 19:10:09 devstack cinder-volume[84538]: INFO cinder.volume.manager [None req-1f67b9c0-552d-44e3-ab59-c3af6946018c tempest-SnapshotDependencyTests-220526168 None] Created volume successfully. Apr 29 19:10:09 devstack sudo[94408]: pam_unix(sudo:session): session closed for user root Apr 29 19:10:09 devstack cinder-volume[84538]: DEBUG oslo_concurrency.processutils [None req-c0511b6f-69cc-48e5-92ba-9f61ea681596 tempest-CreateVolumesFromSnapshotTest-1938046858 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d" returned: 0 in 0.621s {{(pid=84538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 19:10:09 devstack cinder-volume[84538]: DEBUG cinder.manager [None req-c0511b6f-69cc-48e5-92ba-9f61ea681596 tempest-CreateVolumesFromSnapshotTest-1938046858 None] Notifying Schedulers of capabilities ... {{(pid=84538) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 29 19:10:09 devstack cinder-volume[84538]: INFO cinder.volume.manager [None req-c0511b6f-69cc-48e5-92ba-9f61ea681596 tempest-CreateVolumesFromSnapshotTest-1938046858 None] Deleted volume successfully. Apr 29 19:10:09 devstack sudo[94404]: pam_unix(sudo:session): session closed for user root Apr 29 19:10:09 devstack cinder-volume[84538]: DEBUG oslo_concurrency.processutils [None req-cad6c7a4-eaae-404d-9d4e-467245068579 tempest-VolumeDependencyTests-868648422 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-a64b4eb3-d814-459e-9081-f2e0e52cd475" returned: 0 in 0.823s {{(pid=84538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 19:10:09 devstack cinder-volume[84538]: DEBUG oslo_concurrency.processutils [None req-cad6c7a4-eaae-404d-9d4e-467245068579 tempest-VolumeDependencyTests-868648422 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-a64b4eb3-d814-459e-9081-f2e0e52cd475 {{(pid=84538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 19:10:09 devstack sudo[94415]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-a64b4eb3-d814-459e-9081-f2e0e52cd475 Apr 29 19:10:09 devstack sudo[94415]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 19:10:09 devstack cinder-volume[84538]: DEBUG cinder.coordination [None req-c0511b6f-69cc-48e5-92ba-9f61ea681596 tempest-CreateVolumesFromSnapshotTest-1938046858 None] Lock "cinder-2d2109ce-37b6-478b-bb3f-990749f03fc6-delete_volume" released by "delete_volume" :: held 2.369s {{(pid=84538) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 19:10:10 devstack sudo[94415]: pam_unix(sudo:session): session closed for user root Apr 29 19:10:10 devstack cinder-volume[84538]: DEBUG oslo_concurrency.processutils [None req-cad6c7a4-eaae-404d-9d4e-467245068579 tempest-VolumeDependencyTests-868648422 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-a64b4eb3-d814-459e-9081-f2e0e52cd475" returned: 0 in 0.675s {{(pid=84538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 19:10:10 devstack cinder-volume[84538]: DEBUG cinder.coordination [None req-cad6c7a4-eaae-404d-9d4e-467245068579 tempest-VolumeDependencyTests-868648422 None] Lock "cinder-quobyte-a64b4eb3-d814-459e-9081-f2e0e52cd475" released by "delete_volume" :: held 1.580s {{(pid=84538) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 19:10:10 devstack cinder-volume[84538]: DEBUG oslo_concurrency.lockutils [None req-46004a81-eba9-4d21-9091-e005c6d33e05 tempest-SnapshotDependencyTests-220526168 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=84538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 19:10:10 devstack cinder-volume[84538]: DEBUG oslo_concurrency.lockutils [None req-46004a81-eba9-4d21-9091-e005c6d33e05 tempest-SnapshotDependencyTests-220526168 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=84538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 19:10:10 devstack cinder-volume[84538]: DEBUG cinder.volume.drivers.remotefs [None req-46004a81-eba9-4d21-9091-e005c6d33e05 tempest-SnapshotDependencyTests-220526168 None] Creating offline snapshot 588ff3c5-45a8-425a-b4da-02bd8094a686 of volume eda1676c-f078-4f06-beb1-99694d364faa {{(pid=84538) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}} Apr 29 19:10:10 devstack cinder-volume[84538]: DEBUG oslo.privsep.daemon [-] privsep: reply[abb728ef-a753-429f-8e20-4e0b128de2d4]: (4, 'qcow2') {{(pid=85803) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 19:10:10 devstack cinder-volume[84538]: DEBUG oslo_concurrency.processutils [None req-46004a81-eba9-4d21-9091-e005c6d33e05 tempest-SnapshotDependencyTests-220526168 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-eda1676c-f078-4f06-beb1-99694d364faa {{(pid=84538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 19:10:10 devstack cinder-volume[84538]: DEBUG cinder.quota [None req-cad6c7a4-eaae-404d-9d4e-467245068579 tempest-VolumeDependencyTests-868648422 None] Created reservations ['0de2c762-3234-42cd-8917-a89b091528e2', '0b95d90e-2179-4aee-9dc3-3ff5135c0dda', '48dd6f62-dfb1-4394-b9d5-811493ea394d', 'bb9e5756-610c-492a-bb20-700bb21afc54'] {{(pid=84538) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 29 19:10:10 devstack cinder-volume[84538]: DEBUG oslo_concurrency.lockutils [None req-cad6c7a4-eaae-404d-9d4e-467245068579 tempest-VolumeDependencyTests-868648422 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 19:10:10 devstack cinder-volume[84538]: DEBUG oslo_concurrency.lockutils [None req-cad6c7a4-eaae-404d-9d4e-467245068579 tempest-VolumeDependencyTests-868648422 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 19:10:10 devstack cinder-volume[84538]: DEBUG cinder.volume.drivers.quobyte [None req-cad6c7a4-eaae-404d-9d4e-467245068579 tempest-VolumeDependencyTests-868648422 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-34312b00-dd6d-45bb-af98-75855cea8e48': None} {{(pid=84538) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 19:10:10 devstack cinder-volume[84538]: DEBUG cinder.volume.drivers.quobyte [None req-cad6c7a4-eaae-404d-9d4e-467245068579 tempest-VolumeDependencyTests-868648422 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-34312b00-dd6d-45bb-af98-75855cea8e48'] {{(pid=84538) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 19:10:10 devstack cinder-volume[84538]: DEBUG oslo_concurrency.lockutils [None req-cad6c7a4-eaae-404d-9d4e-467245068579 tempest-VolumeDependencyTests-868648422 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=84538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 19:10:10 devstack cinder-volume[84538]: DEBUG oslo_concurrency.processutils [None req-cad6c7a4-eaae-404d-9d4e-467245068579 tempest-VolumeDependencyTests-868648422 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d {{(pid=84538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 19:10:10 devstack sudo[94418]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-eda1676c-f078-4f06-beb1-99694d364faa Apr 29 19:10:10 devstack sudo[94418]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 19:10:10 devstack sudo[94419]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d Apr 29 19:10:10 devstack sudo[94419]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 19:10:11 devstack cinder-volume[84538]: DEBUG cinder.coordination [None req-8c55817d-9f5c-4476-acdb-5fb758e77bac tempest-VolumeDependencyTests-868648422 None] Acquiring lock "cinder-13fa762d-2e94-4381-bb35-2cb334499ba2-delete_volume" by "delete_volume" {{(pid=84538) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 19:10:11 devstack cinder-volume[84538]: DEBUG cinder.coordination [None req-8c55817d-9f5c-4476-acdb-5fb758e77bac tempest-VolumeDependencyTests-868648422 None] Lock "cinder-13fa762d-2e94-4381-bb35-2cb334499ba2-delete_volume" acquired by "delete_volume" :: waited 0.043s {{(pid=84538) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 19:10:11 devstack cinder-volume[84538]: DEBUG cinder.coordination [None req-8c55817d-9f5c-4476-acdb-5fb758e77bac tempest-VolumeDependencyTests-868648422 None] Acquiring lock "cinder-quobyte-13fa762d-2e94-4381-bb35-2cb334499ba2" by "delete_volume" {{(pid=84538) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 19:10:11 devstack cinder-volume[84538]: DEBUG cinder.coordination [None req-8c55817d-9f5c-4476-acdb-5fb758e77bac tempest-VolumeDependencyTests-868648422 None] Lock "cinder-quobyte-13fa762d-2e94-4381-bb35-2cb334499ba2" acquired by "delete_volume" :: waited 0.022s {{(pid=84538) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 19:10:11 devstack cinder-volume[84538]: DEBUG oslo.privsep.daemon [-] privsep: reply[4edec962-f576-446f-8db4-9546621b9242]: (4, 'qcow2') {{(pid=85803) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 19:10:11 devstack cinder-volume[84538]: DEBUG oslo_concurrency.processutils [None req-8c55817d-9f5c-4476-acdb-5fb758e77bac tempest-VolumeDependencyTests-868648422 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-13fa762d-2e94-4381-bb35-2cb334499ba2 {{(pid=84538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 19:10:11 devstack sudo[94425]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-13fa762d-2e94-4381-bb35-2cb334499ba2 Apr 29 19:10:11 devstack sudo[94425]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 19:10:11 devstack sudo[94418]: pam_unix(sudo:session): session closed for user root Apr 29 19:10:11 devstack cinder-volume[84538]: DEBUG oslo_concurrency.processutils [None req-46004a81-eba9-4d21-9091-e005c6d33e05 tempest-SnapshotDependencyTests-220526168 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-eda1676c-f078-4f06-beb1-99694d364faa" returned: 0 in 0.920s {{(pid=84538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 19:10:11 devstack cinder-volume[84538]: DEBUG oslo_concurrency.processutils [None req-46004a81-eba9-4d21-9091-e005c6d33e05 tempest-SnapshotDependencyTests-220526168 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-eda1676c-f078-4f06-beb1-99694d364faa,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-eda1676c-f078-4f06-beb1-99694d364faa.588ff3c5-45a8-425a-b4da-02bd8094a686 1G {{(pid=84538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 19:10:11 devstack sudo[94428]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-eda1676c-f078-4f06-beb1-99694d364faa,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-eda1676c-f078-4f06-beb1-99694d364faa.588ff3c5-45a8-425a-b4da-02bd8094a686 1G Apr 29 19:10:11 devstack sudo[94419]: pam_unix(sudo:session): session closed for user root Apr 29 19:10:11 devstack sudo[94428]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 19:10:11 devstack cinder-volume[84538]: DEBUG oslo_concurrency.processutils [None req-cad6c7a4-eaae-404d-9d4e-467245068579 tempest-VolumeDependencyTests-868648422 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d" returned: 0 in 0.830s {{(pid=84538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 19:10:11 devstack cinder-volume[84538]: DEBUG cinder.manager [None req-cad6c7a4-eaae-404d-9d4e-467245068579 tempest-VolumeDependencyTests-868648422 None] Notifying Schedulers of capabilities ... {{(pid=84538) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 29 19:10:11 devstack cinder-volume[84538]: INFO cinder.volume.manager [None req-cad6c7a4-eaae-404d-9d4e-467245068579 tempest-VolumeDependencyTests-868648422 None] Deleted volume successfully. Apr 29 19:10:11 devstack cinder-volume[84538]: DEBUG cinder.coordination [None req-cad6c7a4-eaae-404d-9d4e-467245068579 tempest-VolumeDependencyTests-868648422 None] Lock "cinder-a64b4eb3-d814-459e-9081-f2e0e52cd475-delete_volume" released by "delete_volume" :: held 2.693s {{(pid=84538) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 19:10:12 devstack sudo[94425]: pam_unix(sudo:session): session closed for user root Apr 29 19:10:12 devstack cinder-volume[84538]: DEBUG oslo_concurrency.processutils [None req-8c55817d-9f5c-4476-acdb-5fb758e77bac tempest-VolumeDependencyTests-868648422 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-13fa762d-2e94-4381-bb35-2cb334499ba2" returned: 0 in 0.796s {{(pid=84538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 19:10:12 devstack cinder-volume[84538]: DEBUG oslo_concurrency.processutils [None req-8c55817d-9f5c-4476-acdb-5fb758e77bac tempest-VolumeDependencyTests-868648422 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-13fa762d-2e94-4381-bb35-2cb334499ba2 {{(pid=84538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 19:10:12 devstack sudo[94436]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-13fa762d-2e94-4381-bb35-2cb334499ba2 Apr 29 19:10:12 devstack sudo[94436]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 19:10:12 devstack sudo[94428]: pam_unix(sudo:session): session closed for user root Apr 29 19:10:12 devstack cinder-volume[84538]: DEBUG oslo_concurrency.processutils [None req-46004a81-eba9-4d21-9091-e005c6d33e05 tempest-SnapshotDependencyTests-220526168 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-eda1676c-f078-4f06-beb1-99694d364faa,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-eda1676c-f078-4f06-beb1-99694d364faa.588ff3c5-45a8-425a-b4da-02bd8094a686 1G" returned: 0 in 0.878s {{(pid=84538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 19:10:12 devstack cinder-volume[84538]: DEBUG oslo_concurrency.processutils [None req-46004a81-eba9-4d21-9091-e005c6d33e05 tempest-SnapshotDependencyTests-220526168 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-eda1676c-f078-4f06-beb1-99694d364faa -F qcow2 /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-eda1676c-f078-4f06-beb1-99694d364faa.588ff3c5-45a8-425a-b4da-02bd8094a686 {{(pid=84538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 19:10:12 devstack sudo[94439]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-eda1676c-f078-4f06-beb1-99694d364faa -F qcow2 /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-eda1676c-f078-4f06-beb1-99694d364faa.588ff3c5-45a8-425a-b4da-02bd8094a686 Apr 29 19:10:12 devstack sudo[94439]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 19:10:12 devstack sudo[94436]: pam_unix(sudo:session): session closed for user root Apr 29 19:10:12 devstack cinder-volume[84538]: DEBUG oslo_concurrency.processutils [None req-8c55817d-9f5c-4476-acdb-5fb758e77bac tempest-VolumeDependencyTests-868648422 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-13fa762d-2e94-4381-bb35-2cb334499ba2" returned: 0 in 0.631s {{(pid=84538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 19:10:12 devstack cinder-volume[84538]: DEBUG cinder.coordination [None req-8c55817d-9f5c-4476-acdb-5fb758e77bac tempest-VolumeDependencyTests-868648422 None] Lock "cinder-quobyte-13fa762d-2e94-4381-bb35-2cb334499ba2" released by "delete_volume" :: held 1.494s {{(pid=84538) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 19:10:12 devstack cinder-volume[84538]: DEBUG cinder.quota [None req-8c55817d-9f5c-4476-acdb-5fb758e77bac tempest-VolumeDependencyTests-868648422 None] Created reservations ['ab96dcf3-33fb-449c-8416-dcf037d25de5', '07af3a9f-a800-4054-bb44-cd2558e8b5b2', '2b99ec50-6506-468f-8c31-cd4dc37ad8d6', '917fdedf-9f3c-4421-90ae-9253c0b5496f'] {{(pid=84538) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 29 19:10:12 devstack cinder-volume[84538]: DEBUG cinder.volume.flows.manager.create_volume [None req-5011bc02-9216-497b-a26a-f995fcf858be tempest-CreateVolumesFromSourceVolumeTest-1326097673 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84538) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Apr 29 19:10:12 devstack cinder-volume[84538]: DEBUG cinder.volume.manager [None req-5011bc02-9216-497b-a26a-f995fcf858be tempest-CreateVolumesFromSourceVolumeTest-1326097673 None] Flow 'volume_create_manager' (d980864c-649e-4bdd-8c73-6c826f46341b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84538) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 19:10:12 devstack cinder-volume[84538]: DEBUG cinder.volume.manager [None req-5011bc02-9216-497b-a26a-f995fcf858be tempest-CreateVolumesFromSourceVolumeTest-1326097673 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3b2458d7-ec09-4eb4-aa05-d11c5434f6e0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 19:10:12 devstack cinder-volume[84538]: DEBUG cinder.volume.manager [None req-5011bc02-9216-497b-a26a-f995fcf858be tempest-CreateVolumesFromSourceVolumeTest-1326097673 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3b2458d7-ec09-4eb4-aa05-d11c5434f6e0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-29T17:10:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-185675842',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d2c97420-eac1-4385-b368-e7c97405d398,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f0f77d776291439f94be3377da80ddc1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T17:10:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T17:10:13Z,use_quota=True,user_id='de7143a50d0a4e579e2e95a28ec120d6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(62b05900-93e3-4190-a88f-1d87324303d1),volume_type_id=62b05900-93e3-4190-a88f-1d87324303d1)' {{(pid=84538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 19:10:12 devstack cinder-volume[84538]: DEBUG cinder.volume.manager [None req-5011bc02-9216-497b-a26a-f995fcf858be tempest-CreateVolumesFromSourceVolumeTest-1326097673 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bc834465-9184-4e38-b474-444b1c510477) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 19:10:12 devstack cinder-volume[84538]: DEBUG cinder.volume.manager [None req-5011bc02-9216-497b-a26a-f995fcf858be tempest-CreateVolumesFromSourceVolumeTest-1326097673 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bc834465-9184-4e38-b474-444b1c510477) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 19:10:12 devstack cinder-volume[84538]: DEBUG cinder.volume.manager [None req-5011bc02-9216-497b-a26a-f995fcf858be tempest-CreateVolumesFromSourceVolumeTest-1326097673 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d251b7a1-8d09-4959-afac-aa58f602f23f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 19:10:13 devstack cinder-volume[84538]: DEBUG cinder.volume.manager [None req-5011bc02-9216-497b-a26a-f995fcf858be tempest-CreateVolumesFromSourceVolumeTest-1326097673 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d251b7a1-8d09-4959-afac-aa58f602f23f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd2c97420-eac1-4385-b368-e7c97405d398', 'volume_name': 'volume-d2c97420-eac1-4385-b368-e7c97405d398', 'volume_size': 1}' {{(pid=84538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 19:10:13 devstack cinder-volume[84538]: DEBUG cinder.volume.manager [None req-5011bc02-9216-497b-a26a-f995fcf858be tempest-CreateVolumesFromSourceVolumeTest-1326097673 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (470be092-f665-46b8-9c37-c34babe24e7d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 19:10:13 devstack cinder-volume[84538]: DEBUG cinder.volume.manager [None req-5011bc02-9216-497b-a26a-f995fcf858be tempest-CreateVolumesFromSourceVolumeTest-1326097673 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (470be092-f665-46b8-9c37-c34babe24e7d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 19:10:13 devstack cinder-volume[84538]: DEBUG cinder.volume.manager [None req-5011bc02-9216-497b-a26a-f995fcf858be tempest-CreateVolumesFromSourceVolumeTest-1326097673 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8275eeca-76ca-4313-aa34-01206d5efe3a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 19:10:13 devstack cinder-volume[84538]: INFO cinder.volume.flows.manager.create_volume [None req-5011bc02-9216-497b-a26a-f995fcf858be tempest-CreateVolumesFromSourceVolumeTest-1326097673 None] Volume d2c97420-eac1-4385-b368-e7c97405d398: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d2c97420-eac1-4385-b368-e7c97405d398', 'volume_size': 1} Apr 29 19:10:13 devstack cinder-volume[84538]: DEBUG oslo_concurrency.lockutils [None req-5011bc02-9216-497b-a26a-f995fcf858be tempest-CreateVolumesFromSourceVolumeTest-1326097673 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 19:10:13 devstack cinder-volume[84538]: DEBUG oslo_concurrency.lockutils [None req-8c55817d-9f5c-4476-acdb-5fb758e77bac tempest-VolumeDependencyTests-868648422 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 19:10:13 devstack cinder-volume[84538]: DEBUG oslo_concurrency.lockutils [None req-8c55817d-9f5c-4476-acdb-5fb758e77bac tempest-VolumeDependencyTests-868648422 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 19:10:13 devstack cinder-volume[84538]: DEBUG cinder.volume.drivers.quobyte [None req-8c55817d-9f5c-4476-acdb-5fb758e77bac tempest-VolumeDependencyTests-868648422 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-34312b00-dd6d-45bb-af98-75855cea8e48': None} {{(pid=84538) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 19:10:13 devstack cinder-volume[84538]: DEBUG cinder.volume.drivers.quobyte [None req-8c55817d-9f5c-4476-acdb-5fb758e77bac tempest-VolumeDependencyTests-868648422 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-34312b00-dd6d-45bb-af98-75855cea8e48'] {{(pid=84538) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 19:10:13 devstack cinder-volume[84538]: DEBUG oslo_concurrency.lockutils [None req-8c55817d-9f5c-4476-acdb-5fb758e77bac tempest-VolumeDependencyTests-868648422 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=84538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 19:10:13 devstack cinder-volume[84538]: DEBUG oslo_concurrency.processutils [None req-8c55817d-9f5c-4476-acdb-5fb758e77bac tempest-VolumeDependencyTests-868648422 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d {{(pid=84538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 19:10:13 devstack sudo[94439]: pam_unix(sudo:session): session closed for user root Apr 29 19:10:13 devstack cinder-volume[84538]: DEBUG oslo_concurrency.processutils [None req-46004a81-eba9-4d21-9091-e005c6d33e05 tempest-SnapshotDependencyTests-220526168 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-eda1676c-f078-4f06-beb1-99694d364faa -F qcow2 /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-eda1676c-f078-4f06-beb1-99694d364faa.588ff3c5-45a8-425a-b4da-02bd8094a686" returned: 0 in 0.668s {{(pid=84538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 19:10:13 devstack cinder-volume[84538]: WARNING cinder.volume.drivers.remotefs [None req-46004a81-eba9-4d21-9091-e005c6d33e05 tempest-SnapshotDependencyTests-220526168 None] /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-eda1676c-f078-4f06-beb1-99694d364faa.588ff3c5-45a8-425a-b4da-02bd8094a686 is being set with open permissions: ugo+rw Apr 29 19:10:13 devstack sudo[94445]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d Apr 29 19:10:13 devstack cinder-volume[84538]: DEBUG oslo_concurrency.processutils [None req-46004a81-eba9-4d21-9091-e005c6d33e05 tempest-SnapshotDependencyTests-220526168 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-eda1676c-f078-4f06-beb1-99694d364faa.588ff3c5-45a8-425a-b4da-02bd8094a686 {{(pid=84538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 19:10:13 devstack sudo[94445]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 19:10:13 devstack sudo[94447]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-eda1676c-f078-4f06-beb1-99694d364faa.588ff3c5-45a8-425a-b4da-02bd8094a686 Apr 29 19:10:13 devstack sudo[94447]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 19:10:13 devstack cinder-volume[84538]: DEBUG cinder.coordination [None req-ae19eed7-f6b3-446a-a895-8f38432aec34 tempest-VolumeDependencyTests-868648422 None] Acquiring lock "cinder-90a642e5-d251-44d5-aa73-d01b4f57c2b2-delete_volume" by "delete_volume" {{(pid=84538) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 19:10:13 devstack cinder-volume[84538]: DEBUG cinder.coordination [None req-ae19eed7-f6b3-446a-a895-8f38432aec34 tempest-VolumeDependencyTests-868648422 None] Lock "cinder-90a642e5-d251-44d5-aa73-d01b4f57c2b2-delete_volume" acquired by "delete_volume" :: waited 0.033s {{(pid=84538) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 19:10:13 devstack cinder-volume[84538]: DEBUG cinder.coordination [None req-ae19eed7-f6b3-446a-a895-8f38432aec34 tempest-VolumeDependencyTests-868648422 None] Acquiring lock "cinder-quobyte-90a642e5-d251-44d5-aa73-d01b4f57c2b2" by "delete_volume" {{(pid=84538) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 19:10:13 devstack cinder-volume[84538]: DEBUG cinder.coordination [None req-ae19eed7-f6b3-446a-a895-8f38432aec34 tempest-VolumeDependencyTests-868648422 None] Lock "cinder-quobyte-90a642e5-d251-44d5-aa73-d01b4f57c2b2" acquired by "delete_volume" :: waited 0.018s {{(pid=84538) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 19:10:13 devstack cinder-volume[84538]: DEBUG oslo.privsep.daemon [-] privsep: reply[e076c0f0-1c96-40cb-bfe8-68e73e222a97]: (4, 'qcow2') {{(pid=85803) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 19:10:13 devstack cinder-volume[84538]: DEBUG oslo_concurrency.processutils [None req-ae19eed7-f6b3-446a-a895-8f38432aec34 tempest-VolumeDependencyTests-868648422 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-90a642e5-d251-44d5-aa73-d01b4f57c2b2 {{(pid=84538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 19:10:13 devstack sudo[94445]: pam_unix(sudo:session): session closed for user root Apr 29 19:10:13 devstack cinder-volume[84538]: DEBUG oslo_concurrency.processutils [None req-8c55817d-9f5c-4476-acdb-5fb758e77bac tempest-VolumeDependencyTests-868648422 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d" returned: 0 in 0.630s {{(pid=84538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 19:10:13 devstack cinder-volume[84538]: DEBUG cinder.manager [None req-8c55817d-9f5c-4476-acdb-5fb758e77bac tempest-VolumeDependencyTests-868648422 None] Notifying Schedulers of capabilities ... {{(pid=84538) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 29 19:10:13 devstack cinder-volume[84538]: INFO cinder.volume.manager [None req-8c55817d-9f5c-4476-acdb-5fb758e77bac tempest-VolumeDependencyTests-868648422 None] Deleted volume successfully. Apr 29 19:10:13 devstack sudo[94447]: pam_unix(sudo:session): session closed for user root Apr 29 19:10:13 devstack cinder-volume[84538]: DEBUG oslo_concurrency.processutils [None req-46004a81-eba9-4d21-9091-e005c6d33e05 tempest-SnapshotDependencyTests-220526168 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-eda1676c-f078-4f06-beb1-99694d364faa.588ff3c5-45a8-425a-b4da-02bd8094a686" returned: 0 in 0.628s {{(pid=84538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 19:10:13 devstack cinder-volume[84538]: DEBUG cinder.coordination [None req-8c55817d-9f5c-4476-acdb-5fb758e77bac tempest-VolumeDependencyTests-868648422 None] Lock "cinder-13fa762d-2e94-4381-bb35-2cb334499ba2-delete_volume" released by "delete_volume" :: held 2.501s {{(pid=84538) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 19:10:13 devstack cinder-volume[84538]: DEBUG oslo_concurrency.processutils [None req-46004a81-eba9-4d21-9091-e005c6d33e05 tempest-SnapshotDependencyTests-220526168 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-eda1676c-f078-4f06-beb1-99694d364faa.info {{(pid=84538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 19:10:13 devstack sudo[94452]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-eda1676c-f078-4f06-beb1-99694d364faa.info Apr 29 19:10:13 devstack sudo[94452]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 19:10:13 devstack sudo[94451]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-90a642e5-d251-44d5-aa73-d01b4f57c2b2 Apr 29 19:10:13 devstack sudo[94451]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 19:10:14 devstack sudo[94452]: pam_unix(sudo:session): session closed for user root Apr 29 19:10:14 devstack cinder-volume[84538]: DEBUG oslo_concurrency.processutils [None req-46004a81-eba9-4d21-9091-e005c6d33e05 tempest-SnapshotDependencyTests-220526168 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-eda1676c-f078-4f06-beb1-99694d364faa.info" returned: 0 in 0.642s {{(pid=84538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 19:10:14 devstack cinder-volume[84538]: WARNING cinder.volume.drivers.remotefs [None req-46004a81-eba9-4d21-9091-e005c6d33e05 tempest-SnapshotDependencyTests-220526168 None] /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-eda1676c-f078-4f06-beb1-99694d364faa.info is being set with open permissions: ugo+rw Apr 29 19:10:14 devstack cinder-volume[84538]: DEBUG oslo_concurrency.processutils [None req-46004a81-eba9-4d21-9091-e005c6d33e05 tempest-SnapshotDependencyTests-220526168 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-eda1676c-f078-4f06-beb1-99694d364faa.info {{(pid=84538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 19:10:14 devstack sudo[94459]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-eda1676c-f078-4f06-beb1-99694d364faa.info Apr 29 19:10:14 devstack sudo[94459]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 19:10:14 devstack sudo[94451]: pam_unix(sudo:session): session closed for user root Apr 29 19:10:14 devstack cinder-volume[84538]: DEBUG oslo_concurrency.processutils [None req-ae19eed7-f6b3-446a-a895-8f38432aec34 tempest-VolumeDependencyTests-868648422 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-90a642e5-d251-44d5-aa73-d01b4f57c2b2" returned: 0 in 0.766s {{(pid=84538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 19:10:14 devstack cinder-volume[84538]: DEBUG oslo_concurrency.processutils [None req-ae19eed7-f6b3-446a-a895-8f38432aec34 tempest-VolumeDependencyTests-868648422 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-90a642e5-d251-44d5-aa73-d01b4f57c2b2 {{(pid=84538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 19:10:14 devstack sudo[94461]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-90a642e5-d251-44d5-aa73-d01b4f57c2b2 Apr 29 19:10:14 devstack sudo[94461]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 19:10:15 devstack sudo[94459]: pam_unix(sudo:session): session closed for user root Apr 29 19:10:15 devstack cinder-volume[84538]: DEBUG oslo_concurrency.processutils [None req-46004a81-eba9-4d21-9091-e005c6d33e05 tempest-SnapshotDependencyTests-220526168 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-eda1676c-f078-4f06-beb1-99694d364faa.info" returned: 0 in 0.606s {{(pid=84538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 19:10:15 devstack cinder-volume[84538]: DEBUG oslo_concurrency.lockutils [None req-46004a81-eba9-4d21-9091-e005c6d33e05 tempest-SnapshotDependencyTests-220526168 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.440s {{(pid=84538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 19:10:15 devstack cinder-volume[84538]: DEBUG oslo_concurrency.lockutils [None req-5011bc02-9216-497b-a26a-f995fcf858be tempest-CreateVolumesFromSourceVolumeTest-1326097673 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.006s {{(pid=84538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 19:10:15 devstack cinder-volume[84538]: DEBUG cinder.volume.drivers.quobyte [None req-5011bc02-9216-497b-a26a-f995fcf858be tempest-CreateVolumesFromSourceVolumeTest-1326097673 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-29T17:10:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-185675842',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d2c97420-eac1-4385-b368-e7c97405d398,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f0f77d776291439f94be3377da80ddc1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T17:10:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T17:10:13Z,use_quota=True,user_id='de7143a50d0a4e579e2e95a28ec120d6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(62b05900-93e3-4190-a88f-1d87324303d1),volume_type_id=62b05900-93e3-4190-a88f-1d87324303d1)}" {{(pid=84538) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 29 19:10:15 devstack cinder-volume[84538]: DEBUG cinder.volume.drivers.remotefs [None req-5011bc02-9216-497b-a26a-f995fcf858be tempest-CreateVolumesFromSourceVolumeTest-1326097673 None] Creating volume d2c97420-eac1-4385-b368-e7c97405d398 {{(pid=84538) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 29 19:10:15 devstack cinder-volume[84538]: DEBUG oslo_concurrency.lockutils [None req-5011bc02-9216-497b-a26a-f995fcf858be tempest-CreateVolumesFromSourceVolumeTest-1326097673 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 19:10:15 devstack cinder-volume[84538]: DEBUG oslo_concurrency.lockutils [None req-5011bc02-9216-497b-a26a-f995fcf858be tempest-CreateVolumesFromSourceVolumeTest-1326097673 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=84538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 19:10:15 devstack cinder-volume[84538]: DEBUG cinder.volume.drivers.quobyte [None req-5011bc02-9216-497b-a26a-f995fcf858be tempest-CreateVolumesFromSourceVolumeTest-1326097673 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-34312b00-dd6d-45bb-af98-75855cea8e48': None} {{(pid=84538) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 19:10:15 devstack cinder-volume[84538]: DEBUG cinder.volume.drivers.quobyte [None req-5011bc02-9216-497b-a26a-f995fcf858be tempest-CreateVolumesFromSourceVolumeTest-1326097673 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-34312b00-dd6d-45bb-af98-75855cea8e48'] {{(pid=84538) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 19:10:15 devstack cinder-volume[84538]: DEBUG oslo_concurrency.lockutils [None req-5011bc02-9216-497b-a26a-f995fcf858be tempest-CreateVolumesFromSourceVolumeTest-1326097673 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=84538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 19:10:15 devstack cinder-volume[84538]: DEBUG cinder.volume.drivers.quobyte [None req-5011bc02-9216-497b-a26a-f995fcf858be tempest-CreateVolumesFromSourceVolumeTest-1326097673 None] Selected osci02.corp.quobyte.com/cinder-vol-34312b00-dd6d-45bb-af98-75855cea8e48 as target Quobyte volume. {{(pid=84538) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 29 19:10:15 devstack cinder-volume[84538]: INFO cinder.volume.drivers.remotefs [None req-5011bc02-9216-497b-a26a-f995fcf858be tempest-CreateVolumesFromSourceVolumeTest-1326097673 None] casted to osci02.corp.quobyte.com/cinder-vol-34312b00-dd6d-45bb-af98-75855cea8e48 Apr 29 19:10:15 devstack cinder-volume[84538]: DEBUG oslo_concurrency.processutils [None req-5011bc02-9216-497b-a26a-f995fcf858be tempest-CreateVolumesFromSourceVolumeTest-1326097673 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-d2c97420-eac1-4385-b368-e7c97405d398 1073741824 {{(pid=84538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 19:10:15 devstack sudo[94461]: pam_unix(sudo:session): session closed for user root Apr 29 19:10:15 devstack cinder-volume[84538]: DEBUG oslo_concurrency.processutils [None req-ae19eed7-f6b3-446a-a895-8f38432aec34 tempest-VolumeDependencyTests-868648422 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-90a642e5-d251-44d5-aa73-d01b4f57c2b2" returned: 0 in 0.620s {{(pid=84538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 19:10:15 devstack sudo[94465]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-d2c97420-eac1-4385-b368-e7c97405d398 1073741824 Apr 29 19:10:15 devstack sudo[94465]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 19:10:15 devstack cinder-volume[84538]: DEBUG cinder.coordination [None req-ae19eed7-f6b3-446a-a895-8f38432aec34 tempest-VolumeDependencyTests-868648422 None] Lock "cinder-quobyte-90a642e5-d251-44d5-aa73-d01b4f57c2b2" released by "delete_volume" :: held 1.435s {{(pid=84538) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 19:10:15 devstack cinder-volume[84538]: INFO cinder.volume.manager [None req-46004a81-eba9-4d21-9091-e005c6d33e05 tempest-SnapshotDependencyTests-220526168 None] Create snapshot completed successfully Apr 29 19:10:15 devstack cinder-volume[84538]: DEBUG cinder.quota [None req-ae19eed7-f6b3-446a-a895-8f38432aec34 tempest-VolumeDependencyTests-868648422 None] Created reservations ['8520865f-a991-41a5-8844-389fa7f267c2', '59c5c9a4-2261-4a95-b256-b39e59e7ea2a', '79dd84b1-330c-4558-adc4-97800e8e45d8', 'c81c2600-a728-43a5-b5c0-3b640628a53e'] {{(pid=84538) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 29 19:10:15 devstack cinder-volume[84538]: DEBUG oslo_concurrency.lockutils [None req-ae19eed7-f6b3-446a-a895-8f38432aec34 tempest-VolumeDependencyTests-868648422 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 19:10:15 devstack cinder-volume[84538]: DEBUG oslo_concurrency.lockutils [None req-ae19eed7-f6b3-446a-a895-8f38432aec34 tempest-VolumeDependencyTests-868648422 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 19:10:15 devstack cinder-volume[84538]: DEBUG cinder.volume.drivers.quobyte [None req-ae19eed7-f6b3-446a-a895-8f38432aec34 tempest-VolumeDependencyTests-868648422 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-34312b00-dd6d-45bb-af98-75855cea8e48': None} {{(pid=84538) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 19:10:15 devstack cinder-volume[84538]: DEBUG cinder.volume.drivers.quobyte [None req-ae19eed7-f6b3-446a-a895-8f38432aec34 tempest-VolumeDependencyTests-868648422 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-34312b00-dd6d-45bb-af98-75855cea8e48'] {{(pid=84538) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 19:10:15 devstack cinder-volume[84538]: DEBUG oslo_concurrency.lockutils [None req-ae19eed7-f6b3-446a-a895-8f38432aec34 tempest-VolumeDependencyTests-868648422 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=84538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 19:10:15 devstack cinder-volume[84538]: DEBUG oslo_concurrency.processutils [None req-ae19eed7-f6b3-446a-a895-8f38432aec34 tempest-VolumeDependencyTests-868648422 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d {{(pid=84538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 19:10:15 devstack sudo[94467]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d Apr 29 19:10:15 devstack sudo[94467]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 19:10:15 devstack sudo[94467]: pam_unix(sudo:session): session closed for user root Apr 29 19:10:15 devstack cinder-volume[84538]: DEBUG oslo_concurrency.processutils [None req-ae19eed7-f6b3-446a-a895-8f38432aec34 tempest-VolumeDependencyTests-868648422 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d" returned: 0 in 0.607s {{(pid=84538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 19:10:15 devstack cinder-volume[84538]: DEBUG cinder.manager [None req-ae19eed7-f6b3-446a-a895-8f38432aec34 tempest-VolumeDependencyTests-868648422 None] Notifying Schedulers of capabilities ... {{(pid=84538) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 29 19:10:15 devstack cinder-volume[84538]: INFO cinder.volume.manager [None req-ae19eed7-f6b3-446a-a895-8f38432aec34 tempest-VolumeDependencyTests-868648422 None] Deleted volume successfully. Apr 29 19:10:15 devstack cinder-volume[84538]: DEBUG cinder.coordination [None req-ae19eed7-f6b3-446a-a895-8f38432aec34 tempest-VolumeDependencyTests-868648422 None] Lock "cinder-90a642e5-d251-44d5-aa73-d01b4f57c2b2-delete_volume" released by "delete_volume" :: held 2.269s {{(pid=84538) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 19:10:15 devstack sudo[94465]: pam_unix(sudo:session): session closed for user root Apr 29 19:10:15 devstack cinder-volume[84538]: DEBUG oslo_concurrency.processutils [None req-5011bc02-9216-497b-a26a-f995fcf858be tempest-CreateVolumesFromSourceVolumeTest-1326097673 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-d2c97420-eac1-4385-b368-e7c97405d398 1073741824" returned: 0 in 0.866s {{(pid=84538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 19:10:15 devstack cinder-volume[84538]: DEBUG oslo_concurrency.processutils [None req-5011bc02-9216-497b-a26a-f995fcf858be tempest-CreateVolumesFromSourceVolumeTest-1326097673 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-d2c97420-eac1-4385-b368-e7c97405d398 {{(pid=84538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 19:10:15 devstack sudo[94473]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-d2c97420-eac1-4385-b368-e7c97405d398 Apr 29 19:10:15 devstack sudo[94473]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 19:10:16 devstack cinder-volume[84538]: DEBUG cinder.volume.flows.manager.create_volume [None req-ea99661e-e762-4a46-ab98-7805a229ca41 tempest-SnapshotDependencyTests-220526168 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84538) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Apr 29 19:10:16 devstack cinder-volume[84538]: DEBUG cinder.volume.manager [None req-ea99661e-e762-4a46-ab98-7805a229ca41 tempest-SnapshotDependencyTests-220526168 None] Flow 'volume_create_manager' (65eb93f5-d5da-4ab6-aab9-385bf228b27d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84538) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 19:10:16 devstack cinder-volume[84538]: DEBUG cinder.volume.manager [None req-ea99661e-e762-4a46-ab98-7805a229ca41 tempest-SnapshotDependencyTests-220526168 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7c72433c-d636-46f4-b3d3-7f6eaaf6a103) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 19:10:16 devstack cinder-volume[84538]: DEBUG cinder.volume.manager [None req-ea99661e-e762-4a46-ab98-7805a229ca41 tempest-SnapshotDependencyTests-220526168 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7c72433c-d636-46f4-b3d3-7f6eaaf6a103) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-29T17:10:16Z,deleted=False,deleted_at=None,display_description=None,display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=64cda84e-3ede-44e2-b879-2f19a175f02c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f2f36b8c787d4693bef9d68f812cd2f2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T17:10:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=588ff3c5-45a8-425a-b4da-02bd8094a686,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T17:10:16Z,use_quota=True,user_id='24efb97024ea4e56b866373a52b82b15',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(62b05900-93e3-4190-a88f-1d87324303d1),volume_type_id=62b05900-93e3-4190-a88f-1d87324303d1)' {{(pid=84538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 19:10:16 devstack cinder-volume[84538]: DEBUG cinder.volume.manager [None req-ea99661e-e762-4a46-ab98-7805a229ca41 tempest-SnapshotDependencyTests-220526168 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5f8f5538-4903-4228-ac98-84f0a15bca45) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 19:10:16 devstack cinder-volume[84538]: DEBUG cinder.volume.manager [None req-ea99661e-e762-4a46-ab98-7805a229ca41 tempest-SnapshotDependencyTests-220526168 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5f8f5538-4903-4228-ac98-84f0a15bca45) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 19:10:16 devstack cinder-volume[84538]: DEBUG cinder.volume.manager [None req-ea99661e-e762-4a46-ab98-7805a229ca41 tempest-SnapshotDependencyTests-220526168 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e490a0e0-2364-4e06-b786-0f98986f81d4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 19:10:16 devstack cinder-volume[84538]: DEBUG cinder.volume.manager [None req-ea99661e-e762-4a46-ab98-7805a229ca41 tempest-SnapshotDependencyTests-220526168 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e490a0e0-2364-4e06-b786-0f98986f81d4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '64cda84e-3ede-44e2-b879-2f19a175f02c', 'volume_name': 'volume-64cda84e-3ede-44e2-b879-2f19a175f02c', 'volume_size': 1, 'snapshot_id': '588ff3c5-45a8-425a-b4da-02bd8094a686'}' {{(pid=84538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 19:10:16 devstack cinder-volume[84538]: DEBUG cinder.volume.manager [None req-ea99661e-e762-4a46-ab98-7805a229ca41 tempest-SnapshotDependencyTests-220526168 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (31ffc433-b90c-41de-ba4b-78dd4c419a88) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 19:10:16 devstack cinder-volume[84538]: DEBUG cinder.volume.manager [None req-ea99661e-e762-4a46-ab98-7805a229ca41 tempest-SnapshotDependencyTests-220526168 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (31ffc433-b90c-41de-ba4b-78dd4c419a88) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 19:10:16 devstack cinder-volume[84538]: DEBUG cinder.volume.manager [None req-ea99661e-e762-4a46-ab98-7805a229ca41 tempest-SnapshotDependencyTests-220526168 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (79d5e50b-0dba-4e91-91b2-cea474adcc72) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 19:10:16 devstack cinder-volume[84538]: INFO cinder.volume.flows.manager.create_volume [None req-ea99661e-e762-4a46-ab98-7805a229ca41 tempest-SnapshotDependencyTests-220526168 None] Volume 64cda84e-3ede-44e2-b879-2f19a175f02c: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-64cda84e-3ede-44e2-b879-2f19a175f02c', 'volume_size': 1, 'snapshot_id': '588ff3c5-45a8-425a-b4da-02bd8094a686'} Apr 29 19:10:16 devstack cinder-volume[84538]: DEBUG oslo_concurrency.lockutils [None req-ea99661e-e762-4a46-ab98-7805a229ca41 tempest-SnapshotDependencyTests-220526168 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=84538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 19:10:16 devstack sudo[94473]: pam_unix(sudo:session): session closed for user root Apr 29 19:10:16 devstack cinder-volume[84538]: DEBUG oslo_concurrency.processutils [None req-5011bc02-9216-497b-a26a-f995fcf858be tempest-CreateVolumesFromSourceVolumeTest-1326097673 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-d2c97420-eac1-4385-b368-e7c97405d398" returned: 0 in 0.657s {{(pid=84538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 19:10:16 devstack cinder-volume[84538]: DEBUG cinder.volume.drivers.quobyte [None req-5011bc02-9216-497b-a26a-f995fcf858be tempest-CreateVolumesFromSourceVolumeTest-1326097673 None] <== create_volume: return (1568ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-34312b00-dd6d-45bb-af98-75855cea8e48'} {{(pid=84538) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 29 19:10:16 devstack cinder-volume[84538]: DEBUG oslo_concurrency.lockutils [None req-5011bc02-9216-497b-a26a-f995fcf858be tempest-CreateVolumesFromSourceVolumeTest-1326097673 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.572s {{(pid=84538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 19:10:16 devstack cinder-volume[84538]: DEBUG oslo_concurrency.lockutils [None req-ea99661e-e762-4a46-ab98-7805a229ca41 tempest-SnapshotDependencyTests-220526168 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.094s {{(pid=84538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 19:10:16 devstack cinder-volume[84538]: DEBUG cinder.coordination [None req-ea99661e-e762-4a46-ab98-7805a229ca41 tempest-SnapshotDependencyTests-220526168 None] Acquiring lock "cinder-quobyte-588ff3c5-45a8-425a-b4da-02bd8094a686-64cda84e-3ede-44e2-b879-2f19a175f02c" by "_create_volume_from_snapshot" {{(pid=84538) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 19:10:16 devstack cinder-volume[84538]: DEBUG cinder.volume.manager [None req-5011bc02-9216-497b-a26a-f995fcf858be tempest-CreateVolumesFromSourceVolumeTest-1326097673 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8275eeca-76ca-4313-aa34-01206d5efe3a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d2c97420-eac1-4385-b368-e7c97405d398', 'volume_size': 1}' {{(pid=84538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 19:10:16 devstack cinder-volume[84538]: DEBUG cinder.volume.manager [None req-5011bc02-9216-497b-a26a-f995fcf858be tempest-CreateVolumesFromSourceVolumeTest-1326097673 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7bad99b4-ad85-4222-a7de-8035b2687128) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 19:10:16 devstack cinder-volume[84538]: DEBUG cinder.coordination [None req-ea99661e-e762-4a46-ab98-7805a229ca41 tempest-SnapshotDependencyTests-220526168 None] Lock "cinder-quobyte-588ff3c5-45a8-425a-b4da-02bd8094a686-64cda84e-3ede-44e2-b879-2f19a175f02c" acquired by "_create_volume_from_snapshot" :: waited 0.029s {{(pid=84538) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 19:10:16 devstack cinder-volume[84538]: DEBUG cinder.volume.drivers.quobyte [None req-ea99661e-e762-4a46-ab98-7805a229ca41 tempest-SnapshotDependencyTests-220526168 None] Creating volume 64cda84e-3ede-44e2-b879-2f19a175f02c from snapshot 588ff3c5-45a8-425a-b4da-02bd8094a686 {{(pid=84538) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:356}} Apr 29 19:10:16 devstack cinder-volume[84538]: DEBUG oslo_concurrency.lockutils [None req-ea99661e-e762-4a46-ab98-7805a229ca41 tempest-SnapshotDependencyTests-220526168 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 19:10:16 devstack cinder-volume[84538]: DEBUG oslo_concurrency.lockutils [None req-ea99661e-e762-4a46-ab98-7805a229ca41 tempest-SnapshotDependencyTests-220526168 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 19:10:16 devstack cinder-volume[84538]: DEBUG cinder.volume.drivers.quobyte [None req-ea99661e-e762-4a46-ab98-7805a229ca41 tempest-SnapshotDependencyTests-220526168 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-34312b00-dd6d-45bb-af98-75855cea8e48': None} {{(pid=84538) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 19:10:16 devstack cinder-volume[84538]: DEBUG cinder.volume.drivers.quobyte [None req-ea99661e-e762-4a46-ab98-7805a229ca41 tempest-SnapshotDependencyTests-220526168 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-34312b00-dd6d-45bb-af98-75855cea8e48'] {{(pid=84538) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 19:10:16 devstack cinder-volume[84538]: DEBUG oslo_concurrency.lockutils [None req-ea99661e-e762-4a46-ab98-7805a229ca41 tempest-SnapshotDependencyTests-220526168 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=84538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 19:10:16 devstack cinder-volume[84538]: DEBUG cinder.volume.drivers.quobyte [None req-ea99661e-e762-4a46-ab98-7805a229ca41 tempest-SnapshotDependencyTests-220526168 None] Selected osci02.corp.quobyte.com/cinder-vol-34312b00-dd6d-45bb-af98-75855cea8e48 as target Quobyte volume. {{(pid=84538) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 29 19:10:16 devstack cinder-volume[84538]: DEBUG cinder.coordination [None req-ea99661e-e762-4a46-ab98-7805a229ca41 tempest-SnapshotDependencyTests-220526168 None] Acquiring lock "cinder-quobyte-64cda84e-3ede-44e2-b879-2f19a175f02c" by "_copy_volume_from_snapshot" {{(pid=84538) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 19:10:16 devstack cinder-volume[84538]: INFO cinder.volume.flows.manager.create_volume [None req-5011bc02-9216-497b-a26a-f995fcf858be tempest-CreateVolumesFromSourceVolumeTest-1326097673 None] Volume volume-d2c97420-eac1-4385-b368-e7c97405d398 (d2c97420-eac1-4385-b368-e7c97405d398): created successfully Apr 29 19:10:16 devstack cinder-volume[84538]: DEBUG cinder.volume.manager [None req-5011bc02-9216-497b-a26a-f995fcf858be tempest-CreateVolumesFromSourceVolumeTest-1326097673 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7bad99b4-ad85-4222-a7de-8035b2687128) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 19:10:16 devstack cinder-volume[84538]: DEBUG cinder.volume.manager [None req-5011bc02-9216-497b-a26a-f995fcf858be tempest-CreateVolumesFromSourceVolumeTest-1326097673 None] Flow 'volume_create_manager' (d980864c-649e-4bdd-8c73-6c826f46341b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84538) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 19:10:16 devstack cinder-volume[84538]: DEBUG cinder.coordination [None req-ea99661e-e762-4a46-ab98-7805a229ca41 tempest-SnapshotDependencyTests-220526168 None] Lock "cinder-quobyte-64cda84e-3ede-44e2-b879-2f19a175f02c" acquired by "_copy_volume_from_snapshot" :: waited 0.050s {{(pid=84538) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 19:10:16 devstack cinder-volume[84538]: DEBUG cinder.volume.drivers.quobyte [None req-ea99661e-e762-4a46-ab98-7805a229ca41 tempest-SnapshotDependencyTests-220526168 None] snapshot: 588ff3c5-45a8-425a-b4da-02bd8094a686, volume: 64cda84e-3ede-44e2-b879-2f19a175f02c, {{(pid=84538) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Apr 29 19:10:16 devstack cinder-volume[84538]: INFO cinder.volume.manager [None req-5011bc02-9216-497b-a26a-f995fcf858be tempest-CreateVolumesFromSourceVolumeTest-1326097673 None] Created volume successfully. Apr 29 19:10:16 devstack cinder-volume[84538]: DEBUG oslo_concurrency.lockutils [None req-ea99661e-e762-4a46-ab98-7805a229ca41 tempest-SnapshotDependencyTests-220526168 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 19:10:16 devstack cinder-volume[84538]: DEBUG oslo_concurrency.lockutils [None req-ea99661e-e762-4a46-ab98-7805a229ca41 tempest-SnapshotDependencyTests-220526168 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 19:10:16 devstack cinder-volume[84538]: DEBUG cinder.volume.drivers.quobyte [None req-ea99661e-e762-4a46-ab98-7805a229ca41 tempest-SnapshotDependencyTests-220526168 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-34312b00-dd6d-45bb-af98-75855cea8e48': None} {{(pid=84538) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 19:10:16 devstack cinder-volume[84538]: DEBUG cinder.volume.drivers.quobyte [None req-ea99661e-e762-4a46-ab98-7805a229ca41 tempest-SnapshotDependencyTests-220526168 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-34312b00-dd6d-45bb-af98-75855cea8e48'] {{(pid=84538) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 19:10:16 devstack cinder-volume[84538]: DEBUG oslo_concurrency.lockutils [None req-ea99661e-e762-4a46-ab98-7805a229ca41 tempest-SnapshotDependencyTests-220526168 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=84538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 19:10:16 devstack cinder-volume[84538]: DEBUG oslo.privsep.daemon [-] privsep: reply[7d5a1199-1b2a-4f93-857f-e541d36f96e5]: (4, 'qcow2') {{(pid=85803) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 19:10:16 devstack cinder-volume[84538]: DEBUG oslo_concurrency.processutils [None req-ea99661e-e762-4a46-ab98-7805a229ca41 tempest-SnapshotDependencyTests-220526168 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-eda1676c-f078-4f06-beb1-99694d364faa.588ff3c5-45a8-425a-b4da-02bd8094a686 {{(pid=84538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 19:10:16 devstack sudo[94476]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-eda1676c-f078-4f06-beb1-99694d364faa.588ff3c5-45a8-425a-b4da-02bd8094a686 Apr 29 19:10:16 devstack sudo[94476]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 19:10:17 devstack sudo[94476]: pam_unix(sudo:session): session closed for user root Apr 29 19:10:17 devstack cinder-volume[84538]: DEBUG oslo_concurrency.processutils [None req-ea99661e-e762-4a46-ab98-7805a229ca41 tempest-SnapshotDependencyTests-220526168 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-eda1676c-f078-4f06-beb1-99694d364faa.588ff3c5-45a8-425a-b4da-02bd8094a686" returned: 0 in 0.811s {{(pid=84538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 19:10:17 devstack cinder-volume[84538]: DEBUG cinder.volume.drivers.remotefs [None req-ea99661e-e762-4a46-ab98-7805a229ca41 tempest-SnapshotDependencyTests-220526168 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-eda1676c-f078-4f06-beb1-99694d364faa(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=84538) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 29 19:10:17 devstack cinder-volume[84538]: DEBUG cinder.volume.drivers.quobyte [None req-ea99661e-e762-4a46-ab98-7805a229ca41 tempest-SnapshotDependencyTests-220526168 None] will copy from snapshot at /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-eda1676c-f078-4f06-beb1-99694d364faa {{(pid=84538) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Apr 29 19:10:17 devstack cinder-volume[84538]: DEBUG cinder.volume.drivers.quobyte [None req-ea99661e-e762-4a46-ab98-7805a229ca41 tempest-SnapshotDependencyTests-220526168 None] Creating direct copy from snapshot {{(pid=84538) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Apr 29 19:10:17 devstack cinder-volume[84538]: DEBUG oslo.privsep.daemon [-] privsep: reply[12349129-635c-4611-939a-d15f4c0c21bf]: (4, 'qcow2') {{(pid=85803) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 19:10:17 devstack cinder-volume[84538]: DEBUG oslo_concurrency.processutils [None req-ea99661e-e762-4a46-ab98-7805a229ca41 tempest-SnapshotDependencyTests-220526168 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-eda1676c-f078-4f06-beb1-99694d364faa {{(pid=84538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 19:10:17 devstack cinder-volume[84538]: DEBUG cinder.volume.flows.manager.create_volume [None req-b0fb69d6-d97b-49b5-8732-c8afc17a7922 tempest-CreateVolumesFromSourceVolumeTest-1326097673 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84538) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Apr 29 19:10:17 devstack cinder-volume[84538]: DEBUG cinder.volume.manager [None req-b0fb69d6-d97b-49b5-8732-c8afc17a7922 tempest-CreateVolumesFromSourceVolumeTest-1326097673 None] Flow 'volume_create_manager' (25dcb29e-0ce4-4db6-b1d6-4426a052ba0b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84538) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 19:10:17 devstack cinder-volume[84538]: DEBUG cinder.volume.manager [None req-b0fb69d6-d97b-49b5-8732-c8afc17a7922 tempest-CreateVolumesFromSourceVolumeTest-1326097673 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (47eedadb-633f-418e-9702-6b6e8c924ec4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 19:10:17 devstack sudo[94481]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-eda1676c-f078-4f06-beb1-99694d364faa Apr 29 19:10:17 devstack sudo[94481]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 19:10:17 devstack cinder-volume[84538]: DEBUG cinder.volume.manager [None req-b0fb69d6-d97b-49b5-8732-c8afc17a7922 tempest-CreateVolumesFromSourceVolumeTest-1326097673 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (47eedadb-633f-418e-9702-6b6e8c924ec4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-29T17:10:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-849803513',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c87f36a1-9f58-4db9-b14e-385367db8d77,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f0f77d776291439f94be3377da80ddc1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T17:10:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T17:10:18Z,use_quota=True,user_id='de7143a50d0a4e579e2e95a28ec120d6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(62b05900-93e3-4190-a88f-1d87324303d1),volume_type_id=62b05900-93e3-4190-a88f-1d87324303d1)' {{(pid=84538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 19:10:17 devstack cinder-volume[84538]: DEBUG cinder.volume.manager [None req-b0fb69d6-d97b-49b5-8732-c8afc17a7922 tempest-CreateVolumesFromSourceVolumeTest-1326097673 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9c5503ae-3017-49d5-9e0d-d1924601cae3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 19:10:17 devstack cinder-volume[84538]: DEBUG cinder.volume.manager [None req-b0fb69d6-d97b-49b5-8732-c8afc17a7922 tempest-CreateVolumesFromSourceVolumeTest-1326097673 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9c5503ae-3017-49d5-9e0d-d1924601cae3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 19:10:17 devstack cinder-volume[84538]: DEBUG cinder.volume.manager [None req-b0fb69d6-d97b-49b5-8732-c8afc17a7922 tempest-CreateVolumesFromSourceVolumeTest-1326097673 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (835932b3-dac5-4294-a7c1-45998ddd48a8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 19:10:17 devstack cinder-volume[84538]: DEBUG cinder.volume.manager [None req-b0fb69d6-d97b-49b5-8732-c8afc17a7922 tempest-CreateVolumesFromSourceVolumeTest-1326097673 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (835932b3-dac5-4294-a7c1-45998ddd48a8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c87f36a1-9f58-4db9-b14e-385367db8d77', 'volume_name': 'volume-c87f36a1-9f58-4db9-b14e-385367db8d77', 'volume_size': 1}' {{(pid=84538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 19:10:17 devstack cinder-volume[84538]: DEBUG cinder.volume.manager [None req-b0fb69d6-d97b-49b5-8732-c8afc17a7922 tempest-CreateVolumesFromSourceVolumeTest-1326097673 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f94377d7-7a05-49c7-a042-f458939e28b8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 19:10:17 devstack cinder-volume[84538]: DEBUG cinder.volume.manager [None req-b0fb69d6-d97b-49b5-8732-c8afc17a7922 tempest-CreateVolumesFromSourceVolumeTest-1326097673 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f94377d7-7a05-49c7-a042-f458939e28b8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 19:10:17 devstack cinder-volume[84538]: DEBUG cinder.volume.manager [None req-b0fb69d6-d97b-49b5-8732-c8afc17a7922 tempest-CreateVolumesFromSourceVolumeTest-1326097673 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9e32599e-1bac-4589-8d1e-c6863431e229) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 19:10:17 devstack cinder-volume[84538]: INFO cinder.volume.flows.manager.create_volume [None req-b0fb69d6-d97b-49b5-8732-c8afc17a7922 tempest-CreateVolumesFromSourceVolumeTest-1326097673 None] Volume c87f36a1-9f58-4db9-b14e-385367db8d77: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c87f36a1-9f58-4db9-b14e-385367db8d77', 'volume_size': 1} Apr 29 19:10:17 devstack cinder-volume[84538]: DEBUG oslo_concurrency.lockutils [None req-b0fb69d6-d97b-49b5-8732-c8afc17a7922 tempest-CreateVolumesFromSourceVolumeTest-1326097673 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 19:10:18 devstack cinder-volume[84538]: DEBUG cinder.volume.flows.manager.create_volume [None req-49ee15da-cade-452c-bbb3-2a800de210d4 tempest-CreateVolumesFromSourceVolumeTest-1326097673 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84538) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Apr 29 19:10:18 devstack cinder-volume[84538]: DEBUG cinder.volume.manager [None req-49ee15da-cade-452c-bbb3-2a800de210d4 tempest-CreateVolumesFromSourceVolumeTest-1326097673 None] Flow 'volume_create_manager' (b03e06c7-6c50-454e-91de-c48dcfdd1907) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84538) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 19:10:18 devstack cinder-volume[84538]: DEBUG cinder.volume.manager [None req-49ee15da-cade-452c-bbb3-2a800de210d4 tempest-CreateVolumesFromSourceVolumeTest-1326097673 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (614838f8-f05c-48f6-a883-a350a6abf7b8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 19:10:18 devstack cinder-volume[84538]: DEBUG cinder.volume.manager [None req-49ee15da-cade-452c-bbb3-2a800de210d4 tempest-CreateVolumesFromSourceVolumeTest-1326097673 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (614838f8-f05c-48f6-a883-a350a6abf7b8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-29T17:10:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-342150368',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6ba70692-2d6a-43f4-ab5f-686fe849038e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f0f77d776291439f94be3377da80ddc1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T17:10:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T17:10:18Z,use_quota=True,user_id='de7143a50d0a4e579e2e95a28ec120d6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(62b05900-93e3-4190-a88f-1d87324303d1),volume_type_id=62b05900-93e3-4190-a88f-1d87324303d1)' {{(pid=84538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 19:10:18 devstack cinder-volume[84538]: DEBUG cinder.volume.manager [None req-49ee15da-cade-452c-bbb3-2a800de210d4 tempest-CreateVolumesFromSourceVolumeTest-1326097673 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (533689dc-27f1-40f8-bdd0-0c2d53b93f9b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 19:10:18 devstack cinder-volume[84538]: DEBUG cinder.volume.manager [None req-49ee15da-cade-452c-bbb3-2a800de210d4 tempest-CreateVolumesFromSourceVolumeTest-1326097673 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (533689dc-27f1-40f8-bdd0-0c2d53b93f9b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 19:10:18 devstack cinder-volume[84538]: DEBUG cinder.volume.manager [None req-49ee15da-cade-452c-bbb3-2a800de210d4 tempest-CreateVolumesFromSourceVolumeTest-1326097673 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b39c26be-ee70-4f55-921b-53e7fbe4562e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 19:10:18 devstack cinder-volume[84538]: DEBUG cinder.volume.manager [None req-49ee15da-cade-452c-bbb3-2a800de210d4 tempest-CreateVolumesFromSourceVolumeTest-1326097673 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b39c26be-ee70-4f55-921b-53e7fbe4562e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6ba70692-2d6a-43f4-ab5f-686fe849038e', 'volume_name': 'volume-6ba70692-2d6a-43f4-ab5f-686fe849038e', 'volume_size': 1}' {{(pid=84538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 19:10:18 devstack cinder-volume[84538]: DEBUG cinder.volume.manager [None req-49ee15da-cade-452c-bbb3-2a800de210d4 tempest-CreateVolumesFromSourceVolumeTest-1326097673 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5a23351d-28ab-4da2-986a-b509bffe3ca6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 19:10:18 devstack cinder-volume[84538]: DEBUG cinder.volume.manager [None req-49ee15da-cade-452c-bbb3-2a800de210d4 tempest-CreateVolumesFromSourceVolumeTest-1326097673 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5a23351d-28ab-4da2-986a-b509bffe3ca6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 19:10:18 devstack cinder-volume[84538]: DEBUG cinder.volume.manager [None req-49ee15da-cade-452c-bbb3-2a800de210d4 tempest-CreateVolumesFromSourceVolumeTest-1326097673 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (199fd03e-5892-4052-9061-0e0b4f3452e2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 19:10:18 devstack cinder-volume[84538]: INFO cinder.volume.flows.manager.create_volume [None req-49ee15da-cade-452c-bbb3-2a800de210d4 tempest-CreateVolumesFromSourceVolumeTest-1326097673 None] Volume 6ba70692-2d6a-43f4-ab5f-686fe849038e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6ba70692-2d6a-43f4-ab5f-686fe849038e', 'volume_size': 1} Apr 29 19:10:18 devstack cinder-volume[84538]: DEBUG oslo_concurrency.lockutils [None req-49ee15da-cade-452c-bbb3-2a800de210d4 tempest-CreateVolumesFromSourceVolumeTest-1326097673 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 19:10:18 devstack cinder-volume[84538]: DEBUG cinder.volume.flows.manager.create_volume [None req-b502e0c8-6a39-40f1-b5bd-0c6991e78d6a tempest-CreateVolumesFromSourceVolumeTest-1326097673 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84538) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Apr 29 19:10:18 devstack cinder-volume[84538]: DEBUG cinder.volume.manager [None req-b502e0c8-6a39-40f1-b5bd-0c6991e78d6a tempest-CreateVolumesFromSourceVolumeTest-1326097673 None] Flow 'volume_create_manager' (8ce962b4-cba2-40e0-ae27-86786f05048c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84538) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 19:10:18 devstack cinder-volume[84538]: DEBUG cinder.volume.manager [None req-b502e0c8-6a39-40f1-b5bd-0c6991e78d6a tempest-CreateVolumesFromSourceVolumeTest-1326097673 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fcf83a16-d488-47b3-9bd1-de65eaf2217f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 19:10:18 devstack cinder-volume[84538]: DEBUG cinder.volume.manager [None req-b502e0c8-6a39-40f1-b5bd-0c6991e78d6a tempest-CreateVolumesFromSourceVolumeTest-1326097673 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fcf83a16-d488-47b3-9bd1-de65eaf2217f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-29T17:10:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1588830143',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f880cb45-048b-4ea0-a079-a3035dcbcced,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f0f77d776291439f94be3377da80ddc1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T17:10:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T17:10:18Z,use_quota=True,user_id='de7143a50d0a4e579e2e95a28ec120d6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(62b05900-93e3-4190-a88f-1d87324303d1),volume_type_id=62b05900-93e3-4190-a88f-1d87324303d1)' {{(pid=84538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 19:10:18 devstack cinder-volume[84538]: DEBUG cinder.volume.manager [None req-b502e0c8-6a39-40f1-b5bd-0c6991e78d6a tempest-CreateVolumesFromSourceVolumeTest-1326097673 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (86a2d90a-41b4-4d47-ae17-1a738ae66b68) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 19:10:18 devstack cinder-volume[84538]: DEBUG cinder.volume.manager [None req-b502e0c8-6a39-40f1-b5bd-0c6991e78d6a tempest-CreateVolumesFromSourceVolumeTest-1326097673 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (86a2d90a-41b4-4d47-ae17-1a738ae66b68) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 19:10:18 devstack cinder-volume[84538]: DEBUG cinder.volume.manager [None req-b502e0c8-6a39-40f1-b5bd-0c6991e78d6a tempest-CreateVolumesFromSourceVolumeTest-1326097673 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4c637ebc-a7a9-4997-bc5e-a1c196452c88) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 19:10:18 devstack cinder-volume[84538]: DEBUG cinder.volume.manager [None req-b502e0c8-6a39-40f1-b5bd-0c6991e78d6a tempest-CreateVolumesFromSourceVolumeTest-1326097673 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4c637ebc-a7a9-4997-bc5e-a1c196452c88) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f880cb45-048b-4ea0-a079-a3035dcbcced', 'volume_name': 'volume-f880cb45-048b-4ea0-a079-a3035dcbcced', 'volume_size': 1}' {{(pid=84538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 19:10:18 devstack cinder-volume[84538]: DEBUG cinder.volume.manager [None req-b502e0c8-6a39-40f1-b5bd-0c6991e78d6a tempest-CreateVolumesFromSourceVolumeTest-1326097673 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fe5bfcee-186b-4af3-aa22-a36887950258) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 19:10:18 devstack cinder-volume[84538]: DEBUG cinder.volume.manager [None req-b502e0c8-6a39-40f1-b5bd-0c6991e78d6a tempest-CreateVolumesFromSourceVolumeTest-1326097673 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fe5bfcee-186b-4af3-aa22-a36887950258) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 19:10:18 devstack sudo[94481]: pam_unix(sudo:session): session closed for user root Apr 29 19:10:18 devstack cinder-volume[84538]: DEBUG cinder.volume.manager [None req-b502e0c8-6a39-40f1-b5bd-0c6991e78d6a tempest-CreateVolumesFromSourceVolumeTest-1326097673 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8cc6060d-4861-4c5d-9626-3b7c6c37ec92) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 19:10:18 devstack cinder-volume[84538]: INFO cinder.volume.flows.manager.create_volume [None req-b502e0c8-6a39-40f1-b5bd-0c6991e78d6a tempest-CreateVolumesFromSourceVolumeTest-1326097673 None] Volume f880cb45-048b-4ea0-a079-a3035dcbcced: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f880cb45-048b-4ea0-a079-a3035dcbcced', 'volume_size': 1} Apr 29 19:10:18 devstack cinder-volume[84538]: DEBUG oslo_concurrency.lockutils [None req-b502e0c8-6a39-40f1-b5bd-0c6991e78d6a tempest-CreateVolumesFromSourceVolumeTest-1326097673 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 19:10:18 devstack cinder-volume[84538]: DEBUG oslo_concurrency.processutils [None req-ea99661e-e762-4a46-ab98-7805a229ca41 tempest-SnapshotDependencyTests-220526168 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-eda1676c-f078-4f06-beb1-99694d364faa" returned: 0 in 0.816s {{(pid=84538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 19:10:18 devstack cinder-volume[84538]: DEBUG cinder.utils [None req-ea99661e-e762-4a46-ab98-7805a229ca41 tempest-SnapshotDependencyTests-220526168 None] Path /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-64cda84e-3ede-44e2-b879-2f19a175f02c not found in is_blk_device check {{(pid=84538) is_blk_device /opt/stack/cinder/cinder/utils.py:602}} Apr 29 19:10:18 devstack cinder-volume[84538]: DEBUG oslo_concurrency.processutils [None req-ea99661e-e762-4a46-ab98-7805a229ca41 tempest-SnapshotDependencyTests-220526168 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-eda1676c-f078-4f06-beb1-99694d364faa /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-64cda84e-3ede-44e2-b879-2f19a175f02c {{(pid=84538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 19:10:18 devstack sudo[94488]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-eda1676c-f078-4f06-beb1-99694d364faa /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-64cda84e-3ede-44e2-b879-2f19a175f02c Apr 29 19:10:18 devstack sudo[94488]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 19:10:18 devstack cinder-volume[84538]: DEBUG cinder.volume.flows.manager.create_volume [None req-12285ae6-6ae4-447d-9be0-56437c645e81 tempest-CreateVolumesFromSourceVolumeTest-1326097673 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84538) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Apr 29 19:10:18 devstack cinder-volume[84538]: DEBUG cinder.volume.manager [None req-12285ae6-6ae4-447d-9be0-56437c645e81 tempest-CreateVolumesFromSourceVolumeTest-1326097673 None] Flow 'volume_create_manager' (31cd82b4-a80e-4b4b-8809-fbff7381e90c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84538) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 19:10:18 devstack cinder-volume[84538]: DEBUG cinder.volume.manager [None req-12285ae6-6ae4-447d-9be0-56437c645e81 tempest-CreateVolumesFromSourceVolumeTest-1326097673 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (139ce4ee-f842-434b-84c3-7ea277908ccb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 19:10:18 devstack cinder-volume[84538]: DEBUG cinder.volume.manager [None req-12285ae6-6ae4-447d-9be0-56437c645e81 tempest-CreateVolumesFromSourceVolumeTest-1326097673 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (139ce4ee-f842-434b-84c3-7ea277908ccb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-29T17:10:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1505390489',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1876ac2e-036d-473e-91b5-cd99e1c8a5b9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f0f77d776291439f94be3377da80ddc1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T17:10:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T17:10:19Z,use_quota=True,user_id='de7143a50d0a4e579e2e95a28ec120d6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(62b05900-93e3-4190-a88f-1d87324303d1),volume_type_id=62b05900-93e3-4190-a88f-1d87324303d1)' {{(pid=84538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 19:10:18 devstack cinder-volume[84538]: DEBUG cinder.volume.manager [None req-12285ae6-6ae4-447d-9be0-56437c645e81 tempest-CreateVolumesFromSourceVolumeTest-1326097673 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f79cc9a9-d2a5-43de-b207-7a5eae8c48ce) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 19:10:18 devstack cinder-volume[84538]: DEBUG cinder.volume.manager [None req-12285ae6-6ae4-447d-9be0-56437c645e81 tempest-CreateVolumesFromSourceVolumeTest-1326097673 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f79cc9a9-d2a5-43de-b207-7a5eae8c48ce) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 19:10:18 devstack cinder-volume[84538]: DEBUG cinder.volume.manager [None req-12285ae6-6ae4-447d-9be0-56437c645e81 tempest-CreateVolumesFromSourceVolumeTest-1326097673 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b88e1b33-c159-4860-a420-23f9723b51c3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 19:10:18 devstack cinder-volume[84538]: DEBUG cinder.volume.manager [None req-12285ae6-6ae4-447d-9be0-56437c645e81 tempest-CreateVolumesFromSourceVolumeTest-1326097673 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b88e1b33-c159-4860-a420-23f9723b51c3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1876ac2e-036d-473e-91b5-cd99e1c8a5b9', 'volume_name': 'volume-1876ac2e-036d-473e-91b5-cd99e1c8a5b9', 'volume_size': 1}' {{(pid=84538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 19:10:18 devstack cinder-volume[84538]: DEBUG cinder.volume.manager [None req-12285ae6-6ae4-447d-9be0-56437c645e81 tempest-CreateVolumesFromSourceVolumeTest-1326097673 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f1650e74-0937-4c1e-886e-1062deb95619) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 19:10:18 devstack cinder-volume[84538]: DEBUG cinder.volume.manager [None req-12285ae6-6ae4-447d-9be0-56437c645e81 tempest-CreateVolumesFromSourceVolumeTest-1326097673 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f1650e74-0937-4c1e-886e-1062deb95619) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 19:10:18 devstack cinder-volume[84538]: DEBUG cinder.volume.manager [None req-12285ae6-6ae4-447d-9be0-56437c645e81 tempest-CreateVolumesFromSourceVolumeTest-1326097673 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9ad996c4-6046-4f1a-b863-f97d80d42d0f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 19:10:18 devstack cinder-volume[84538]: INFO cinder.volume.flows.manager.create_volume [None req-12285ae6-6ae4-447d-9be0-56437c645e81 tempest-CreateVolumesFromSourceVolumeTest-1326097673 None] Volume 1876ac2e-036d-473e-91b5-cd99e1c8a5b9: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1876ac2e-036d-473e-91b5-cd99e1c8a5b9', 'volume_size': 1} Apr 29 19:10:18 devstack cinder-volume[84538]: DEBUG oslo_concurrency.lockutils [None req-12285ae6-6ae4-447d-9be0-56437c645e81 tempest-CreateVolumesFromSourceVolumeTest-1326097673 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 19:10:19 devstack cinder-volume[84538]: DEBUG cinder.volume.flows.manager.create_volume [None req-094719ab-8e93-40a0-84a6-3d888d9d33dc tempest-CreateVolumesFromSourceVolumeTest-1326097673 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84538) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Apr 29 19:10:19 devstack cinder-volume[84538]: DEBUG cinder.volume.manager [None req-094719ab-8e93-40a0-84a6-3d888d9d33dc tempest-CreateVolumesFromSourceVolumeTest-1326097673 None] Flow 'volume_create_manager' (2f2e91c2-c3cb-4df9-9c3f-7d3a85567555) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84538) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 19:10:19 devstack cinder-volume[84538]: DEBUG cinder.volume.manager [None req-094719ab-8e93-40a0-84a6-3d888d9d33dc tempest-CreateVolumesFromSourceVolumeTest-1326097673 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4fc6d841-0e11-4f80-b740-e57d61e16779) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 19:10:19 devstack cinder-volume[84538]: DEBUG cinder.volume.manager [None req-094719ab-8e93-40a0-84a6-3d888d9d33dc tempest-CreateVolumesFromSourceVolumeTest-1326097673 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4fc6d841-0e11-4f80-b740-e57d61e16779) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-29T17:10:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1041332802',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8405e6d8-b9e3-4444-a005-f4cedd4c10e4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f0f77d776291439f94be3377da80ddc1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T17:10:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T17:10:19Z,use_quota=True,user_id='de7143a50d0a4e579e2e95a28ec120d6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(62b05900-93e3-4190-a88f-1d87324303d1),volume_type_id=62b05900-93e3-4190-a88f-1d87324303d1)' {{(pid=84538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 19:10:19 devstack cinder-volume[84538]: DEBUG cinder.volume.manager [None req-094719ab-8e93-40a0-84a6-3d888d9d33dc tempest-CreateVolumesFromSourceVolumeTest-1326097673 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (db318882-5b05-4344-a55c-23382e366bd7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 19:10:19 devstack cinder-volume[84538]: DEBUG cinder.volume.manager [None req-094719ab-8e93-40a0-84a6-3d888d9d33dc tempest-CreateVolumesFromSourceVolumeTest-1326097673 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (db318882-5b05-4344-a55c-23382e366bd7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 19:10:19 devstack cinder-volume[84538]: DEBUG cinder.volume.manager [None req-094719ab-8e93-40a0-84a6-3d888d9d33dc tempest-CreateVolumesFromSourceVolumeTest-1326097673 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (29351c0b-28e7-4e3b-bd44-6996733908a7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 19:10:19 devstack cinder-volume[84538]: DEBUG cinder.volume.manager [None req-094719ab-8e93-40a0-84a6-3d888d9d33dc tempest-CreateVolumesFromSourceVolumeTest-1326097673 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (29351c0b-28e7-4e3b-bd44-6996733908a7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8405e6d8-b9e3-4444-a005-f4cedd4c10e4', 'volume_name': 'volume-8405e6d8-b9e3-4444-a005-f4cedd4c10e4', 'volume_size': 1}' {{(pid=84538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 19:10:19 devstack cinder-volume[84538]: DEBUG cinder.volume.manager [None req-094719ab-8e93-40a0-84a6-3d888d9d33dc tempest-CreateVolumesFromSourceVolumeTest-1326097673 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (03826fa7-3281-4fcb-927b-ce90db967e3d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 19:10:19 devstack cinder-volume[84538]: DEBUG cinder.volume.manager [None req-094719ab-8e93-40a0-84a6-3d888d9d33dc tempest-CreateVolumesFromSourceVolumeTest-1326097673 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (03826fa7-3281-4fcb-927b-ce90db967e3d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 19:10:19 devstack cinder-volume[84538]: DEBUG cinder.volume.manager [None req-094719ab-8e93-40a0-84a6-3d888d9d33dc tempest-CreateVolumesFromSourceVolumeTest-1326097673 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (420b07fc-844d-422b-a134-f5d56cfdba58) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 19:10:19 devstack cinder-volume[84538]: INFO cinder.volume.flows.manager.create_volume [None req-094719ab-8e93-40a0-84a6-3d888d9d33dc tempest-CreateVolumesFromSourceVolumeTest-1326097673 None] Volume 8405e6d8-b9e3-4444-a005-f4cedd4c10e4: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8405e6d8-b9e3-4444-a005-f4cedd4c10e4', 'volume_size': 1} Apr 29 19:10:19 devstack cinder-volume[84538]: DEBUG oslo_concurrency.lockutils [None req-094719ab-8e93-40a0-84a6-3d888d9d33dc tempest-CreateVolumesFromSourceVolumeTest-1326097673 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 19:10:23 devstack sudo[94488]: pam_unix(sudo:session): session closed for user root Apr 29 19:10:23 devstack cinder-volume[84538]: DEBUG oslo_concurrency.processutils [None req-ea99661e-e762-4a46-ab98-7805a229ca41 tempest-SnapshotDependencyTests-220526168 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-eda1676c-f078-4f06-beb1-99694d364faa /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-64cda84e-3ede-44e2-b879-2f19a175f02c" returned: 0 in 4.580s {{(pid=84538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 19:10:23 devstack cinder-volume[84538]: DEBUG oslo.privsep.daemon [-] privsep: reply[80e9eb9f-1af6-4e30-92aa-d4f223f63961]: (4, 'qcow2') {{(pid=85803) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 19:10:23 devstack cinder-volume[84538]: DEBUG oslo_concurrency.processutils [None req-ea99661e-e762-4a46-ab98-7805a229ca41 tempest-SnapshotDependencyTests-220526168 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-eda1676c-f078-4f06-beb1-99694d364faa {{(pid=84538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 19:10:23 devstack sudo[94502]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-eda1676c-f078-4f06-beb1-99694d364faa Apr 29 19:10:23 devstack sudo[94502]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 19:10:23 devstack sudo[94502]: pam_unix(sudo:session): session closed for user root Apr 29 19:10:23 devstack cinder-volume[84538]: DEBUG oslo_concurrency.processutils [None req-ea99661e-e762-4a46-ab98-7805a229ca41 tempest-SnapshotDependencyTests-220526168 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-eda1676c-f078-4f06-beb1-99694d364faa" returned: 0 in 0.825s {{(pid=84538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 19:10:23 devstack cinder-volume[84538]: DEBUG cinder.image.image_utils [None req-ea99661e-e762-4a46-ab98-7805a229ca41 tempest-SnapshotDependencyTests-220526168 None] Image conversion details: src /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-eda1676c-f078-4f06-beb1-99694d364faa, size 1024.00 MB, duration 4.58 sec, destination /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-64cda84e-3ede-44e2-b879-2f19a175f02c {{(pid=84538) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}} Apr 29 19:10:23 devstack cinder-volume[84538]: INFO cinder.image.image_utils [None req-ea99661e-e762-4a46-ab98-7805a229ca41 tempest-SnapshotDependencyTests-220526168 None] Converted 1024.00 MB image at 223.55 MB/s Apr 29 19:10:23 devstack cinder-volume[84538]: WARNING cinder.volume.drivers.remotefs [None req-ea99661e-e762-4a46-ab98-7805a229ca41 tempest-SnapshotDependencyTests-220526168 None] /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-64cda84e-3ede-44e2-b879-2f19a175f02c is being set with open permissions: ugo+rw Apr 29 19:10:23 devstack cinder-volume[84538]: DEBUG oslo_concurrency.processutils [None req-ea99661e-e762-4a46-ab98-7805a229ca41 tempest-SnapshotDependencyTests-220526168 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-64cda84e-3ede-44e2-b879-2f19a175f02c {{(pid=84538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 19:10:23 devstack sudo[94507]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-64cda84e-3ede-44e2-b879-2f19a175f02c Apr 29 19:10:23 devstack sudo[94507]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 19:10:24 devstack sudo[94507]: pam_unix(sudo:session): session closed for user root Apr 29 19:10:24 devstack cinder-volume[84538]: DEBUG oslo_concurrency.processutils [None req-ea99661e-e762-4a46-ab98-7805a229ca41 tempest-SnapshotDependencyTests-220526168 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-64cda84e-3ede-44e2-b879-2f19a175f02c" returned: 0 in 0.605s {{(pid=84538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 19:10:24 devstack cinder-volume[84538]: DEBUG cinder.coordination [None req-ea99661e-e762-4a46-ab98-7805a229ca41 tempest-SnapshotDependencyTests-220526168 None] Lock "cinder-quobyte-64cda84e-3ede-44e2-b879-2f19a175f02c" released by "_copy_volume_from_snapshot" :: held 7.762s {{(pid=84538) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 19:10:24 devstack cinder-volume[84538]: DEBUG cinder.coordination [None req-ea99661e-e762-4a46-ab98-7805a229ca41 tempest-SnapshotDependencyTests-220526168 None] Lock "cinder-quobyte-588ff3c5-45a8-425a-b4da-02bd8094a686-64cda84e-3ede-44e2-b879-2f19a175f02c" released by "_create_volume_from_snapshot" :: held 7.828s {{(pid=84538) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 19:10:24 devstack cinder-volume[84538]: DEBUG oslo_concurrency.lockutils [None req-ea99661e-e762-4a46-ab98-7805a229ca41 tempest-SnapshotDependencyTests-220526168 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 7.858s {{(pid=84538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 19:10:24 devstack cinder-volume[84538]: DEBUG oslo_concurrency.lockutils [None req-b0fb69d6-d97b-49b5-8732-c8afc17a7922 tempest-CreateVolumesFromSourceVolumeTest-1326097673 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 6.664s {{(pid=84538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 19:10:24 devstack cinder-volume[84538]: DEBUG cinder.volume.drivers.quobyte [None req-b0fb69d6-d97b-49b5-8732-c8afc17a7922 tempest-CreateVolumesFromSourceVolumeTest-1326097673 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-29T17:10:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-849803513',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c87f36a1-9f58-4db9-b14e-385367db8d77,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f0f77d776291439f94be3377da80ddc1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T17:10:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T17:10:18Z,use_quota=True,user_id='de7143a50d0a4e579e2e95a28ec120d6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(62b05900-93e3-4190-a88f-1d87324303d1),volume_type_id=62b05900-93e3-4190-a88f-1d87324303d1)}" {{(pid=84538) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 29 19:10:24 devstack cinder-volume[84538]: DEBUG cinder.volume.drivers.remotefs [None req-b0fb69d6-d97b-49b5-8732-c8afc17a7922 tempest-CreateVolumesFromSourceVolumeTest-1326097673 None] Creating volume c87f36a1-9f58-4db9-b14e-385367db8d77 {{(pid=84538) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 29 19:10:24 devstack cinder-volume[84538]: DEBUG oslo_concurrency.lockutils [None req-b0fb69d6-d97b-49b5-8732-c8afc17a7922 tempest-CreateVolumesFromSourceVolumeTest-1326097673 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 19:10:24 devstack cinder-volume[84538]: DEBUG oslo_concurrency.lockutils [None req-b0fb69d6-d97b-49b5-8732-c8afc17a7922 tempest-CreateVolumesFromSourceVolumeTest-1326097673 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 19:10:24 devstack cinder-volume[84538]: DEBUG cinder.volume.drivers.quobyte [None req-b0fb69d6-d97b-49b5-8732-c8afc17a7922 tempest-CreateVolumesFromSourceVolumeTest-1326097673 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-34312b00-dd6d-45bb-af98-75855cea8e48': None} {{(pid=84538) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 19:10:24 devstack cinder-volume[84538]: DEBUG cinder.volume.drivers.quobyte [None req-b0fb69d6-d97b-49b5-8732-c8afc17a7922 tempest-CreateVolumesFromSourceVolumeTest-1326097673 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-34312b00-dd6d-45bb-af98-75855cea8e48'] {{(pid=84538) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 19:10:24 devstack cinder-volume[84538]: DEBUG oslo_concurrency.lockutils [None req-b0fb69d6-d97b-49b5-8732-c8afc17a7922 tempest-CreateVolumesFromSourceVolumeTest-1326097673 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=84538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 19:10:24 devstack cinder-volume[84538]: DEBUG cinder.volume.drivers.quobyte [None req-b0fb69d6-d97b-49b5-8732-c8afc17a7922 tempest-CreateVolumesFromSourceVolumeTest-1326097673 None] Selected osci02.corp.quobyte.com/cinder-vol-34312b00-dd6d-45bb-af98-75855cea8e48 as target Quobyte volume. {{(pid=84538) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 29 19:10:24 devstack cinder-volume[84538]: INFO cinder.volume.drivers.remotefs [None req-b0fb69d6-d97b-49b5-8732-c8afc17a7922 tempest-CreateVolumesFromSourceVolumeTest-1326097673 None] casted to osci02.corp.quobyte.com/cinder-vol-34312b00-dd6d-45bb-af98-75855cea8e48 Apr 29 19:10:24 devstack cinder-volume[84538]: DEBUG oslo_concurrency.processutils [None req-b0fb69d6-d97b-49b5-8732-c8afc17a7922 tempest-CreateVolumesFromSourceVolumeTest-1326097673 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-c87f36a1-9f58-4db9-b14e-385367db8d77 1073741824 {{(pid=84538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 19:10:24 devstack sudo[94510]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-c87f36a1-9f58-4db9-b14e-385367db8d77 1073741824 Apr 29 19:10:24 devstack sudo[94510]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 19:10:24 devstack cinder-volume[84538]: DEBUG cinder.volume.manager [None req-ea99661e-e762-4a46-ab98-7805a229ca41 tempest-SnapshotDependencyTests-220526168 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (79d5e50b-0dba-4e91-91b2-cea474adcc72) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-64cda84e-3ede-44e2-b879-2f19a175f02c', 'volume_size': 1, 'snapshot_id': '588ff3c5-45a8-425a-b4da-02bd8094a686'}' {{(pid=84538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 19:10:24 devstack cinder-volume[84538]: DEBUG cinder.volume.manager [None req-ea99661e-e762-4a46-ab98-7805a229ca41 tempest-SnapshotDependencyTests-220526168 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (896dd156-ab36-4e07-88a9-00a241fc8784) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 19:10:24 devstack cinder-volume[84538]: INFO cinder.volume.flows.manager.create_volume [None req-ea99661e-e762-4a46-ab98-7805a229ca41 tempest-SnapshotDependencyTests-220526168 None] Volume volume-64cda84e-3ede-44e2-b879-2f19a175f02c (64cda84e-3ede-44e2-b879-2f19a175f02c): created successfully Apr 29 19:10:24 devstack cinder-volume[84538]: DEBUG cinder.volume.manager [None req-ea99661e-e762-4a46-ab98-7805a229ca41 tempest-SnapshotDependencyTests-220526168 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (896dd156-ab36-4e07-88a9-00a241fc8784) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 19:10:24 devstack cinder-volume[84538]: DEBUG cinder.volume.manager [None req-ea99661e-e762-4a46-ab98-7805a229ca41 tempest-SnapshotDependencyTests-220526168 None] Flow 'volume_create_manager' (65eb93f5-d5da-4ab6-aab9-385bf228b27d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84538) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 19:10:24 devstack cinder-volume[84538]: INFO cinder.volume.manager [None req-ea99661e-e762-4a46-ab98-7805a229ca41 tempest-SnapshotDependencyTests-220526168 None] Created volume successfully. Apr 29 19:10:25 devstack cinder-volume[84538]: DEBUG oslo_service.periodic_task [None req-a93183a6-1080-461c-84de-2fcb210d4f60 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=84538) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}} Apr 29 19:10:25 devstack cinder-volume[84538]: DEBUG oslo_concurrency.lockutils [None req-a93183a6-1080-461c-84de-2fcb210d4f60 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 19:10:25 devstack cinder-volume[84538]: DEBUG oslo_concurrency.lockutils [None req-a93183a6-1080-461c-84de-2fcb210d4f60 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=84538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 19:10:25 devstack cinder-volume[84538]: DEBUG cinder.volume.drivers.quobyte [None req-a93183a6-1080-461c-84de-2fcb210d4f60 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-34312b00-dd6d-45bb-af98-75855cea8e48': None} {{(pid=84538) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 19:10:25 devstack cinder-volume[84538]: DEBUG cinder.volume.drivers.quobyte [None req-a93183a6-1080-461c-84de-2fcb210d4f60 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-34312b00-dd6d-45bb-af98-75855cea8e48'] {{(pid=84538) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 19:10:25 devstack cinder-volume[84538]: DEBUG oslo_concurrency.lockutils [None req-a93183a6-1080-461c-84de-2fcb210d4f60 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=84538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 19:10:25 devstack cinder-volume[84538]: DEBUG oslo_concurrency.processutils [None req-a93183a6-1080-461c-84de-2fcb210d4f60 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d {{(pid=84538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 19:10:25 devstack sudo[94516]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d Apr 29 19:10:25 devstack sudo[94516]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 19:10:25 devstack cinder-volume[84538]: DEBUG cinder.coordination [None req-4773a6e2-1786-4bb5-9977-a2e94c9612db tempest-SnapshotDependencyTests-220526168 None] Acquiring lock "cinder-588ff3c5-45a8-425a-b4da-02bd8094a686-delete_snapshot" by "delete_snapshot" {{(pid=84538) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 19:10:25 devstack cinder-volume[84538]: DEBUG cinder.coordination [None req-4773a6e2-1786-4bb5-9977-a2e94c9612db tempest-SnapshotDependencyTests-220526168 None] Lock "cinder-588ff3c5-45a8-425a-b4da-02bd8094a686-delete_snapshot" acquired by "delete_snapshot" :: waited 0.023s {{(pid=84538) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 19:10:25 devstack cinder-volume[84538]: DEBUG cinder.coordination [None req-4773a6e2-1786-4bb5-9977-a2e94c9612db tempest-SnapshotDependencyTests-220526168 None] Acquiring lock "cinder-quobyte-eda1676c-f078-4f06-beb1-99694d364faa" by "delete_snapshot" {{(pid=84538) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 19:10:25 devstack cinder-volume[84538]: DEBUG cinder.coordination [None req-4773a6e2-1786-4bb5-9977-a2e94c9612db tempest-SnapshotDependencyTests-220526168 None] Lock "cinder-quobyte-eda1676c-f078-4f06-beb1-99694d364faa" acquired by "delete_snapshot" :: waited 0.016s {{(pid=84538) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 19:10:25 devstack cinder-volume[84538]: DEBUG cinder.coordination [None req-4773a6e2-1786-4bb5-9977-a2e94c9612db tempest-SnapshotDependencyTests-220526168 None] Acquiring lock "cinder-quobyte-588ff3c5-45a8-425a-b4da-02bd8094a686" by "_delete_snapshot" {{(pid=84538) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 19:10:25 devstack cinder-volume[84538]: DEBUG cinder.coordination [None req-4773a6e2-1786-4bb5-9977-a2e94c9612db tempest-SnapshotDependencyTests-220526168 None] Lock "cinder-quobyte-588ff3c5-45a8-425a-b4da-02bd8094a686" acquired by "_delete_snapshot" :: waited 0.018s {{(pid=84538) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 19:10:25 devstack cinder-volume[84538]: DEBUG cinder.volume.drivers.remotefs [None req-4773a6e2-1786-4bb5-9977-a2e94c9612db tempest-SnapshotDependencyTests-220526168 None] Deleting offline snapshot 588ff3c5-45a8-425a-b4da-02bd8094a686 of volume eda1676c-f078-4f06-beb1-99694d364faa {{(pid=84538) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 29 19:10:25 devstack cinder-volume[84538]: DEBUG cinder.volume.drivers.remotefs [None req-4773a6e2-1786-4bb5-9977-a2e94c9612db tempest-SnapshotDependencyTests-220526168 None] snapshot_file for this snap is: volume-eda1676c-f078-4f06-beb1-99694d364faa.588ff3c5-45a8-425a-b4da-02bd8094a686 {{(pid=84538) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 29 19:10:25 devstack cinder-volume[84538]: DEBUG oslo.privsep.daemon [-] privsep: reply[2da0ab92-2411-4a81-9df8-c3cb0a89d0b3]: (4, 'qcow2') {{(pid=85803) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 19:10:25 devstack cinder-volume[84538]: DEBUG oslo_concurrency.processutils [None req-4773a6e2-1786-4bb5-9977-a2e94c9612db tempest-SnapshotDependencyTests-220526168 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-eda1676c-f078-4f06-beb1-99694d364faa.588ff3c5-45a8-425a-b4da-02bd8094a686 {{(pid=84538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 19:10:25 devstack sudo[94510]: pam_unix(sudo:session): session closed for user root Apr 29 19:10:25 devstack cinder-volume[84538]: DEBUG oslo_concurrency.processutils [None req-b0fb69d6-d97b-49b5-8732-c8afc17a7922 tempest-CreateVolumesFromSourceVolumeTest-1326097673 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-c87f36a1-9f58-4db9-b14e-385367db8d77 1073741824" returned: 0 in 0.813s {{(pid=84538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 19:10:25 devstack cinder-volume[84538]: DEBUG oslo_concurrency.processutils [None req-b0fb69d6-d97b-49b5-8732-c8afc17a7922 tempest-CreateVolumesFromSourceVolumeTest-1326097673 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-c87f36a1-9f58-4db9-b14e-385367db8d77 {{(pid=84538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 19:10:25 devstack sudo[94519]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-c87f36a1-9f58-4db9-b14e-385367db8d77 Apr 29 19:10:25 devstack sudo[94519]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 19:10:25 devstack sudo[94518]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-eda1676c-f078-4f06-beb1-99694d364faa.588ff3c5-45a8-425a-b4da-02bd8094a686 Apr 29 19:10:25 devstack sudo[94518]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 19:10:25 devstack sudo[94516]: pam_unix(sudo:session): session closed for user root Apr 29 19:10:25 devstack cinder-volume[84538]: DEBUG oslo_concurrency.processutils [None req-a93183a6-1080-461c-84de-2fcb210d4f60 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d" returned: 0 in 0.660s {{(pid=84538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 19:10:25 devstack cinder-volume[84538]: DEBUG cinder.manager [None req-a93183a6-1080-461c-84de-2fcb210d4f60 None None] Notifying Schedulers of capabilities ... {{(pid=84538) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 29 19:10:25 devstack sudo[94519]: pam_unix(sudo:session): session closed for user root Apr 29 19:10:25 devstack cinder-volume[84538]: DEBUG oslo_concurrency.processutils [None req-b0fb69d6-d97b-49b5-8732-c8afc17a7922 tempest-CreateVolumesFromSourceVolumeTest-1326097673 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-c87f36a1-9f58-4db9-b14e-385367db8d77" returned: 0 in 0.595s {{(pid=84538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 19:10:25 devstack cinder-volume[84538]: DEBUG cinder.volume.drivers.quobyte [None req-b0fb69d6-d97b-49b5-8732-c8afc17a7922 tempest-CreateVolumesFromSourceVolumeTest-1326097673 None] <== create_volume: return (1456ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-34312b00-dd6d-45bb-af98-75855cea8e48'} {{(pid=84538) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 29 19:10:25 devstack cinder-volume[84538]: DEBUG oslo_concurrency.lockutils [None req-b0fb69d6-d97b-49b5-8732-c8afc17a7922 tempest-CreateVolumesFromSourceVolumeTest-1326097673 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.459s {{(pid=84538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 19:10:25 devstack cinder-volume[84538]: DEBUG oslo_concurrency.lockutils [None req-49ee15da-cade-452c-bbb3-2a800de210d4 tempest-CreateVolumesFromSourceVolumeTest-1326097673 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 7.842s {{(pid=84538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 19:10:25 devstack cinder-volume[84538]: DEBUG cinder.volume.drivers.quobyte [None req-49ee15da-cade-452c-bbb3-2a800de210d4 tempest-CreateVolumesFromSourceVolumeTest-1326097673 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-29T17:10:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-342150368',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6ba70692-2d6a-43f4-ab5f-686fe849038e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f0f77d776291439f94be3377da80ddc1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T17:10:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T17:10:18Z,use_quota=True,user_id='de7143a50d0a4e579e2e95a28ec120d6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(62b05900-93e3-4190-a88f-1d87324303d1),volume_type_id=62b05900-93e3-4190-a88f-1d87324303d1)}" {{(pid=84538) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 29 19:10:25 devstack cinder-volume[84538]: DEBUG cinder.volume.drivers.remotefs [None req-49ee15da-cade-452c-bbb3-2a800de210d4 tempest-CreateVolumesFromSourceVolumeTest-1326097673 None] Creating volume 6ba70692-2d6a-43f4-ab5f-686fe849038e {{(pid=84538) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 29 19:10:25 devstack cinder-volume[84538]: DEBUG oslo_concurrency.lockutils [None req-49ee15da-cade-452c-bbb3-2a800de210d4 tempest-CreateVolumesFromSourceVolumeTest-1326097673 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 19:10:25 devstack cinder-volume[84538]: DEBUG oslo_concurrency.lockutils [None req-49ee15da-cade-452c-bbb3-2a800de210d4 tempest-CreateVolumesFromSourceVolumeTest-1326097673 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 19:10:25 devstack cinder-volume[84538]: DEBUG cinder.volume.drivers.quobyte [None req-49ee15da-cade-452c-bbb3-2a800de210d4 tempest-CreateVolumesFromSourceVolumeTest-1326097673 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-34312b00-dd6d-45bb-af98-75855cea8e48': None} {{(pid=84538) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 19:10:25 devstack cinder-volume[84538]: DEBUG cinder.volume.drivers.quobyte [None req-49ee15da-cade-452c-bbb3-2a800de210d4 tempest-CreateVolumesFromSourceVolumeTest-1326097673 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-34312b00-dd6d-45bb-af98-75855cea8e48'] {{(pid=84538) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 19:10:25 devstack cinder-volume[84538]: DEBUG oslo_concurrency.lockutils [None req-49ee15da-cade-452c-bbb3-2a800de210d4 tempest-CreateVolumesFromSourceVolumeTest-1326097673 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=84538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 19:10:25 devstack cinder-volume[84538]: DEBUG cinder.volume.drivers.quobyte [None req-49ee15da-cade-452c-bbb3-2a800de210d4 tempest-CreateVolumesFromSourceVolumeTest-1326097673 None] Selected osci02.corp.quobyte.com/cinder-vol-34312b00-dd6d-45bb-af98-75855cea8e48 as target Quobyte volume. {{(pid=84538) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 29 19:10:25 devstack cinder-volume[84538]: INFO cinder.volume.drivers.remotefs [None req-49ee15da-cade-452c-bbb3-2a800de210d4 tempest-CreateVolumesFromSourceVolumeTest-1326097673 None] casted to osci02.corp.quobyte.com/cinder-vol-34312b00-dd6d-45bb-af98-75855cea8e48 Apr 29 19:10:25 devstack cinder-volume[84538]: DEBUG oslo_concurrency.processutils [None req-49ee15da-cade-452c-bbb3-2a800de210d4 tempest-CreateVolumesFromSourceVolumeTest-1326097673 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-6ba70692-2d6a-43f4-ab5f-686fe849038e 1073741824 {{(pid=84538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 19:10:25 devstack sudo[94527]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-6ba70692-2d6a-43f4-ab5f-686fe849038e 1073741824 Apr 29 19:10:25 devstack sudo[94527]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 19:10:25 devstack cinder-volume[84538]: DEBUG cinder.volume.manager [None req-b0fb69d6-d97b-49b5-8732-c8afc17a7922 tempest-CreateVolumesFromSourceVolumeTest-1326097673 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9e32599e-1bac-4589-8d1e-c6863431e229) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c87f36a1-9f58-4db9-b14e-385367db8d77', 'volume_size': 1}' {{(pid=84538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 19:10:25 devstack cinder-volume[84538]: DEBUG cinder.volume.manager [None req-b0fb69d6-d97b-49b5-8732-c8afc17a7922 tempest-CreateVolumesFromSourceVolumeTest-1326097673 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (21bb3c2c-a0f6-49a2-8868-eb9f4d3f8673) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 19:10:25 devstack cinder-volume[84538]: INFO cinder.volume.flows.manager.create_volume [None req-b0fb69d6-d97b-49b5-8732-c8afc17a7922 tempest-CreateVolumesFromSourceVolumeTest-1326097673 None] Volume volume-c87f36a1-9f58-4db9-b14e-385367db8d77 (c87f36a1-9f58-4db9-b14e-385367db8d77): created successfully Apr 29 19:10:25 devstack cinder-volume[84538]: DEBUG cinder.volume.manager [None req-b0fb69d6-d97b-49b5-8732-c8afc17a7922 tempest-CreateVolumesFromSourceVolumeTest-1326097673 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (21bb3c2c-a0f6-49a2-8868-eb9f4d3f8673) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 19:10:26 devstack sudo[94518]: pam_unix(sudo:session): session closed for user root Apr 29 19:10:26 devstack cinder-volume[84538]: DEBUG cinder.volume.manager [None req-b0fb69d6-d97b-49b5-8732-c8afc17a7922 tempest-CreateVolumesFromSourceVolumeTest-1326097673 None] Flow 'volume_create_manager' (25dcb29e-0ce4-4db6-b1d6-4426a052ba0b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84538) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 19:10:26 devstack cinder-volume[84538]: DEBUG oslo_concurrency.processutils [None req-4773a6e2-1786-4bb5-9977-a2e94c9612db tempest-SnapshotDependencyTests-220526168 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-eda1676c-f078-4f06-beb1-99694d364faa.588ff3c5-45a8-425a-b4da-02bd8094a686" returned: 0 in 0.733s {{(pid=84538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 19:10:26 devstack cinder-volume[84538]: DEBUG cinder.volume.drivers.remotefs [None req-4773a6e2-1786-4bb5-9977-a2e94c9612db tempest-SnapshotDependencyTests-220526168 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-eda1676c-f078-4f06-beb1-99694d364faa(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=84538) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 29 19:10:26 devstack cinder-volume[84538]: INFO cinder.volume.manager [None req-b0fb69d6-d97b-49b5-8732-c8afc17a7922 tempest-CreateVolumesFromSourceVolumeTest-1326097673 None] Created volume successfully. Apr 29 19:10:26 devstack cinder-volume[84538]: DEBUG oslo.privsep.daemon [-] privsep: reply[fc92fecb-28f6-4c0f-b7ab-f0a3063fb472]: (4, 'qcow2') {{(pid=85803) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 19:10:26 devstack cinder-volume[84538]: DEBUG oslo_concurrency.processutils [None req-4773a6e2-1786-4bb5-9977-a2e94c9612db tempest-SnapshotDependencyTests-220526168 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-eda1676c-f078-4f06-beb1-99694d364faa {{(pid=84538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 19:10:26 devstack sudo[94529]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-eda1676c-f078-4f06-beb1-99694d364faa Apr 29 19:10:26 devstack sudo[94529]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 19:10:26 devstack sudo[94527]: pam_unix(sudo:session): session closed for user root Apr 29 19:10:26 devstack cinder-volume[84538]: DEBUG oslo_concurrency.processutils [None req-49ee15da-cade-452c-bbb3-2a800de210d4 tempest-CreateVolumesFromSourceVolumeTest-1326097673 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-6ba70692-2d6a-43f4-ab5f-686fe849038e 1073741824" returned: 0 in 0.773s {{(pid=84538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 19:10:26 devstack cinder-volume[84538]: DEBUG oslo_concurrency.processutils [None req-49ee15da-cade-452c-bbb3-2a800de210d4 tempest-CreateVolumesFromSourceVolumeTest-1326097673 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-6ba70692-2d6a-43f4-ab5f-686fe849038e {{(pid=84538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 19:10:26 devstack sudo[94537]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-6ba70692-2d6a-43f4-ab5f-686fe849038e Apr 29 19:10:26 devstack sudo[94537]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 19:10:26 devstack sudo[94529]: pam_unix(sudo:session): session closed for user root Apr 29 19:10:26 devstack cinder-volume[84538]: DEBUG oslo_concurrency.processutils [None req-4773a6e2-1786-4bb5-9977-a2e94c9612db tempest-SnapshotDependencyTests-220526168 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-eda1676c-f078-4f06-beb1-99694d364faa" returned: 0 in 0.778s {{(pid=84538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 19:10:26 devstack cinder-volume[84538]: DEBUG oslo_concurrency.processutils [None req-4773a6e2-1786-4bb5-9977-a2e94c9612db tempest-SnapshotDependencyTests-220526168 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-eda1676c-f078-4f06-beb1-99694d364faa.588ff3c5-45a8-425a-b4da-02bd8094a686 {{(pid=84538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 19:10:26 devstack sudo[94539]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-eda1676c-f078-4f06-beb1-99694d364faa.588ff3c5-45a8-425a-b4da-02bd8094a686 Apr 29 19:10:26 devstack sudo[94539]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 19:10:27 devstack sudo[94537]: pam_unix(sudo:session): session closed for user root Apr 29 19:10:27 devstack cinder-volume[84538]: DEBUG oslo_concurrency.processutils [None req-49ee15da-cade-452c-bbb3-2a800de210d4 tempest-CreateVolumesFromSourceVolumeTest-1326097673 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-6ba70692-2d6a-43f4-ab5f-686fe849038e" returned: 0 in 0.628s {{(pid=84538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 19:10:27 devstack cinder-volume[84538]: DEBUG cinder.volume.drivers.quobyte [None req-49ee15da-cade-452c-bbb3-2a800de210d4 tempest-CreateVolumesFromSourceVolumeTest-1326097673 None] <== create_volume: return (1446ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-34312b00-dd6d-45bb-af98-75855cea8e48'} {{(pid=84538) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 29 19:10:27 devstack cinder-volume[84538]: DEBUG oslo_concurrency.lockutils [None req-49ee15da-cade-452c-bbb3-2a800de210d4 tempest-CreateVolumesFromSourceVolumeTest-1326097673 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.450s {{(pid=84538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 19:10:27 devstack cinder-volume[84538]: DEBUG oslo_concurrency.lockutils [None req-b502e0c8-6a39-40f1-b5bd-0c6991e78d6a tempest-CreateVolumesFromSourceVolumeTest-1326097673 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 8.963s {{(pid=84538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 19:10:27 devstack cinder-volume[84538]: DEBUG cinder.volume.drivers.quobyte [None req-b502e0c8-6a39-40f1-b5bd-0c6991e78d6a tempest-CreateVolumesFromSourceVolumeTest-1326097673 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-29T17:10:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1588830143',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f880cb45-048b-4ea0-a079-a3035dcbcced,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f0f77d776291439f94be3377da80ddc1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T17:10:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T17:10:18Z,use_quota=True,user_id='de7143a50d0a4e579e2e95a28ec120d6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(62b05900-93e3-4190-a88f-1d87324303d1),volume_type_id=62b05900-93e3-4190-a88f-1d87324303d1)}" {{(pid=84538) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 29 19:10:27 devstack cinder-volume[84538]: DEBUG cinder.volume.drivers.remotefs [None req-b502e0c8-6a39-40f1-b5bd-0c6991e78d6a tempest-CreateVolumesFromSourceVolumeTest-1326097673 None] Creating volume f880cb45-048b-4ea0-a079-a3035dcbcced {{(pid=84538) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 29 19:10:27 devstack cinder-volume[84538]: DEBUG oslo_concurrency.lockutils [None req-b502e0c8-6a39-40f1-b5bd-0c6991e78d6a tempest-CreateVolumesFromSourceVolumeTest-1326097673 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 19:10:27 devstack cinder-volume[84538]: DEBUG oslo_concurrency.lockutils [None req-b502e0c8-6a39-40f1-b5bd-0c6991e78d6a tempest-CreateVolumesFromSourceVolumeTest-1326097673 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=84538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 19:10:27 devstack cinder-volume[84538]: DEBUG cinder.volume.drivers.quobyte [None req-b502e0c8-6a39-40f1-b5bd-0c6991e78d6a tempest-CreateVolumesFromSourceVolumeTest-1326097673 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-34312b00-dd6d-45bb-af98-75855cea8e48': None} {{(pid=84538) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 19:10:27 devstack cinder-volume[84538]: DEBUG cinder.volume.drivers.quobyte [None req-b502e0c8-6a39-40f1-b5bd-0c6991e78d6a tempest-CreateVolumesFromSourceVolumeTest-1326097673 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-34312b00-dd6d-45bb-af98-75855cea8e48'] {{(pid=84538) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 19:10:27 devstack cinder-volume[84538]: DEBUG oslo_concurrency.lockutils [None req-b502e0c8-6a39-40f1-b5bd-0c6991e78d6a tempest-CreateVolumesFromSourceVolumeTest-1326097673 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=84538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 19:10:27 devstack cinder-volume[84538]: DEBUG cinder.volume.drivers.quobyte [None req-b502e0c8-6a39-40f1-b5bd-0c6991e78d6a tempest-CreateVolumesFromSourceVolumeTest-1326097673 None] Selected osci02.corp.quobyte.com/cinder-vol-34312b00-dd6d-45bb-af98-75855cea8e48 as target Quobyte volume. {{(pid=84538) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 29 19:10:27 devstack cinder-volume[84538]: INFO cinder.volume.drivers.remotefs [None req-b502e0c8-6a39-40f1-b5bd-0c6991e78d6a tempest-CreateVolumesFromSourceVolumeTest-1326097673 None] casted to osci02.corp.quobyte.com/cinder-vol-34312b00-dd6d-45bb-af98-75855cea8e48 Apr 29 19:10:27 devstack cinder-volume[84538]: DEBUG oslo_concurrency.processutils [None req-b502e0c8-6a39-40f1-b5bd-0c6991e78d6a tempest-CreateVolumesFromSourceVolumeTest-1326097673 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-f880cb45-048b-4ea0-a079-a3035dcbcced 1073741824 {{(pid=84538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 19:10:27 devstack cinder-volume[84538]: DEBUG cinder.volume.manager [None req-49ee15da-cade-452c-bbb3-2a800de210d4 tempest-CreateVolumesFromSourceVolumeTest-1326097673 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (199fd03e-5892-4052-9061-0e0b4f3452e2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6ba70692-2d6a-43f4-ab5f-686fe849038e', 'volume_size': 1}' {{(pid=84538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 19:10:27 devstack sudo[94545]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-f880cb45-048b-4ea0-a079-a3035dcbcced 1073741824 Apr 29 19:10:27 devstack sudo[94545]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 19:10:27 devstack cinder-volume[84538]: DEBUG cinder.volume.manager [None req-49ee15da-cade-452c-bbb3-2a800de210d4 tempest-CreateVolumesFromSourceVolumeTest-1326097673 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0b7902c4-6b43-4638-92bb-b6879fae4ae2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 19:10:27 devstack cinder-volume[84538]: INFO cinder.volume.flows.manager.create_volume [None req-49ee15da-cade-452c-bbb3-2a800de210d4 tempest-CreateVolumesFromSourceVolumeTest-1326097673 None] Volume volume-6ba70692-2d6a-43f4-ab5f-686fe849038e (6ba70692-2d6a-43f4-ab5f-686fe849038e): created successfully Apr 29 19:10:27 devstack cinder-volume[84538]: DEBUG cinder.volume.manager [None req-49ee15da-cade-452c-bbb3-2a800de210d4 tempest-CreateVolumesFromSourceVolumeTest-1326097673 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0b7902c4-6b43-4638-92bb-b6879fae4ae2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 19:10:27 devstack cinder-volume[84538]: DEBUG cinder.volume.manager [None req-49ee15da-cade-452c-bbb3-2a800de210d4 tempest-CreateVolumesFromSourceVolumeTest-1326097673 None] Flow 'volume_create_manager' (b03e06c7-6c50-454e-91de-c48dcfdd1907) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84538) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 19:10:27 devstack cinder-volume[84538]: INFO cinder.volume.manager [None req-49ee15da-cade-452c-bbb3-2a800de210d4 tempest-CreateVolumesFromSourceVolumeTest-1326097673 None] Created volume successfully. Apr 29 19:10:27 devstack sudo[94539]: pam_unix(sudo:session): session closed for user root Apr 29 19:10:27 devstack cinder-volume[84538]: DEBUG oslo_concurrency.processutils [None req-4773a6e2-1786-4bb5-9977-a2e94c9612db tempest-SnapshotDependencyTests-220526168 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-eda1676c-f078-4f06-beb1-99694d364faa.588ff3c5-45a8-425a-b4da-02bd8094a686" returned: 0 in 0.699s {{(pid=84538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 19:10:27 devstack cinder-volume[84538]: DEBUG oslo_concurrency.processutils [None req-4773a6e2-1786-4bb5-9977-a2e94c9612db tempest-SnapshotDependencyTests-220526168 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-eda1676c-f078-4f06-beb1-99694d364faa.588ff3c5-45a8-425a-b4da-02bd8094a686 {{(pid=84538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 19:10:27 devstack sudo[94547]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-eda1676c-f078-4f06-beb1-99694d364faa.588ff3c5-45a8-425a-b4da-02bd8094a686 Apr 29 19:10:27 devstack sudo[94547]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 19:10:28 devstack sudo[94547]: pam_unix(sudo:session): session closed for user root Apr 29 19:10:28 devstack cinder-volume[84538]: DEBUG oslo_concurrency.processutils [None req-4773a6e2-1786-4bb5-9977-a2e94c9612db tempest-SnapshotDependencyTests-220526168 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-eda1676c-f078-4f06-beb1-99694d364faa.588ff3c5-45a8-425a-b4da-02bd8094a686" returned: 0 in 0.612s {{(pid=84538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 19:10:28 devstack sudo[94545]: pam_unix(sudo:session): session closed for user root Apr 29 19:10:28 devstack cinder-volume[84538]: DEBUG oslo_concurrency.processutils [None req-b502e0c8-6a39-40f1-b5bd-0c6991e78d6a tempest-CreateVolumesFromSourceVolumeTest-1326097673 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-f880cb45-048b-4ea0-a079-a3035dcbcced 1073741824" returned: 0 in 0.772s {{(pid=84538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 19:10:28 devstack cinder-volume[84538]: DEBUG cinder.coordination [None req-4773a6e2-1786-4bb5-9977-a2e94c9612db tempest-SnapshotDependencyTests-220526168 None] Lock "cinder-quobyte-588ff3c5-45a8-425a-b4da-02bd8094a686" released by "_delete_snapshot" :: held 2.926s {{(pid=84538) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 19:10:28 devstack cinder-volume[84538]: DEBUG cinder.coordination [None req-4773a6e2-1786-4bb5-9977-a2e94c9612db tempest-SnapshotDependencyTests-220526168 None] Lock "cinder-quobyte-eda1676c-f078-4f06-beb1-99694d364faa" released by "delete_snapshot" :: held 2.953s {{(pid=84538) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 19:10:28 devstack cinder-volume[84538]: DEBUG oslo_concurrency.processutils [None req-b502e0c8-6a39-40f1-b5bd-0c6991e78d6a tempest-CreateVolumesFromSourceVolumeTest-1326097673 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-f880cb45-048b-4ea0-a079-a3035dcbcced {{(pid=84538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 19:10:28 devstack sudo[94554]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-f880cb45-048b-4ea0-a079-a3035dcbcced Apr 29 19:10:28 devstack sudo[94554]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 19:10:28 devstack cinder-volume[84538]: DEBUG cinder.quota [None req-4773a6e2-1786-4bb5-9977-a2e94c9612db tempest-SnapshotDependencyTests-220526168 None] Created reservations ['e09dc779-0df7-423b-b874-2391d164064f', '5a028420-b430-404f-be90-cf30cc311911', 'fd5ad40a-6890-4056-8b9e-a9d7a9a03932', '9562e51d-977c-4e8d-9460-497073fb5332'] {{(pid=84538) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 29 19:10:28 devstack cinder-volume[84538]: INFO cinder.volume.manager [None req-4773a6e2-1786-4bb5-9977-a2e94c9612db tempest-SnapshotDependencyTests-220526168 None] Delete snapshot completed successfully. Apr 29 19:10:28 devstack cinder-volume[84538]: DEBUG cinder.coordination [None req-4773a6e2-1786-4bb5-9977-a2e94c9612db tempest-SnapshotDependencyTests-220526168 None] Lock "cinder-588ff3c5-45a8-425a-b4da-02bd8094a686-delete_snapshot" released by "delete_snapshot" :: held 3.100s {{(pid=84538) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 19:10:28 devstack cinder-volume[84538]: DEBUG cinder.coordination [None req-9fd030b3-f7d9-4be6-b95f-9a3c4c91f3e6 tempest-SnapshotDependencyTests-220526168 None] Acquiring lock "cinder-eda1676c-f078-4f06-beb1-99694d364faa-delete_volume" by "delete_volume" {{(pid=84538) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 19:10:28 devstack cinder-volume[84538]: DEBUG cinder.coordination [None req-9fd030b3-f7d9-4be6-b95f-9a3c4c91f3e6 tempest-SnapshotDependencyTests-220526168 None] Lock "cinder-eda1676c-f078-4f06-beb1-99694d364faa-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=84538) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 19:10:28 devstack cinder-volume[84538]: DEBUG cinder.coordination [None req-9fd030b3-f7d9-4be6-b95f-9a3c4c91f3e6 tempest-SnapshotDependencyTests-220526168 None] Acquiring lock "cinder-quobyte-eda1676c-f078-4f06-beb1-99694d364faa" by "delete_volume" {{(pid=84538) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 19:10:28 devstack cinder-volume[84538]: DEBUG cinder.coordination [None req-9fd030b3-f7d9-4be6-b95f-9a3c4c91f3e6 tempest-SnapshotDependencyTests-220526168 None] Lock "cinder-quobyte-eda1676c-f078-4f06-beb1-99694d364faa" acquired by "delete_volume" :: waited 0.021s {{(pid=84538) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 19:10:28 devstack cinder-volume[84538]: DEBUG oslo.privsep.daemon [-] privsep: reply[ce144553-740b-4d58-97b1-df8f38de658a]: (4, 'qcow2') {{(pid=85803) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 19:10:28 devstack cinder-volume[84538]: DEBUG oslo_concurrency.processutils [None req-9fd030b3-f7d9-4be6-b95f-9a3c4c91f3e6 tempest-SnapshotDependencyTests-220526168 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-eda1676c-f078-4f06-beb1-99694d364faa {{(pid=84538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 19:10:28 devstack sudo[94557]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-eda1676c-f078-4f06-beb1-99694d364faa Apr 29 19:10:28 devstack sudo[94557]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 19:10:28 devstack sudo[94554]: pam_unix(sudo:session): session closed for user root Apr 29 19:10:28 devstack cinder-volume[84538]: DEBUG oslo_concurrency.processutils [None req-b502e0c8-6a39-40f1-b5bd-0c6991e78d6a tempest-CreateVolumesFromSourceVolumeTest-1326097673 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-f880cb45-048b-4ea0-a079-a3035dcbcced" returned: 0 in 0.610s {{(pid=84538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 19:10:28 devstack cinder-volume[84538]: DEBUG cinder.volume.drivers.quobyte [None req-b502e0c8-6a39-40f1-b5bd-0c6991e78d6a tempest-CreateVolumesFromSourceVolumeTest-1326097673 None] <== create_volume: return (1434ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-34312b00-dd6d-45bb-af98-75855cea8e48'} {{(pid=84538) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 29 19:10:28 devstack cinder-volume[84538]: DEBUG oslo_concurrency.lockutils [None req-b502e0c8-6a39-40f1-b5bd-0c6991e78d6a tempest-CreateVolumesFromSourceVolumeTest-1326097673 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.438s {{(pid=84538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 19:10:28 devstack cinder-volume[84538]: DEBUG oslo_concurrency.lockutils [None req-12285ae6-6ae4-447d-9be0-56437c645e81 tempest-CreateVolumesFromSourceVolumeTest-1326097673 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 10.048s {{(pid=84538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 19:10:28 devstack cinder-volume[84538]: DEBUG cinder.volume.drivers.quobyte [None req-12285ae6-6ae4-447d-9be0-56437c645e81 tempest-CreateVolumesFromSourceVolumeTest-1326097673 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-29T17:10:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1505390489',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1876ac2e-036d-473e-91b5-cd99e1c8a5b9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f0f77d776291439f94be3377da80ddc1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T17:10:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T17:10:19Z,use_quota=True,user_id='de7143a50d0a4e579e2e95a28ec120d6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(62b05900-93e3-4190-a88f-1d87324303d1),volume_type_id=62b05900-93e3-4190-a88f-1d87324303d1)}" {{(pid=84538) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 29 19:10:28 devstack cinder-volume[84538]: DEBUG cinder.volume.drivers.remotefs [None req-12285ae6-6ae4-447d-9be0-56437c645e81 tempest-CreateVolumesFromSourceVolumeTest-1326097673 None] Creating volume 1876ac2e-036d-473e-91b5-cd99e1c8a5b9 {{(pid=84538) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 29 19:10:28 devstack cinder-volume[84538]: DEBUG oslo_concurrency.lockutils [None req-12285ae6-6ae4-447d-9be0-56437c645e81 tempest-CreateVolumesFromSourceVolumeTest-1326097673 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 19:10:28 devstack cinder-volume[84538]: DEBUG oslo_concurrency.lockutils [None req-12285ae6-6ae4-447d-9be0-56437c645e81 tempest-CreateVolumesFromSourceVolumeTest-1326097673 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=84538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 19:10:28 devstack cinder-volume[84538]: DEBUG cinder.volume.drivers.quobyte [None req-12285ae6-6ae4-447d-9be0-56437c645e81 tempest-CreateVolumesFromSourceVolumeTest-1326097673 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-34312b00-dd6d-45bb-af98-75855cea8e48': None} {{(pid=84538) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 19:10:28 devstack cinder-volume[84538]: DEBUG cinder.volume.drivers.quobyte [None req-12285ae6-6ae4-447d-9be0-56437c645e81 tempest-CreateVolumesFromSourceVolumeTest-1326097673 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-34312b00-dd6d-45bb-af98-75855cea8e48'] {{(pid=84538) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 19:10:28 devstack cinder-volume[84538]: DEBUG oslo_concurrency.lockutils [None req-12285ae6-6ae4-447d-9be0-56437c645e81 tempest-CreateVolumesFromSourceVolumeTest-1326097673 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=84538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 19:10:28 devstack cinder-volume[84538]: DEBUG cinder.volume.drivers.quobyte [None req-12285ae6-6ae4-447d-9be0-56437c645e81 tempest-CreateVolumesFromSourceVolumeTest-1326097673 None] Selected osci02.corp.quobyte.com/cinder-vol-34312b00-dd6d-45bb-af98-75855cea8e48 as target Quobyte volume. {{(pid=84538) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 29 19:10:28 devstack cinder-volume[84538]: INFO cinder.volume.drivers.remotefs [None req-12285ae6-6ae4-447d-9be0-56437c645e81 tempest-CreateVolumesFromSourceVolumeTest-1326097673 None] casted to osci02.corp.quobyte.com/cinder-vol-34312b00-dd6d-45bb-af98-75855cea8e48 Apr 29 19:10:28 devstack cinder-volume[84538]: DEBUG oslo_concurrency.processutils [None req-12285ae6-6ae4-447d-9be0-56437c645e81 tempest-CreateVolumesFromSourceVolumeTest-1326097673 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-1876ac2e-036d-473e-91b5-cd99e1c8a5b9 1073741824 {{(pid=84538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 19:10:28 devstack sudo[94560]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-1876ac2e-036d-473e-91b5-cd99e1c8a5b9 1073741824 Apr 29 19:10:28 devstack sudo[94560]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 19:10:28 devstack cinder-volume[84538]: DEBUG cinder.volume.manager [None req-b502e0c8-6a39-40f1-b5bd-0c6991e78d6a tempest-CreateVolumesFromSourceVolumeTest-1326097673 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8cc6060d-4861-4c5d-9626-3b7c6c37ec92) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f880cb45-048b-4ea0-a079-a3035dcbcced', 'volume_size': 1}' {{(pid=84538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 19:10:28 devstack cinder-volume[84538]: DEBUG cinder.volume.manager [None req-b502e0c8-6a39-40f1-b5bd-0c6991e78d6a tempest-CreateVolumesFromSourceVolumeTest-1326097673 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (55cdc6e1-bf33-4913-8307-5df844db9f63) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 19:10:28 devstack cinder-volume[84538]: INFO cinder.volume.flows.manager.create_volume [None req-b502e0c8-6a39-40f1-b5bd-0c6991e78d6a tempest-CreateVolumesFromSourceVolumeTest-1326097673 None] Volume volume-f880cb45-048b-4ea0-a079-a3035dcbcced (f880cb45-048b-4ea0-a079-a3035dcbcced): created successfully Apr 29 19:10:28 devstack cinder-volume[84538]: DEBUG cinder.volume.manager [None req-b502e0c8-6a39-40f1-b5bd-0c6991e78d6a tempest-CreateVolumesFromSourceVolumeTest-1326097673 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (55cdc6e1-bf33-4913-8307-5df844db9f63) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 19:10:28 devstack cinder-volume[84538]: DEBUG cinder.volume.manager [None req-b502e0c8-6a39-40f1-b5bd-0c6991e78d6a tempest-CreateVolumesFromSourceVolumeTest-1326097673 None] Flow 'volume_create_manager' (8ce962b4-cba2-40e0-ae27-86786f05048c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84538) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 19:10:28 devstack cinder-volume[84538]: INFO cinder.volume.manager [None req-b502e0c8-6a39-40f1-b5bd-0c6991e78d6a tempest-CreateVolumesFromSourceVolumeTest-1326097673 None] Created volume successfully. Apr 29 19:10:29 devstack sudo[94557]: pam_unix(sudo:session): session closed for user root Apr 29 19:10:29 devstack cinder-volume[84538]: DEBUG oslo_concurrency.processutils [None req-9fd030b3-f7d9-4be6-b95f-9a3c4c91f3e6 tempest-SnapshotDependencyTests-220526168 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-eda1676c-f078-4f06-beb1-99694d364faa" returned: 0 in 0.739s {{(pid=84538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 19:10:29 devstack cinder-volume[84538]: DEBUG oslo_concurrency.processutils [None req-9fd030b3-f7d9-4be6-b95f-9a3c4c91f3e6 tempest-SnapshotDependencyTests-220526168 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-eda1676c-f078-4f06-beb1-99694d364faa {{(pid=84538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 19:10:29 devstack sudo[94566]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-eda1676c-f078-4f06-beb1-99694d364faa Apr 29 19:10:29 devstack sudo[94566]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 19:10:29 devstack sudo[94560]: pam_unix(sudo:session): session closed for user root Apr 29 19:10:29 devstack cinder-volume[84538]: DEBUG oslo_concurrency.processutils [None req-12285ae6-6ae4-447d-9be0-56437c645e81 tempest-CreateVolumesFromSourceVolumeTest-1326097673 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-1876ac2e-036d-473e-91b5-cd99e1c8a5b9 1073741824" returned: 0 in 0.828s {{(pid=84538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 19:10:29 devstack cinder-volume[84538]: DEBUG oslo_concurrency.processutils [None req-12285ae6-6ae4-447d-9be0-56437c645e81 tempest-CreateVolumesFromSourceVolumeTest-1326097673 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-1876ac2e-036d-473e-91b5-cd99e1c8a5b9 {{(pid=84538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 19:10:29 devstack sudo[94571]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-1876ac2e-036d-473e-91b5-cd99e1c8a5b9 Apr 29 19:10:29 devstack sudo[94571]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 19:10:29 devstack sudo[94566]: pam_unix(sudo:session): session closed for user root Apr 29 19:10:29 devstack cinder-volume[84538]: DEBUG oslo_concurrency.processutils [None req-9fd030b3-f7d9-4be6-b95f-9a3c4c91f3e6 tempest-SnapshotDependencyTests-220526168 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-eda1676c-f078-4f06-beb1-99694d364faa" returned: 0 in 0.656s {{(pid=84538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 19:10:29 devstack cinder-volume[84538]: DEBUG cinder.coordination [None req-9fd030b3-f7d9-4be6-b95f-9a3c4c91f3e6 tempest-SnapshotDependencyTests-220526168 None] Lock "cinder-quobyte-eda1676c-f078-4f06-beb1-99694d364faa" released by "delete_volume" :: held 1.461s {{(pid=84538) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 19:10:30 devstack cinder-volume[84538]: DEBUG cinder.quota [None req-9fd030b3-f7d9-4be6-b95f-9a3c4c91f3e6 tempest-SnapshotDependencyTests-220526168 None] Created reservations ['5060e074-5ad7-4e93-8f9d-2a1ca1cd0c5a', '77df5561-4f87-44ca-b433-237319d1dbb8', 'c47fe094-7b61-480c-8714-752f4d4cdde5', '0de2822c-bebb-450b-8f7b-7dacb9ae97f2'] {{(pid=84538) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 29 19:10:30 devstack cinder-volume[84538]: DEBUG oslo_concurrency.lockutils [None req-9fd030b3-f7d9-4be6-b95f-9a3c4c91f3e6 tempest-SnapshotDependencyTests-220526168 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 19:10:30 devstack cinder-volume[84538]: DEBUG oslo_concurrency.lockutils [None req-9fd030b3-f7d9-4be6-b95f-9a3c4c91f3e6 tempest-SnapshotDependencyTests-220526168 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 19:10:30 devstack cinder-volume[84538]: DEBUG cinder.volume.drivers.quobyte [None req-9fd030b3-f7d9-4be6-b95f-9a3c4c91f3e6 tempest-SnapshotDependencyTests-220526168 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-34312b00-dd6d-45bb-af98-75855cea8e48': None} {{(pid=84538) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 19:10:30 devstack cinder-volume[84538]: DEBUG cinder.volume.drivers.quobyte [None req-9fd030b3-f7d9-4be6-b95f-9a3c4c91f3e6 tempest-SnapshotDependencyTests-220526168 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-34312b00-dd6d-45bb-af98-75855cea8e48'] {{(pid=84538) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 19:10:30 devstack cinder-volume[84538]: DEBUG oslo_concurrency.lockutils [None req-9fd030b3-f7d9-4be6-b95f-9a3c4c91f3e6 tempest-SnapshotDependencyTests-220526168 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=84538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 19:10:30 devstack cinder-volume[84538]: DEBUG oslo_concurrency.processutils [None req-9fd030b3-f7d9-4be6-b95f-9a3c4c91f3e6 tempest-SnapshotDependencyTests-220526168 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d {{(pid=84538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 19:10:30 devstack sudo[94574]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d Apr 29 19:10:30 devstack sudo[94574]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 19:10:30 devstack sudo[94571]: pam_unix(sudo:session): session closed for user root Apr 29 19:10:30 devstack cinder-volume[84538]: DEBUG oslo_concurrency.processutils [None req-12285ae6-6ae4-447d-9be0-56437c645e81 tempest-CreateVolumesFromSourceVolumeTest-1326097673 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-1876ac2e-036d-473e-91b5-cd99e1c8a5b9" returned: 0 in 0.652s {{(pid=84538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 19:10:30 devstack cinder-volume[84538]: DEBUG cinder.volume.drivers.quobyte [None req-12285ae6-6ae4-447d-9be0-56437c645e81 tempest-CreateVolumesFromSourceVolumeTest-1326097673 None] <== create_volume: return (1525ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-34312b00-dd6d-45bb-af98-75855cea8e48'} {{(pid=84538) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 29 19:10:30 devstack cinder-volume[84538]: DEBUG oslo_concurrency.lockutils [None req-12285ae6-6ae4-447d-9be0-56437c645e81 tempest-CreateVolumesFromSourceVolumeTest-1326097673 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.528s {{(pid=84538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 19:10:30 devstack cinder-volume[84538]: DEBUG oslo_concurrency.lockutils [None req-094719ab-8e93-40a0-84a6-3d888d9d33dc tempest-CreateVolumesFromSourceVolumeTest-1326097673 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 11.247s {{(pid=84538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 19:10:30 devstack cinder-volume[84538]: DEBUG cinder.volume.drivers.quobyte [None req-094719ab-8e93-40a0-84a6-3d888d9d33dc tempest-CreateVolumesFromSourceVolumeTest-1326097673 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-29T17:10:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1041332802',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8405e6d8-b9e3-4444-a005-f4cedd4c10e4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f0f77d776291439f94be3377da80ddc1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T17:10:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T17:10:19Z,use_quota=True,user_id='de7143a50d0a4e579e2e95a28ec120d6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(62b05900-93e3-4190-a88f-1d87324303d1),volume_type_id=62b05900-93e3-4190-a88f-1d87324303d1)}" {{(pid=84538) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 29 19:10:30 devstack cinder-volume[84538]: DEBUG cinder.volume.drivers.remotefs [None req-094719ab-8e93-40a0-84a6-3d888d9d33dc tempest-CreateVolumesFromSourceVolumeTest-1326097673 None] Creating volume 8405e6d8-b9e3-4444-a005-f4cedd4c10e4 {{(pid=84538) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 29 19:10:30 devstack cinder-volume[84538]: DEBUG oslo_concurrency.lockutils [None req-094719ab-8e93-40a0-84a6-3d888d9d33dc tempest-CreateVolumesFromSourceVolumeTest-1326097673 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 19:10:30 devstack cinder-volume[84538]: DEBUG oslo_concurrency.lockutils [None req-094719ab-8e93-40a0-84a6-3d888d9d33dc tempest-CreateVolumesFromSourceVolumeTest-1326097673 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=84538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 19:10:30 devstack cinder-volume[84538]: DEBUG cinder.volume.drivers.quobyte [None req-094719ab-8e93-40a0-84a6-3d888d9d33dc tempest-CreateVolumesFromSourceVolumeTest-1326097673 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-34312b00-dd6d-45bb-af98-75855cea8e48': None} {{(pid=84538) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 19:10:30 devstack cinder-volume[84538]: DEBUG cinder.volume.drivers.quobyte [None req-094719ab-8e93-40a0-84a6-3d888d9d33dc tempest-CreateVolumesFromSourceVolumeTest-1326097673 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-34312b00-dd6d-45bb-af98-75855cea8e48'] {{(pid=84538) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 19:10:30 devstack cinder-volume[84538]: DEBUG oslo_concurrency.lockutils [None req-094719ab-8e93-40a0-84a6-3d888d9d33dc tempest-CreateVolumesFromSourceVolumeTest-1326097673 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=84538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 19:10:30 devstack cinder-volume[84538]: DEBUG cinder.volume.drivers.quobyte [None req-094719ab-8e93-40a0-84a6-3d888d9d33dc tempest-CreateVolumesFromSourceVolumeTest-1326097673 None] Selected osci02.corp.quobyte.com/cinder-vol-34312b00-dd6d-45bb-af98-75855cea8e48 as target Quobyte volume. {{(pid=84538) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 29 19:10:30 devstack cinder-volume[84538]: INFO cinder.volume.drivers.remotefs [None req-094719ab-8e93-40a0-84a6-3d888d9d33dc tempest-CreateVolumesFromSourceVolumeTest-1326097673 None] casted to osci02.corp.quobyte.com/cinder-vol-34312b00-dd6d-45bb-af98-75855cea8e48 Apr 29 19:10:30 devstack cinder-volume[84538]: DEBUG oslo_concurrency.processutils [None req-094719ab-8e93-40a0-84a6-3d888d9d33dc tempest-CreateVolumesFromSourceVolumeTest-1326097673 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-8405e6d8-b9e3-4444-a005-f4cedd4c10e4 1073741824 {{(pid=84538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 19:10:30 devstack sudo[94577]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-8405e6d8-b9e3-4444-a005-f4cedd4c10e4 1073741824 Apr 29 19:10:30 devstack sudo[94577]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 19:10:30 devstack cinder-volume[84538]: DEBUG cinder.volume.manager [None req-12285ae6-6ae4-447d-9be0-56437c645e81 tempest-CreateVolumesFromSourceVolumeTest-1326097673 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9ad996c4-6046-4f1a-b863-f97d80d42d0f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1876ac2e-036d-473e-91b5-cd99e1c8a5b9', 'volume_size': 1}' {{(pid=84538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 19:10:30 devstack cinder-volume[84538]: DEBUG cinder.volume.manager [None req-12285ae6-6ae4-447d-9be0-56437c645e81 tempest-CreateVolumesFromSourceVolumeTest-1326097673 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (27c79b15-4e15-430e-8be8-76c7b9eedb11) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 19:10:30 devstack cinder-volume[84538]: INFO cinder.volume.flows.manager.create_volume [None req-12285ae6-6ae4-447d-9be0-56437c645e81 tempest-CreateVolumesFromSourceVolumeTest-1326097673 None] Volume volume-1876ac2e-036d-473e-91b5-cd99e1c8a5b9 (1876ac2e-036d-473e-91b5-cd99e1c8a5b9): created successfully Apr 29 19:10:30 devstack cinder-volume[84538]: DEBUG cinder.volume.manager [None req-12285ae6-6ae4-447d-9be0-56437c645e81 tempest-CreateVolumesFromSourceVolumeTest-1326097673 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (27c79b15-4e15-430e-8be8-76c7b9eedb11) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 19:10:30 devstack cinder-volume[84538]: DEBUG cinder.volume.manager [None req-12285ae6-6ae4-447d-9be0-56437c645e81 tempest-CreateVolumesFromSourceVolumeTest-1326097673 None] Flow 'volume_create_manager' (31cd82b4-a80e-4b4b-8809-fbff7381e90c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84538) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 19:10:30 devstack cinder-volume[84538]: INFO cinder.volume.manager [None req-12285ae6-6ae4-447d-9be0-56437c645e81 tempest-CreateVolumesFromSourceVolumeTest-1326097673 None] Created volume successfully. Apr 29 19:10:30 devstack cinder-volume[84538]: DEBUG cinder.coordination [None req-d2832826-3124-4930-89e7-f0399a5a0a36 tempest-SnapshotDependencyTests-220526168 None] Acquiring lock "cinder-64cda84e-3ede-44e2-b879-2f19a175f02c-delete_volume" by "delete_volume" {{(pid=84538) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 19:10:30 devstack cinder-volume[84538]: DEBUG cinder.coordination [None req-d2832826-3124-4930-89e7-f0399a5a0a36 tempest-SnapshotDependencyTests-220526168 None] Lock "cinder-64cda84e-3ede-44e2-b879-2f19a175f02c-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=84538) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 19:10:30 devstack cinder-volume[84538]: DEBUG cinder.coordination [None req-d2832826-3124-4930-89e7-f0399a5a0a36 tempest-SnapshotDependencyTests-220526168 None] Acquiring lock "cinder-quobyte-64cda84e-3ede-44e2-b879-2f19a175f02c" by "delete_volume" {{(pid=84538) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 19:10:30 devstack sudo[94574]: pam_unix(sudo:session): session closed for user root Apr 29 19:10:30 devstack cinder-volume[84538]: DEBUG oslo_concurrency.processutils [None req-9fd030b3-f7d9-4be6-b95f-9a3c4c91f3e6 tempest-SnapshotDependencyTests-220526168 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d" returned: 0 in 0.654s {{(pid=84538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 19:10:30 devstack cinder-volume[84538]: DEBUG cinder.manager [None req-9fd030b3-f7d9-4be6-b95f-9a3c4c91f3e6 tempest-SnapshotDependencyTests-220526168 None] Notifying Schedulers of capabilities ... {{(pid=84538) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 29 19:10:30 devstack cinder-volume[84538]: DEBUG cinder.coordination [None req-d2832826-3124-4930-89e7-f0399a5a0a36 tempest-SnapshotDependencyTests-220526168 None] Lock "cinder-quobyte-64cda84e-3ede-44e2-b879-2f19a175f02c" acquired by "delete_volume" :: waited 0.017s {{(pid=84538) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 19:10:30 devstack cinder-volume[84538]: INFO cinder.volume.manager [None req-9fd030b3-f7d9-4be6-b95f-9a3c4c91f3e6 tempest-SnapshotDependencyTests-220526168 None] Deleted volume successfully. Apr 29 19:10:30 devstack cinder-volume[84538]: DEBUG oslo.privsep.daemon [-] privsep: reply[ecad9e5d-6c3a-4f2f-91d1-a0cc53527ce2]: (4, 'qcow2') {{(pid=85803) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 19:10:30 devstack cinder-volume[84538]: DEBUG oslo_concurrency.processutils [None req-d2832826-3124-4930-89e7-f0399a5a0a36 tempest-SnapshotDependencyTests-220526168 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-64cda84e-3ede-44e2-b879-2f19a175f02c {{(pid=84538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 19:10:30 devstack cinder-volume[84538]: DEBUG cinder.coordination [None req-9fd030b3-f7d9-4be6-b95f-9a3c4c91f3e6 tempest-SnapshotDependencyTests-220526168 None] Lock "cinder-eda1676c-f078-4f06-beb1-99694d364faa-delete_volume" released by "delete_volume" :: held 2.369s {{(pid=84538) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 19:10:30 devstack sudo[94580]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-64cda84e-3ede-44e2-b879-2f19a175f02c Apr 29 19:10:30 devstack sudo[94580]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 19:10:31 devstack sudo[94577]: pam_unix(sudo:session): session closed for user root Apr 29 19:10:31 devstack cinder-volume[84538]: DEBUG oslo_concurrency.processutils [None req-094719ab-8e93-40a0-84a6-3d888d9d33dc tempest-CreateVolumesFromSourceVolumeTest-1326097673 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-8405e6d8-b9e3-4444-a005-f4cedd4c10e4 1073741824" returned: 0 in 0.820s {{(pid=84538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 19:10:31 devstack cinder-volume[84538]: DEBUG oslo_concurrency.processutils [None req-094719ab-8e93-40a0-84a6-3d888d9d33dc tempest-CreateVolumesFromSourceVolumeTest-1326097673 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-8405e6d8-b9e3-4444-a005-f4cedd4c10e4 {{(pid=84538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 19:10:31 devstack sudo[94585]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-8405e6d8-b9e3-4444-a005-f4cedd4c10e4 Apr 29 19:10:31 devstack sudo[94585]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 19:10:31 devstack sudo[94580]: pam_unix(sudo:session): session closed for user root Apr 29 19:10:31 devstack cinder-volume[84538]: DEBUG oslo_concurrency.processutils [None req-d2832826-3124-4930-89e7-f0399a5a0a36 tempest-SnapshotDependencyTests-220526168 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-64cda84e-3ede-44e2-b879-2f19a175f02c" returned: 0 in 0.777s {{(pid=84538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 19:10:31 devstack cinder-volume[84538]: DEBUG oslo_concurrency.processutils [None req-d2832826-3124-4930-89e7-f0399a5a0a36 tempest-SnapshotDependencyTests-220526168 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-64cda84e-3ede-44e2-b879-2f19a175f02c {{(pid=84538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 19:10:31 devstack sudo[94590]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-64cda84e-3ede-44e2-b879-2f19a175f02c Apr 29 19:10:31 devstack sudo[94590]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 19:10:31 devstack sudo[94585]: pam_unix(sudo:session): session closed for user root Apr 29 19:10:31 devstack cinder-volume[84538]: DEBUG oslo_concurrency.processutils [None req-094719ab-8e93-40a0-84a6-3d888d9d33dc tempest-CreateVolumesFromSourceVolumeTest-1326097673 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-8405e6d8-b9e3-4444-a005-f4cedd4c10e4" returned: 0 in 0.596s {{(pid=84538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 19:10:31 devstack cinder-volume[84538]: DEBUG cinder.volume.drivers.quobyte [None req-094719ab-8e93-40a0-84a6-3d888d9d33dc tempest-CreateVolumesFromSourceVolumeTest-1326097673 None] <== create_volume: return (1458ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-34312b00-dd6d-45bb-af98-75855cea8e48'} {{(pid=84538) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 29 19:10:31 devstack cinder-volume[84538]: DEBUG oslo_concurrency.lockutils [None req-094719ab-8e93-40a0-84a6-3d888d9d33dc tempest-CreateVolumesFromSourceVolumeTest-1326097673 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.463s {{(pid=84538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 19:10:31 devstack cinder-volume[84538]: DEBUG cinder.volume.manager [None req-094719ab-8e93-40a0-84a6-3d888d9d33dc tempest-CreateVolumesFromSourceVolumeTest-1326097673 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (420b07fc-844d-422b-a134-f5d56cfdba58) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8405e6d8-b9e3-4444-a005-f4cedd4c10e4', 'volume_size': 1}' {{(pid=84538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 19:10:31 devstack cinder-volume[84538]: DEBUG cinder.volume.manager [None req-094719ab-8e93-40a0-84a6-3d888d9d33dc tempest-CreateVolumesFromSourceVolumeTest-1326097673 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c80c2897-e630-471e-80cb-969d9c74872a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 19:10:31 devstack cinder-volume[84538]: INFO cinder.volume.flows.manager.create_volume [None req-094719ab-8e93-40a0-84a6-3d888d9d33dc tempest-CreateVolumesFromSourceVolumeTest-1326097673 None] Volume volume-8405e6d8-b9e3-4444-a005-f4cedd4c10e4 (8405e6d8-b9e3-4444-a005-f4cedd4c10e4): created successfully Apr 29 19:10:31 devstack cinder-volume[84538]: DEBUG cinder.volume.manager [None req-094719ab-8e93-40a0-84a6-3d888d9d33dc tempest-CreateVolumesFromSourceVolumeTest-1326097673 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c80c2897-e630-471e-80cb-969d9c74872a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 19:10:31 devstack cinder-volume[84538]: DEBUG cinder.volume.manager [None req-094719ab-8e93-40a0-84a6-3d888d9d33dc tempest-CreateVolumesFromSourceVolumeTest-1326097673 None] Flow 'volume_create_manager' (2f2e91c2-c3cb-4df9-9c3f-7d3a85567555) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84538) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 19:10:31 devstack cinder-volume[84538]: INFO cinder.volume.manager [None req-094719ab-8e93-40a0-84a6-3d888d9d33dc tempest-CreateVolumesFromSourceVolumeTest-1326097673 None] Created volume successfully. Apr 29 19:10:32 devstack sudo[94590]: pam_unix(sudo:session): session closed for user root Apr 29 19:10:32 devstack cinder-volume[84538]: DEBUG oslo_concurrency.processutils [None req-d2832826-3124-4930-89e7-f0399a5a0a36 tempest-SnapshotDependencyTests-220526168 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-64cda84e-3ede-44e2-b879-2f19a175f02c" returned: 0 in 0.615s {{(pid=84538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 19:10:32 devstack cinder-volume[84538]: DEBUG cinder.coordination [None req-d2832826-3124-4930-89e7-f0399a5a0a36 tempest-SnapshotDependencyTests-220526168 None] Lock "cinder-quobyte-64cda84e-3ede-44e2-b879-2f19a175f02c" released by "delete_volume" :: held 1.445s {{(pid=84538) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 19:10:32 devstack cinder-volume[84538]: DEBUG cinder.quota [None req-d2832826-3124-4930-89e7-f0399a5a0a36 tempest-SnapshotDependencyTests-220526168 None] Created reservations ['83414310-903e-4524-85ff-87125cd4ce8d', '941779a4-1aa3-4765-831b-07d7c2db6977', 'd7563601-79ad-40e1-aa32-62fa93b0962a', 'a28fad10-0f7e-4bc7-a283-bf7621da5c18'] {{(pid=84538) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 29 19:10:32 devstack cinder-volume[84538]: DEBUG oslo_concurrency.lockutils [None req-d2832826-3124-4930-89e7-f0399a5a0a36 tempest-SnapshotDependencyTests-220526168 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 19:10:32 devstack cinder-volume[84538]: DEBUG oslo_concurrency.lockutils [None req-d2832826-3124-4930-89e7-f0399a5a0a36 tempest-SnapshotDependencyTests-220526168 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 19:10:32 devstack cinder-volume[84538]: DEBUG cinder.volume.drivers.quobyte [None req-d2832826-3124-4930-89e7-f0399a5a0a36 tempest-SnapshotDependencyTests-220526168 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-34312b00-dd6d-45bb-af98-75855cea8e48': None} {{(pid=84538) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 19:10:32 devstack cinder-volume[84538]: DEBUG cinder.volume.drivers.quobyte [None req-d2832826-3124-4930-89e7-f0399a5a0a36 tempest-SnapshotDependencyTests-220526168 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-34312b00-dd6d-45bb-af98-75855cea8e48'] {{(pid=84538) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 19:10:32 devstack cinder-volume[84538]: DEBUG oslo_concurrency.lockutils [None req-d2832826-3124-4930-89e7-f0399a5a0a36 tempest-SnapshotDependencyTests-220526168 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=84538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 19:10:32 devstack cinder-volume[84538]: DEBUG oslo_concurrency.processutils [None req-d2832826-3124-4930-89e7-f0399a5a0a36 tempest-SnapshotDependencyTests-220526168 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d {{(pid=84538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 19:10:32 devstack sudo[94594]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d Apr 29 19:10:32 devstack sudo[94594]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 19:10:32 devstack cinder-volume[84538]: DEBUG cinder.coordination [None req-37fe5166-42da-47f4-bf9e-91d7e6b0ef2e tempest-CreateVolumesFromSourceVolumeTest-1326097673 None] Acquiring lock "cinder-8405e6d8-b9e3-4444-a005-f4cedd4c10e4-delete_volume" by "delete_volume" {{(pid=84538) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 19:10:32 devstack cinder-volume[84538]: DEBUG cinder.coordination [None req-37fe5166-42da-47f4-bf9e-91d7e6b0ef2e tempest-CreateVolumesFromSourceVolumeTest-1326097673 None] Lock "cinder-8405e6d8-b9e3-4444-a005-f4cedd4c10e4-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=84538) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 19:10:32 devstack cinder-volume[84538]: DEBUG cinder.coordination [None req-37fe5166-42da-47f4-bf9e-91d7e6b0ef2e tempest-CreateVolumesFromSourceVolumeTest-1326097673 None] Acquiring lock "cinder-quobyte-8405e6d8-b9e3-4444-a005-f4cedd4c10e4" by "delete_volume" {{(pid=84538) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 19:10:32 devstack cinder-volume[84538]: DEBUG cinder.coordination [None req-37fe5166-42da-47f4-bf9e-91d7e6b0ef2e tempest-CreateVolumesFromSourceVolumeTest-1326097673 None] Lock "cinder-quobyte-8405e6d8-b9e3-4444-a005-f4cedd4c10e4" acquired by "delete_volume" :: waited 0.016s {{(pid=84538) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 19:10:32 devstack cinder-volume[84538]: DEBUG oslo.privsep.daemon [-] privsep: reply[12ddeac5-ebaa-43a7-a586-3b07cd531306]: (4, 'qcow2') {{(pid=85803) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 19:10:32 devstack cinder-volume[84538]: DEBUG oslo_concurrency.processutils [None req-37fe5166-42da-47f4-bf9e-91d7e6b0ef2e tempest-CreateVolumesFromSourceVolumeTest-1326097673 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-8405e6d8-b9e3-4444-a005-f4cedd4c10e4 {{(pid=84538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 19:10:32 devstack sudo[94596]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-8405e6d8-b9e3-4444-a005-f4cedd4c10e4 Apr 29 19:10:32 devstack sudo[94596]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 19:10:32 devstack sudo[94594]: pam_unix(sudo:session): session closed for user root Apr 29 19:10:32 devstack cinder-volume[84538]: DEBUG oslo_concurrency.processutils [None req-d2832826-3124-4930-89e7-f0399a5a0a36 tempest-SnapshotDependencyTests-220526168 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d" returned: 0 in 0.636s {{(pid=84538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 19:10:32 devstack cinder-volume[84538]: DEBUG cinder.manager [None req-d2832826-3124-4930-89e7-f0399a5a0a36 tempest-SnapshotDependencyTests-220526168 None] Notifying Schedulers of capabilities ... {{(pid=84538) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 29 19:10:32 devstack cinder-volume[84538]: INFO cinder.volume.manager [None req-d2832826-3124-4930-89e7-f0399a5a0a36 tempest-SnapshotDependencyTests-220526168 None] Deleted volume successfully. Apr 29 19:10:32 devstack cinder-volume[84538]: DEBUG cinder.coordination [None req-d2832826-3124-4930-89e7-f0399a5a0a36 tempest-SnapshotDependencyTests-220526168 None] Lock "cinder-64cda84e-3ede-44e2-b879-2f19a175f02c-delete_volume" released by "delete_volume" :: held 2.289s {{(pid=84538) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 19:10:33 devstack sudo[94596]: pam_unix(sudo:session): session closed for user root Apr 29 19:10:33 devstack cinder-volume[84538]: DEBUG oslo_concurrency.processutils [None req-37fe5166-42da-47f4-bf9e-91d7e6b0ef2e tempest-CreateVolumesFromSourceVolumeTest-1326097673 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-8405e6d8-b9e3-4444-a005-f4cedd4c10e4" returned: 0 in 0.784s {{(pid=84538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 19:10:33 devstack cinder-volume[84538]: DEBUG oslo_concurrency.processutils [None req-37fe5166-42da-47f4-bf9e-91d7e6b0ef2e tempest-CreateVolumesFromSourceVolumeTest-1326097673 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-8405e6d8-b9e3-4444-a005-f4cedd4c10e4 {{(pid=84538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 19:10:33 devstack sudo[94602]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-8405e6d8-b9e3-4444-a005-f4cedd4c10e4 Apr 29 19:10:33 devstack sudo[94602]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 19:10:33 devstack sudo[94602]: pam_unix(sudo:session): session closed for user root Apr 29 19:10:33 devstack cinder-volume[84538]: DEBUG oslo_concurrency.processutils [None req-37fe5166-42da-47f4-bf9e-91d7e6b0ef2e tempest-CreateVolumesFromSourceVolumeTest-1326097673 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-8405e6d8-b9e3-4444-a005-f4cedd4c10e4" returned: 0 in 0.634s {{(pid=84538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 19:10:33 devstack cinder-volume[84538]: DEBUG cinder.coordination [None req-37fe5166-42da-47f4-bf9e-91d7e6b0ef2e tempest-CreateVolumesFromSourceVolumeTest-1326097673 None] Lock "cinder-quobyte-8405e6d8-b9e3-4444-a005-f4cedd4c10e4" released by "delete_volume" :: held 1.456s {{(pid=84538) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 19:10:33 devstack cinder-volume[84538]: DEBUG cinder.quota [None req-37fe5166-42da-47f4-bf9e-91d7e6b0ef2e tempest-CreateVolumesFromSourceVolumeTest-1326097673 None] Created reservations ['ea6e960b-62a0-405b-8ba4-3b0ad05c3d2c', 'deb22bfe-9b5c-4a7a-b5fc-627eeba782a7', '8f273134-f500-4c4d-aea1-d13a0776e751', 'ac35318d-2b86-47cd-bbcc-b499807394de'] {{(pid=84538) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 29 19:10:34 devstack cinder-volume[84538]: DEBUG oslo_concurrency.lockutils [None req-37fe5166-42da-47f4-bf9e-91d7e6b0ef2e tempest-CreateVolumesFromSourceVolumeTest-1326097673 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 19:10:34 devstack cinder-volume[84538]: DEBUG oslo_concurrency.lockutils [None req-37fe5166-42da-47f4-bf9e-91d7e6b0ef2e tempest-CreateVolumesFromSourceVolumeTest-1326097673 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 19:10:34 devstack cinder-volume[84538]: DEBUG cinder.volume.drivers.quobyte [None req-37fe5166-42da-47f4-bf9e-91d7e6b0ef2e tempest-CreateVolumesFromSourceVolumeTest-1326097673 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-34312b00-dd6d-45bb-af98-75855cea8e48': None} {{(pid=84538) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 19:10:34 devstack cinder-volume[84538]: DEBUG cinder.volume.drivers.quobyte [None req-37fe5166-42da-47f4-bf9e-91d7e6b0ef2e tempest-CreateVolumesFromSourceVolumeTest-1326097673 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-34312b00-dd6d-45bb-af98-75855cea8e48'] {{(pid=84538) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 19:10:34 devstack cinder-volume[84538]: DEBUG oslo_concurrency.lockutils [None req-37fe5166-42da-47f4-bf9e-91d7e6b0ef2e tempest-CreateVolumesFromSourceVolumeTest-1326097673 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=84538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 19:10:34 devstack cinder-volume[84538]: DEBUG oslo_concurrency.processutils [None req-37fe5166-42da-47f4-bf9e-91d7e6b0ef2e tempest-CreateVolumesFromSourceVolumeTest-1326097673 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d {{(pid=84538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 19:10:34 devstack sudo[94605]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d Apr 29 19:10:34 devstack sudo[94605]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 19:10:34 devstack cinder-volume[84538]: DEBUG cinder.coordination [None req-8489f89e-da13-484c-bd8a-c6e3aaba50a3 tempest-CreateVolumesFromSourceVolumeTest-1326097673 None] Acquiring lock "cinder-1876ac2e-036d-473e-91b5-cd99e1c8a5b9-delete_volume" by "delete_volume" {{(pid=84538) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 19:10:34 devstack cinder-volume[84538]: DEBUG cinder.coordination [None req-8489f89e-da13-484c-bd8a-c6e3aaba50a3 tempest-CreateVolumesFromSourceVolumeTest-1326097673 None] Lock "cinder-1876ac2e-036d-473e-91b5-cd99e1c8a5b9-delete_volume" acquired by "delete_volume" :: waited 0.032s {{(pid=84538) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 19:10:34 devstack sudo[94605]: pam_unix(sudo:session): session closed for user root Apr 29 19:10:34 devstack cinder-volume[84538]: DEBUG cinder.coordination [None req-8489f89e-da13-484c-bd8a-c6e3aaba50a3 tempest-CreateVolumesFromSourceVolumeTest-1326097673 None] Acquiring lock "cinder-quobyte-1876ac2e-036d-473e-91b5-cd99e1c8a5b9" by "delete_volume" {{(pid=84538) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 19:10:34 devstack cinder-volume[84538]: DEBUG oslo_concurrency.processutils [None req-37fe5166-42da-47f4-bf9e-91d7e6b0ef2e tempest-CreateVolumesFromSourceVolumeTest-1326097673 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d" returned: 0 in 0.669s {{(pid=84538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 19:10:34 devstack cinder-volume[84538]: DEBUG cinder.manager [None req-37fe5166-42da-47f4-bf9e-91d7e6b0ef2e tempest-CreateVolumesFromSourceVolumeTest-1326097673 None] Notifying Schedulers of capabilities ... {{(pid=84538) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 29 19:10:34 devstack cinder-volume[84538]: INFO cinder.volume.manager [None req-37fe5166-42da-47f4-bf9e-91d7e6b0ef2e tempest-CreateVolumesFromSourceVolumeTest-1326097673 None] Deleted volume successfully. Apr 29 19:10:34 devstack cinder-volume[84538]: DEBUG cinder.coordination [None req-8489f89e-da13-484c-bd8a-c6e3aaba50a3 tempest-CreateVolumesFromSourceVolumeTest-1326097673 None] Lock "cinder-quobyte-1876ac2e-036d-473e-91b5-cd99e1c8a5b9" acquired by "delete_volume" :: waited 0.025s {{(pid=84538) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 19:10:34 devstack cinder-volume[84538]: DEBUG oslo.privsep.daemon [-] privsep: reply[74ce71ef-1dfd-4881-b7b6-dc389a25d688]: (4, 'qcow2') {{(pid=85803) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 19:10:34 devstack cinder-volume[84538]: DEBUG oslo_concurrency.processutils [None req-8489f89e-da13-484c-bd8a-c6e3aaba50a3 tempest-CreateVolumesFromSourceVolumeTest-1326097673 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-1876ac2e-036d-473e-91b5-cd99e1c8a5b9 {{(pid=84538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 19:10:34 devstack cinder-volume[84538]: DEBUG cinder.coordination [None req-37fe5166-42da-47f4-bf9e-91d7e6b0ef2e tempest-CreateVolumesFromSourceVolumeTest-1326097673 None] Lock "cinder-8405e6d8-b9e3-4444-a005-f4cedd4c10e4-delete_volume" released by "delete_volume" :: held 2.367s {{(pid=84538) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 19:10:34 devstack sudo[94609]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-1876ac2e-036d-473e-91b5-cd99e1c8a5b9 Apr 29 19:10:34 devstack sudo[94609]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 19:10:35 devstack sudo[94609]: pam_unix(sudo:session): session closed for user root Apr 29 19:10:35 devstack cinder-volume[84538]: DEBUG oslo_concurrency.processutils [None req-8489f89e-da13-484c-bd8a-c6e3aaba50a3 tempest-CreateVolumesFromSourceVolumeTest-1326097673 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-1876ac2e-036d-473e-91b5-cd99e1c8a5b9" returned: 0 in 0.740s {{(pid=84538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 19:10:35 devstack cinder-volume[84538]: DEBUG oslo_concurrency.processutils [None req-8489f89e-da13-484c-bd8a-c6e3aaba50a3 tempest-CreateVolumesFromSourceVolumeTest-1326097673 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-1876ac2e-036d-473e-91b5-cd99e1c8a5b9 {{(pid=84538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 19:10:35 devstack sudo[94614]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-1876ac2e-036d-473e-91b5-cd99e1c8a5b9 Apr 29 19:10:35 devstack sudo[94614]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 19:10:36 devstack sudo[94614]: pam_unix(sudo:session): session closed for user root Apr 29 19:10:36 devstack cinder-volume[84538]: DEBUG oslo_concurrency.processutils [None req-8489f89e-da13-484c-bd8a-c6e3aaba50a3 tempest-CreateVolumesFromSourceVolumeTest-1326097673 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-1876ac2e-036d-473e-91b5-cd99e1c8a5b9" returned: 0 in 0.654s {{(pid=84538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 19:10:36 devstack cinder-volume[84538]: DEBUG cinder.coordination [None req-8489f89e-da13-484c-bd8a-c6e3aaba50a3 tempest-CreateVolumesFromSourceVolumeTest-1326097673 None] Lock "cinder-quobyte-1876ac2e-036d-473e-91b5-cd99e1c8a5b9" released by "delete_volume" :: held 1.438s {{(pid=84538) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 19:10:36 devstack cinder-volume[84538]: DEBUG cinder.quota [None req-8489f89e-da13-484c-bd8a-c6e3aaba50a3 tempest-CreateVolumesFromSourceVolumeTest-1326097673 None] Created reservations ['0a7aea7a-6988-4c14-b25a-d7defbdc93d3', 'cdfda647-2e02-4c24-81af-122798410737', '434bd9be-9000-49f5-bd80-304826b92ab1', '208afd40-6b49-4d70-9d0a-013dd182cff6'] {{(pid=84538) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 29 19:10:36 devstack cinder-volume[84538]: DEBUG oslo_concurrency.lockutils [None req-8489f89e-da13-484c-bd8a-c6e3aaba50a3 tempest-CreateVolumesFromSourceVolumeTest-1326097673 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 19:10:36 devstack cinder-volume[84538]: DEBUG oslo_concurrency.lockutils [None req-8489f89e-da13-484c-bd8a-c6e3aaba50a3 tempest-CreateVolumesFromSourceVolumeTest-1326097673 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 19:10:36 devstack cinder-volume[84538]: DEBUG cinder.volume.drivers.quobyte [None req-8489f89e-da13-484c-bd8a-c6e3aaba50a3 tempest-CreateVolumesFromSourceVolumeTest-1326097673 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-34312b00-dd6d-45bb-af98-75855cea8e48': None} {{(pid=84538) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 19:10:36 devstack cinder-volume[84538]: DEBUG cinder.volume.drivers.quobyte [None req-8489f89e-da13-484c-bd8a-c6e3aaba50a3 tempest-CreateVolumesFromSourceVolumeTest-1326097673 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-34312b00-dd6d-45bb-af98-75855cea8e48'] {{(pid=84538) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 19:10:36 devstack cinder-volume[84538]: DEBUG oslo_concurrency.lockutils [None req-8489f89e-da13-484c-bd8a-c6e3aaba50a3 tempest-CreateVolumesFromSourceVolumeTest-1326097673 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=84538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 19:10:36 devstack cinder-volume[84538]: DEBUG oslo_concurrency.processutils [None req-8489f89e-da13-484c-bd8a-c6e3aaba50a3 tempest-CreateVolumesFromSourceVolumeTest-1326097673 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d {{(pid=84538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 19:10:36 devstack sudo[94617]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d Apr 29 19:10:36 devstack sudo[94617]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 19:10:36 devstack cinder-volume[84538]: DEBUG cinder.coordination [None req-7cecc61d-7dae-4cc5-8d1f-1ae7b4fb9203 tempest-CreateVolumesFromSourceVolumeTest-1326097673 None] Acquiring lock "cinder-f880cb45-048b-4ea0-a079-a3035dcbcced-delete_volume" by "delete_volume" {{(pid=84538) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 19:10:36 devstack cinder-volume[84538]: DEBUG cinder.coordination [None req-7cecc61d-7dae-4cc5-8d1f-1ae7b4fb9203 tempest-CreateVolumesFromSourceVolumeTest-1326097673 None] Lock "cinder-f880cb45-048b-4ea0-a079-a3035dcbcced-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=84538) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 19:10:36 devstack sudo[94617]: pam_unix(sudo:session): session closed for user root Apr 29 19:10:36 devstack cinder-volume[84538]: DEBUG oslo_concurrency.processutils [None req-8489f89e-da13-484c-bd8a-c6e3aaba50a3 tempest-CreateVolumesFromSourceVolumeTest-1326097673 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d" returned: 0 in 0.663s {{(pid=84538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 19:10:36 devstack cinder-volume[84538]: DEBUG cinder.manager [None req-8489f89e-da13-484c-bd8a-c6e3aaba50a3 tempest-CreateVolumesFromSourceVolumeTest-1326097673 None] Notifying Schedulers of capabilities ... {{(pid=84538) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 29 19:10:36 devstack cinder-volume[84538]: INFO cinder.volume.manager [None req-8489f89e-da13-484c-bd8a-c6e3aaba50a3 tempest-CreateVolumesFromSourceVolumeTest-1326097673 None] Deleted volume successfully. Apr 29 19:10:37 devstack cinder-volume[84538]: DEBUG cinder.coordination [None req-7cecc61d-7dae-4cc5-8d1f-1ae7b4fb9203 tempest-CreateVolumesFromSourceVolumeTest-1326097673 None] Acquiring lock "cinder-quobyte-f880cb45-048b-4ea0-a079-a3035dcbcced" by "delete_volume" {{(pid=84538) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 19:10:37 devstack cinder-volume[84538]: DEBUG cinder.coordination [None req-7cecc61d-7dae-4cc5-8d1f-1ae7b4fb9203 tempest-CreateVolumesFromSourceVolumeTest-1326097673 None] Lock "cinder-quobyte-f880cb45-048b-4ea0-a079-a3035dcbcced" acquired by "delete_volume" :: waited 0.021s {{(pid=84538) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 19:10:37 devstack cinder-volume[84538]: DEBUG cinder.coordination [None req-8489f89e-da13-484c-bd8a-c6e3aaba50a3 tempest-CreateVolumesFromSourceVolumeTest-1326097673 None] Lock "cinder-1876ac2e-036d-473e-91b5-cd99e1c8a5b9-delete_volume" released by "delete_volume" :: held 2.378s {{(pid=84538) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 19:10:37 devstack cinder-volume[84538]: DEBUG oslo.privsep.daemon [-] privsep: reply[53849806-fe81-42d2-ae1b-b6e08297b5a0]: (4, 'qcow2') {{(pid=85803) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 19:10:37 devstack cinder-volume[84538]: DEBUG oslo_concurrency.processutils [None req-7cecc61d-7dae-4cc5-8d1f-1ae7b4fb9203 tempest-CreateVolumesFromSourceVolumeTest-1326097673 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-f880cb45-048b-4ea0-a079-a3035dcbcced {{(pid=84538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 19:10:37 devstack sudo[94621]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-f880cb45-048b-4ea0-a079-a3035dcbcced Apr 29 19:10:37 devstack sudo[94621]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 19:10:37 devstack sudo[94621]: pam_unix(sudo:session): session closed for user root Apr 29 19:10:37 devstack cinder-volume[84538]: DEBUG oslo_concurrency.processutils [None req-7cecc61d-7dae-4cc5-8d1f-1ae7b4fb9203 tempest-CreateVolumesFromSourceVolumeTest-1326097673 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-f880cb45-048b-4ea0-a079-a3035dcbcced" returned: 0 in 0.745s {{(pid=84538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 19:10:37 devstack cinder-volume[84538]: DEBUG oslo_concurrency.processutils [None req-7cecc61d-7dae-4cc5-8d1f-1ae7b4fb9203 tempest-CreateVolumesFromSourceVolumeTest-1326097673 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-f880cb45-048b-4ea0-a079-a3035dcbcced {{(pid=84538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 19:10:37 devstack sudo[94626]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-f880cb45-048b-4ea0-a079-a3035dcbcced Apr 29 19:10:37 devstack sudo[94626]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 19:10:38 devstack sudo[94626]: pam_unix(sudo:session): session closed for user root Apr 29 19:10:38 devstack cinder-volume[84538]: DEBUG oslo_concurrency.processutils [None req-7cecc61d-7dae-4cc5-8d1f-1ae7b4fb9203 tempest-CreateVolumesFromSourceVolumeTest-1326097673 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-f880cb45-048b-4ea0-a079-a3035dcbcced" returned: 0 in 0.654s {{(pid=84538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 19:10:38 devstack cinder-volume[84538]: DEBUG cinder.coordination [None req-7cecc61d-7dae-4cc5-8d1f-1ae7b4fb9203 tempest-CreateVolumesFromSourceVolumeTest-1326097673 None] Lock "cinder-quobyte-f880cb45-048b-4ea0-a079-a3035dcbcced" released by "delete_volume" :: held 1.453s {{(pid=84538) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 19:10:38 devstack cinder-volume[84538]: DEBUG cinder.quota [None req-7cecc61d-7dae-4cc5-8d1f-1ae7b4fb9203 tempest-CreateVolumesFromSourceVolumeTest-1326097673 None] Created reservations ['cbf9d138-5038-4887-9bad-e86df4b00f3e', '03e2b6ce-fe22-4684-bdd9-9544834bf249', '7e1d63a4-f128-4ab7-b124-97103f01d64e', 'a76ae6b0-ad73-46fa-b55a-e0d18bec7f2d'] {{(pid=84538) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 29 19:10:38 devstack cinder-volume[84538]: DEBUG oslo_concurrency.lockutils [None req-7cecc61d-7dae-4cc5-8d1f-1ae7b4fb9203 tempest-CreateVolumesFromSourceVolumeTest-1326097673 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 19:10:38 devstack cinder-volume[84538]: DEBUG oslo_concurrency.lockutils [None req-7cecc61d-7dae-4cc5-8d1f-1ae7b4fb9203 tempest-CreateVolumesFromSourceVolumeTest-1326097673 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 19:10:38 devstack cinder-volume[84538]: DEBUG cinder.volume.drivers.quobyte [None req-7cecc61d-7dae-4cc5-8d1f-1ae7b4fb9203 tempest-CreateVolumesFromSourceVolumeTest-1326097673 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-34312b00-dd6d-45bb-af98-75855cea8e48': None} {{(pid=84538) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 19:10:38 devstack cinder-volume[84538]: DEBUG cinder.volume.drivers.quobyte [None req-7cecc61d-7dae-4cc5-8d1f-1ae7b4fb9203 tempest-CreateVolumesFromSourceVolumeTest-1326097673 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-34312b00-dd6d-45bb-af98-75855cea8e48'] {{(pid=84538) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 19:10:38 devstack cinder-volume[84538]: DEBUG oslo_concurrency.lockutils [None req-7cecc61d-7dae-4cc5-8d1f-1ae7b4fb9203 tempest-CreateVolumesFromSourceVolumeTest-1326097673 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=84538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 19:10:38 devstack cinder-volume[84538]: DEBUG oslo_concurrency.processutils [None req-7cecc61d-7dae-4cc5-8d1f-1ae7b4fb9203 tempest-CreateVolumesFromSourceVolumeTest-1326097673 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d {{(pid=84538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 19:10:38 devstack sudo[94632]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d Apr 29 19:10:38 devstack sudo[94632]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 19:10:39 devstack cinder-volume[84538]: DEBUG cinder.coordination [None req-f0d424b5-ce11-49ce-bbb5-12950655c668 tempest-CreateVolumesFromSourceVolumeTest-1326097673 None] Acquiring lock "cinder-6ba70692-2d6a-43f4-ab5f-686fe849038e-delete_volume" by "delete_volume" {{(pid=84538) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 19:10:39 devstack cinder-volume[84538]: DEBUG cinder.coordination [None req-f0d424b5-ce11-49ce-bbb5-12950655c668 tempest-CreateVolumesFromSourceVolumeTest-1326097673 None] Lock "cinder-6ba70692-2d6a-43f4-ab5f-686fe849038e-delete_volume" acquired by "delete_volume" :: waited 0.041s {{(pid=84538) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 19:10:39 devstack cinder-volume[84538]: DEBUG cinder.coordination [None req-f0d424b5-ce11-49ce-bbb5-12950655c668 tempest-CreateVolumesFromSourceVolumeTest-1326097673 None] Acquiring lock "cinder-quobyte-6ba70692-2d6a-43f4-ab5f-686fe849038e" by "delete_volume" {{(pid=84538) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 19:10:39 devstack cinder-volume[84538]: DEBUG cinder.coordination [None req-f0d424b5-ce11-49ce-bbb5-12950655c668 tempest-CreateVolumesFromSourceVolumeTest-1326097673 None] Lock "cinder-quobyte-6ba70692-2d6a-43f4-ab5f-686fe849038e" acquired by "delete_volume" :: waited 0.015s {{(pid=84538) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 19:10:39 devstack sudo[94632]: pam_unix(sudo:session): session closed for user root Apr 29 19:10:39 devstack cinder-volume[84538]: DEBUG oslo_concurrency.processutils [None req-7cecc61d-7dae-4cc5-8d1f-1ae7b4fb9203 tempest-CreateVolumesFromSourceVolumeTest-1326097673 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d" returned: 0 in 0.702s {{(pid=84538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 19:10:39 devstack cinder-volume[84538]: DEBUG cinder.manager [None req-7cecc61d-7dae-4cc5-8d1f-1ae7b4fb9203 tempest-CreateVolumesFromSourceVolumeTest-1326097673 None] Notifying Schedulers of capabilities ... {{(pid=84538) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 29 19:10:39 devstack cinder-volume[84538]: INFO cinder.volume.manager [None req-7cecc61d-7dae-4cc5-8d1f-1ae7b4fb9203 tempest-CreateVolumesFromSourceVolumeTest-1326097673 None] Deleted volume successfully. Apr 29 19:10:39 devstack cinder-volume[84538]: DEBUG oslo.privsep.daemon [-] privsep: reply[5334457c-55af-42ad-be31-1842beb9ad47]: (4, 'qcow2') {{(pid=85803) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 19:10:39 devstack cinder-volume[84538]: DEBUG oslo_concurrency.processutils [None req-f0d424b5-ce11-49ce-bbb5-12950655c668 tempest-CreateVolumesFromSourceVolumeTest-1326097673 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-6ba70692-2d6a-43f4-ab5f-686fe849038e {{(pid=84538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 19:10:39 devstack cinder-volume[84538]: DEBUG cinder.coordination [None req-7cecc61d-7dae-4cc5-8d1f-1ae7b4fb9203 tempest-CreateVolumesFromSourceVolumeTest-1326097673 None] Lock "cinder-f880cb45-048b-4ea0-a079-a3035dcbcced-delete_volume" released by "delete_volume" :: held 2.418s {{(pid=84538) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 19:10:39 devstack sudo[94635]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-6ba70692-2d6a-43f4-ab5f-686fe849038e Apr 29 19:10:39 devstack sudo[94635]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 19:10:40 devstack sudo[94635]: pam_unix(sudo:session): session closed for user root Apr 29 19:10:40 devstack cinder-volume[84538]: DEBUG oslo_concurrency.processutils [None req-f0d424b5-ce11-49ce-bbb5-12950655c668 tempest-CreateVolumesFromSourceVolumeTest-1326097673 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-6ba70692-2d6a-43f4-ab5f-686fe849038e" returned: 0 in 0.798s {{(pid=84538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 19:10:40 devstack cinder-volume[84538]: DEBUG oslo_concurrency.processutils [None req-f0d424b5-ce11-49ce-bbb5-12950655c668 tempest-CreateVolumesFromSourceVolumeTest-1326097673 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-6ba70692-2d6a-43f4-ab5f-686fe849038e {{(pid=84538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 19:10:40 devstack sudo[94641]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-6ba70692-2d6a-43f4-ab5f-686fe849038e Apr 29 19:10:40 devstack sudo[94641]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 19:10:40 devstack sudo[94641]: pam_unix(sudo:session): session closed for user root Apr 29 19:10:40 devstack cinder-volume[84538]: DEBUG oslo_concurrency.processutils [None req-f0d424b5-ce11-49ce-bbb5-12950655c668 tempest-CreateVolumesFromSourceVolumeTest-1326097673 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-6ba70692-2d6a-43f4-ab5f-686fe849038e" returned: 0 in 0.639s {{(pid=84538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 19:10:40 devstack cinder-volume[84538]: DEBUG cinder.coordination [None req-f0d424b5-ce11-49ce-bbb5-12950655c668 tempest-CreateVolumesFromSourceVolumeTest-1326097673 None] Lock "cinder-quobyte-6ba70692-2d6a-43f4-ab5f-686fe849038e" released by "delete_volume" :: held 1.499s {{(pid=84538) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 19:10:40 devstack cinder-volume[84538]: DEBUG cinder.quota [None req-f0d424b5-ce11-49ce-bbb5-12950655c668 tempest-CreateVolumesFromSourceVolumeTest-1326097673 None] Created reservations ['1c1371db-b5b7-4177-8d46-82e0c8291557', '46ad31b7-bccd-4dd6-8910-a573a994b24d', '60241402-c38a-4e00-b0b9-5d835464f317', 'c005790d-eaf5-4606-90d0-54b4e3747659'] {{(pid=84538) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 29 19:10:40 devstack cinder-volume[84538]: DEBUG oslo_concurrency.lockutils [None req-f0d424b5-ce11-49ce-bbb5-12950655c668 tempest-CreateVolumesFromSourceVolumeTest-1326097673 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 19:10:40 devstack cinder-volume[84538]: DEBUG oslo_concurrency.lockutils [None req-f0d424b5-ce11-49ce-bbb5-12950655c668 tempest-CreateVolumesFromSourceVolumeTest-1326097673 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 19:10:40 devstack cinder-volume[84538]: DEBUG cinder.volume.drivers.quobyte [None req-f0d424b5-ce11-49ce-bbb5-12950655c668 tempest-CreateVolumesFromSourceVolumeTest-1326097673 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-34312b00-dd6d-45bb-af98-75855cea8e48': None} {{(pid=84538) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 19:10:40 devstack cinder-volume[84538]: DEBUG cinder.volume.drivers.quobyte [None req-f0d424b5-ce11-49ce-bbb5-12950655c668 tempest-CreateVolumesFromSourceVolumeTest-1326097673 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-34312b00-dd6d-45bb-af98-75855cea8e48'] {{(pid=84538) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 19:10:40 devstack cinder-volume[84538]: DEBUG oslo_concurrency.lockutils [None req-f0d424b5-ce11-49ce-bbb5-12950655c668 tempest-CreateVolumesFromSourceVolumeTest-1326097673 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=84538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 19:10:40 devstack cinder-volume[84538]: DEBUG oslo_concurrency.processutils [None req-f0d424b5-ce11-49ce-bbb5-12950655c668 tempest-CreateVolumesFromSourceVolumeTest-1326097673 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d {{(pid=84538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 19:10:40 devstack sudo[94646]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d Apr 29 19:10:40 devstack sudo[94646]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 19:10:41 devstack cinder-volume[84538]: DEBUG cinder.coordination [None req-d49834a1-f927-4a32-8efe-eec649670fb1 tempest-CreateVolumesFromSourceVolumeTest-1326097673 None] Acquiring lock "cinder-c87f36a1-9f58-4db9-b14e-385367db8d77-delete_volume" by "delete_volume" {{(pid=84538) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 19:10:41 devstack cinder-volume[84538]: DEBUG cinder.coordination [None req-d49834a1-f927-4a32-8efe-eec649670fb1 tempest-CreateVolumesFromSourceVolumeTest-1326097673 None] Lock "cinder-c87f36a1-9f58-4db9-b14e-385367db8d77-delete_volume" acquired by "delete_volume" :: waited 0.036s {{(pid=84538) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 19:10:41 devstack cinder-volume[84538]: DEBUG cinder.coordination [None req-d49834a1-f927-4a32-8efe-eec649670fb1 tempest-CreateVolumesFromSourceVolumeTest-1326097673 None] Acquiring lock "cinder-quobyte-c87f36a1-9f58-4db9-b14e-385367db8d77" by "delete_volume" {{(pid=84538) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 19:10:41 devstack cinder-volume[84538]: DEBUG cinder.coordination [None req-d49834a1-f927-4a32-8efe-eec649670fb1 tempest-CreateVolumesFromSourceVolumeTest-1326097673 None] Lock "cinder-quobyte-c87f36a1-9f58-4db9-b14e-385367db8d77" acquired by "delete_volume" :: waited 0.018s {{(pid=84538) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 19:10:41 devstack sudo[94646]: pam_unix(sudo:session): session closed for user root Apr 29 19:10:41 devstack cinder-volume[84538]: DEBUG oslo_concurrency.processutils [None req-f0d424b5-ce11-49ce-bbb5-12950655c668 tempest-CreateVolumesFromSourceVolumeTest-1326097673 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d" returned: 0 in 0.656s {{(pid=84538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 19:10:41 devstack cinder-volume[84538]: DEBUG cinder.manager [None req-f0d424b5-ce11-49ce-bbb5-12950655c668 tempest-CreateVolumesFromSourceVolumeTest-1326097673 None] Notifying Schedulers of capabilities ... {{(pid=84538) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 29 19:10:41 devstack cinder-volume[84538]: INFO cinder.volume.manager [None req-f0d424b5-ce11-49ce-bbb5-12950655c668 tempest-CreateVolumesFromSourceVolumeTest-1326097673 None] Deleted volume successfully. Apr 29 19:10:41 devstack cinder-volume[84538]: DEBUG oslo.privsep.daemon [-] privsep: reply[e73b5784-5553-43bb-a8b2-7dfd63054026]: (4, 'qcow2') {{(pid=85803) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 19:10:41 devstack cinder-volume[84538]: DEBUG oslo_concurrency.processutils [None req-d49834a1-f927-4a32-8efe-eec649670fb1 tempest-CreateVolumesFromSourceVolumeTest-1326097673 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-c87f36a1-9f58-4db9-b14e-385367db8d77 {{(pid=84538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 19:10:41 devstack cinder-volume[84538]: DEBUG cinder.coordination [None req-f0d424b5-ce11-49ce-bbb5-12950655c668 tempest-CreateVolumesFromSourceVolumeTest-1326097673 None] Lock "cinder-6ba70692-2d6a-43f4-ab5f-686fe849038e-delete_volume" released by "delete_volume" :: held 2.382s {{(pid=84538) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 19:10:41 devstack sudo[94649]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-c87f36a1-9f58-4db9-b14e-385367db8d77 Apr 29 19:10:41 devstack sudo[94649]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 19:10:42 devstack sudo[94649]: pam_unix(sudo:session): session closed for user root Apr 29 19:10:42 devstack cinder-volume[84538]: DEBUG oslo_concurrency.processutils [None req-d49834a1-f927-4a32-8efe-eec649670fb1 tempest-CreateVolumesFromSourceVolumeTest-1326097673 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-c87f36a1-9f58-4db9-b14e-385367db8d77" returned: 0 in 0.730s {{(pid=84538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 19:10:42 devstack cinder-volume[84538]: DEBUG oslo_concurrency.processutils [None req-d49834a1-f927-4a32-8efe-eec649670fb1 tempest-CreateVolumesFromSourceVolumeTest-1326097673 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-c87f36a1-9f58-4db9-b14e-385367db8d77 {{(pid=84538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 19:10:42 devstack sudo[94654]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-c87f36a1-9f58-4db9-b14e-385367db8d77 Apr 29 19:10:42 devstack sudo[94654]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 19:10:42 devstack sudo[94654]: pam_unix(sudo:session): session closed for user root Apr 29 19:10:42 devstack cinder-volume[84538]: DEBUG oslo_concurrency.processutils [None req-d49834a1-f927-4a32-8efe-eec649670fb1 tempest-CreateVolumesFromSourceVolumeTest-1326097673 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-c87f36a1-9f58-4db9-b14e-385367db8d77" returned: 0 in 0.599s {{(pid=84538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 19:10:42 devstack cinder-volume[84538]: DEBUG cinder.coordination [None req-d49834a1-f927-4a32-8efe-eec649670fb1 tempest-CreateVolumesFromSourceVolumeTest-1326097673 None] Lock "cinder-quobyte-c87f36a1-9f58-4db9-b14e-385367db8d77" released by "delete_volume" :: held 1.379s {{(pid=84538) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 19:10:42 devstack cinder-volume[84538]: DEBUG cinder.quota [None req-d49834a1-f927-4a32-8efe-eec649670fb1 tempest-CreateVolumesFromSourceVolumeTest-1326097673 None] Created reservations ['10653165-4b6c-4917-aad0-7be403781db9', 'fff538a7-4e62-4b7c-af84-c1c484be0b66', '312cab8f-cb52-4f60-b8c6-8480b235e08d', '9dc37226-7f37-4b53-afff-e87eeaab1df2'] {{(pid=84538) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 29 19:10:43 devstack cinder-volume[84538]: DEBUG oslo_concurrency.lockutils [None req-d49834a1-f927-4a32-8efe-eec649670fb1 tempest-CreateVolumesFromSourceVolumeTest-1326097673 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 19:10:43 devstack cinder-volume[84538]: DEBUG oslo_concurrency.lockutils [None req-d49834a1-f927-4a32-8efe-eec649670fb1 tempest-CreateVolumesFromSourceVolumeTest-1326097673 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 19:10:43 devstack cinder-volume[84538]: DEBUG cinder.volume.drivers.quobyte [None req-d49834a1-f927-4a32-8efe-eec649670fb1 tempest-CreateVolumesFromSourceVolumeTest-1326097673 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-34312b00-dd6d-45bb-af98-75855cea8e48': None} {{(pid=84538) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 19:10:43 devstack cinder-volume[84538]: DEBUG cinder.volume.drivers.quobyte [None req-d49834a1-f927-4a32-8efe-eec649670fb1 tempest-CreateVolumesFromSourceVolumeTest-1326097673 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-34312b00-dd6d-45bb-af98-75855cea8e48'] {{(pid=84538) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 19:10:43 devstack cinder-volume[84538]: DEBUG oslo_concurrency.lockutils [None req-d49834a1-f927-4a32-8efe-eec649670fb1 tempest-CreateVolumesFromSourceVolumeTest-1326097673 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=84538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 19:10:43 devstack cinder-volume[84538]: DEBUG oslo_concurrency.processutils [None req-d49834a1-f927-4a32-8efe-eec649670fb1 tempest-CreateVolumesFromSourceVolumeTest-1326097673 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d {{(pid=84538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 19:10:43 devstack sudo[94657]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d Apr 29 19:10:43 devstack sudo[94657]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 19:10:43 devstack sudo[94657]: pam_unix(sudo:session): session closed for user root Apr 29 19:10:43 devstack cinder-volume[84538]: DEBUG oslo_concurrency.processutils [None req-d49834a1-f927-4a32-8efe-eec649670fb1 tempest-CreateVolumesFromSourceVolumeTest-1326097673 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d" returned: 0 in 0.605s {{(pid=84538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 19:10:43 devstack cinder-volume[84538]: DEBUG cinder.manager [None req-d49834a1-f927-4a32-8efe-eec649670fb1 tempest-CreateVolumesFromSourceVolumeTest-1326097673 None] Notifying Schedulers of capabilities ... {{(pid=84538) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 29 19:10:43 devstack cinder-volume[84538]: INFO cinder.volume.manager [None req-d49834a1-f927-4a32-8efe-eec649670fb1 tempest-CreateVolumesFromSourceVolumeTest-1326097673 None] Deleted volume successfully. Apr 29 19:10:43 devstack cinder-volume[84538]: DEBUG cinder.coordination [None req-d49834a1-f927-4a32-8efe-eec649670fb1 tempest-CreateVolumesFromSourceVolumeTest-1326097673 None] Lock "cinder-c87f36a1-9f58-4db9-b14e-385367db8d77-delete_volume" released by "delete_volume" :: held 2.191s {{(pid=84538) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 19:10:43 devstack cinder-volume[84538]: DEBUG cinder.coordination [None req-d087cd73-b428-483b-bf12-07fa2edeb775 tempest-CreateVolumesFromSourceVolumeTest-1326097673 None] Acquiring lock "cinder-d2c97420-eac1-4385-b368-e7c97405d398-delete_volume" by "delete_volume" {{(pid=84538) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 19:10:43 devstack cinder-volume[84538]: DEBUG cinder.coordination [None req-d087cd73-b428-483b-bf12-07fa2edeb775 tempest-CreateVolumesFromSourceVolumeTest-1326097673 None] Lock "cinder-d2c97420-eac1-4385-b368-e7c97405d398-delete_volume" acquired by "delete_volume" :: waited 0.014s {{(pid=84538) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 19:10:43 devstack cinder-volume[84538]: DEBUG cinder.coordination [None req-d087cd73-b428-483b-bf12-07fa2edeb775 tempest-CreateVolumesFromSourceVolumeTest-1326097673 None] Acquiring lock "cinder-quobyte-d2c97420-eac1-4385-b368-e7c97405d398" by "delete_volume" {{(pid=84538) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 19:10:43 devstack cinder-volume[84538]: DEBUG cinder.coordination [None req-d087cd73-b428-483b-bf12-07fa2edeb775 tempest-CreateVolumesFromSourceVolumeTest-1326097673 None] Lock "cinder-quobyte-d2c97420-eac1-4385-b368-e7c97405d398" acquired by "delete_volume" :: waited 0.017s {{(pid=84538) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 19:10:43 devstack cinder-volume[84538]: DEBUG oslo.privsep.daemon [-] privsep: reply[429883bc-81cd-4cab-9cd5-33cbcd538735]: (4, 'qcow2') {{(pid=85803) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 19:10:43 devstack cinder-volume[84538]: DEBUG oslo_concurrency.processutils [None req-d087cd73-b428-483b-bf12-07fa2edeb775 tempest-CreateVolumesFromSourceVolumeTest-1326097673 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-d2c97420-eac1-4385-b368-e7c97405d398 {{(pid=84538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 19:10:43 devstack sudo[94660]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-d2c97420-eac1-4385-b368-e7c97405d398 Apr 29 19:10:43 devstack sudo[94660]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 19:10:44 devstack sudo[94660]: pam_unix(sudo:session): session closed for user root Apr 29 19:10:44 devstack cinder-volume[84538]: DEBUG oslo_concurrency.processutils [None req-d087cd73-b428-483b-bf12-07fa2edeb775 tempest-CreateVolumesFromSourceVolumeTest-1326097673 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-d2c97420-eac1-4385-b368-e7c97405d398" returned: 0 in 0.694s {{(pid=84538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 19:10:44 devstack cinder-volume[84538]: DEBUG oslo_concurrency.processutils [None req-d087cd73-b428-483b-bf12-07fa2edeb775 tempest-CreateVolumesFromSourceVolumeTest-1326097673 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-d2c97420-eac1-4385-b368-e7c97405d398 {{(pid=84538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 19:10:44 devstack sudo[94665]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-d2c97420-eac1-4385-b368-e7c97405d398 Apr 29 19:10:44 devstack sudo[94665]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 19:10:45 devstack sudo[94665]: pam_unix(sudo:session): session closed for user root Apr 29 19:10:45 devstack cinder-volume[84538]: DEBUG oslo_concurrency.processutils [None req-d087cd73-b428-483b-bf12-07fa2edeb775 tempest-CreateVolumesFromSourceVolumeTest-1326097673 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d/volume-d2c97420-eac1-4385-b368-e7c97405d398" returned: 0 in 0.634s {{(pid=84538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 19:10:45 devstack cinder-volume[84538]: DEBUG cinder.coordination [None req-d087cd73-b428-483b-bf12-07fa2edeb775 tempest-CreateVolumesFromSourceVolumeTest-1326097673 None] Lock "cinder-quobyte-d2c97420-eac1-4385-b368-e7c97405d398" released by "delete_volume" :: held 1.369s {{(pid=84538) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 19:10:45 devstack cinder-volume[84538]: DEBUG cinder.quota [None req-d087cd73-b428-483b-bf12-07fa2edeb775 tempest-CreateVolumesFromSourceVolumeTest-1326097673 None] Created reservations ['df4f9466-2573-4c49-a058-7e1744a60742', '3b3bcfde-ea2f-4411-8c0b-89b8d1cb7665', '31b0ef48-d561-49cc-9cea-148b0b0f4841', 'c9d6497b-630d-4e7c-9355-fee0f469d521'] {{(pid=84538) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 29 19:10:45 devstack cinder-volume[84538]: DEBUG oslo_concurrency.lockutils [None req-d087cd73-b428-483b-bf12-07fa2edeb775 tempest-CreateVolumesFromSourceVolumeTest-1326097673 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 19:10:45 devstack cinder-volume[84538]: DEBUG oslo_concurrency.lockutils [None req-d087cd73-b428-483b-bf12-07fa2edeb775 tempest-CreateVolumesFromSourceVolumeTest-1326097673 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 19:10:45 devstack cinder-volume[84538]: DEBUG cinder.volume.drivers.quobyte [None req-d087cd73-b428-483b-bf12-07fa2edeb775 tempest-CreateVolumesFromSourceVolumeTest-1326097673 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-34312b00-dd6d-45bb-af98-75855cea8e48': None} {{(pid=84538) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 19:10:45 devstack cinder-volume[84538]: DEBUG cinder.volume.drivers.quobyte [None req-d087cd73-b428-483b-bf12-07fa2edeb775 tempest-CreateVolumesFromSourceVolumeTest-1326097673 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-34312b00-dd6d-45bb-af98-75855cea8e48'] {{(pid=84538) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 19:10:45 devstack cinder-volume[84538]: DEBUG oslo_concurrency.lockutils [None req-d087cd73-b428-483b-bf12-07fa2edeb775 tempest-CreateVolumesFromSourceVolumeTest-1326097673 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=84538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 19:10:45 devstack cinder-volume[84538]: DEBUG oslo_concurrency.processutils [None req-d087cd73-b428-483b-bf12-07fa2edeb775 tempest-CreateVolumesFromSourceVolumeTest-1326097673 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d {{(pid=84538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 19:10:45 devstack sudo[94668]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d Apr 29 19:10:45 devstack sudo[94668]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 19:10:45 devstack sudo[94668]: pam_unix(sudo:session): session closed for user root Apr 29 19:10:45 devstack cinder-volume[84538]: DEBUG oslo_concurrency.processutils [None req-d087cd73-b428-483b-bf12-07fa2edeb775 tempest-CreateVolumesFromSourceVolumeTest-1326097673 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9fa67435c75ff2687ce914ec5e71904d" returned: 0 in 0.572s {{(pid=84538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 19:10:45 devstack cinder-volume[84538]: DEBUG cinder.manager [None req-d087cd73-b428-483b-bf12-07fa2edeb775 tempest-CreateVolumesFromSourceVolumeTest-1326097673 None] Notifying Schedulers of capabilities ... {{(pid=84538) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 29 19:10:45 devstack cinder-volume[84538]: INFO cinder.volume.manager [None req-d087cd73-b428-483b-bf12-07fa2edeb775 tempest-CreateVolumesFromSourceVolumeTest-1326097673 None] Deleted volume successfully. Apr 29 19:10:45 devstack cinder-volume[84538]: DEBUG cinder.coordination [None req-d087cd73-b428-483b-bf12-07fa2edeb775 tempest-CreateVolumesFromSourceVolumeTest-1326097673 None] Lock "cinder-d2c97420-eac1-4385-b368-e7c97405d398-delete_volume" released by "delete_volume" :: held 2.136s {{(pid=84538) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 19:10:55 devstack cinder-volume[84538]: DEBUG dbcounter [-] [84538] Writing DB stats cinder:DELETE=14,cinder:UPDATE=162,cinder:SELECT=107,cinder:INSERT=44 {{(pid=84538) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Apr 29 19:10:55 devstack cinder-volume[84538]: DEBUG dbcounter [-] [84538] Writing DB stats cinder:SELECT=104,cinder:INSERT=33,cinder:UPDATE=156,cinder:DELETE=12 {{(pid=84538) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}